8bit Inference on CPU

[bell__sefi]

I am interested in inferring 8bit OpenVINO models on specific CPUs. However I can't figure out if they support and know to leverage the quantization.

Do these HW support 8bit inference?

1. NUC7i5BNB - Ubuntu 18.04 - Intel Core i5-7260U CPU @2.20GHZ fixed

2. Dell Laptop - ICL-U - Ubuntu 18.04 - Intel Core i7 - 1065G7 CPU @ 1.30GHz fixed

Thank you very much

[Rizal_Intel · Accepted solution]

Hello Bell,

Yes, the hardware mentioned can support 8 bit inferencing using the CPU plugin.

According to this hardware requirement, 6th to 10th generation Intel® Core™ processors and Intel® Xeon® processors are supported.

Core i5-7260U is 7th generation and Intel Core i7 - 1065G7 is 10th generation which means both is within the range of supported processors.

Regards,

Rizal