Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.

8bit Inference on CPU

bell__sefi
Beginner
245 Views

I am interested in inferring 8bit OpenVINO models on specific CPUs. However I can't figure out if they support and know to leverage the quantization.

Do these HW support 8bit inference?

1. NUC7i5BNB - Ubuntu 18.04 - Intel Core i5-7260U CPU @2.20GHZ fixed

2. Dell Laptop - ICL-U - Ubuntu 18.04 - Intel Core i7 - 1065G7 CPU @ 1.30GHz fixed

 

Thank you very much

0 Kudos
1 Solution
Rizal_Intel
Moderator
238 Views

Hello Bell,


Yes, the hardware mentioned can support 8 bit inferencing using the CPU plugin.


According to this hardware requirement, 6th to 10th generation Intel® Core™ processors and Intel® Xeon® processors are supported.

Core i5-7260U is 7th generation and Intel Core i7 - 1065G7 is 10th generation which means both is within the range of supported processors.


Regards,

Rizal


View solution in original post

1 Reply
Rizal_Intel
Moderator
239 Views

Hello Bell,


Yes, the hardware mentioned can support 8 bit inferencing using the CPU plugin.


According to this hardware requirement, 6th to 10th generation Intel® Core™ processors and Intel® Xeon® processors are supported.

Core i5-7260U is 7th generation and Intel Core i7 - 1065G7 is 10th generation which means both is within the range of supported processors.


Regards,

Rizal


Reply