Community
cancel
Showing results for 
Search instead for 
Did you mean: 
bell__sefi
Beginner
146 Views

8bit Inference on CPU

Jump to solution

I am interested in inferring 8bit OpenVINO models on specific CPUs. However I can't figure out if they support and know to leverage the quantization.

Do these HW support 8bit inference?

1. NUC7i5BNB - Ubuntu 18.04 - Intel Core i5-7260U CPU @2.20GHZ fixed

2. Dell Laptop - ICL-U - Ubuntu 18.04 - Intel Core i7 - 1065G7 CPU @ 1.30GHz fixed

 

Thank you very much

0 Kudos
1 Solution
Rizal_Intel
Moderator
139 Views

Hello Bell,


Yes, the hardware mentioned can support 8 bit inferencing using the CPU plugin.


According to this hardware requirement, 6th to 10th generation Intel® Core™ processors and Intel® Xeon® processors are supported.

Core i5-7260U is 7th generation and Intel Core i7 - 1065G7 is 10th generation which means both is within the range of supported processors.


Regards,

Rizal


View solution in original post

1 Reply
Rizal_Intel
Moderator
140 Views

Hello Bell,


Yes, the hardware mentioned can support 8 bit inferencing using the CPU plugin.


According to this hardware requirement, 6th to 10th generation Intel® Core™ processors and Intel® Xeon® processors are supported.

Core i5-7260U is 7th generation and Intel Core i7 - 1065G7 is 10th generation which means both is within the range of supported processors.


Regards,

Rizal


View solution in original post

Reply