Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

Problem with INT8 Quantization

Di_Fiore__Cristian
390 Views

Hi, I am trying to optimize my FP32 model in the INT8 model using the workbench.
At the end of the optimization, I use the INT8 model in my application, but the results are not the same as the previous model(Wrong results).
Is it due to the validation set?

I am using the latest version of OpenVINO.

Best regards, Cristian.

0 Kudos
1 Reply
Max_L_Intel
Moderator
358 Views

Hi Cristian @Di_Fiore__Cristian 

Please share more details about your case - what's the model, application (sample/demo), calibration method (maximum performance calibration, maximum accuracy calibration), etc.

Depending on calibration method you used, during INT8 quantization you should expect some accuracy drop as a sacrifice for performance improvement. Please see more details here https://docs.openvinotoolkit.org/latest/_docs_Workbench_DG_Int_8_Quantization.html

Best regards, Max.

0 Kudos
Reply