Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
56 Views

Problem with INT8 Quantization

Hi, I am trying to optimize my FP32 model in the INT8 model using the workbench.
At the end of the optimization, I use the INT8 model in my application, but the results are not the same as the previous model(Wrong results).
Is it due to the validation set?

I am using the latest version of OpenVINO.

Best regards, Cristian.

0 Kudos
1 Reply
Highlighted
Moderator
24 Views

Re: Problem with INT8 Quantization

Hi Cristian @Di_Fiore__Cristian 

Please share more details about your case - what's the model, application (sample/demo), calibration method (maximum performance calibration, maximum accuracy calibration), etc.

Depending on calibration method you used, during INT8 quantization you should expect some accuracy drop as a sacrifice for performance improvement. Please see more details here https://docs.openvinotoolkit.org/latest/_docs_Workbench_DG_Int_8_Quantization.html

Best regards, Max.

0 Kudos