Hi, I am trying to optimize my FP32 model in the INT8 model using the workbench.
At the end of the optimization, I use the INT8 model in my application, but the results are not the same as the previous model(Wrong results).
Is it due to the validation set?
I am using the latest version of OpenVINO.
Best regards, Cristian.
Hi Cristian @Di_Fiore__Cristian
Please share more details about your case - what's the model, application (sample/demo), calibration method (maximum performance calibration, maximum accuracy calibration), etc.
Depending on calibration method you used, during INT8 quantization you should expect some accuracy drop as a sacrifice for performance improvement. Please see more details here https://docs.openvinotoolkit.org/latest/_docs_Workbench_DG_Int_8_Quantization.html
Best regards, Max.