Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6574 Discussions

Combination of fp32 and int8 inference using OpenVINO

Sengodan__Nathiyaa
Débutant
521 Visites

I would like to run the inference for a network using OpenVINO, but some layers in the network using int8 and some in fp32.

We know that we can run the inference in int8 using Calibration tool. But is there any way to manually make some of the layers in the network run in fp32 mode itself after we calibrate the model ?. Like making changes in .xml file generated from Calibration tool , etc.,

0 Compliments
1 Répondre
Shubha_R_Intel
Employé
521 Visites

Dear Nathiyaa:

Looks like this is a duplicate question which I have answered i here:

https://software.intel.com/en-us/forums/computer-vision/topic/806590

Thanks,

Shubha

0 Compliments
Répondre