FP32 -> INT8 inception Intel's performance counters reproducing

Intel® Distribution of OpenVINO™ Toolkit

Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

FP32 -> INT8 inception Intel's performance counters reproducing

198 Views

Hi Intel team,

Could you please describe here (point, copy-paste if this is a duplicate)

exact steps to reproduce INT8 quantization benefit which is described here

https://docs.openvinotoolkit.org/latest/_docs_IE_DG_Int8Inference.html

under the section Performance Counters ?

Since there are a lot of links about how-to (FP32->INT8) but there is no any successful story so far as I see.

Either config file is missing and should be created self or the same should be done for annotation sets.

Shouldn't it all be placed into some one place for this feature verification/estimation by end user before any development?

Thanks.

Link Copied

0 Replies

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.