8-bit inference on Neural Compute Stick 2 - Intel Community

Intel® Distribution of OpenVINO™ Toolkit

Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

8-bit inference on Neural Compute Stick 2

468 Views

I've seen that OpenVINO offers the possibility to do low-precision inference with 8-bit integers using the Calibration Tool. The question is: can you do low-precision inference on the Neural Compute Stick 2? In my opinion, it would be a really useful thing for an accelerator.

Link Copied

1 Reply

468 Views

Dear Cariaggi, Francesco,

INT8 precision on Myriad products is not supported.

Shubha

Copy link

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.