Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.
5920 Discussions

Does NCS2 use half of its ability with 1 inference number?

HesamSH
New Contributor I
382 Views

I've read somewhere that the Intel Neural Computer Stick actually uses half of its ability of number of inference requests is set to 1, and to get the maximum performance, there has to be 4 inference requests.

Is this so and officially approved by Intel? And if so, why is that so?

Labels (2)
0 Kudos
3 Replies
David_G_Intel
Moderator
344 Views

Hello HesamSH

  

Thank you for posting on the Intel️® communities. We moved this thread to the correct forum, the team in charge will get back to you soon.

 

Regards, 

David G 

Intel Customer Support Technician 


Peh_Intel
Moderator
325 Views

Hi HesamSH,


OpenVINO Inference Engine allows you to perform inference in synchronous and asynchronous modes with arbitrary number of infer requests (the number of infer requests may be limited by target device capabilities).


For Intel® Neural Compute Stick 2, four inference requests for each Executable Network are recommended for optimum performance.



Regards,

Peh


Peh_Intel
Moderator
304 Views

Hi HesamSH,


This thread will no longer be monitored since we have provided answers. If you need any additional information from Intel, please submit a new question. 



Regards,

Peh


Reply