Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6392 Discussions

Can we increase the performance/output by using multiple NCS 2 devices and how?

SDwiv1
Beginner
1,297 Views

I know this has been asked before, but after trying to implement suggested solution it did not work out..

 

I have tried running the human pose estimation demo on the raspberry pi 3B+ model and got a throughput of 2.77 FPS. So I tried using 2 NCS 2 devices on a normal machine running Ubuntu (virtualBox) and got the performance of 3.44 FPS max.

 

So my question is:

 

Does using multiple NCS 2 devices actually help the performance of running the model and how to enable it do so?

 

Could you explain how we can modify the human pose estimation demo to be able to run on multiple NCS 2 devices.

 

Thank you,

Sweta

 

 

 

 

 

0 Kudos
2 Replies
Wanner_G_Intel
Moderator
471 Views
Hello SDwiv1, Thank you for joining this Intel Community. To better assist you, please visit the following support web links and website for more information and troubleshooting. Home Site https://www.movidius.com/ Product Landing Page https://software.intel.com/en-us/neural-compute-stick Developer Forum https://ncsforum.movidius.com/categories/general-discussions Wanner G. Intel Customer Support Technician Under Contract to Intel Corporation
0 Kudos
JesusE_Intel
Moderator
471 Views

Hi SDwiv1,

 

The developer forum (https://ncsforum.movidius.com) will be migrated to this forum. It is possible to use multiple NCS device with the OpenVINO Toolkit. The Inference Engine API will distribute inferences to the NCS devices based on the device load. Take a look at "Multiple NCS Devices" section at the following page for additional information.

https://software.intel.com/en-us/articles/transitioning-from-intel-movidius-neural-compute-sdk-to-openvino-toolkit

 

Regards,

Jesus

0 Kudos
Reply