Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

Executing multiple graphs on a stick

idata
Employee
757 Views

Is it possible to execute multiple graphs on the same stick simultaneously assuming we have graphs which do nor require all shaves?

 

Thanks,

 

Yair
0 Kudos
5 Replies
idata
Employee
470 Views

@yairh Right now it is not possible to execute multiple graphs simultaneously on the same stick. Currently, the solution for using multiple networks with the NCS is to enumerate multiple NCS devices, open each device, load a graph file into each NCS device and then call load tensor and get result for each one to perform the inferences.

 

This post may help: https://ncsforum.movidius.com/discussion/112/chaining-movidius-sticks#latest

0 Kudos
idata
Employee
470 Views

Tome,

 

Any plans to support this option?

 

Thanks,

 

Yair
0 Kudos
idata
Employee
470 Views

@yairh We're definitely looking into support for this feature.

0 Kudos
idata
Employee
470 Views

I have opened a pull request at: https://github.com/duangenquan/YoloV2NCS/pull/6

 

Enable multiple NCS devices to improve the throughput, hope this helps.
0 Kudos
idata
Employee
470 Views

My previous pull request was merged, visit this link for details: https://github.com/duangenquan/YoloV2NCS

0 Kudos
Reply