Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Catastrope
Beginner
144 Views

Parallel Processing using MYRIAD (Multiple Inference Requests)

Let's say that I want to make use of 4 MYRIAD devices by making 4 inference requests in parallel. Is this possible? I was able to make 4 inference requests but I can't assign each inference request to each of the VPUs. The result, I am having 4x of the expected latency. 

 

Please help! Thanks!

0 Kudos
3 Replies
SuryaPSC_Intel
Employee
144 Views

Hi Catastrope,

Please refer to Multiple NCS devices for creating an OpenVINO™ toolkit application for multiple devices. Also you may refer to a similar thread for more information..

Best Regards,

Surya

Catastrope
Beginner
144 Views

Thanks! But, is there an existing implementation of a sample source code in C++? 

SuryaPSC_Intel
Employee
144 Views

Hi Catastrophe,

Please refer to Leverage Multiple Intel® Neural Compute Sticks with Intel® Distribution of OpenVINO™ Toolkit for more information,

Best Regards,

Surya

Reply