Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

multiple stick for one graph

idata
Employee
662 Views

Is it possible to use multiple stick for one graph?

 

Thanks.

0 Kudos
6 Replies
idata
Employee
408 Views

for video or any other task?

0 Kudos
idata
Employee
408 Views

@zufeifei Hi, I want to use multiple stick to speed up fps for video, and i want to deal with it with one graph.

 

Is it possible to make it?

 

Thanks.

0 Kudos
idata
Employee
408 Views

@kris1110

 

 cc: @zufeifei

 

I am boosting with one graph(MobileNetSSD[Caffe]) + four sticks.

 

Is that it?

 

I am sorry if I made a mistake.

 

https://github.com/PINTO0309/MobileNet-SSD-RealSense#usb-camera-mode-multistick-x4-boostedasynchronous-screen-drawing--multistickssdwithrealsensepy
0 Kudos
idata
Employee
408 Views

Basically what you need to do is give each stick its own frame. They can't work together on a frame but they can work on different frames at the same time. Each inference should take about the same amount of time so you don't have to worry about them coming out of order.

0 Kudos
idata
Employee
408 Views

All what mail929 said is correct.

 

Load sharing can not be done using multiple sticks.

 

However, it is possible to increase the number of prediction per unit time by using multiple sticks in parallel.

 

Also, my sample program correctly corrects the image processing order by utilizing thread-safe Queue.

 

Of course, a bit of overhead will occur…

 

The best performance will not be obtained unless true load balancing is supported by the NCSDK API.
0 Kudos
idata
Employee
408 Views

@mail929 @PINTO I got it. Thanks for your comments.

0 Kudos
Reply