Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

multiple stick for one graph

idata
Funcionário
1.354 Visualizações

Is it possible to use multiple stick for one graph?

 

Thanks.

0 Kudos
6 Respostas
idata
Funcionário
1.100 Visualizações

for video or any other task?

idata
Funcionário
1.100 Visualizações

@zufeifei Hi, I want to use multiple stick to speed up fps for video, and i want to deal with it with one graph.

 

Is it possible to make it?

 

Thanks.

idata
Funcionário
1.100 Visualizações

@kris1110

 

 cc: @zufeifei

 

I am boosting with one graph(MobileNetSSD[Caffe]) + four sticks.

 

Is that it?

 

I am sorry if I made a mistake.

 

https://github.com/PINTO0309/MobileNet-SSD-RealSense#usb-camera-mode-multistick-x4-boostedasynchronous-screen-drawing--multistickssdwithrealsensepy
idata
Funcionário
1.100 Visualizações

Basically what you need to do is give each stick its own frame. They can't work together on a frame but they can work on different frames at the same time. Each inference should take about the same amount of time so you don't have to worry about them coming out of order.

idata
Funcionário
1.100 Visualizações

All what mail929 said is correct.

 

Load sharing can not be done using multiple sticks.

 

However, it is possible to increase the number of prediction per unit time by using multiple sticks in parallel.

 

Also, my sample program correctly corrects the image processing order by utilizing thread-safe Queue.

 

Of course, a bit of overhead will occur…

 

The best performance will not be obtained unless true load balancing is supported by the NCSDK API.
idata
Funcionário
1.100 Visualizações

@mail929 @PINTO I got it. Thanks for your comments.

Responder