Run myriadx-8-vpu compute node doesn't produces results

[gorza__lorenzo1]

Hi, 

I'm running some tests in Intel DevCloud portal with jupyter notebook, OpenVINO version 2021.1, when I run a job in the terminal connected to my notebook 

qsub main_job.sh -l nodes=1:idc002mx8 -F "./models/intel/person-vehicle-bike-detection-crossroad-0078/FP16/person-vehicle-bike-detection-crossroad-0078.xml MYRIAD 0.75 ./video/in_video/test.mp4 ./video/out/out_test_cpui5_6500te_0078_8VPU.mp4 CPUi5_6500te_075_0078_8VPU.txt 50 2000 5 2000" -N TEST_CPUi5_6500te_075_0078_8VPU

the system works correctly, but once the operations have been performed in query device section log that I've in my code I can't see the MYRIAD device listed, and the code for the test on the MYRIAD VPUs doesn't execute well. This seems that the the job doesn't see the 8 VPU in the server machine. The strange thing is that when I execute the same job for 1 or 2 MYRIAD VPUs

qsub main_job.sh -l nodes=1:idc014upxa10fx1 -F "./models/intel/person-vehicle-bike-detection-crossroad-0078/FP16/person-vehicle-bike-detection-crossroad-0078.xml MYRIAD 0.75 ./video/in_video/test.mp4 ./video/out/out_test_cpui7_8665ue_0078_2VPU.mp4 CPUi7_8665ue_075_0078_2VPU.txt 50 2000 5 2000" -N TEST_CPUi7_8665UE_075_0078_2VPU

all the code performs well.

There are some reason why the job seem to doesn't seen the 8 MYRIAD VPUs on idc002mx8 compute node? 

Thanks.  

[RaeesaM_Intel]

Hi,

Thank you for posting in Intel Forums.

We are moving this case to Intel Devcloud for Edge Forum so that the subject matter experts can help you out.

Regards,

Raeesa

[Stewart_C_Intel]

There are two options. For using the myriad vpus, you can choose -d MYRIAD, or -d HDDL. If you choose MYRIAD then you must schedule inferences for each device, but if you choose HDDL, then the plugin will schedule the devices for you.  Also have a look at examples for the MULTI plugin/device option for a simple round robin scheduler.

[junche4x]

HDDL not works on some  edge nodes. (idc015ai5/idc024...)

it says:

exec_net = ie.load_network(network=net, device_name=device)
File "ie_api.pyx", line 306, in openvino.inference_engine.ie_api.IECore.load_network
File "ie_api.pyx", line 315, in openvino.inference_engine.ie_api.IECore.load_network
RuntimeError: no devices found

[Sahira_Intel · Accepted solution]

Hi junche4x,

Were you able to resolve your issue?

idc015ai5 does not have a VPU on node, hence the error.

We did test idc024 and did not run into any issues so it should be able to run HDDL. 

Best Regards,

Sahira