Cannot use HDDL : no devices found

[Potato]

[15:52:20.0689][3199]I[main.cpp:246] ## HDDL_INSTALL_DIR: /home/devkit/intel/openvino_2022/runtime/3rdparty/hddl
[15:52:20.0690][3199]I[main.cpp:248] Config file '/home/devkit/intel/openvino_2022/runtime/3rdparty/hddl/config/hddl_service.config' has been loaded
[15:52:20.0692][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_service_alive.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0693][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_service_ready.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0693][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_service_failed.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0693][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0713][3199]I[AutobootStarter.cpp:156] Info: No running autoboot process. Start autoboot daemon...
[15:52:20.0926][3201]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_autoboot_alive.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0928][3201]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_autoboot_ready.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0930][3201]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_autoboot_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0932][3201]I[FileHelper.cpp:268] Set file:/tmp/hddl_autoboot_device.map owner: user-'no_change', group-'users', mode-'0660'
[15:52:20.0936][3201]I[AutoBoot.cpp:308] [Firmware Config] deviceName=default deviceNum=0 firmwarePath=/home/devkit/intel/openvino_2022/runtime/3rdparty/hddl/lib/mvnc/usb-ma2x8x.mvcmd
[15:52:21.3960][3205]I[AutoBoot.cpp:197] Start boot device 5.1-ma2480
[15:52:21.6491][3205]I[AutoBoot.cpp:199] Device 5.1-ma2480 boot success, firmware=/home/devkit/intel/openvino_2022/runtime/3rdparty/hddl/lib/mvnc/usb-ma2x8x.mvcmd
[15:52:21.6491][3205]I[AutoBoot.cpp:197] Start boot device 5.2-ma2480
[15:52:21.8936][3205]I[AutoBoot.cpp:199] Device 5.2-ma2480 boot success, firmware=/home/devkit/intel/openvino_2022/runtime/3rdparty/hddl/lib/mvnc/usb-ma2x8x.mvcmd
[15:52:41.8962][3199]I[AutobootStarter.cpp:85] Info: Autoboot is running.
[15:52:41.9036][3199]W[ConfigParser.cpp:269] Warning: Cannot find key, path=scheduler_config.max_graph_per_device subclass=0, use default value: 1.
[15:52:41.9036][3199]W[ConfigParser.cpp:291] Warning: Cannot find key, path=scheduler_config.use_sgad_by_default subclass=0, use default value: false.
[15:52:41.9044][3199]I[DeviceSchedulerFactory.cpp:56] Info: ## DeviceSchedulerFacotry ## Created Squeeze Device-Scheduler2.
[15:52:41.9051][3199]I[DeviceManager.cpp:551] ## SqueezeScheduler created ##
[15:52:41.9051][3199]I[DeviceManager.cpp:649] times 0: try to create worker on device(6.2)
[usb_read:374] error=5, total size is=84,leave size=84
E: [xLink] [ 0] dispatcherEventReceive:337 dispatcherEventReceive() Read failed -1 | event 0x7fd0c27fbe10 USB_WRITE_REQ

E: [xLink] [ 0] eventReader:270 eventReader stopped
scheduler thread exit
info: /home/jenkins/agent/workspace/MYRIAD/IE-Packages/BuildAndPush/hddl-mvnc/XLink/shared/XLinkDispatcher.c:986: E: [ncAPI] [ 0] ncDeviceOpenBooted:892 Failed to connect device

[15:52:42.9069][3199]ERROR[HddlMyriadXDevice.cpp:134] Error: ncDeviceOpenBooted() failed, device=6.2 rc=-6
[15:52:42.9070][3199]ERROR[WorkThread.cpp:361] Error: open device failed, rc=-6
[15:52:42.9070][3199]ERROR[DeviceManager.cpp:652] [FAILED] times 0: create worker on device(6.2)
[15:52:43.9075][3199]I[DeviceManager.cpp:649] times 1: try to create worker on device(6.2)
[usb_read:374] error=5, total size is=84,leave size=84
E: [xLink] [ 0] dispatcherEventReceive:337 dispatcherEventReceive() Read failed -1 | event 0x7fd0c27fbe10 USB_WRITE_REQ

E: [ncAPI] [ 0] ncDeviceOpenBooted:892 Failed to connect device
info: /home/jenkins/agent/workspace/MYRIAD/IE-Packages/BuildAndPush/hddl-mvnc/XLink/shared/XLinkDispatcher.c:265:
[15:52:49.9090][3199]ERROR[HddlMyriadXDevice.cpp:134] Error: ncDeviceOpenBooted() failed, device=6.2 rc=-6
[15:52:49.9091][3199]ERROR[WorkThread.cpp:361] Error: open device failed, rc=-6
[15:52:49.9091][3199]ERROR[DeviceManager.cpp:652] [FAILED] times 1: create worker on device(6.2)
[15:52:49.9094][3199]ERROR[DeviceManager.cpp:663] Don't find device 6.2, please restart service!!!
[15:52:49.9095][3199]I[DeviceManager.cpp:649] times 0: try to create worker on device(6.1)
[usb_read:374] error=5, total size is=84,leave size=84
E: [xLink] [ 0] dispatcherEventReceive:337 dispatcherEventReceive() Read failed -1 | event 0x7fd0c17f9e10 USB_WRITE_REQ

E: [xLink] [ 0] eventReader:270 eventReader stopped
scheduler thread exit
E: [ncAPI] [ 0] ncDeviceOpenBooted:892 Failed to connect device

[15:52:50.9113][3199]ERROR[HddlMyriadXDevice.cpp:134] Error: ncDeviceOpenBooted() failed, device=6.1 rc=-6
[15:52:50.9114][3199]ERROR[WorkThread.cpp:361] Error: open device failed, rc=-6
[15:52:50.9114][3199]ERROR[DeviceManager.cpp:652] [FAILED] times 0: create worker on device(6.1)
[15:52:51.9118][3199]I[DeviceManager.cpp:649] times 1: try to create worker on device(6.1)
[usb_read:374] error=5, total size is=84,leave size=84
E: [xLink] [ 0] dispatcherEventReceive:337 dispatcherEventReceive() Read failed -1 | event 0x7fd0c27fbe10 USB_WRITE_REQ

E: [xLink] [ 0] eventReader:270 eventReader stopped
E: [ncAPI] [ 0] ncDeviceOpenBooted:892 Failed to connect device

info: /home/jenkins/agent/workspace/MYRIAD/IE-Packages/BuildAndPush/hddl-mvnc/XLink/shared/XLinkDispatcher.c:483: scheduler thread exit
[15:52:57.9133][3199]ERROR[HddlMyriadXDevice.cpp:134] Error: ncDeviceOpenBooted() failed, device=6.1 rc=-6
[15:52:57.9134][3199]ERROR[WorkThread.cpp:361] Error: open device failed, rc=-6
[15:52:57.9135][3199]ERROR[DeviceManager.cpp:652] [FAILED] times 1: create worker on device(6.1)
[15:52:57.9138][3199]ERROR[DeviceManager.cpp:663] Don't find device 6.1, please restart service!!!
[15:52:57.9139][3199]I[DeviceManager.cpp:145] DEVICE FOUND : 0
[15:52:57.9139][3199]I[DeviceManager.cpp:146] DEVICE OPENED : 0
[15:52:57.9140][3199]I[DeviceManagerCreator.cpp:81] New device manager(DeviceManager0) created with subclass(0), deviceCount(2)
[15:52:57.9179][3199]I[TaskSchedulerFactory.cpp:45] Info: ## TaskSchedulerFactory ## Created Polling Task-Scheduler.
[15:52:57.9189][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_snapshot.sock owner: user-'no_change', group-'users', mode-'0660'
[15:52:57.9195][3199]I[FileHelper.cpp:268] Set file:/var/tmp/hddl_service.sock owner: user-'no_change', group-'users', mode-'0660'
[15:52:57.9198][3199]I[MessageDispatcher.cpp:87] Message Dispatcher initialization finished
[15:52:57.9198][3199]I[main.cpp:106] SERVICE IS READY ...
[15:52:57.9683][3258]I[ClientManager.cpp:159] client(id:1) registered: clientName=openvino_intel_hddl_plugin socket=2
[15:52:57.9751][3258]I[ClientManager.cpp:189] client(id:1) unregistered: clientName=openvino_intel_hddl_plugin socket=2
Traceback (most recent call last):
File "hello_reshape_ssd.py", line 120, in <module>
sys.exit(main())
File "hello_reshape_ssd.py", line 78, in main
compiled_model = core.compile_model(model, device_name)
File "/home/devkit/intel/openvino_2022/python/python3.8/openvino/runtime/ie_api.py", line 387, in compile_model
super().compile_model(model, device_name, {} if config is None else config),
RuntimeError: no devices found

This is the whole error messages..

I followed this link

https://docs.openvino.ai/2022.2/openvino_docs_install_guides_installing_openvino_ivad_vpu.html#vpu-guide

But this error occured.

How can I solve this problem?

OpenVino : 2022.2

OS : Ubuntu 20.04.5 LTS

CPU : Intel i5-8365UE

VPU : VEGA-330

Thank you.

[Peh_Intel]

Hi Potato,

Thanks for highlighting this issue.

I also encounter the same issue when inferencing on HDDL with OpenVINO™ 2022.2. I will escalate this matter to our development team to have a look.

As per now, please try inferencing on HDDL with OpenVINO™ 2022.1 as I was able to do so.

1)     Install OpenVINO™ 2022.1.

2)     Set the environment variables.

source /opt/intel/openvino_2022/setupvars.sh

3)     Install dependencies.

${HDDL_INSTALL_DIR}/install_IVAD_VPU_dependencies.sh

4)     Reboot.

reboot

5)     Set the environment variables.

source /opt/intel/openvino_2022/setupvars.sh

6)     Install driver:

cd ${HDDL_INSTALL_DIR}/drivers

sudo ./setup.sh install

Regards,

Peh

[Potato]

Hi Peh,

Thanks for fast reply.

I tried installing 2022.1 and successfully installed HDDL.

But is there no way to use HDDL on OpenVino 2022.2 now?

Thanks.

[Peh_Intel]

Hi Potato,

Thanks for confirming OpenVINO™ 2022.1 works for you.

For OpenVINO™ 2022.2, it seems that the issues appeared due to its VPU firmware. As a workaround, you can copy the OpenVINO™ 2022.1 VPU firmware and replace into OpenVINO™ 2022.2 VPU firmware.

There are 3 files needed to be replaced.

1) sudo cp <2022.1_INSTALL_DIR>/runtime/3rdparty/hddl/lib/mvnc/usb-ma2x8x.mvcmd <2022.2_INSTALL_DIR>/ runtime/3rdparty/hddl/lib/mvnc/usb-ma2x8x.mvcmd

2) sudo cp <2022.1_INSTALL_DIR>/runtime/lib/intel64/pcie-ma2x8x.mvcmd <2022.2_INSTALL_DIR>/ runtime/lib/intel64/pcie-ma2x8x.mvcmd

3) sudo cp <2022.1_INSTALL_DIR>/runtime/lib/intel64/usb-ma2x8x.mvcmd <2022.2_INSTALL_DIR>/ runtime/lib/intel64/usb-ma2x8x.mvcmd

Regards,

Peh

[Peh_Intel]

Hi Potato,

This thread will no longer be monitored since we have provided a solution. If you need any additional information from Intel, please submit a new question. 

Regards,

Peh