- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I want to use HDDL to accelerator my inference by onnxruntime in container, but i got the following message. Could anyone help me to resolve it? Thanks.
2021-01-20 02:32:01.571815411 [E:onnxruntime:, sequential_executor.cc:333 Execute] Non-zero status code returned while running OpenVINO-EP-subgraph_2 node. Name:'OpenVINOExecutionProvider_OpenVINO-EP-subgraph_2_0' Status Message: /code/onnxruntime/onnxruntime/core/providers/openvino/backends/vadm_backend.cc:113 onnxruntime::openvino_ep::VADMBackend::VADMBackend(const onnxruntime::Provider_ModelProto&, onnxruntime::openvino_ep::GlobalContext&, const onnxruntime::openvino_ep::SubGraphContext&) [OpenVINO-EP] Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_2_0_client->loadGraph(_graph, networkName, graphFileContent.data(), graphFileContent.size(), config) failed: HDDL_DEVICE_ERROR
2021-01-20 02:32:01.572340: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running OpenVINO-EP-subgraph_2 node. Name:'OpenVINOExecutionProvider_OpenVINO-EP-subgraph_2_0' Status Message: /code/onnxruntime/onnxruntime/core/providers/openvino/backends/vadm_backend.cc:113 onnxruntime::openvino_ep::VADMBackend::VADMBackend(const onnxruntime::Provider_ModelProto&, onnxruntime::openvino_ep::GlobalContext&, const onnxruntime::openvino_ep::SubGraphContext&) [OpenVINO-EP] Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_2_0_client->loadGraph(_graph, networkName, graphFileContent.data(), graphFileContent.size(), config) failed: HDDL_DEVICE_ERROR
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi fredchang,
Thank you for reaching out to us. We are investigating this issue and will get back to you as soon as possible.
Regards,
Adli
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Adli,
More information to you.
The OS is Ubuntu 18.04
OpenVINO is 2021.1.110
onnxruntime is 1.6.0
There was already a device node “/dev/ion” mounted in container and a running HDDL daemon in host.
There is only one Myriad X VPU on the edge device.
Thanks.
Regards,
Fred
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi fredchang,
Thank you for sharing that information. We highly value it.
Regards,
Adli
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Fred,
Thank you for waiting and our apologies for the late reply.
For your case, we would like to isolate the issue first to find whether the cause for the error is due to HDDL component, Docker component or ONNX Runtime component.
As such, firstly, we request you to verify that HDDL plugin is working fine in Docker environment by running the Security Barrier Camera Demo, by following the steps available in either of the following links:
For built Docker image:
For Ubuntu Docker image downloaded from Docker hub:
https://hub.docker.com/r/openvino/ubuntu18_dev
If the demo runs successfully and there are no issues with HDDL plugin in Docker container, then we can narrow down the cause to ONNX Runtime component. For your information, OpenVINO Execution Provider is not part of the OpenVINO toolkit, and it’s supported in ONNX Runtime GitHub by developers directly.
The instructions to run OpenVINO is given in the link below:
https://github.com/microsoft/onnxruntime/tree/master/dockerfiles#openvino
Specifically, the steps to run OpenVINO on Myriad VPU Accelerator are available here:
https://github.com/microsoft/onnxruntime/tree/master/dockerfiles#openvino-on-myriad-vpu-accelerator
If you are still facing issues after executing the steps given above, we suggest you post your questions on the ONNX Runtime GitHub (link given below) for further assistance.
https://github.com/microsoft/onnxruntime/issues
Regards,
Munesh
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Fred,
This thread will no longer be monitored since we have provided recommendations and references. If you need any additional information from Intel, please submit a new question.
Regards,
Munesh
![](/skins/images/7B0AB6865064EAE32B30EC9A4E94B48A/responsive_peak/images/icon_anonymous_message.png)
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page