I have tried to launch an inference with both device "HETERO:CPU,MYRIAD" on my mac and I get this error:
Traceback (most recent call last): File "main.py", line 166, in <module> main(args) File "main.py", line 29, in main face_Detect = FaceDetection(args.face_detection, args.device) File "/Users/samo/Documents/1_formation/1_intel_edge_course/project_5/Computer-Pointer-Controller/src/facedetection.py", line 12, in __init__ self.model_loaded = Model(MODEL_PATH, DEVICE) File "/Users/samo/Documents/1_formation/1_intel_edge_course/project_5/Computer-Pointer-Controller/src/model.py", line 34, in __init__ self.layers_map = self.ie.query_network(network=self.net, device_name=device_name) File "ie_api.pyx", line 373, in openvino.inference_engine.ie_api.IECore.query_network RuntimeError: Failed to create plugin libHeteroPlugin.dylib for device HETERO Please, check your environment Cannot load library 'libHeteroPlugin.dylib': dlopen(libHeteroPlugin.dylib, 1): image not found
I have installed the last openvino toolkit version and when I use CPU only it is working well.
Note: My NCS2 is working on demo provided with the installation.
Thanks for your help,
Did you temporarily set the environment variable or did you permanently set it?
Temporary:-- you need to run this command each time you open a new terminal to run Openvino models
each time you run your terminal you should be able to see
[setupvars.sh] OpenVINO environment initialized.
If you did not see this means that setupvars is not initialized and you need to do so
This probably the cause.
It is set permanently I am using zsh. I have no problem running with the device "CPU" I will however check if the lib is on the right folder but I doubt that is the issue here.
Thanks for your reply.
Any chance that you tried to put CPU as highest priority and see whether it works? "HETERO:MYRIAD,CPU" --basically if its fails to run the network on Myriad it will automatically use CPU, if this works means that something is wrong with the Myriad device.
Please note that some topology is not friendly to heterogeneous execution on some devices or cannot be executed in such mode at all.
Please also note that different devices use different datatypes, such as CPU uses FP32 while GPU can use FP32 and FP16.
Some conversion are done automatically , for instance, execution on GPU with CPU as a fallback, you need to use only FP16 IR, the waste will be automatically converted from FP16 to FP32 by the Hetero plugin.
You can refer here for supported network: https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_supported_plugins_MYRIAD.html
For the error that you got:
Please, check your environment
Cannot load library 'libHeteroPlugin.dylib': dlopen(libHeteroPlugin.dylib, 1): image not found
Seems like the program is unable to locate the Plugin library. You should be good to go if you had able to run after Installation Guide for Linux* tho.
Plus, here is some info regarding Hetero Plugin: https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_supported_plugins_HETERO.html#introducin...
I should have mention that I am on OSX, after a look at within the folder I can confirm that I don't have the lib libHeteroPlugin.dylib mention on the error.
Do I have to build it from the cpp file provided with the installation or is it possible that lib is a part of a paid side of the product as it is for FPGA in my understanding?
Thanks for your help,
Please help to ensure that you install the NCS plugin for OSX according to this resource:
We have different plugin packages for different OS.
Make sure that you installed it correctly according to this official documentation and try to rerun the Hetero command.
We were able to replicate this behavior observed on macOS, so seems like libHeteroPlugin.dylib just wasn't built. We investigate this and get back to you once there's any news.
Best regards, Max.
That's the problem confirmed with Intel Distribution of OpenVINO. You can test now the master branch release of OpenVINO from https://github.com/openvinotoolkit/openvino/tree/master
And this change is also planned to be included into next public OpenVINO release.
Thanks for reporting this to OpenVINO community.
This thread will no longer be monitored since we have provided our suggestions. If you need any additional information from Intel, please submit a new question.