OpenVINO 2022.1.0 compile tool(https://github.com/openvinotoolkit/openvino/tree/2022.1.0/tools/compile_tool) is expected to work on a machine that does not have the physical device connected. But it throws the below error when tried to compile and export a blob for MYRIAD device.
The same usecase works on OpenVINO 2021.4.2 compile tool.
Looks like this is a bug on 2022.1.0 version.
Note: System does not have MYRIAD device connected and usecases were run inside docker containers with ubuntu 20.04 base OS. The hostsystem has ubuntu 20.04 OS as well.
Also is this compile tool supported for CPU and GPU devices ?
Thanks for the response Wan.
In OpenVINO 2022.1.0 version, is compile tool supported for CPU and GPU device ? Can we generate a compiled blob for target device as CPU/GPU ? If yes, can we run inference using the compiled blob on CPU/GPU device instead of IR files(i.e. bin and xml files) ?
According to the documentation, the compile tool only compiles networks for Intel® Neural Compute Stick 2 (MYRIAD plugin) only.
Run the compile_tool.exe with MYRIAD as the target device:
compile_tool.exe -m model.xml -o model.blob -d MYRIAD
By the way, we can generate a compiled blob using export() function of the ExecutableNetwork class. However, this model caching is only available for CPU plugin only.
1. Export the current executable network.
ie = IECore()
net = ie.read_network(model=path_to_xml_file, weights=path_to_bin_file)
exec_net = ie.load_network(network=net, device_name="CPU", num_requests=4)
2. Blob file is generated in the path.
3. Create an executable network from a previously exported network.
ie = IECore()
exec_net_imported = ie.import_network(model_file=”<path>/model.blob”, device_name="CPU")
We’ve got a reply from our developer. The permanent fix is in progress. You may use the following workaround provided by our developer to compile a network for inference and export it to a binary file:
Step 1: Create "myriad.conf" file with the following content:
Step 2: Execute compile_tool using the following command:
compile_tool.exe -m model.xml -d MYRIAD -c myriad.conf
Hope it helps!
Thanks for your question.
This thread will no longer be monitored since we have provided a workaround.
If you need any additional information from Intel, please submit a new question.