- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
I converted my Caffe model to IR using the latest version (2019 R1). Now I'm trying to use the calibration tool sample to convert my FP32 model to INT8. I'm able to load the model as FP32 and get the accuracy but it throws an error while loading the model for the first iteration of INT8, precisely in this line:
ExecutableNetwork executable_network = _pluginI8C.LoadNetwork(network, { { CONFIG_KEY(EXCLUSIVE_ASYNC_REQUESTS), CONFIG_VALUE(YES) } });
The message on the console:
[ INFO ] InferenceEngine: API version ............ 1.6 Build .................. 22443 [ INFO ] Parsing input parameters [ INFO ] Loading plugin API version ............ 1.6 Build .................. 22443 Description ....... MKLDNNPlugin [ INFO ] Loading network files [ INFO ] Preparing input blobs [ INFO ] Batch size is 1 [ INFO ] Collecting accuracy metric in FP32 mode to get a baseline, collecting activation statistics Progress: [....................] 100.00% done FP32 Accuracy: 95.45% [ INFO ] Verification of network accuracy if all possible layers converted to INT8 Validate int8 accuracy, threshold for activation statistics = 100.00 [ ERROR ] Inference problem: Supported primitive descriptors list is empty for node: Mul_722/FusedScaleShift_ ..\src\mkldnn_plugin\mkldnn_node.cpp:224 f:\intelswtools\openvino_2019.1.087\deployment_tools\inference_engine\include\details\ie_exception_conversion.hpp:71
Please let me know how to resolve this issue.
Thanks,
Indrajit
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Indrajit, before using the calibration tool, please use one of the openvino samples and run inference on your model. Does it work ?
Thanks,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Indrajit,
Thank you verifying. Is this Caffe model available in the public domain ? Or is it your personal one ? If it is your model, please send it to me over PM.
Thanks,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Shubha,
Could you please send me a message so that I can reply to it.
Thanks,
Indrajit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Indrajit, I just PM'd you. I hope you got the message ?
Thanks,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Indrajit,
1. Firstly, can you rerun calibration tool with additional command line arguments (CPU extension), please:
-l C:\Users\sdramani\Documents\Intel\OpenVINO\inference_engine_samples_build_2017\intel64\Release\cpu_extension.dll
I hope everything should work with that.
2. Secondly, I would like to suggest to use Python Calibration Tool: https://docs.openvinotoolkit.org/latest/_inference_engine_tools_calibration_tool_README.html. Python Calibration Tool supports more datasets and topologies.
Best regards, Edward
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Indrajit, I already tried what Edward suggested (adding -l cpu_extension.dll). Still got the same error. Does it work for you ? If adding -l fails, it's a bug (which I've already filed).
Thanks,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Edward,
Adding CPU extension didn't work.
Also, I have tried the python calibration tool which gives the same error.
Thanks
Indrajit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Indrajit,
can you kindly supply the full Python calibrate.py command you used here ?
Thanks,
Shubha
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page