Where link list to verify OpenVINO for Device CPU? Have Error when Run the Image Classification Verification Script

[Chiu__Hsien_Hsiang]

When Run the OpenVINO sample to run Car classification verification script

and

Have Error message

" … Failed to create plugin C:\Program File (x86)\IntelSWTools\openvino\deployment_tools\inference_engin\bin\intel64\MKLDNNPlugin.dll for device CPU

Please check your environment

Cannot load library 'C:Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engin\bin\intel64\Release\MKLDNNPlug.dl':1114 from cwd: C:\Users\...\Documents\Inte\OpenVINO\Inference_engin_samples_build\intel64\Release

Error"

Is this error CPU requirement or the set Environment path error?

The pc to test run Demo script is using

System Processor:
Intel(R) Atom(TM)x5-Z8350 CPU @1.44GHz 1.44 GHz

Windows 10, 64bits.

Is the CPU meet the OpenVINO requirement?

Where link to verify PC CPU for OpenVINO?

or

if Environment path error, where should be fixed to solve the Error?

[SIRIGIRI_V_Intel]

Hi Hsiang,

This issue might be due to the system path variable. Can you check whether the path of the MKLDNNPlugin.dll is added to the PATH of system variables.

If not added try to add the path and retry to execute the demos.

If the problem is still not resolved, please provide the complete logs to debug the issue.

Regards,

Ram prasad

[Tiger__Chris]

I have the same issue with Intel(R) Atom(TM) CPU E3845. windows 64bit.

[ ERROR ] Failed to create plugin C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll for device CPU
Please, check your environment
Cannot load library 'C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll': 1114 from cwd: C:\Users\123\Documents\Intel\OpenVINO\inference_engine_samples_build\intel64\Release

and the dll is in the right position and i also put environment variable in PATH but it does not work. 

[SIRIGIRI_V_Intel]

Please refer the below quote.

Max L. (Intel) wrote:

Hi Adrian.

Have you followed "Set the Environment Variables" step? https://docs.openvinotoolkit.org/latest/_docs_install_guides_installing_...

OpenVINO toolkit environment variables are removed when you close the Command Prompt window. As an option, you can permanently set the environment variables manually.

Feel free to ask any other questions.

Regards,

Ram prasad

[zhang__duoduo]

I have  the exactly the same question, have you solved it?

[SIRIGIRI_V_Intel]

Have you followed the steps mentioned above?

If you are still facing the issue, try to install the OpenVINO from a Docker image.

Hope this helps.

Regards,

Ram prasad

[Chiu__Hsien_Hsiang]

Hi Ram,

Thanks for your messages and provided solutions

1 Environment path solution, and 2nd solution: install the OpenVINO from a Docker image

Summary:

Yes, I have followed the steps mentioned above,

but still has same error when run the demo.

and 

have difficult to follow the 2nd solution : install the OpenVINO from a Docker image.

https://docs.openvinotoolkit.org/latest/_docs_install_guides_installing_openvino_docker_windows.html

Could someone please have make guiding very details step by step to follow how to  
How create your Dockerfile
How to built Docker Image
for Install Intel@ Distribution of OpenVINO toolkeit for Windows* from Docker Image

I am using Mini PC for this OpenVINO project. Attached my computer system info screen picture for reference.

Thank you,

Here are the completed steps and CMD logs with 5 Screen pictures  for debug reference.

Attached 5 screen pictures

Picture 1: SetVars ( Re Do Set Environment command)

Picture 2: Add path for MKLDNNPlugin (Manual Add the path of MKLDNNPlugin.dll)

Picture 3: Demo run error Screen (After Run Demo)

Picture 4: Verify MKLDNNPlugin.dll is in the  

The MKLDNNPlugin.dll is in the
C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll

Picture 5:  MKLDNNPlugin.dll missing

No KLDNNPlugin.dll in the C:\Users\share\Documents\Intel|OpenVINO\interface_engine_samples_build\intel64\Release folder,
and there is no MKLDNNPlugin.dll.

Here is completed Steps and Error logs for reference:

Steps 1: Re do the Environment setup again.

C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo>cd c:\Program Files (x86)\IntelSWTools\openvino\bin\

c:\Program Files (x86)\IntelSWTools\openvino\bin>setupvars.bat
Python 3.7.7
ECHO is off.
PYTHONPATH=c:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\open_model_zoo\tools\accuracy_checker;c:\Program Files (x86)\IntelSWTools\openvino\python\python3.7;c:\Program Files (x86)\IntelSWTools\openvino\python\python3;c:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\model_optimizer;
[setupvars.bat] OpenVINO environment initialized

Step 2: Manual check Environment Path:
Add new path to the directory path of the MKLDNNPlugin.dll to the PATH of system variables.
"C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Releas"

Step 3: Re-Run the Demo Run the Image Classification Verification Script,      (But still has same error)!

c:\Program Files (x86)\IntelSWTools\openvino\bin> cd C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\

C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo>demo_squeezenet_download_convert_run.bat
target_precision = FP16
Python 3.7.7
ECHO is off.
PYTHONPATH=C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\open_model_zoo\tools\accuracy_checker;C:\Program Files (x86)\IntelSWTools\openvino\python\python3.7;C:\Program Files (x86)\IntelSWTools\openvino\python\python3;C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\model_optimizer;c:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\open_model_zoo\tools\accuracy_checker;c:\Program Files (x86)\IntelSWTools\openvino\python\python3.7;c:\Program Files (x86)\IntelSWTools\openvino\python\python3;c:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\model_optimizer;
[setupvars.bat] OpenVINO environment initialized
INTEL_OPENVINO_DIR is set to C:\Program Files (x86)\IntelSWTools\openvino
Python 3.7.7
ECHO is off.
Requirement already satisfied: pyyaml in c:\users\share\appdata\roaming\python\python37\site-packages (from -r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 1)) (5.3)
Requirement already satisfied: requests in c:\users\share\appdata\roaming\python\python37\site-packages (from -r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 2)) (2.18.4)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in c:\users\share\appdata\roaming\python\python37\site-packages (from requests->-r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 2)) (1.22)
Requirement already satisfied: idna<2.7,>=2.5 in c:\users\share\appdata\roaming\python\python37\site-packages (from requests->-r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 2)) (2.6)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\share\appdata\roaming\python\python37\site-packages (from requests->-r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 2)) (2019.11.28)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in c:\users\share\appdata\roaming\python\python37\site-packages (from requests->-r C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\..\open_model_zoo\tools\downloader\requirements.in (line 2)) (3.0.4)
Download public squeezenet1.1 model
python "C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\open_model_zoo\tools\downloader\downloader.py" --name "squeezenet1.1" --output_dir "C:\Users\share\Documents\Intel\OpenVINO\openvino_models\models" --cache_dir "C:\Users\share\Documents\Intel\OpenVINO\openvino_models\cache"
################|| Downloading models ||################

========== Retrieving C:\Users\share\Documents\Intel\OpenVINO\openvino_models\models\public\squeezenet1.1\squeezenet1.1.prototxt from the cache

========== Retrieving C:\Users\share\Documents\Intel\OpenVINO\openvino_models\models\public\squeezenet1.1\squeezenet1.1.caffemodel from the cache

################|| Post-processing ||################

========== Replacing text in C:\Users\share\Documents\Intel\OpenVINO\openvino_models\models\public\squeezenet1.1\squeezenet1.1.prototxt
squeezenet1.1 model downloading completed

Waiting for 0 seconds, press a key to continue ...

Target folder C:\Users\share\Documents\Intel\OpenVINO\openvino_models\ir\public\squeezenet1.1\FP16 already exists. Skipping IR generation with Model Optimizer.
If you want to convert a model again, remove the entire C:\Users\share\Documents\Intel\OpenVINO\openvino_models\ir\public\squeezenet1.1\FP16 folder.

Waiting for 0 seconds, press a key to continue ...

###############|| Generate VS solution for Inference Engine samples using cmake ||###############

Waiting for 0 seconds, press a key to continue ...
Creating Visual Studio 16 2019 x64 files in C:\Users\share\Documents\Intel\OpenVINO\inference_engine_samples_build...
-- Selecting Windows SDK version 10.0.18362.0 to target Windows 10.0.17134.
-- The C compiler identification is MSVC 19.24.28319.0
-- The CXX compiler identification is MSVC 19.24.28319.0
-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.24.28314/bin/Hostx64/x64/cl.exe
-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.24.28314/bin/Hostx64/x64/cl.exe - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.24.28314/bin/Hostx64/x64/cl.exe
-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/Community/VC/Tools/MSVC/14.24.28314/bin/Hostx64/x64/cl.exe - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found InferenceEngine: C:/Program Files (x86)/IntelSWTools/openvino/deployment_tools/inference_engine/lib/intel64/Release/inference_engine.lib (Required is at least version "2.1")
-- Configuring done
-- Generating done
-- Build files have been written to: C:/Users/share/Documents/Intel/OpenVINO/inference_engine_samples_build

Waiting for 0 seconds, press a key to continue ...

###############|| Build Inference Engine samples using MS Visual Studio (MSBuild.exe) ||###############

Waiting for 0 seconds, press a key to continue ...
"C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Current\Bin\MSBuild.exe" Samples.sln /p:Configuration=Release /t:classification_sample_async /clp:ErrorsOnly /m
Microsoft (R) Build Engine version 16.4.0+e901037fe for .NET Framework
Copyright (C) Microsoft Corporation. All rights reserved.

Waiting for 0 seconds, press a key to continue ...

###############|| Run Inference Engine classification sample ||###############

Waiting for 0 seconds, press a key to continue ...
        1 file(s) copied.
classification_sample_async.exe -i "C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\car.png" -m "C:\Users\share\Documents\Intel\OpenVINO\openvino_models\ir\public\squeezenet1.1\FP16\squeezenet1.1.xml" -d CPU
[ INFO ] InferenceEngine:
        API version ............ 2.1
        Build .................. 37988
        Description ....... API
[ INFO ] Parsing input parameters
[ INFO ] Parsing input parameters
[ INFO ] Files were added: 1
[ INFO ]     C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\demo\car.png
[ INFO ] Creating Inference Engine
[ ERROR ] Failed to create plugin C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll for device CPU
Please, check your environment
Cannot load library 'C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll': 1114 from cwd: C:\Users\share\Documents\Intel\OpenVINO\inference_engine_samples_build\intel64\Release

Error

Step 4: checking the the MKLDNNPlugin.dll

The MKLDNNPlugin.dll is in the
C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll

But
No KLDNNPlugin.dll in the C:\Users\share\Documents\Intel|OpenVINO\interface_engine_samples_build\intel64\Release floder,
and there is no MKLDNNPlugin.dll.
 

For 2nd solution:
install the OpenVINO from a Docker image.
https://docs.openvinotoolkit.org/latest/_docs_install_guides_installing_openvino_docker_windows.html
Install Intel® Distribution of OpenVINO™ toolkit for Windows* from Docker* Image

***** Need additional guilding details in step by step

" How to To build a Docker image, create a Dockerfile "
that contains defined variables
and
commands required to create an OpenVINO toolkit installation image.

Need step by step guilding for
How create your Dockerfile
How to built Docker Image
for Install Intel@ Distribution of OpenVINO toolkeit for Windows* from Docker Image

Thank you,

[SIRIGIRI_V_Intel]

Can you copy the MKLDNNPlugin.dll from

C:\Program Files (x86)\IntelSWTools\openvino\deployment_tools\inference_engine\bin\intel64\Release\MKLDNNPlugin.dll 

to

C:\Users\share\Documents\Intel|OpenVINO\interface_engine_samples_build\intel64\Release

folder.

Then re-run the verification script.

For the 2^nd method:

To install the OpenVINO from a Docker image, install the Docker for windows and follow the below steps to build the Docker image for CPU.

Create the Dockerfile using the following example as a template:

FROM mcr.microsoft.com/windows/servercore:ltsc2019

ENV http_proxy $HTTP_PROXY

ENV https_proxy $HTTPS_PROXY

ARG DOWNLOAD_LINK=http://registrationcenter-download.intel.com/akdlm/irc_nas/13231/w_openvino_toolkit_p_2019.0.000.exe

ADD https://www.python.org/ftp/python/3.7.3/python-3.7.3.exe C:/python-3.7.3.exe

RUN C:\python-3.7.3.exe /passive InstallAllUsers=1 TargetDir=c:\Python37

RUN setx PATH "C:\Python37;C:\Python37\Scripts;%PATH%"

RUN python.exe -m pip --proxy=$https_proxy install cmake

ADD $DOWNLOAD_LINK w_openvino_toolkit_p_2019.0.000.exe

RUN start /WAIT w_openvino_toolkit_p_2019.0.000.exe --s --a install --eula=accept --output=c:\openvino_out.txt

CMD cmd.exe

Change the DOWNLOAD_LINK parameter in line 5 to the latest OpenVINO link and modify the commands in line 17 and 19 as per the requirements.

You can get the DOWLOAD_LINK from the Intel® Distribution of OpenVINO™ toolkit download page https://software.seek.intel.com/openvino-toolkit after registration. Right click the Offline Installer button on the download page in your browser and press Copy link address

To build a Docker* image for CPU, run the following command:

docker build . -t <image_name> \

--build-arg HTTP_PROXY=<http://your_proxy_server.com:port> \

--build-arg HTTPS_PROXY=<https://your_proxy_server.com:port>

[Chiu__Hsien_Hsiang]

Hi Ram,

Have Copy and Paste the MKLDNNPlugin.dll from directory, is not able to solve error

and also have tested Manual add all related Environment PATH too, still has same error.

Have difficult to follow the 2nd solution: install the OpenVINO from a Docker image

I have download the Docker Desktop for Windows,and Sign in.

Here is the update dockerfile script I have use

FROM mcr.microsoft.com/windows/servercore:ltsc2019
ENV http_proxy $HTTP_PROXY
ENV https_proxy $HTTPS_PROXY
ARG DOWNLOAD_LINK=http://registrationcenter-download.intel.com/akdlm/irc_nas/16359/w_openvino_toolkit_p_2020.1.033.exe
ADD https://www.python.org/ftp/python/3.7.3/python-3.7.3.exe C:/python-3.7.3.exe
RUN C:\python-3.7.3.exe /passive InstallAllUsers=1 TargetDir=c:\Python37
RUN setx PATH "C:\Python37;C:\Python37\Scripts;%PATH%"
RUN python.exe -m pip --proxy=$https_proxy install cmake
ADD $DOWNLOAD_LINK w_openvino_toolkit_p_2020.1.033.exe
RUN start /WAIT w_openvino_toolkit_p_2020.1.033.exe --s --a install --eula=accept --output=c:\openvino_out.txt
CMD cmd.exe

and

Have set my computer Proxy server IP and port : 172.22.0.1:8800

But have difficult to follow how To build a Docker* image for CPU, how to run the following command:

docker build . -t <image_name> 

--build-arg HTTP_PROXY=<http://your_proxy_server.com:port>

--build-arg HTTPS_PROXY=<https://your_proxy_server.com:port>

Tested: Docker Run hello-world, unable to pull the hello-world

"C:\Users\share\Desktop\containers>docker run hello-world
Unable to find image 'hello-world:latest' locally
latest: Pulling from library/hello-world
docker: no matching manifest for windows/amd64 10.0.17134 in the manifest list entries.
See 'docker run --help'."

Doesn't know where begin to fix docker error, and how to build a Docker* image for CPU.

Could someone make video demo for the install the OpenVINO from a Docker image to follow?

Thanks

[Chiu__Hsien_Hsiang]

Hi Ram,

Have verify the Docker installation,

Change Docker setting to switch to Linux containers, and re-test pull Hello-World.

Hello From docker, confirm Docker (Linux containers) is working correctly.

But if switch Docker back to Windows containers setting, then re-test Hello-World will fail.

C:\Users\share\Desktop\containers\mydockerbuilt>docker run hello-world
Unable to find image 'hello-world:latest' locally
latest: Pulling from library/hello-world
docker: no matching manifest for windows/amd64 10.0.17134 in the manifest list entries.
See 'docker run --help'.

Anyone know the solution to makes Docker Windows containers setting works?

and how To build a Docker* image for CPU, how to run the following command:

docker build . -t <image_name> 

--build-arg HTTP_PROXY=<http://your_proxy_server.com:port>

--build-arg HTTPS_PROXY=<https://your_proxy_server.com:port>