How to run openvino model on cpu and ncs2 on raspberry pi

[Gama]

Hello, I have the same problem How to run openvino model on cpu on raspberry pi - Intel Community

as I ran ncs2 on debian 11 rasberry pi 4 and after installing arm cpu using openvino contribute the ncs2 device isn't recognized as before I followed the instructions in this link https://www.intel.com/content/www/us/en/support/articles/000094846/boards-and-kits.html besides the openvino contribute link https://github.com/openvinotoolkit/openvino_contrib/blob/master/modules/arm_plugin/README.md

I modified the rules file generated by sh ~/openvino_dist/install_dependencies/install_NCS_udev_rules.sh and copied the file to the rules folder sudo cp ~/openvino_dist/97-myriad-usbboot.rules /etc/udev/rules.d/ but the system doesn't show the myriad and only show the arm cpu 

OS Debian 11 
raspberry pi 4 
ncs2 

[Wan_Intel]

Hi Gama,

Thanks for reaching out to us.

Could you please try the following suggestion and see if your issue was able to resolve?

• Please ensure you have set up the OpenVINO™ environment with the following command:

source ~/openvino_dist/setupvars.sh

• Please ensure you cloned the OpenVINO™ 2022.1 during the installation:

git clone --recurse-submodules --single-branch --branch=2022.1.0 https://github.com/openvinotoolkit/openvino.git

On another note, we do have pre-built package for OpenVINO™ 2022.3.1.

You may use OpenVINO™ 2022.3.1 pre-built package, which support ARM and Intel® Neural Compute Stick 2:

l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_arm64.tgz

Regards,

Wan

[Gama]

Hi Wan, 

thanks for your responding. 

I found out that I used openvino 2023.0.0 and it was not supported to run VPUs, so I cloned openvino 2022.3.1 instead.

git clone --recurse-submodules --single-branch --branch=2022.3.1 https://github.com/openvinotoolkit/openvino.git

I ran into 2 problems during the make openvino_contribute for arm cpu and opencv can't be installed and give me error during making. 

cmake -DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=~/openvino_dist \
-DENABLE_INTEL_MYRIAD=ON \
-DENABLE_INTEL_CPU=ON \
-DENABLE_INTEL_GPU=OFF \
-DENABLE_CLDNN=OFF \
-DENABLE_AUTO=ON \
-DENABLE_MULTI=ON \
-DENABLE_HETERO=ON \
-DENABLE_TEMPLATE=OFF \
-DENABLE_TESTS=OFF \
-DENABLE_OV_ONNX_FRONTEND=OFF \
-DENABLE_OV_PADDLE_FRONTEND=OFF \
-DENABLE_OV_TF_FRONTEND=OFF \
-DENABLE_NCC_STYLE=OFF \
-DENABLE_SSE42=OFF \
-DTHREADING=SEQ \
-DENABLE_OPENCV=ON \
-DENABLE_PYTHON=ON \
-DOPENVINO_EXTRA_MODULES=<openvino_contrib>/modules \
-DPYTHON_EXECUTABLE=$(which python3.9) \
-DPYTHON_LIBRARY=/usr/lib/aarch64-linux-gnu/libpython3.9.so \
-DPYTHON_INCLUDE_DIR=/usr/include/python3.9 ..

what can be the problem? is it the same thing to use this version l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_arm64.tgz 

as cloning directly from github? and if I use version 2022.1.0, will I have to use the extra modules option with openvino_contribute ? 

"I'm using Debian 11 not Debian 9"

[Gama]

I completed the making of the openvino with openvino_contribute with arm plugin as follows 

cmake -DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=~/openvino_dist \
-DENABLE_INTEL_MYRIAD=ON \
-DENABLE_INTEL_CPU=ON \
-DENABLE_INTEL_GPU=OFF \
-DENABLE_CLDNN=OFF \
-DENABLE_AUTO=ON \
-DENABLE_MULTI=ON \
-DENABLE_HETERO=ON \
-DENABLE_TEMPLATE=OFF \
-DENABLE_TESTS=OFF \
-DENABLE_OV_ONNX_FRONTEND=OFF \
-DENABLE_OV_PADDLE_FRONTEND=OFF \
-DENABLE_OV_TF_FRONTEND=OFF \
-DENABLE_NCC_STYLE=OFF \
-DENABLE_SSE42=OFF \
-DTHREADING=SEQ \
-DENABLE_OPENCV=OFF \
-DENABLE_PYTHON=ON \
-DOPENVINO_EXTRA_MODULES=<openvino_contrib>/modules -DBUILD_custom_operations=OFF -DBUILD_java_api=OFF -DBUILD_mo_pytorch=OFF -DBUILD_nvidia_plugin=OFF -DBUILD_optimum=OFF -DBUILD_ovms_ai_extension=OFF -DBUILD_token_merging=OFF \
-DPYTHON_EXECUTABLE=$(which python3.9) \
-DPYTHON_LIBRARY=/usr/lib/aarch64-linux-gnu/libpython3.9.so \
-DPYTHON_INCLUDE_DIR=/usr/include/python3.9 ..

but openvino only see MYRIAD, what should I do ? 

[Gama]

If I want to work with 
l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_arm64.tgz

how can I use it ? should I build ? what are the steps ? and from where should I find these prebuilt packages ?
can I use it with debian 11 or must I work on debian 9 ? 

[Peh_Intel · Accepted solution]

Hi Gama,

You can refer to the Install OpenVINO™ Runtime for Raspbian OS:

https://docs.openvino.ai/2022.3/openvino_docs_install_guides_installing_openvino_raspbian.html

In short, you just need to extract files from this prebuilt package, install some dependencies, set the environment variable (setupvars.sh) and you are ready to use. 

[Wan_Intel]

Hello Gama,

Thanks for your question.

If you need any additional information from Intel, please submit a new question as this thread will no longer be monitored.

Regards,

Wan