Issue with current EII 3.0.1 in leveraging AMX optimization on 4th Gen Intel Xeon(Sapphire Rapids)

[sagi-scalers-ai]

System information (version)

EII => 3.0.1

Operating System => Ubuntu 20.04

Problem classification => INFO

Detailed description

The version of OpenVINO (2021.4) in the latest version of EII does not support execution of inference with AMX optimization on 4th Gen Xeon . Is it possible to update OpenVINO version to 2022.3 on EII - Video Analytics module? If yes, Please guide us on the steps.

[JesusE_Intel · Accepted solution]

Hi sagi-scalers-ai,

Thanks for reaching out! Edge Insights for Industrial has not been validated with OpenVINO 2022.3.0. I can submit a feature request for the development team to consider upgrading the OpenVINO version.

That being said, you can try to update the OPENVINO_IMAGE variable by modifying the .env file under <installation location>/edge_insights_industrial/Edge_Insights_for_Industrial_3.0.1/IEdgeInsights/build. You will also need to update a couple of Dockerfiles to update the new location of the OpenVINO setupvars.sh as it has changed in newer releases. The new location is /opt/intel/openvino/setupvars.sh. Previously, it was /opt/intel/OpenVINO/bin/setupvars.sh.

Once the variable has been updated, run python3 builder.py in the build directory followed by the commands shown in the output.

Also, in the latest release of OpenVINO, OpenCV is no longer included. This will require you to update the Dockerfiles to include OpenCV. There may be additional changes needed to update the OpenVINO version on EII.

Hope this helps!

Regards,

Jesus

[JesusE_Intel]

If you need any additional information, please submit a new question as this thread will no longer be monitored.