Intel® Edge Software Hub
Get answers from community peers to your questions about building Edge Software Hub solutions for edge compute node.
Announcements
Welcome to the Intel Community! If you like the answer to your question, please mark it as 'Accepted Solution' to help others.

The Edge Software Vision Package for Red Hat Enterprise Linux is now available here.

Learn more about developing on Intel® Hardware and Software here.
401 Discussions

ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10
Beginner
‎09-15-2022 08:15 PM
6,163 Views
Solved Jump to solution

Hello,

I have installed and run the Intel ESDQ package for vision on a target system (Processor: Intel(R) Core (TM) i3-10100E CPU @ 3.20GHz). After installation, some of the test modules Failed. 

As shown in attachment, the modules “Intel Distribution of OpenVINO toolkit 2021 4 Runtime, Deep Learning DL Streamer Pipelines” have failed.

Attached, please check the logs and ESDQ test report generated. Would you please share your comments and suggestions about this issue.

 

ModulesInfo

 

Installed Module

Status

0

Amazon_Web_Services_Greengrass_Prerequisites

SUCCESS

1

K3s_Lightweight_Kubernetes

SUCCESS

2

Azure_IoT_Edge_Prerequisites

SUCCESS

3

Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime

FAILED

4

Deep_Learning_DL_Streamer_Pipelines

FAILED

5

Docker_Community_Edition_CE

SUCCESS

6

Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container

SUCCESS

7

edgex_foundry

SUCCESS

8

RI_MultiCamera_Social_Distancing

SUCCESS

9

esdq

SUCCESS

10

Docker_Compose

SUCCESS

 

Target System Information:

CPU: Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz

OS: Ubuntu 18.04.5 LTS

Kernel: 5.4.0-125-generic

ESDQ Version: 5.0

 

 

Thanks & Regards,

Julien

 

 

Labels (1)
esdqReport_2022-09-12_06_50_17.zip
0 Kudos
1 Solution
JesusE_Intel
Moderator
‎11-15-2022 09:35 AM
4,577 Views
Solved Jump to solution

Hi Julien,


The system you are using is a 11th Gen Desktop processor version with Intel UHD Graphics. I'm testing on a 11th Gen Mobile processor. I'll need to see if I can find a system to test ESDQ. In the meantime, could you make sure the graphics driver is setup and user permissions have been set?


Configurations for Intel® Processor Graphics (GPU) with OpenVINO™ — OpenVINO™ documentation — Version(2022.1)


Regards,

Jesus


View solution in original post

0 Kudos
Copy link

Link Copied

33 Replies
JesusE_Intel
Moderator
‎09-16-2022 02:50 PM
4,994 Views
Solved Jump to solution

Hi Julien,


I just tested ESDQ5.0 on Ubuntu 18.04 and OpenVINO failed to install as well. Looking at the logs, I see ONNX failed to install which caused the OpenVINO Model Optimizer installation to fail. I resolved this by installing ONNX manually: pip3 install onnx==1.8.1. Could you try and see if this resolves the issue for you?


If this does not work, please provide the log files for OpenVINO installation under /var/log/esb-cli/Edge_Software_Device_Qualification/Intel_Distribution_of_OpenVINO_toolkit_2021.4_Runtime


Regards,

Jesus


0 Kudos
Copy link
jim-tech10
Beginner
‎09-18-2022 10:53 PM
4,963 Views
Solved Jump to solution
In response to JesusE_Intel

Hi Jesus,

 

Thanks for the response. I have followed your instructions by installing the ONNX and run the ESDQ again. Then, the OpenVino works fine for now.

But I face some new issues as shown below, the MSDK5 test fails, and the report is missing for the VATS_Test_Module.

Attached, please check the test report. Have you faced this issue as well? Please let me know if you have an idea on how to solve it, please.

 

Summary

 

  Property Value
0 ESDQ Version 5.0
1 Execution Timestamp UTC 2022-09-19 03:44:11
2 Duration 0:09:48
3 Number of test category 3
4 Test Categories 'SysInfo' 'Vision_Test_Module' 'VATS_Test_Module'

 

SystemInfo

 

  System Category Property Value
0 SOFTWARE INFO OS version Ubuntu 18.04.5 LTS
1 SOFTWARE INFO Kernel 5.4.0-125-generic
2 HARDWARE INFO Device Manufacturer Default string
3 HARDWARE INFO Hardware Architecture x86_64
4 HARDWARE INFO Processor Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz
5 HARDWARE INFO GPU Intel Corporation
6 HARDWARE INFO Memory size 3.7G
7 HDD Configurations Model ATA WDC WDS250G2B0A (scsi)
8 HDD Configurations Disk /dev/sda 250GB
9 HDD Configurations Sector size (logical/physical) 512B/512B
10 HDD Configurations Partition Table gpt
11 HDD Configurations Disk Flags Header Number Start End Size File system Name Flags
12 HDD Configurations Disk Flags 1 1049kB 538MB 537MB fat32 EFI System Partition boot esp
13 HDD Configurations Disk Flags 2 538MB 250GB 250GB ext4
14 HARDWARE ACCELERATOR VPU 0
15 HARDWARE ACCELERATOR FPGA 0

 

ModulesInfo

 

  Installed Module Status
0 Amazon_Web_Services_Greengrass_Prerequisites SUCCESS
1 K3s_Lightweight_Kubernetes SUCCESS
2 Azure_IoT_Edge_Prerequisites SUCCESS
3 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime SUCCESS
4 Deep_Learning_DL_Streamer_Pipelines SUCCESS
5 Docker_Community_Edition_CE SUCCESS
6 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container SUCCESS
7 edgex_foundry SUCCESS
8 RI_MultiCamera_Social_Distancing SUCCESS
9 esdq SUCCESS
10 Docker_Compose SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
1 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
2 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
3 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
4 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
5 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
6 aws_greengrass AWS1 aws_hello_world_sample Pass
7 k3s K3S1 k3s_sample Pass
8 openvino CPU1 hello_reshape_ssd with CPU Pass
9 openvino CPU2 style_transfer_sample_python with CPU Pass
10 openvino CPU3 object_detection_demo_ssd_async CPU Pass
11 openvino CPU4 object_detection_demo_python with CPU Pass
12 openvino GPU1 hello_reshape_ssd with GPU Pass
13 openvino GPU2 style_transfer_sample_python with GPU Pass
14 openvino GPU3 object_detection_demo_ssd_async GPU Pass
15 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass

VATS_Test_Module

Missing report !

 

 

Thanks &  Regards,

Julien

 

In response to JesusE_Intel
0 Kudos
Copy link
jim-tech10
Beginner
‎09-19-2022 02:15 AM
4,940 Views
Solved Jump to solution
In response to jim-tech10

Please check the logs and test report in attachment. 

In response to jim-tech10
esdqReport_2022-09-19_05_14_03.zip
0 Kudos
Copy link
JesusE_Intel
Moderator
‎09-19-2022 01:37 PM
4,928 Views
Solved Jump to solution

Hi Julien,

 

From the logs, I can see your system is not detecting any hardware accelerator (HDDL) devices. Is there one installed in your system? Can you provide the output of the lsusb command? The empty VATs tests are expected when no HDDL device is connected to the system.

 

Regarding the MediaSDK test fails, I see [ERROR], sts=MFX_ERR_UNSUPPORTED(-3) error in the log file. Could you please try the steps included in the Troubleshooting section of the installation guide? Please let me know if this works for you.

 

 

Regards,

Jesus


0 Kudos
Copy link
jim-tech10
Beginner
‎09-21-2022 12:26 AM
4,813 Views
Solved Jump to solution
In response to JesusE_Intel

Hi Jesus,

Thanks for the response.

I have used the “Intel® Neural Compute Stick 2” shown in attachment and run the test again. The VATs tests is appeared now, but there are some failed tests from VATs. Attached, please check the update result. Please let me know if you have any suggestions.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest.

ModulesInfo

  Installed Module Status
0 Amazon_Web_Services_Greengrass_Prerequisites SUCCESS
1 K3s_Lightweight_Kubernetes SUCCESS
2 Azure_IoT_Edge_Prerequisites SUCCESS
3 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime SUCCESS
4 Deep_Learning_DL_Streamer_Pipelines SUCCESS
5 Docker_Community_Edition_CE SUCCESS
6 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container SUCCESS
7 edgex_foundry SUCCESS
8 RI_MultiCamera_Social_Distancing SUCCESS
9 esdq SUCCESS
10 Docker_Compose SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
1 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
2 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
3 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
4 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
5 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
6 aws_greengrass AWS1 aws_hello_world_sample Pass
7 k3s K3S1 k3s_sample Pass
8 openvino CPU1 hello_reshape_ssd with CPU Pass
9 openvino CPU2 style_transfer_sample_python with CPU Pass
10 openvino CPU3 object_detection_demo_ssd_async CPU Pass
11 openvino CPU4 object_detection_demo_python with CPU Pass
12 openvino GPU1 hello_reshape_ssd with GPU Pass
13 openvino GPU2 style_transfer_sample_python with GPU Pass
14 openvino GPU3 object_detection_demo_ssd_async GPU Pass
15 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass
16 openvino HDDL1 hello_reshape_ssd with HDDL Fail
17 openvino HDDL2 style_transfer_sample_python with HDDL Fail
18 openvino HDDL3 object_detection_demo_ssd_async HDDL Fail
19 openvino HDDL4 object_detection_demo_ssd_async_python with HDDL Fail

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Fail 2 0% 2022-09-21-15:05:40 2022-09-21-15:06:19 39s 0.0 24.6 0.2 4.2
1 reset_1 Pass 1 100% 2022-09-21-15:06:20 2022-09-21-15:06:23 3s 0.0 0.0 0.0 0.0
2 hardware_ping Fail 1 0% 2022-09-21-15:06:24 2022-09-21-15:07:03 39s 0.1 1.0 0.0 0.3
3 io_ping_test Pass 1 100% 2022-09-21-15:07:04 2022-09-21-15:07:07 3s 0.0 0.0 0.2 0.2
4 performance_alexnet Fail 1 0% 2022-09-21-15:07:08 2022-09-21-15:07:11 3s 0.0 0.0 0.3 0.3
5 performance_densenet-121 Fail 1 0% 2022-09-21-15:07:12 2022-09-21-15:07:16 3s 0.0 0.0 0.3 0.3
6 performance_googlenet-v1 Fail 1 0% 2022-09-21-15:07:17 2022-09-21-15:07:20 3s 0.0 0.0 0.3 0.3
7 performance_mobilenet-ssd Fail 1 0% 2022-09-21-15:07:21 2022-09-21-15:07:24 3s 0.0 0.0 0.3 0.3
8 performance_mobilenet-v1-1.0-224 Fail 1 0% 2022-09-21-15:07:25 2022-09-21-15:07:28 3s 0.0 0.0 0.3 0.3
9 performance_mobilenet-v2 Fail 1 0% 2022-09-21-15:07:29 2022-09-21-15:07:32 3s 0.0 0.0 0.3 0.3
10 performance_squeezenet1.1 Fail 1 0% 2022-09-21-15:07:33 2022-09-21-15:07:36 3s 0.0 0.0 0.3 0.3
11 performance_resnet-50-pytorch Fail 1 0% 2022-09-21-15:07:37 2022-09-21-15:07:40 3s 0.0 0.0 0.3 0.3
12 thermal_test Fail 1 0% 2022-09-21-15:07:41 Wed Sep 21 15:07:44 2022 3s 0.0 0.0 0.2 0.2

 

 

 

Thanks & regards,

--Julien

In response to JesusE_Intel
esdqReport_2022-09-21_07_08_12.zip
300 KB
84 KB
0 Kudos
Copy link
jim-tech10
Beginner
‎09-21-2022 12:35 AM
4,813 Views
Solved Jump to solution
In response to JesusE_Intel

Hi Jesus,

Thanks for the response.

I have used the “Intel® Neural Compute Stick 2” shown in attachment and run the test again. The VATs tests is appeared now, but there are some failed tests from VATs. Attached, please check the update result. Please let me know if you have any suggestions.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest.

ModulesInfo

  Installed Module Status
0 Amazon_Web_Services_Greengrass_Prerequisites SUCCESS
1 K3s_Lightweight_Kubernetes SUCCESS
2 Azure_IoT_Edge_Prerequisites SUCCESS
3 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime SUCCESS
4 Deep_Learning_DL_Streamer_Pipelines SUCCESS
5 Docker_Community_Edition_CE SUCCESS
6 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container SUCCESS
7 edgex_foundry SUCCESS
8 RI_MultiCamera_Social_Distancing SUCCESS
9 esdq SUCCESS
10 Docker_Compose SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
1 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
2 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
3 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
4 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
5 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
6 aws_greengrass AWS1 aws_hello_world_sample Pass
7 k3s K3S1 k3s_sample Pass
8 openvino CPU1 hello_reshape_ssd with CPU Pass
9 openvino CPU2 style_transfer_sample_python with CPU Pass
10 openvino CPU3 object_detection_demo_ssd_async CPU Pass
11 openvino CPU4 object_detection_demo_python with CPU Pass
12 openvino GPU1 hello_reshape_ssd with GPU Pass
13 openvino GPU2 style_transfer_sample_python with GPU Pass
14 openvino GPU3 object_detection_demo_ssd_async GPU Pass
15 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass
16 openvino HDDL1 hello_reshape_ssd with HDDL Fail
17 openvino HDDL2 style_transfer_sample_python with HDDL Fail
18 openvino HDDL3 object_detection_demo_ssd_async HDDL Fail
19 openvino HDDL4 object_detection_demo_ssd_async_python with HDDL Fail

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Fail 2 0% 2022-09-21-15:05:40 2022-09-21-15:06:19 39s 0.0 24.6 0.2 4.2
1 reset_1 Pass 1 100% 2022-09-21-15:06:20 2022-09-21-15:06:23 3s 0.0 0.0 0.0 0.0
2 hardware_ping Fail 1 0% 2022-09-21-15:06:24 2022-09-21-15:07:03 39s 0.1 1.0 0.0 0.3
3 io_ping_test Pass 1 100% 2022-09-21-15:07:04 2022-09-21-15:07:07 3s 0.0 0.0 0.2 0.2
4 performance_alexnet Fail 1 0% 2022-09-21-15:07:08 2022-09-21-15:07:11 3s 0.0 0.0 0.3 0.3
5 performance_densenet-121 Fail 1 0% 2022-09-21-15:07:12 2022-09-21-15:07:16 3s 0.0 0.0 0.3 0.3
6 performance_googlenet-v1 Fail 1 0% 2022-09-21-15:07:17 2022-09-21-15:07:20 3s 0.0 0.0 0.3 0.3
7 performance_mobilenet-ssd Fail 1 0% 2022-09-21-15:07:21 2022-09-21-15:07:24 3s 0.0 0.0 0.3 0.3
8 performance_mobilenet-v1-1.0-224 Fail 1 0% 2022-09-21-15:07:25 2022-09-21-15:07:28 3s 0.0 0.0 0.3 0.3
9 performance_mobilenet-v2 Fail 1 0% 2022-09-21-15:07:29 2022-09-21-15:07:32 3s 0.0 0.0 0.3 0.3
10 performance_squeezenet1.1 Fail 1 0% 2022-09-21-15:07:33 2022-09-21-15:07:36 3s 0.0 0.0 0.3 0.3
11 performance_resnet-50-pytorch Fail 1 0% 2022-09-21-15:07:37 2022-09-21-15:07:40 3s 0.0 0.0 0.3 0.3
12 thermal_test Fail 1 0% 2022-09-21-15:07:41 Wed Sep 21 15:07:44 2022 3s 0.0 0.0 0.2 0.2

 

 

 

Thanks & regards,

--Julien

In response to JesusE_Intel
esdqReport_2022-09-21_07_08_12.zip
300 KB
0 Kudos
Copy link
jim-tech10
Beginner
‎09-21-2022 12:44 AM
4,813 Views
Solved Jump to solution
In response to JesusE_Intel

Hi Jesus,

Thanks for the response.

I have used the “Intel® Neural Compute Stick 2” shown in attachment and run the test again. The VATs tests is appeared now, but there are some failed tests from VATs. Attached, please check the update result. Please let me know if you have any suggestions.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest, Thanks.

ModulesInfo

  Installed Module Status
0 Amazon_Web_Services_Greengrass_Prerequisites SUCCESS
1 K3s_Lightweight_Kubernetes SUCCESS
2 Azure_IoT_Edge_Prerequisites SUCCESS
3 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime SUCCESS
4 Deep_Learning_DL_Streamer_Pipelines SUCCESS
5 Docker_Community_Edition_CE SUCCESS
6 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container SUCCESS
7 edgex_foundry SUCCESS
8 RI_MultiCamera_Social_Distancing SUCCESS
9 esdq SUCCESS
10 Docker_Compose SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
1 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
2 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
3 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
4 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
5 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
6 aws_greengrass AWS1 aws_hello_world_sample Pass
7 k3s K3S1 k3s_sample Pass
8 openvino CPU1 hello_reshape_ssd with CPU Pass
9 openvino CPU2 style_transfer_sample_python with CPU Pass
10 openvino CPU3 object_detection_demo_ssd_async CPU Pass
11 openvino CPU4 object_detection_demo_python with CPU Pass
12 openvino GPU1 hello_reshape_ssd with GPU Pass
13 openvino GPU2 style_transfer_sample_python with GPU Pass
14 openvino GPU3 object_detection_demo_ssd_async GPU Pass
15 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass
16 openvino HDDL1 hello_reshape_ssd with HDDL Fail
17 openvino HDDL2 style_transfer_sample_python with HDDL Fail
18 openvino HDDL3 object_detection_demo_ssd_async HDDL Fail
19 openvino HDDL4 object_detection_demo_ssd_async_python with HDDL Fail

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Fail 2 0% 2022-09-21-15:05:40 2022-09-21-15:06:19 39s 0.0 24.6 0.2 4.2
1 reset_1 Pass 1 100% 2022-09-21-15:06:20 2022-09-21-15:06:23 3s 0.0 0.0 0.0 0.0
2 hardware_ping Fail 1 0% 2022-09-21-15:06:24 2022-09-21-15:07:03 39s 0.1 1.0 0.0 0.3
3 io_ping_test Pass 1 100% 2022-09-21-15:07:04 2022-09-21-15:07:07 3s 0.0 0.0 0.2 0.2
4 performance_alexnet Fail 1 0% 2022-09-21-15:07:08 2022-09-21-15:07:11 3s 0.0 0.0 0.3 0.3
5 performance_densenet-121 Fail 1 0% 2022-09-21-15:07:12 2022-09-21-15:07:16 3s 0.0 0.0 0.3 0.3
6 performance_googlenet-v1 Fail 1 0% 2022-09-21-15:07:17 2022-09-21-15:07:20 3s 0.0 0.0 0.3 0.3
7 performance_mobilenet-ssd Fail 1 0% 2022-09-21-15:07:21 2022-09-21-15:07:24 3s 0.0 0.0 0.3 0.3
8 performance_mobilenet-v1-1.0-224 Fail 1 0% 2022-09-21-15:07:25 2022-09-21-15:07:28 3s 0.0 0.0 0.3 0.3
9 performance_mobilenet-v2 Fail 1 0% 2022-09-21-15:07:29 2022-09-21-15:07:32 3s 0.0 0.0 0.3 0.3
10 performance_squeezenet1.1 Fail 1 0% 2022-09-21-15:07:33 2022-09-21-15:07:36 3s 0.0 0.0 0.3 0.3
11 performance_resnet-50-pytorch Fail 1 0% 2022-09-21-15:07:37 2022-09-21-15:07:40 3s 0.0 0.0 0.3 0.3
12 thermal_test Fail 1 0% 2022-09-21-15:07:41 Wed Sep 21 15:07:44 2022 3s 0.0 0.0 0.2 0.2

 

 

 

Thanks & regards,

--Julien

 

In response to JesusE_Intel
esdqReport_2022-09-21_07_08_12.zip
300 KB
0 Kudos
Copy link
jim-tech10
Beginner
‎09-21-2022 12:48 AM
4,813 Views
Solved Jump to solution

Hi Jesus,

Thanks for the response.

I have used the “Intel® Neural Compute Stick 2” shown in attachment and run the test again. The VATs tests is appeared now, but there are some failed tests from VATs. Attached, please check the update result. Please let me know if you have any suggestions.

 

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest, thanks.

 

ModulesInfo

 

  Installed Module Status
0 Amazon_Web_Services_Greengrass_Prerequisites SUCCESS
1 K3s_Lightweight_Kubernetes SUCCESS
2 Azure_IoT_Edge_Prerequisites SUCCESS
3 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime SUCCESS
4 Deep_Learning_DL_Streamer_Pipelines SUCCESS
5 Docker_Community_Edition_CE SUCCESS
6 Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container SUCCESS
7 edgex_foundry SUCCESS
8 RI_MultiCamera_Social_Distancing SUCCESS
9 esdq SUCCESS
10 Docker_Compose SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
1 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
2 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
3 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
4 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
5 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
6 aws_greengrass AWS1 aws_hello_world_sample Pass
7 k3s K3S1 k3s_sample Pass
8 openvino CPU1 hello_reshape_ssd with CPU Pass
9 openvino CPU2 style_transfer_sample_python with CPU Pass
10 openvino CPU3 object_detection_demo_ssd_async CPU Pass
11 openvino CPU4 object_detection_demo_python with CPU Pass
12 openvino GPU1 hello_reshape_ssd with GPU Pass
13 openvino GPU2 style_transfer_sample_python with GPU Pass
14 openvino GPU3 object_detection_demo_ssd_async GPU Pass
15 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass
16 openvino HDDL1 hello_reshape_ssd with HDDL Fail
17 openvino HDDL2 style_transfer_sample_python with HDDL Fail
18 openvino HDDL3 object_detection_demo_ssd_async HDDL Fail
19 openvino HDDL4 object_detection_demo_ssd_async_python with HDDL Fail

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Fail 2 0% 2022-09-21-15:05:40 2022-09-21-15:06:19 39s 0.0 24.6 0.2 4.2
1 reset_1 Pass 1 100% 2022-09-21-15:06:20 2022-09-21-15:06:23 3s 0.0 0.0 0.0 0.0
2 hardware_ping Fail 1 0% 2022-09-21-15:06:24 2022-09-21-15:07:03 39s 0.1 1.0 0.0 0.3
3 io_ping_test Pass 1 100% 2022-09-21-15:07:04 2022-09-21-15:07:07 3s 0.0 0.0 0.2 0.2
4 performance_alexnet Fail 1 0% 2022-09-21-15:07:08 2022-09-21-15:07:11 3s 0.0 0.0 0.3 0.3
5 performance_densenet-121 Fail 1 0% 2022-09-21-15:07:12 2022-09-21-15:07:16 3s 0.0 0.0 0.3 0.3
6 performance_googlenet-v1 Fail 1 0% 2022-09-21-15:07:17 2022-09-21-15:07:20 3s 0.0 0.0 0.3 0.3
7 performance_mobilenet-ssd Fail 1 0% 2022-09-21-15:07:21 2022-09-21-15:07:24 3s 0.0 0.0 0.3 0.3
8 performance_mobilenet-v1-1.0-224 Fail 1 0% 2022-09-21-15:07:25 2022-09-21-15:07:28 3s 0.0 0.0 0.3 0.3
9 performance_mobilenet-v2 Fail 1 0% 2022-09-21-15:07:29 2022-09-21-15:07:32 3s 0.0 0.0 0.3 0.3
10 performance_squeezenet1.1 Fail 1 0% 2022-09-21-15:07:33 2022-09-21-15:07:36 3s 0.0 0.0 0.3 0.3
11 performance_resnet-50-pytorch Fail 1 0% 2022-09-21-15:07:37 2022-09-21-15:07:40 3s 0.0 0.0 0.3 0.3
12 thermal_test Fail 1 0% 2022-09-21-15:07:41 Wed Sep 21 15:07:44 2022 3s 0.0 0.0 0.2 0.2

 

Thanks & regards,

--Julien

 

esdqReport_2022-09-21_07_08_12.zip
300 KB
0 Kudos
Copy link
JesusE_Intel
Moderator
‎09-27-2022 12:56 PM
4,789 Views
Solved Jump to solution

Hi Julien,

 

Apologies for the delay, I somehow missed the notification for your last message.  I believe you need to use an Intel Vision Accelerator with MYRIAD X (HDDL) that uses the HDDL Plugin. The Intel Neural Compute Stick 2 utilizes the Myriad Plugin from OpenVINO. The HDDL plugin may also pick up the NCS 2 and configure it as an HDDL device but I'll need to run some tests and confirm.

 

In the meantime, could you try these steps: https://www.intel.com/content/www/us/en/developer/articles/technical/edge-software-device-qualification-vision.html#inpage-nav-6-undefined-1

 

Also, try to install the Intel NCS 2 device rules:

Install and Configure Intel® Distribution of OpenVINO™ toolkit for Linux* — OpenVINO™ documentation — Version(2021.4)

 

Regards,

Jesus

 

0 Kudos
Copy link
jim-tech10
Beginner
‎09-28-2022 12:02 AM
4,767 Views
Solved Jump to solution

Hi Jesus,

Thanks for your response. I have already tried the troubleshooting steps mentioned in these links but still not working.

About the Intel NCS 2 device rules, the demo (Image Classification verification script.) test still shows “[ERROR] no device found” as shown in attachment.

Attached, please also check the output of lsusb command. Please let me know if you have further information about the The HDDL plugin to configure the NCS 2 as an HDDL device.

 

Thanks & regards,

--Julien

 

69 KB
506 KB
0 Kudos
Copy link
JesusE_Intel
Moderator
‎09-29-2022 04:50 PM
4,719 Views
Solved Jump to solution

Hi Julien,

 

The lsusb command shows the Intel Neural Compute Stick 2 is being used by the HDDL Plugin. Could you try to use the latest ESDQ 6.1 and see if the same behavior is seen? After installing ESDQ 6.0 reboot your system to ensure the device rules have been properly configured for the Myriad X device.

 

From my test, only the HDDL Hardware ping fails, all other tests pass. I will confirm with the team if we have validated with an Intel Neural Compute Stick 2.

 

Regards,

Jesus

 

0 Kudos
Copy link
jim-tech10
Beginner
‎09-30-2022 02:44 AM
4,706 Views
Solved Jump to solution

Hi Jesus,

 

Thanks for the update. I have some more questions:

Which ubuntu version do you use to run the ESDQ6.0 vision test?

Have you done any additional configuration for NCS 2 (or just plug & play)?

 

As you suggested I have installed, the ESDQ6.1 vision on ubuntu 18.04 but some VATS still fail.

I also face this new problem with the new version (ESDQ6.01) , the Vision_Test_Module can not be executed because it is stuck while Pinging https://www.intel.com to check the internet connectivity as shown below (over 1 hour):

“Pinging https://www.intel.com for checking Internet Connectivity. Please wait for few seconds.”  any idea about this issue?

 

Attached, please check logs for the ESDQ6.1 test. Please let me know about your suggestions.

 

Thanks & Regards

Julien

 

193 KB
esdqReport_2022-09-30_09_10_41.zip
0 Kudos
Copy link
JesusE_Intel
Moderator
‎09-30-2022 08:54 AM
4,699 Views
Solved Jump to solution

Hi Julien,


For ESDQ 6.1, I am running on Ubuntu 20.04. I am just connecting the NCS 2 when running the tests.

  1. Installed fresh Ubuntu 20.04
  2. Installed updates: apt update && apt upgrade
  3. Installed esdq 6.1
  4. Run test: esdq run -r


I did see the Vision Test Modules getting stuck pinging the site. I assumed it was an issue on my network. Let me open a bug for this new issue, thanks for pointing that out.


Regards,

Jesus


0 Kudos
Copy link
jim-tech10
Beginner
‎10-03-2022 03:24 AM
4,632 Views
Solved Jump to solution

Hi Jesus,

I have followed your instructions to run the ESDQ6.1 Vision test on ubuntu 20.04 but still face the same issue as shown below. Do you think it might be hardware issue? 

I also face the same problem to ping the intel website (https://www.intel.com) while running the Vision Test Modules. Please let me know if there is any update about this bug.

ModulesInfo

 

  Installed Module Status
0 K3s_Lightweight_Kubernetes SUCCESS
1 Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_Runtime SUCCESS
2 Intel_Deep_Learning_Streamer SUCCESS
3 Docker_Community_Edition_CE SUCCESS
4 Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_in_a_Container SUCCESS
5 Docker_Compose SUCCESS
6 Edgex_Foundry SUCCESS
7 RI_MultiCamera_Social_Distancing SUCCESS
8 esdq SUCCESS

 

Test Suites

Vision_Test_Module

Missing report !

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Fail 2 0% 2022-10-03-15:40:11 2022-10-03-15:40:41 30s 0.0 24.0 0.0 0.5
1 reset_1 Pass 1 100% 2022-10-03-15:40:42 2022-10-03-15:40:45 3s 0.0 0.0 0.0 0.0
2 hardware_ping Fail 1 0% 2022-10-03-15:40:46 2022-10-03-15:41:16 30s 0.1 1.0 0.0 0.0
3 io_ping_test Pass 1 100% 2022-10-03-15:41:17 2022-10-03-15:41:20 3s 0.0 0.0 0.0 0.0
4 performance_alexnet Fail 1 0% 2022-10-03-15:41:21 2022-10-03-15:41:24 3s 0.0 0.0 0.0 0.0
5 performance_densenet-121 Fail 1 0% 2022-10-03-15:41:25 2022-10-03-15:41:28 3s 0.0 0.0 0.1 0.1
6 performance_googlenet-v1 Fail 1 0% 2022-10-03-15:41:29 2022-10-03-15:41:33 3s 0.0 0.0 0.0 0.0
7 performance_mobilenet-ssd Fail 1 0% 2022-10-03-15:41:34 2022-10-03-15:41:37 3s 0.0 0.0 0.0 0.0
8 performance_mobilenet-v1-1.0-224 Fail 1 0% 2022-10-03-15:41:38 2022-10-03-15:41:41 3s 0.0 0.0 0.0 0.0
9 performance_mobilenet-v2 Fail 1 0% 2022-10-03-15:41:42 2022-10-03-15:41:45 3s 0.0 0.0 0.0 0.0
10 performance_squeezenet1.1 Fail 1 0% 2022-10-03-15:41:46 2022-10-03-15:41:49 3s 0.0 0.0 0.0 0.0
11 performance_resnet-50-pytorch Fail 1 0% 2022-10-03-15:41:50 2022-10-03-15:41:53 3s 0.0 0.0 0.0 0.0
12 thermal_test Fail 1 0% 2022-10-03-15:41:54 Mon Oct 3 15:41:57 2022 3s 0.0 0.0 0.0 0.0

 

Thanks & Regards,

 

--Julien

esdqReport_2022-10-03_07_41_57.zip
0 Kudos
Copy link
JesusE_Intel
Moderator
‎10-05-2022 10:34 AM
4,591 Views
Solved Jump to solution

Hi Julien,


I have reached out to my peers for additional feedback, I will let you know what I find out.


Regards,

Jesus


0 Kudos
Copy link
JesusE_Intel
Moderator
‎10-13-2022 12:54 PM
4,472 Views
Solved Jump to solution

Hi Julien,


I was informed you are in contact with someone from the team directly. Please let me know if you still need assistance on this discussion or if we can proceed to close it.


Regards,

Jesus


0 Kudos
Copy link
jim-tech10
Beginner
‎10-14-2022 02:18 AM
4,332 Views
Solved Jump to solution

Hi Jesus

I am using a new “Accelerator Card with 8 x Movidius Myriad X” for the ESDQ test. I will share the update report soon. And yes, I still  need an assistance. I haven’t received any updates recently.

 

Thanks & Regards,

--Julien

0 Kudos
Copy link
JesusE_Intel
Moderator
‎10-14-2022 03:40 PM
4,300 Views
Solved Jump to solution

Hi Julien,


Sounds good, I will wait the test results.


Regards,

Jesus


0 Kudos
Copy link
jim-tech10
Beginner
‎10-18-2022 03:03 AM
4,076 Views
Solved Jump to solution

Hi Jesus

Attached, please check an update of the test report. With the “Intel Accelerator Card with 8 x Movidius Myriad X”, most of the ESDQ6.1 vision test passed. Except the script related to media sdk encode with h265 failed as shown below. 

 

SystemInfo

 

  System Category Property Value
0 SOFTWARE INFO OS version Ubuntu 20.04.5 LTS
1 SOFTWARE INFO Kernel 5.15.0-50-generic
2 HARDWARE INFO Device Manufacturer Default string
3 HARDWARE INFO Hardware Architecture x86_64
4 HARDWARE INFO Processor Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz
5 HARDWARE INFO GPU Intel Corporation
6 HARDWARE INFO Memory size 35Gi
7 HDD Configurations Model ATA INTEL SSDSC2BB08 (scsi)
8 HDD Configurations Disk /dev/sda 80.0GB
9 HDD Configurations Sector size (logical/physical) 512B/4096B
10 HDD Configurations Partition Table gpt
11 HDD Configurations Disk Flags Header Number Start End Size File system Name Flags
12 HDD Configurations Disk Flags 1 1049kB 538MB 537MB fat32 EFI System Partition boot esp
13 HDD Configurations Disk Flags 2 538MB 80.0GB 79.5GB ext4
14 HARDWARE ACCELERATOR VPU 8 Intel® Movidius™ Visual Processing Unit
15 HARDWARE ACCELERATOR FPGA 0

 

ModulesInfo

 

  Installed Module Status
0 K3s_Lightweight_Kubernetes SUCCESS
1 Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_Runtime SUCCESS
2 Intel_Deep_Learning_Streamer SUCCESS
3 Docker_Community_Edition_CE SUCCESS
4 Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_in_a_Container SUCCESS
5 Docker_Compose SUCCESS
6 Edgex_Foundry SUCCESS
7 RI_MultiCamera_Social_Distancing SUCCESS
8 esdq SUCCESS

 

Test Suites

Vision_Test_Module

  ModuleName Test CaseName SampleProgram Status
0 container_openvino CPU1 image_processing_demo CPU Pass
1 container_openvino CPU2 object_detection_demo_python with CPU Pass
2 container_openvino GPU1 image_processing_demo GPU Pass
3 container_openvino GPU2 object_detection_demo_python with GPU Pass
4 media_sdk MSDK1 Mediasdk_sample_decode with h264 Pass
5 media_sdk MSDK2 mediasdk_sample_multi_transcode with h264 and mpeg2 Pass
6 media_sdk MSDK3 mediasdk_set_commands with h264 mixed model Pass
7 media_sdk MSDK4 mediasdk_set_commands with h265 mixed model Pass
8 media_sdk MSDK5 mediasdk_sample_encode with h265 Fail
9 media_sdk MSDK6 mediasdk_sample_vpp with sw Pass
10 aws_greengrass AWS1 aws_hello_world_sample Pass
11 k3s K3S1 k3s_sample Pass
12 openvino CPU1 hello_reshape_ssd with CPU Pass
13 openvino CPU2 style_transfer_sample_python with CPU Pass
14 openvino CPU3 object_detection_demo_ssd_async CPU Pass
15 openvino CPU4 object_detection_demo_python with CPU Pass
16 openvino GPU1 hello_reshape_ssd with GPU Pass
17 openvino GPU2 style_transfer_sample_python with GPU Pass
18 openvino GPU3 object_detection_demo_ssd_async GPU Pass
19 openvino GPU4 run_tc_object_detection_demo_ssd__python with GPU Pass
20 openvino HDDL1 hello_reshape_ssd with HDDL Pass
21 openvino HDDL2 style_transfer_sample_python with HDDL Pass
22 openvino HDDL3 object_detection_demo_ssd_async HDDL Pass
23 openvino HDDL4 object_detection_demo_ssd_async_python with HDDL Pass

 

VATS_Test_Module

  Test ID Status Iterations Pass Rate Start Time End Time Duration Host Ave CPU (%) Host Max CPU (%) Host Ave Memory (%) Host Max Memory (%)
0 firmware_loading_time Pass 2 100% 2022-10-18-11:09:36 2022-10-18-11:10:34 57s 34.6 68.0 0.0 0.9
1 reset_1 Pass 1 100% 2022-10-18-11:10:35 2022-10-18-11:10:38 3s 0.0 0.0 0.0 0.0
2 hardware_ping Pass 1 100% 2022-10-18-11:10:39 2022-10-18-11:12:24 1min 45s 0.0 1.0 0.0 0.0
3 io_ping_test Pass 1 100% 2022-10-18-11:12:25 2022-10-18-11:12:28 3s 0.0 0.0 0.0 0.0
4 performance_alexnet Pass 1 100% 2022-10-18-11:12:29 2022-10-18-11:13:39 1min 9s 10.6 33.7 0.0 0.8
5 performance_densenet-121 Pass 1 100% 2022-10-18-11:13:40 2022-10-18-11:14:46 1min 6s 6.8 21.0 0.0 0.2
6 performance_googlenet-v1 Pass 1 100% 2022-10-18-11:14:47 2022-10-18-11:15:51 1min 3s 12.7 20.3 0.2 0.2
7 performance_mobilenet-ssd Pass 1 100% 2022-10-18-11:15:52 2022-10-18-11:16:58 1min 6s 8.5 24.3 0.0 0.2
8 performance_mobilenet-v1-1.0-224 Pass 1 100% 2022-10-18-11:16:59 2022-10-18-11:18:03 1min 3s 14.6 23.3 0.2 0.2
9 performance_mobilenet-v2 Pass 1 100% 2022-10-18-11:18:04 2022-10-18-11:19:10 1min 6s 10.6 28.3 0.0 0.2
10 performance_squeezenet1.1 Pass 1 100% 2022-10-18-11:19:11 2022-10-18-11:20:15 1min 3s 33.0 33.5 0.1 0.1
11 performance_resnet-50-pytorch Pass 1 100% 2022-10-18-11:20:16 2022-10-18-11:21:22 1min 6s 5.9 24.6 0.0 0.5
12 thermal_test Pass 1 100% 2022-10-18-11:21:23 Tue Oct 18 11:21:44 2022 21s 5.7 33.3 0.0 0.3

 

 

Thanks & Regards,

--Julien

 

esdqReport_2022-10-18_03_21_45.zip
0 Kudos
Copy link
JesusE_Intel
Moderator
‎10-21-2022 12:15 PM
3,899 Views
Solved Jump to solution

Hi Julien,


Glad the Vision Accelerator Tests are now working with the Hardware Accelerator! Looking at the test results and log files shared. The Media SDK encode sample is failing with the following error:


libva info: VA-API version 1.12.0

libva info: User environment variable requested driver 'iHD'

libva info: Trying to open /opt/intel/mediasdk/lib64/iHD_drv_video.so

libva info: Found init function __vaDriverInit_1_12

libva info: va_openDriver() returns 0


[ERROR], sts=MFX_ERR_UNSUPPORTED(-3), AllocFrames, Query (for encoder) failed at /docker/worker/mediasdk/build_dir/repos/MediaSDK/samples/sample_encode/src/pipeline_encode.cpp:964


[ERROR], sts=MFX_ERR_UNSUPPORTED(-3), ResetMFXComponents, AllocFrames failed at /docker/worker/mediasdk/build_dir/repos/MediaSDK/samples/sample_encode/src/pipeline_encode.cpp:2071


[ERROR], sts=MFX_ERR_UNSUPPORTED(-3), Init, ResetMFXComponents failed at /docker/worker/mediasdk/build_dir/repos/MediaSDK/samples/sample_encode/src/pipeline_encode.cpp:1852


[ERROR], sts=MFX_ERR_UNSUPPORTED(-3), main, pPipeline->Init failed at /docker/worker/mediasdk/build_dir/repos/MediaSDK/samples/sample_encode/src/sample_encode.cpp:1745

Frame number: 0

Encoding fps: -nan

mediasdk_sample_encode with h265 program Failed 253


Could you check if the steps mentioned in the follownig link address the issue?

https://www.intel.com/content/www/us/en/developer/articles/technical/edge-software-device-qualification-vision.html#inpage-nav-6-1-1


Regards,

Jesus


0 Kudos
Copy link
Reply

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.