topic ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU in Edge Software Catalog

ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Fri, 16 Sep 2022 03:15:50 GMT

Hello,

I have installed and run the Intel ESDQ package for vision on a target system (Processor: Intel(R) Core (TM) i3-10100E CPU @ 3.20GHz). After installation, some of the test modules Failed.

As shown in attachment, the modules “Intel Distribution of OpenVINO toolkit 2021 4 Runtime, Deep Learning DL Streamer Pipelines” have failed.

Attached, please check the logs and ESDQ test report generated. Would you please share your comments and suggestions about this issue.

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	FAILED
4	Deep_Learning_DL_Streamer_Pipelines	FAILED
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Target System Information:

CPU: Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz

OS: Ubuntu 18.04.5 LTS

Kernel: 5.4.0-125-generic

ESDQ Version: 5.0

Thanks & Regards,

Julien

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Fri, 16 Sep 2022 21:50:02 GMT

Hi Julien,

I just tested ESDQ5.0 on Ubuntu 18.04 and OpenVINO failed to install as well. Looking at the logs, I see ONNX failed to install which caused the OpenVINO Model Optimizer installation to fail. I resolved this by installing ONNX manually: pip3 install onnx==1.8.1. Could you try and see if this resolves the issue for you?

If this does not work, please provide the log files for OpenVINO installation under /var/log/esb-cli/Edge_Software_Device_Qualification/Intel_Distribution_of_OpenVINO_toolkit_2021.4_Runtime

Regards,

Jesus

回應： Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Mon, 19 Sep 2022 05:53:38 GMT

Hi Jesus,

Thanks for the response. I have followed your instructions by installing the ONNX and run the ESDQ again. Then, the OpenVino works fine for now.

But I face some new issues as shown below, the MSDK5 test fails, and the report is missing for the VATS_Test_Module.

Attached, please check the test report. Have you faced this issue as well? Please let me know if you have an idea on how to solve it, please.

Summary

	Property	Value
0	ESDQ Version	5.0
1	Execution Timestamp UTC	2022-09-19 03:44:11
2	Duration	0:09:48
3	Number of test category	3
4	Test Categories	'SysInfo' 'Vision_Test_Module' 'VATS_Test_Module'

SystemInfo

	System Category	Property	Value
0	SOFTWARE INFO	OS version	Ubuntu 18.04.5 LTS
1	SOFTWARE INFO	Kernel	5.4.0-125-generic
2	HARDWARE INFO	Device Manufacturer	Default string
3	HARDWARE INFO	Hardware Architecture	x86_64
4	HARDWARE INFO	Processor	Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz
5	HARDWARE INFO	GPU	Intel Corporation
6	HARDWARE INFO	Memory size	3.7G
7	HDD Configurations	Model	ATA WDC WDS250G2B0A (scsi)
8	HDD Configurations	Disk /dev/sda	250GB
9	HDD Configurations	Sector size (logical/physical)	512B/512B
10	HDD Configurations	Partition Table	gpt
11	HDD Configurations	Disk Flags Header	Number Start End Size File system Name Flags
12	HDD Configurations	Disk Flags	1 1049kB 538MB 537MB fat32 EFI System Partition boot esp
13	HDD Configurations	Disk Flags	2 538MB 250GB 250GB ext4
14	HARDWARE ACCELERATOR	VPU	0
15	HARDWARE ACCELERATOR	FPGA	0

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	SUCCESS
4	Deep_Learning_DL_Streamer_Pipelines	SUCCESS
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
1	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
2	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
3	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
4	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
5	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
6	aws_greengrass	AWS1	aws_hello_world_sample	Pass
7	k3s	K3S1	k3s_sample	Pass
8	openvino	CPU1	hello_reshape_ssd with CPU	Pass
9	openvino	CPU2	style_transfer_sample_python with CPU	Pass
10	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
11	openvino	CPU4	object_detection_demo_python with CPU	Pass
12	openvino	GPU1	hello_reshape_ssd with GPU	Pass
13	openvino	GPU2	style_transfer_sample_python with GPU	Pass
14	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
15	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass

VATS_Test_Module

Missing report !

Thanks & Regards,

Julien

回應： Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Mon, 19 Sep 2022 09:15:04 GMT

Please check the logs and test report in attachment.

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Mon, 19 Sep 2022 20:37:07 GMT

Hi Julien,

From the logs, I can see your system is not detecting any hardware accelerator (HDDL) devices. Is there one installed in your system? Can you provide the output of the lsusb command? The empty VATs tests are expected when no HDDL device is connected to the system.

Regarding the MediaSDK test fails, I see [ERROR], sts=MFX_ERR_UNSUPPORTED(-3) error in the log file. Could you please try the steps included in the Troubleshooting section of the installation guide? Please let me know if this works for you.

Regards,

Jesus

回應： Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Wed, 21 Sep 2022 07:26:33 GMT

Hi Jesus,

Thanks for the response.

I have used the “Intel® Neural Compute Stick 2” shown in attachment and run the test again. The VATs tests is appeared now, but there are some failed tests from VATs. Attached, please check the update result. Please let me know if you have any suggestions.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest.

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	SUCCESS
4	Deep_Learning_DL_Streamer_Pipelines	SUCCESS
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
1	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
2	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
3	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
4	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
5	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
6	aws_greengrass	AWS1	aws_hello_world_sample	Pass
7	k3s	K3S1	k3s_sample	Pass
8	openvino	CPU1	hello_reshape_ssd with CPU	Pass
9	openvino	CPU2	style_transfer_sample_python with CPU	Pass
10	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
11	openvino	CPU4	object_detection_demo_python with CPU	Pass
12	openvino	GPU1	hello_reshape_ssd with GPU	Pass
13	openvino	GPU2	style_transfer_sample_python with GPU	Pass
14	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
15	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass
16	openvino	HDDL1	hello_reshape_ssd with HDDL	Fail
17	openvino	HDDL2	style_transfer_sample_python with HDDL	Fail
18	openvino	HDDL3	object_detection_demo_ssd_async HDDL	Fail
19	openvino	HDDL4	object_detection_demo_ssd_async_python with HDDL	Fail

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Fail	2	0%	2022-09-21-15:05:40	2022-09-21-15:06:19	39s	0.0	24.6	0.2	4.2
1	reset_1	Pass	1	100%	2022-09-21-15:06:20	2022-09-21-15:06:23	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Fail	1	0%	2022-09-21-15:06:24	2022-09-21-15:07:03	39s	0.1	1.0	0.0	0.3
3	io_ping_test	Pass	1	100%	2022-09-21-15:07:04	2022-09-21-15:07:07	3s	0.0	0.0	0.2	0.2
4	performance_alexnet	Fail	1	0%	2022-09-21-15:07:08	2022-09-21-15:07:11	3s	0.0	0.0	0.3	0.3
5	performance_densenet-121	Fail	1	0%	2022-09-21-15:07:12	2022-09-21-15:07:16	3s	0.0	0.0	0.3	0.3
6	performance_googlenet-v1	Fail	1	0%	2022-09-21-15:07:17	2022-09-21-15:07:20	3s	0.0	0.0	0.3	0.3
7	performance_mobilenet-ssd	Fail	1	0%	2022-09-21-15:07:21	2022-09-21-15:07:24	3s	0.0	0.0	0.3	0.3
8	performance_mobilenet-v1-1.0-224	Fail	1	0%	2022-09-21-15:07:25	2022-09-21-15:07:28	3s	0.0	0.0	0.3	0.3
9	performance_mobilenet-v2	Fail	1	0%	2022-09-21-15:07:29	2022-09-21-15:07:32	3s	0.0	0.0	0.3	0.3
10	performance_squeezenet1.1	Fail	1	0%	2022-09-21-15:07:33	2022-09-21-15:07:36	3s	0.0	0.0	0.3	0.3
11	performance_resnet-50-pytorch	Fail	1	0%	2022-09-21-15:07:37	2022-09-21-15:07:40	3s	0.0	0.0	0.3	0.3
12	thermal_test	Fail	1	0%	2022-09-21-15:07:41	Wed Sep 21 15:07:44 2022	3s	0.0	0.0	0.2	0.2

Thanks & regards,

--Julien

回應： Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Wed, 21 Sep 2022 07:35:51 GMT

Hi Jesus,

Thanks for the response.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest.

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	SUCCESS
4	Deep_Learning_DL_Streamer_Pipelines	SUCCESS
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
1	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
2	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
3	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
4	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
5	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
6	aws_greengrass	AWS1	aws_hello_world_sample	Pass
7	k3s	K3S1	k3s_sample	Pass
8	openvino	CPU1	hello_reshape_ssd with CPU	Pass
9	openvino	CPU2	style_transfer_sample_python with CPU	Pass
10	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
11	openvino	CPU4	object_detection_demo_python with CPU	Pass
12	openvino	GPU1	hello_reshape_ssd with GPU	Pass
13	openvino	GPU2	style_transfer_sample_python with GPU	Pass
14	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
15	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass
16	openvino	HDDL1	hello_reshape_ssd with HDDL	Fail
17	openvino	HDDL2	style_transfer_sample_python with HDDL	Fail
18	openvino	HDDL3	object_detection_demo_ssd_async HDDL	Fail
19	openvino	HDDL4	object_detection_demo_ssd_async_python with HDDL	Fail

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Fail	2	0%	2022-09-21-15:05:40	2022-09-21-15:06:19	39s	0.0	24.6	0.2	4.2
1	reset_1	Pass	1	100%	2022-09-21-15:06:20	2022-09-21-15:06:23	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Fail	1	0%	2022-09-21-15:06:24	2022-09-21-15:07:03	39s	0.1	1.0	0.0	0.3
3	io_ping_test	Pass	1	100%	2022-09-21-15:07:04	2022-09-21-15:07:07	3s	0.0	0.0	0.2	0.2
4	performance_alexnet	Fail	1	0%	2022-09-21-15:07:08	2022-09-21-15:07:11	3s	0.0	0.0	0.3	0.3
5	performance_densenet-121	Fail	1	0%	2022-09-21-15:07:12	2022-09-21-15:07:16	3s	0.0	0.0	0.3	0.3
6	performance_googlenet-v1	Fail	1	0%	2022-09-21-15:07:17	2022-09-21-15:07:20	3s	0.0	0.0	0.3	0.3
7	performance_mobilenet-ssd	Fail	1	0%	2022-09-21-15:07:21	2022-09-21-15:07:24	3s	0.0	0.0	0.3	0.3
8	performance_mobilenet-v1-1.0-224	Fail	1	0%	2022-09-21-15:07:25	2022-09-21-15:07:28	3s	0.0	0.0	0.3	0.3
9	performance_mobilenet-v2	Fail	1	0%	2022-09-21-15:07:29	2022-09-21-15:07:32	3s	0.0	0.0	0.3	0.3
10	performance_squeezenet1.1	Fail	1	0%	2022-09-21-15:07:33	2022-09-21-15:07:36	3s	0.0	0.0	0.3	0.3
11	performance_resnet-50-pytorch	Fail	1	0%	2022-09-21-15:07:37	2022-09-21-15:07:40	3s	0.0	0.0	0.3	0.3
12	thermal_test	Fail	1	0%	2022-09-21-15:07:41	Wed Sep 21 15:07:44 2022	3s	0.0	0.0	0.2	0.2

Thanks & regards,

--Julien

回應： Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Wed, 21 Sep 2022 07:44:09 GMT

Hi Jesus,

Thanks for the response.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest, Thanks.

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	SUCCESS
4	Deep_Learning_DL_Streamer_Pipelines	SUCCESS
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
1	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
2	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
3	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
4	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
5	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
6	aws_greengrass	AWS1	aws_hello_world_sample	Pass
7	k3s	K3S1	k3s_sample	Pass
8	openvino	CPU1	hello_reshape_ssd with CPU	Pass
9	openvino	CPU2	style_transfer_sample_python with CPU	Pass
10	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
11	openvino	CPU4	object_detection_demo_python with CPU	Pass
12	openvino	GPU1	hello_reshape_ssd with GPU	Pass
13	openvino	GPU2	style_transfer_sample_python with GPU	Pass
14	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
15	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass
16	openvino	HDDL1	hello_reshape_ssd with HDDL	Fail
17	openvino	HDDL2	style_transfer_sample_python with HDDL	Fail
18	openvino	HDDL3	object_detection_demo_ssd_async HDDL	Fail
19	openvino	HDDL4	object_detection_demo_ssd_async_python with HDDL	Fail

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Fail	2	0%	2022-09-21-15:05:40	2022-09-21-15:06:19	39s	0.0	24.6	0.2	4.2
1	reset_1	Pass	1	100%	2022-09-21-15:06:20	2022-09-21-15:06:23	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Fail	1	0%	2022-09-21-15:06:24	2022-09-21-15:07:03	39s	0.1	1.0	0.0	0.3
3	io_ping_test	Pass	1	100%	2022-09-21-15:07:04	2022-09-21-15:07:07	3s	0.0	0.0	0.2	0.2
4	performance_alexnet	Fail	1	0%	2022-09-21-15:07:08	2022-09-21-15:07:11	3s	0.0	0.0	0.3	0.3
5	performance_densenet-121	Fail	1	0%	2022-09-21-15:07:12	2022-09-21-15:07:16	3s	0.0	0.0	0.3	0.3
6	performance_googlenet-v1	Fail	1	0%	2022-09-21-15:07:17	2022-09-21-15:07:20	3s	0.0	0.0	0.3	0.3
7	performance_mobilenet-ssd	Fail	1	0%	2022-09-21-15:07:21	2022-09-21-15:07:24	3s	0.0	0.0	0.3	0.3
8	performance_mobilenet-v1-1.0-224	Fail	1	0%	2022-09-21-15:07:25	2022-09-21-15:07:28	3s	0.0	0.0	0.3	0.3
9	performance_mobilenet-v2	Fail	1	0%	2022-09-21-15:07:29	2022-09-21-15:07:32	3s	0.0	0.0	0.3	0.3
10	performance_squeezenet1.1	Fail	1	0%	2022-09-21-15:07:33	2022-09-21-15:07:36	3s	0.0	0.0	0.3	0.3
11	performance_resnet-50-pytorch	Fail	1	0%	2022-09-21-15:07:37	2022-09-21-15:07:40	3s	0.0	0.0	0.3	0.3
12	thermal_test	Fail	1	0%	2022-09-21-15:07:41	Wed Sep 21 15:07:44 2022	3s	0.0	0.0	0.2	0.2

Thanks & regards,

--Julien

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Wed, 21 Sep 2022 07:48:09 GMT

Hi Jesus,

Thanks for the response.

I have also tried to use the steps included in the Troubleshooting section of the installation guide to fix the MediaSDK test. But it doesn’t work for me. Please suggest, thanks.

ModulesInfo

	Installed Module	Status
0	Amazon_Web_Services_Greengrass_Prerequisites	SUCCESS
1	K3s_Lightweight_Kubernetes	SUCCESS
2	Azure_IoT_Edge_Prerequisites	SUCCESS
3	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Runtime	SUCCESS
4	Deep_Learning_DL_Streamer_Pipelines	SUCCESS
5	Docker_Community_Edition_CE	SUCCESS
6	Intel_Distribution_of_OpenVINO_toolkit_2021_4_Container	SUCCESS
7	edgex_foundry	SUCCESS
8	RI_MultiCamera_Social_Distancing	SUCCESS
9	esdq	SUCCESS
10	Docker_Compose	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
1	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
2	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
3	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
4	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
5	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
6	aws_greengrass	AWS1	aws_hello_world_sample	Pass
7	k3s	K3S1	k3s_sample	Pass
8	openvino	CPU1	hello_reshape_ssd with CPU	Pass
9	openvino	CPU2	style_transfer_sample_python with CPU	Pass
10	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
11	openvino	CPU4	object_detection_demo_python with CPU	Pass
12	openvino	GPU1	hello_reshape_ssd with GPU	Pass
13	openvino	GPU2	style_transfer_sample_python with GPU	Pass
14	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
15	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass
16	openvino	HDDL1	hello_reshape_ssd with HDDL	Fail
17	openvino	HDDL2	style_transfer_sample_python with HDDL	Fail
18	openvino	HDDL3	object_detection_demo_ssd_async HDDL	Fail
19	openvino	HDDL4	object_detection_demo_ssd_async_python with HDDL	Fail

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Fail	2	0%	2022-09-21-15:05:40	2022-09-21-15:06:19	39s	0.0	24.6	0.2	4.2
1	reset_1	Pass	1	100%	2022-09-21-15:06:20	2022-09-21-15:06:23	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Fail	1	0%	2022-09-21-15:06:24	2022-09-21-15:07:03	39s	0.1	1.0	0.0	0.3
3	io_ping_test	Pass	1	100%	2022-09-21-15:07:04	2022-09-21-15:07:07	3s	0.0	0.0	0.2	0.2
4	performance_alexnet	Fail	1	0%	2022-09-21-15:07:08	2022-09-21-15:07:11	3s	0.0	0.0	0.3	0.3
5	performance_densenet-121	Fail	1	0%	2022-09-21-15:07:12	2022-09-21-15:07:16	3s	0.0	0.0	0.3	0.3
6	performance_googlenet-v1	Fail	1	0%	2022-09-21-15:07:17	2022-09-21-15:07:20	3s	0.0	0.0	0.3	0.3
7	performance_mobilenet-ssd	Fail	1	0%	2022-09-21-15:07:21	2022-09-21-15:07:24	3s	0.0	0.0	0.3	0.3
8	performance_mobilenet-v1-1.0-224	Fail	1	0%	2022-09-21-15:07:25	2022-09-21-15:07:28	3s	0.0	0.0	0.3	0.3
9	performance_mobilenet-v2	Fail	1	0%	2022-09-21-15:07:29	2022-09-21-15:07:32	3s	0.0	0.0	0.3	0.3
10	performance_squeezenet1.1	Fail	1	0%	2022-09-21-15:07:33	2022-09-21-15:07:36	3s	0.0	0.0	0.3	0.3
11	performance_resnet-50-pytorch	Fail	1	0%	2022-09-21-15:07:37	2022-09-21-15:07:40	3s	0.0	0.0	0.3	0.3
12	thermal_test	Fail	1	0%	2022-09-21-15:07:41	Wed Sep 21 15:07:44 2022	3s	0.0	0.0	0.2	0.2

Thanks & regards,

--Julien

Re: ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Tue, 27 Sep 2022 20:05:59 GMT

Hi Julien,

Apologies for the delay, I somehow missed the notification for your last message. I believe you need to use an Intel Vision Accelerator with MYRIAD X (HDDL) that uses the HDDL Plugin. The Intel Neural Compute Stick 2 utilizes the Myriad Plugin from OpenVINO. The HDDL plugin may also pick up the NCS 2 and configure it as an HDDL device but I'll need to run some tests and confirm.

In the meantime, could you try these steps: https://www.intel.com/content/www/us/en/developer/articles/technical/edge-software-device-qualification-vision.html#inpage-nav-6-undefined-1

Also, try to install the Intel NCS 2 device rules:

Install and Configure Intel® Distribution of OpenVINO™ toolkit for Linux* — OpenVINO™ documentation — Version(2021.4)

Regards,

Jesus

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Wed, 28 Sep 2022 07:02:11 GMT

Hi Jesus,

Thanks for your response. I have already tried the troubleshooting steps mentioned in these links but still not working.

About the Intel NCS 2 device rules, the demo (Image Classification verification script.) test still shows “[ERROR] no device found” as shown in attachment.

Attached, please also check the output of lsusb command. Please let me know if you have further information about the The HDDL plugin to configure the NCS 2 as an HDDL device.

Thanks & regards,

--Julien

Re: ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Thu, 29 Sep 2022 23:52:57 GMT

Hi Julien,

The lsusb command shows the Intel Neural Compute Stick 2 is being used by the HDDL Plugin. Could you try to use the latest ESDQ 6.1 and see if the same behavior is seen? After installing ESDQ 6.0 reboot your system to ensure the device rules have been properly configured for the Myriad X device.

From my test, only the HDDL Hardware ping fails, all other tests pass. I will confirm with the team if we have validated with an Intel Neural Compute Stick 2.

Regards,

Jesus

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Fri, 30 Sep 2022 09:44:08 GMT

Hi Jesus,

Thanks for the update. I have some more questions:

Which ubuntu version do you use to run the ESDQ6.0 vision test?

Have you done any additional configuration for NCS 2 (or just plug & play)?

As you suggested I have installed, the ESDQ6.1 vision on ubuntu 18.04 but some VATS still fail.

I also face this new problem with the new version (ESDQ6.01) , the Vision_Test_Module can not be executed because it is stuck while Pinging https://www.intel.com to check the internet connectivity as shown below (over 1 hour):

“Pinging https://www.intel.com for checking Internet Connectivity. Please wait for few seconds.” any idea about this issue?

Attached, please check logs for the ESDQ6.1 test. Please let me know about your suggestions.

Thanks & Regards

Julien

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Fri, 30 Sep 2022 15:54:48 GMT

Hi Julien,

For ESDQ 6.1, I am running on Ubuntu 20.04. I am just connecting the NCS 2 when running the tests.

Installed fresh Ubuntu 20.04
Installed updates: apt update && apt upgrade
Installed esdq 6.1
Run test: esdq run -r

I did see the Vision Test Modules getting stuck pinging the site. I assumed it was an issue on my network. Let me open a bug for this new issue, thanks for pointing that out.

Regards,

Jesus

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Mon, 03 Oct 2022 10:24:41 GMT

Hi Jesus,

I have followed your instructions to run the ESDQ6.1 Vision test on ubuntu 20.04 but still face the same issue as shown below. Do you think it might be hardware issue?

I also face the same problem to ping the intel website (https://www.intel.com) while running the Vision Test Modules. Please let me know if there is any update about this bug.

ModulesInfo

	Installed Module	Status
0	K3s_Lightweight_Kubernetes	SUCCESS
1	Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_Runtime	SUCCESS
2	Intel_Deep_Learning_Streamer	SUCCESS
3	Docker_Community_Edition_CE	SUCCESS
4	Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_in_a_Container	SUCCESS
5	Docker_Compose	SUCCESS
6	Edgex_Foundry	SUCCESS
7	RI_MultiCamera_Social_Distancing	SUCCESS
8	esdq	SUCCESS

Test Suites

Vision_Test_Module

Missing report !

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Fail	2	0%	2022-10-03-15:40:11	2022-10-03-15:40:41	30s	0.0	24.0	0.0	0.5
1	reset_1	Pass	1	100%	2022-10-03-15:40:42	2022-10-03-15:40:45	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Fail	1	0%	2022-10-03-15:40:46	2022-10-03-15:41:16	30s	0.1	1.0	0.0	0.0
3	io_ping_test	Pass	1	100%	2022-10-03-15:41:17	2022-10-03-15:41:20	3s	0.0	0.0	0.0	0.0
4	performance_alexnet	Fail	1	0%	2022-10-03-15:41:21	2022-10-03-15:41:24	3s	0.0	0.0	0.0	0.0
5	performance_densenet-121	Fail	1	0%	2022-10-03-15:41:25	2022-10-03-15:41:28	3s	0.0	0.0	0.1	0.1
6	performance_googlenet-v1	Fail	1	0%	2022-10-03-15:41:29	2022-10-03-15:41:33	3s	0.0	0.0	0.0	0.0
7	performance_mobilenet-ssd	Fail	1	0%	2022-10-03-15:41:34	2022-10-03-15:41:37	3s	0.0	0.0	0.0	0.0
8	performance_mobilenet-v1-1.0-224	Fail	1	0%	2022-10-03-15:41:38	2022-10-03-15:41:41	3s	0.0	0.0	0.0	0.0
9	performance_mobilenet-v2	Fail	1	0%	2022-10-03-15:41:42	2022-10-03-15:41:45	3s	0.0	0.0	0.0	0.0
10	performance_squeezenet1.1	Fail	1	0%	2022-10-03-15:41:46	2022-10-03-15:41:49	3s	0.0	0.0	0.0	0.0
11	performance_resnet-50-pytorch	Fail	1	0%	2022-10-03-15:41:50	2022-10-03-15:41:53	3s	0.0	0.0	0.0	0.0
12	thermal_test	Fail	1	0%	2022-10-03-15:41:54	Mon Oct 3 15:41:57 2022	3s	0.0	0.0	0.0	0.0

Thanks & Regards,

--Julien

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Wed, 05 Oct 2022 17:34:43 GMT

Hi Julien,

I have reached out to my peers for additional feedback, I will let you know what I find out.

Regards,

Jesus

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Thu, 13 Oct 2022 19:54:18 GMT

Hi Julien,

I was informed you are in contact with someone from the team directly. Please let me know if you still need assistance on this discussion or if we can proceed to close it.

Regards,

Jesus

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Fri, 14 Oct 2022 09:18:38 GMT

Hi Jesus

I am using a new “Accelerator Card with 8 x Movidius Myriad X” for the ESDQ test. I will share the update report soon. And yes, I still need an assistance. I haven’t received any updates recently.

Thanks & Regards,

--Julien

Re:ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

JesusE_Intel — Fri, 14 Oct 2022 22:40:47 GMT

Hi Julien,

Sounds good, I will wait the test results.

Regards,

Jesus

回應： ESDQ5.0 Vision on Intel(R) Core(TM) i3-10100E CPU

jim-tech10 — Tue, 18 Oct 2022 10:03:26 GMT

Hi Jesus

Attached, please check an update of the test report. With the “Intel Accelerator Card with 8 x Movidius Myriad X”, most of the ESDQ6.1 vision test passed. Except the script related to media sdk encode with h265 failed as shown below.

SystemInfo

	System Category	Property	Value
0	SOFTWARE INFO	OS version	Ubuntu 20.04.5 LTS
1	SOFTWARE INFO	Kernel	5.15.0-50-generic
2	HARDWARE INFO	Device Manufacturer	Default string
3	HARDWARE INFO	Hardware Architecture	x86_64
4	HARDWARE INFO	Processor	Intel(R) Core(TM) i3-10100E CPU @ 3.20GHz
5	HARDWARE INFO	GPU	Intel Corporation
6	HARDWARE INFO	Memory size	35Gi
7	HDD Configurations	Model	ATA INTEL SSDSC2BB08 (scsi)
8	HDD Configurations	Disk /dev/sda	80.0GB
9	HDD Configurations	Sector size (logical/physical)	512B/4096B
10	HDD Configurations	Partition Table	gpt
11	HDD Configurations	Disk Flags Header	Number Start End Size File system Name Flags
12	HDD Configurations	Disk Flags	1 1049kB 538MB 537MB fat32 EFI System Partition boot esp
13	HDD Configurations	Disk Flags	2 538MB 80.0GB 79.5GB ext4
14	HARDWARE ACCELERATOR	VPU	8 Intel® Movidius™ Visual Processing Unit
15	HARDWARE ACCELERATOR	FPGA	0

ModulesInfo

	Installed Module	Status
0	K3s_Lightweight_Kubernetes	SUCCESS
1	Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_Runtime	SUCCESS
2	Intel_Deep_Learning_Streamer	SUCCESS
3	Docker_Community_Edition_CE	SUCCESS
4	Intel_Distribution_of_OpenVINO_toolkit_2021_4_2_in_a_Container	SUCCESS
5	Docker_Compose	SUCCESS
6	Edgex_Foundry	SUCCESS
7	RI_MultiCamera_Social_Distancing	SUCCESS
8	esdq	SUCCESS

Test Suites

Vision_Test_Module

	ModuleName	Test CaseName	SampleProgram	Status
0	container_openvino	CPU1	image_processing_demo CPU	Pass
1	container_openvino	CPU2	object_detection_demo_python with CPU	Pass
2	container_openvino	GPU1	image_processing_demo GPU	Pass
3	container_openvino	GPU2	object_detection_demo_python with GPU	Pass
4	media_sdk	MSDK1	Mediasdk_sample_decode with h264	Pass
5	media_sdk	MSDK2	mediasdk_sample_multi_transcode with h264 and mpeg2	Pass
6	media_sdk	MSDK3	mediasdk_set_commands with h264 mixed model	Pass
7	media_sdk	MSDK4	mediasdk_set_commands with h265 mixed model	Pass
8	media_sdk	MSDK5	mediasdk_sample_encode with h265	Fail
9	media_sdk	MSDK6	mediasdk_sample_vpp with sw	Pass
10	aws_greengrass	AWS1	aws_hello_world_sample	Pass
11	k3s	K3S1	k3s_sample	Pass
12	openvino	CPU1	hello_reshape_ssd with CPU	Pass
13	openvino	CPU2	style_transfer_sample_python with CPU	Pass
14	openvino	CPU3	object_detection_demo_ssd_async CPU	Pass
15	openvino	CPU4	object_detection_demo_python with CPU	Pass
16	openvino	GPU1	hello_reshape_ssd with GPU	Pass
17	openvino	GPU2	style_transfer_sample_python with GPU	Pass
18	openvino	GPU3	object_detection_demo_ssd_async GPU	Pass
19	openvino	GPU4	run_tc_object_detection_demo_ssd__python with GPU	Pass
20	openvino	HDDL1	hello_reshape_ssd with HDDL	Pass
21	openvino	HDDL2	style_transfer_sample_python with HDDL	Pass
22	openvino	HDDL3	object_detection_demo_ssd_async HDDL	Pass
23	openvino	HDDL4	object_detection_demo_ssd_async_python with HDDL	Pass

VATS_Test_Module

	Test ID	Status	Iterations	Pass Rate	Start Time	End Time	Duration	Host Ave CPU (%)	Host Max CPU (%)	Host Ave Memory (%)	Host Max Memory (%)
0	firmware_loading_time	Pass	2	100%	2022-10-18-11:09:36	2022-10-18-11:10:34	57s	34.6	68.0	0.0	0.9
1	reset_1	Pass	1	100%	2022-10-18-11:10:35	2022-10-18-11:10:38	3s	0.0	0.0	0.0	0.0
2	hardware_ping	Pass	1	100%	2022-10-18-11:10:39	2022-10-18-11:12:24	1min 45s	0.0	1.0	0.0	0.0
3	io_ping_test	Pass	1	100%	2022-10-18-11:12:25	2022-10-18-11:12:28	3s	0.0	0.0	0.0	0.0
4	performance_alexnet	Pass	1	100%	2022-10-18-11:12:29	2022-10-18-11:13:39	1min 9s	10.6	33.7	0.0	0.8
5	performance_densenet-121	Pass	1	100%	2022-10-18-11:13:40	2022-10-18-11:14:46	1min 6s	6.8	21.0	0.0	0.2
6	performance_googlenet-v1	Pass	1	100%	2022-10-18-11:14:47	2022-10-18-11:15:51	1min 3s	12.7	20.3	0.2	0.2
7	performance_mobilenet-ssd	Pass	1	100%	2022-10-18-11:15:52	2022-10-18-11:16:58	1min 6s	8.5	24.3	0.0	0.2
8	performance_mobilenet-v1-1.0-224	Pass	1	100%	2022-10-18-11:16:59	2022-10-18-11:18:03	1min 3s	14.6	23.3	0.2	0.2
9	performance_mobilenet-v2	Pass	1	100%	2022-10-18-11:18:04	2022-10-18-11:19:10	1min 6s	10.6	28.3	0.0	0.2
10	performance_squeezenet1.1	Pass	1	100%	2022-10-18-11:19:11	2022-10-18-11:20:15	1min 3s	33.0	33.5	0.1	0.1
11	performance_resnet-50-pytorch	Pass	1	100%	2022-10-18-11:20:16	2022-10-18-11:21:22	1min 6s	5.9	24.6	0.0	0.5
12	thermal_test	Pass	1	100%	2022-10-18-11:21:23	Tue Oct 18 11:21:44 2022	21s	5.7	33.3	0.0	0.3

Thanks & Regards,

--Julien