ESDQ for Mertro AI Test failed in OpenVINO Benchmark and GPU Freq Performance Test

[jackys]

Hello !

I encountered some issues in ESDQ for Metro AI Test.

The test case "OpenVINO Benchmark Test","GPU Freq Performance Test" have failed.

Attached,please check the ESDQ test report generated. Would you please share your comments and suggestions about this issue.

Thank you so much !

Best Regards,

Jackys 

[JesusE_Intel]

Hi Jackys,

It appears that the OpenVINO tests did not run. Could you try the troubleshooting steps mentioned in item #5 of the troubleshooting section in the documentation and let me know if that resolves the issue?

https://docs.openedgeplatform.intel.com/vision-automation-test-u20/user-guide/Get-Started-Guide.html#troubleshooting

Regards,

Jesus

[jackys]

Hi Jesus,

I have retried running the OpenVINO tests,but it still failed.

Attached is command log,please review and share your comments and suggestions.

Thank a lot !

Best Regards,

Jackys 

[jackys]

Hi Jesus,

My problem hasn't been resolved,I have already replied to you, but haven’t received information.

Waiting for you news,Thank a lot !

Best Regards

Jackys

[JesusE_Intel]

Hi Jackys,

I apologize for the delay in my response. I was setting up a fresh environment to reproduce your issue and am currently running the full test suite. I will update you as soon as it's complete.

I noticed you may be using an older version of the software package (Metro_AI_Suite_Device_Qualification_for_Hardware_Builder_1.0). While I run my tests, could you try using the latest software package (v2.0)?

Regards,

Jesus

[jackys]

Hi Jesus,

Thank for your kindly reply.

An overview like that of the Metro AI Suite Device Qualification Tool,the Atom x6000 series does not support testing?

https://edgesoftwarecatalog.intel.com/details/?microserviceType=recipe&microserviceNameForUrl=metro-ai-suite-device-qualification-for-hardware-builder

Please help me confirm the testing requirements,Thank a lot !

Best Regards

Jackys

[JesusE_Intel · Accepted solution]

Hi Jackys,

That's correct, the system requirements list Intel Atom® X7000 Series and N-series processors. However, the tests should still run, and based on the output you provided, they don't appear to be running at all. I suggest trying the latest package to see if the results are the same. Please note that this still doesn't guarantee the tests will pass, as your system doesn't meet the requirements.

On my end, the tests completed and passed using a fresh Ubuntu 24.04 OS with Intel® Edge System Qualification (Intel® ESQ) for Metro AI Suite v2.0.0.

Regards,

Jesus

[jackys]

Hi Jesus,

I have already tried ESQ Test with Metro test module ver.2.0,the "GPU Freq Performance Test" still fail.

Perhaps the Atom x6000 series doesn't meet the requirements.

Thank you for your great support.

Best Regards

Jackys

[JesusE_Intel]

No problem! If you have any additional questions, please feel free to start a new discussion as this thread will no longer be monitored.

[codex174]

Thanks for sharing that, Jackys. When OpenVINO benchmark and GPU frequency tests fail like that, it usually means your system can’t fully access or use the GPU during testing.

Try these steps:

1. Make sure your Intel GPU drivers are fully updated.

2. Reinstall the OpenVINO toolkit and verify it’s the right version for your OS.

3. Check if the GPU is actually detected with clinfo or lspci commands.

4. Disable any power-saving mode that limits GPU frequency.

Sometimes the CPU ends up handling all the load when the GPU can’t be used, that’s called a bottleneck, and it causes the test to fail or show very low scores. Fixing GPU detection usually resolves it.

[ethancarter199825]

Thanks a lot! That worked perfectly. Everything’s running fine now.