Measuring VPU impact on the system performance

[Morabito__Roberto]

Hi OpenVINO folks!

I have a system featuring a built-in Intel® Movidius™ Myriad™ X. I started wondering whether there is a way to measure the performance impact, on the entire system, caused by the VPU when this is used for performing inference tasks.

To explain my inquiry better, there are several tools that, for example, that allow you to measure GPU performance (ex. jtop). Is there anything similar but for the VPU? I was also wondering if the usage of the VPU affects the system load average of the entire system.

Thank you so much in advance.

Best Regards,
Roberto

[Sahira_Intel]

Hi Roberto,

I see you asked a similar question about VPU performance here. In terms of VPU affecting the system load average of the entire system, it would depend on the kind of model you are running although it would not be the actual VPU that would be affecting the system load, but the entire process of running inference. 

Please let me know if you have any further questions.

Best Regards,

Sahira