Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6392 Discussions

How can we observe GNA resources allocation?

Roxy1
Novice
760 Views

Hello,
Acer can run our own speech model in in Live Speech Recognition Demo app(CPU information: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz).Do you have any suggestions how can we observe GNA resources allocation, such as memory usage and GNA loading, in order that we could have evaluations of how many size model can be loaded with best performance.

Any advices from Intel side will do good help for us, many thanks.

0 Kudos
4 Replies
Peh_Intel
Moderator
729 Views

Hi Roxy,

 

Thanks for reaching out to us.

 

For your information, GNA plugin is designed for offloading continuous inference workloads including but not limited to noise reduction or speech recognition to save power and free CPU resources.

 

When running Live Speech Recognition Demo with GNA plugin, CPU memory usage is decrease compared to run the demo with CPU plugin.

 

You can observe the CPU memory usage in Performance Monitor.

  1. Search Performance Monitor in Window Search Box, and run the App.
  2. From the Menu on the left side, expand Monitoring Tools, and click on Performance Monitor.
  3. You can observe the memory usage in the Line Graph.
  4. Run the demo with CPU first, and then followed by GNA. Performance monitor shows drop in CPU residency with GNA Plugin.

 


Regards,

Peh


0 Kudos
Roxy1
Novice
708 Views

 Hi Peh

I would like to observe GNA status, especially loading more than one model. 

While GNA multi-thread, do you have any tool which can show GNA loading which just like CPU usage%?

0 Kudos
Peh_Intel
Moderator
690 Views

Hi Roxy,


Unfortunately, we do not have tool to directly observe GNA status.


You may interest with this How to Interpret Performance Counters for collecting performance counters with the Inference Engine API.



Regards,

Peh


0 Kudos
Peh_Intel
Moderator
599 Views

Hi Roxy,


This thread will no longer be monitored since we have provided suggestion. If you need any additional information from Intel, please submit a new question. 



Regards,

Peh


0 Kudos
Reply