Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.

OpenVINO CPU usage is very high

Sataki__Mostafa
Beginner
524 Views

Hi.

I use OpenVINO R3 and R4 versions .Both versions inference time are low for my tensorflow model but CPU usage is very high(nearly 100%).I use mobilenet model on video with 25 fps and the image dimension is 300*300. How can i reduce CPU usage?

0 Kudos
4 Replies
nikos1
Valued Contributor I
524 Views

Hi Mostafa, 

Are you using -d CPU ? Then high CPU load is expected.

You could try using -d GPU or use a Movidius NCS2 or other inference device for lower CPU load.

Cheers,

Nikos

Sataki__Mostafa
Beginner
524 Views
If you attention to my question inference time for each sample is low (5 ms) but CPU usage in WINDOWS is nearly 95%.
Severine_H_Intel
Employee
524 Views

Dear Mostafa, this is normal that the CPU usage is high if you do inference on CPU. Which behavior do you expect from your application? Low CPU usage? 

As Nikos mentioned, if you want to want to not use the CPU for inference, use -d GPU or -d MYRIAD for doing the inference on either GPU or Movidius.

Best, 

Severine 

Sataki__Mostafa
Beginner
524 Views

I solve it by define OMP_NUM_THREADS = 1 envionment variable .

Reply