OpenVINO CPU usage is very high

[Sataki__Mostafa]

Hi.

I use OpenVINO R3 and R4 versions .Both versions inference time are low for my tensorflow model but CPU usage is very high(nearly 100%).I use mobilenet model on video with 25 fps and the image dimension is 300*300. How can i reduce CPU usage?

[nikos1]

Hi Mostafa, 

Are you using -d CPU ? Then high CPU load is expected.

You could try using -d GPU or use a Movidius NCS2 or other inference device for lower CPU load.

Cheers,

Nikos

[Sataki__Mostafa]

If you attention to my question inference time for each sample is low (5 ms) but CPU usage in WINDOWS is nearly 95%.

[Severine_H_Intel]

Dear Mostafa, this is normal that the CPU usage is high if you do inference on CPU. Which behavior do you expect from your application? Low CPU usage? 

As Nikos mentioned, if you want to want to not use the CPU for inference, use -d GPU or -d MYRIAD for doing the inference on either GPU or Movidius.

Best, 

Severine 

[Sataki__Mostafa]

I solve it by define OMP_NUM_THREADS = 1 envionment variable .