Community
cancel
Showing results for 
Search instead for 
Did you mean: 
LHenr2
Beginner
109 Views

Atom CPU cap/render time surges when NCS 2 inferences

Dear all:

Today I worked on an atom with NCS offloading project. I am baffled with

a situation when running interactive_face_detection_demo sample in OpenVino R5.

 

When CPU was doing inferencing, it took only 34.05ms for CPU to cap/render,

But when NCS 2 was offloading CPU, the CPU took 379ms to cap/render each frame!

 

Does anyone know why? And how would I fix the bottleneck?

 

CPU inferencing,

 

 

NCS 2 inferencing

 

Thank you in advance,

Joey

0 Kudos
1 Reply
Shubha_R_Intel
Employee
109 Views

Dear Henry, Lin,

Can you kindly retry your experiments with the most recent version of OpenVino - 2019.R.1.0.1 ?

According to Interactive Face Detection Documentation there are a few knobs you can play with to get better performance (such as enabling async mode, dynamic batching). But you can find out precisely what is happening by running the sample with the -pc argument which will give you a per-layer performance report.

Hope it helps,

Thanks,

Shubha

 

Reply