Community
cancel
Showing results for 
Search instead for 
Did you mean: 
jiang__lynyan
Beginner
74 Views

Why does it take more time when I use two models at the same time

I created a InferRequest using model A, and the infer  time is 65ms,also another InferRequest using model B, the infer  time is 47ms.
However, I created two InferRequest using Model A (called infer_a) and Model B (called infer_b) at the same time and infer the same picture sequentially using infer_a, infer_b, it takes time 119ms and 120ms respectively.
Why does it take more time when I use two models?
 

0 Kudos
1 Reply
nikos1
Valued Contributor I
74 Views

Hello Lynyan,

What was the OS and inference device? CPU, GPU, MYRIAD? How did you profile? Did you run many iterations for the device to warm up?

Reply