Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.
5966 Discussions

Why does it take more time when I use two models at the same time

jiang__lynyan
Beginner
130 Views

I created a InferRequest using model A, and the infer  time is 65ms,also another InferRequest using model B, the infer  time is 47ms.
However, I created two InferRequest using Model A (called infer_a) and Model B (called infer_b) at the same time and infer the same picture sequentially using infer_a, infer_b, it takes time 119ms and 120ms respectively.
Why does it take more time when I use two models?
 

0 Kudos
1 Reply
nikos1
Valued Contributor I
130 Views

Hello Lynyan,

What was the OS and inference device? CPU, GPU, MYRIAD? How did you profile? Did you run many iterations for the device to warm up?

Reply