Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6403 Discussions

Why does it take more time when I use two models at the same time

jiang__lynyan
Beginner
268 Views

I created a InferRequest using model A, and the infer  time is 65ms,also another InferRequest using model B, the infer  time is 47ms.
However, I created two InferRequest using Model A (called infer_a) and Model B (called infer_b) at the same time and infer the same picture sequentially using infer_a, infer_b, it takes time 119ms and 120ms respectively.
Why does it take more time when I use two models?
 

0 Kudos
1 Reply
nikos1
Valued Contributor I
268 Views

Hello Lynyan,

What was the OS and inference device? CPU, GPU, MYRIAD? How did you profile? Did you run many iterations for the device to warm up?

0 Kudos
Reply