Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6552 Discussions

Why does it take more time when I use two models at the same time

jiang__lynyan
Beginner
‎12-12-2018 06:34 PM
443 Views

I created a InferRequest using model A, and the infer  time is 65ms,also another InferRequest using model B, the infer  time is 47ms.
However, I created two InferRequest using Model A (called infer_a) and Model B (called infer_b) at the same time and infer the same picture sequentially using infer_a, infer_b, it takes time 119ms and 120ms respectively.
Why does it take more time when I use two models?
 

0 Kudos

Link Copied

1 Reply
nikos1
Valued Contributor I
‎01-05-2019 06:36 PM
443 Views

Hello Lynyan,

What was the OS and inference device? CPU, GPU, MYRIAD? How did you profile? Did you run many iterations for the device to warm up?

0 Kudos
Copy link
Reply

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.