Why does it take more time when I use two models at the same time

[jiang__lynyan]

I created a InferRequest using model A, and the infer  time is 65ms,also another InferRequest using model B, the infer  time is 47ms.
However, I created two InferRequest using Model A (called infer_a) and Model B (called infer_b) at the same time and infer the same picture sequentially using infer_a, infer_b, it takes time 119ms and 120ms respectively.
Why does it take more time when I use two models?
 

[nikos1]

Hello Lynyan,

What was the OS and inference device? CPU, GPU, MYRIAD? How did you profile? Did you run many iterations for the device to warm up?