Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.
6022 Discussions

Weird FPS trend of synchronous and asynchronous mode

Han0310
Novice
156 Views

Hi,

 

As suggested, the FPS using asynchronous mode suppose to be higher than synchronous. However, my model's FPS for asynchronous is lower than synchronous mode. Is there any explanation or solution for this? Besides, I found that the average latency for synchronous mode can be calculated by dividing the duration by count but it is not applicable for the asynchronous mode. Is there any way to calculate the latency in that case? Thx in advance.

 

Asynchronous:

Han0310_0-1657961133631.png

CPU_async.PNG

Synchronous:

Han0310_1-1657961169488.png

CPU.PNG

  

0 Kudos
2 Replies
IntelSupport
Community Manager
103 Views

Hi Han0310,

 

Thanks for reaching out.

From my side, the asynchronous is faster than synchronous as below:

Asynchronous:

async.JPG

Synchronous:

sync.JPG

Latency measures inference time (in ms) required to process a single input.

Throughput is calculated by dividing the number of inputs that were processed by the processing time.

The formula is:

 

FPS = Inferred number of images

           Processing time in seconds

 

Check out this documentation for more information.

 

 

 

Regards,

Aznie

 

IntelSupport
Community Manager
76 Views

Hi Han0310,


This thread will no longer be monitored since we have provided the information. If you need any additional information from Intel, please submit a new question. 



Regards,

Aznie


Reply