Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6401 Discussions

How throughput/FPS is calculated in workbench?

AbhijeetJ_Intel
Moderator
‎05-16-2022 03:24 AM
988 Views

Hi,

What are the metrics/ formulas used while calculating Throughput/ FPS in the workbench?

 

AbhijeetJ_Intel_0-1652696451451.png

 

0 Kudos

Link Copied

2 Replies
Hairul_Intel
Moderator
‎05-19-2022 08:23 PM
948 Views

Hi AbhijeetJ_Intel,

Thank you for reaching out to us.

 

Throughput (frames per second, FPS) is a measurement used when it comes to batch inputs. To calculate throughput, divide the number of inputs that were processed by the processing time:

 

Hairul_Intel_0-1653017051741.png

 

 

Meanwhile, the latency value measures inference time (ms) required to process a single input.

 

Refer to the What Is Inference Performance documentation for more details.

 

 

Regards,

Hairul

 

0 Kudos
Copy link
Hairul_Intel
Moderator
‎05-29-2022 05:44 PM
915 Views

Hi AbhijeetJ,

This thread will no longer be monitored since we have provided a solution. If you need any additional information from Intel, please submit a new question.

 

 

Regards,

Hairul


0 Kudos
Copy link
Reply

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.