Thank you for reaching out to us.
Throughput (frames per second, FPS) is a measurement used when it comes to batch inputs. To calculate throughput, divide the number of inputs that were processed by the processing time:
Meanwhile, the latency value measures inference time (ms) required to process a single input.
Refer to the What Is Inference Performance documentation for more details.
This thread will no longer be monitored since we have provided a solution. If you need any additional information from Intel, please submit a new question.