Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6573 토론

What backend does OpenVino inference Benchmark use?

Joon
초급자
2,062 조회수

Hello, 

I am trying to run the openvino inference becnhmark sample. However, I was wondering what back-end (runtime) does openvino use? To be specific, some inference benchmark uses tensorflow, onnxruntime, etc. However, during use the openvino inference benchmark I was not able to set up these back-end.
Therefore, I was wondering if openvino inference benchmark uses its own runtime. 

Also, what I understand is that size of memory definitely can affect the results of throughput. However, even if I increase the size of memory 8GB to 16GB, the overall throughput are similar. Is it because I run the benchmark differently? or the size of memory does not really affect the results?

I am new to the openvino tools. Please correct me if I misunderstand something!
Thank you so much for the time and consideration

0 포인트
1 솔루션
JesusE_Intel
중재자
2,017 조회수

Hi Joon,


The OpenVINO toolkit uses the Inference Engine to read, load and inference the model (Intermediate Representation) on the target device. You can find additional information on the Inference Engine Documentation. The benchmark app is measuring the latency for each executed infer request, please see the How It Works section in the app documentation.


Regards,

Jesus


원본 게시물의 솔루션 보기

0 포인트
3 응답
JesusE_Intel
중재자
2,018 조회수

Hi Joon,


The OpenVINO toolkit uses the Inference Engine to read, load and inference the model (Intermediate Representation) on the target device. You can find additional information on the Inference Engine Documentation. The benchmark app is measuring the latency for each executed infer request, please see the How It Works section in the app documentation.


Regards,

Jesus


0 포인트
JesusE_Intel
중재자
2,008 조회수

Hi Joon,


Just following up to see if you have any additional questions after my last response.


Regards,

Jesus


0 포인트
JesusE_Intel
중재자
2,001 조회수

Intel will no longer monitor this thread since we have provided a solution. If you need any additional information from Intel, please submit a new question. 


0 포인트
응답