Community
cancel
Showing results for 
Search instead for 
Did you mean: 
kman066
Beginner
457 Views

The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

Jump to solution

Hi:

  I am Kman.When i use the HDDL-R8 accelerator card to run the official demo.The fps are very low,and it showed a very low "util%". This phenomenon is very metaphysical.My hardware configuration is as follows:

CPU: i3  8145UE
Vision Accelerator Card: hddl-R8
OS: Ubuntu18.04
OpenVINO:2020.4

微信图片_20200816201639.jpg

0 Kudos
1 Solution
Max_L_Intel
Moderator
380 Views

Hi @WU__Tianwen 

That might depend on different settings and exact hardware that you test, but generally that should not be the case. We have very limited performance benchmark results, but there you can see that Vision Accelerator Design with VPUs (HDDL) shows higher performance for "Throughput" section for FP16 comparing even to Core i7 for INT8 precision.
Usually we recommend to use Benchmark App within OpenVINO package to measure the performance.

View solution in original post

5 Replies
XFR1998
Beginner
450 Views

fxxk!!! I have the same problem as u.......I need help

Max_L_Intel
Moderator
404 Views

Hi @kman066 

It might be sufficient for your application and model to utilize this amount of HDDL card resources to parallelize the execution as much as possible.
Also, it is recommended to have at minimum 32 inference requests in flight to fully saturate the device. See Request-Based API and “GetBlob” Idiom and Benchmark App Sample (-nireq parameter) for more information.

Thanks.

WU__Tianwen
New Contributor I
392 Views

Hello,@Max_L_Intel !

I also do some test on HDDL-R8.https://github.com/TNTWEN/OpenVINO-YOLOV4/issues/5 

In YOLO video test,It seems that the speed of HDDL-R8 is slower than intel GPU.Is this normal? I wonder if this is the limit of hddlr8's performance

Thanks a lot!

Max_L_Intel
Moderator
381 Views

Hi @WU__Tianwen 

That might depend on different settings and exact hardware that you test, but generally that should not be the case. We have very limited performance benchmark results, but there you can see that Vision Accelerator Design with VPUs (HDDL) shows higher performance for "Throughput" section for FP16 comparing even to Core i7 for INT8 precision.
Usually we recommend to use Benchmark App within OpenVINO package to measure the performance.

View solution in original post

Max_L_Intel
Moderator
352 Views

This thread will no longer be monitored since we have provided our suggestions. If you need any additional information from Intel, please submit a new question.

Reply