topic Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo. in Intel® Distribution of OpenVINO™ Toolkit

The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

kman066 — Sun, 16 Aug 2020 12:21:11 GMT

Hi：

I am Kman.When i use the HDDL-R8 accelerator card to run the official demo.The fps are very low,and it showed a very low "util%". This phenomenon is very metaphysical.My hardware configuration is as follows:

CPU: i3 8145UE
Vision Accelerator Card: hddl-R8
OS: Ubuntu18.04
OpenVINO:2020.4

Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

XFR1998 — Sun, 16 Aug 2020 12:30:31 GMT

fxxk!!! I have the same problem as u.......I need help

Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

Max_L_Intel — Wed, 19 Aug 2020 14:16:00 GMT

Hi @kman066

It might be sufficient for your application and model to utilize this amount of HDDL card resources to parallelize the execution as much as possible.
Also, it is recommended to have at minimum 32 inference requests in flight to fully saturate the device. See Request-Based API and “GetBlob” Idiom and Benchmark App Sample (-nireq parameter) for more information.

Thanks.

Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

WU__Tianwen — Thu, 20 Aug 2020 08:14:31 GMT

Hello,@Max_L_Intel !

I also do some test on HDDL-R8.https://github.com/TNTWEN/OpenVINO-YOLOV4/issues/5

In YOLO video test,It seems that the speed of HDDL-R8 is slower than intel GPU.Is this normal? I wonder if this is the limit of hddlr8's performance

Thanks a lot！

Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

Max_L_Intel — Thu, 20 Aug 2020 14:17:19 GMT

Hi @WU__Tianwen

That might depend on different settings and exact hardware that you test, but generally that should not be the case. We have very limited performance benchmark results, but there you can see that Vision Accelerator Design with VPUs (HDDL) shows higher performance for "Throughput" section for FP16 comparing even to Core i7 for INT8 precision.
Usually we recommend to use Benchmark App within OpenVINO package to measure the performance.

Re: The HDDL-R8 accelerator card has a very low usage rate when running the official demo.

Max_L_Intel — Fri, 28 Aug 2020 10:28:03 GMT

This thread will no longer be monitored since we have provided our suggestions. If you need any additional information from Intel, please submit a new question.