do infernce on GPU cost 57ms but 30ms on CPU - Intel Community

Intel® Distribution of OpenVINO™ Toolkit

Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

do infernce on GPU cost 57ms but 30ms on CPU

604 次查看

I have a model ,it only cost 30ms on CPU, but 57ms on GPU. the time cost is average value by 1000 times.

how can I reduce execution time on GPU?

链接已复制

2 回复数

604 次查看

there are five "Interp" layers in the model， is this the main reson that doing inference on GPU device cost much more time?

复制链接

604 次查看

Does anyone know the reason？

复制链接

周一至周五提供社区支持。请单击此处查看其他联系方式。

英特尔不会验证所有解决方案，包括但不限于该社区中可能出现的任何文件传输。对此，英特尔不做任何明确或隐含的担保，包括但不限于对适销性、适用于特定用途和非侵权的隐含担保，以及由履约习惯、交易习惯和贸易惯例引起的任何担保。

关于编译器优化的更多完整信息，请参阅我们的优化通知.