Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6454 Discussions

do infernce on GPU cost 57ms but 30ms on CPU

liang__heng1
Beginner
369 Views

I have a model ,it  only cost 30ms on CPU, but 57ms on GPU.  the time cost is average value by 1000 times. 

how can I reduce execution time on GPU? 

0 Kudos
2 Replies
liang__heng1
Beginner
369 Views

there are five  "Interp" layers in the model, is  this the main reson that doing inference on GPU device cost much more time?

0 Kudos
liang__heng1
Beginner
369 Views

Does anyone know the reason?

0 Kudos
Reply