Community
cancel
Showing results for 
Search instead for 
Did you mean: 
nikos1
Valued Contributor I
161 Views

Zero-copy OpenCL image or buffer to OpenVino input when on clDNN

Hello, Just wondering in an OpenCL pipeline how we can send GPU OpenCL images or  buffers to OpenVino / clDNN plug-in for inference? Trying to have an end-to-end zero-copy pipeline with all images staying on GPU. If this is possible, in such a pipeline is input resizing also supported?

0 Kudos
2 Replies
Anna_B_Intel
Employee
161 Views

Hi Nikos, 

I have one advice about loading data to Inference Engine which is applicable to all plugins - don't use SetBlob function from InferRequest, use GetBlob only. No clDNN specific tricks.

Input resizing can be done earlier using OpenCV for example.

Best wishes, 

Anna

nikos1
Valued Contributor I
161 Views

Hi Anna,

use GetBlob only

Thank you for your advice. We are currently using SetBlob in our applications but we can refactor to use GetBlob (I believe that would be more async so it could run faster). Still this will require copies from CPU to GPU, correct? Ideally, we should send our GPU OpenCL image or buffer directly to the clDNN input when the GPU device is selected for zero-copy.

Nikos

 

Reply