I'm trying to queue multiple images for inferencing on NCS with NCSDK v2 APIs. Here, I'm assuming that multiple images are processed in a batch and returns output. Presently images are being sent for inferencing in a loop sequentially like this:
for img in range(list_img):
graph.queue_inference_with_fifo_elem(fifoIn, fifoOut, img, 'user object')
My concern is:
Please provide any comments or suggestions on this regard.
@madhusudhan_s It's a queue, so if you send in five images, it processes each image, one at a time. We don't support batch image processing at the moment. I don't know of any work-arounds with APi2 because one device can only process one inference at a time with the current NCSDK 2.04.00.06.