I referred https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_DynamicBatching.html and trying to implement the dynamic batching with the /intel/openvino/deployment_tools/open_model_zoo/models/public/mask_rcnn_inception_v2_coco. I have converted the model into IR and used to implement the dynamic batching. But when loading the network in python using (ie.load_network(network=net, device_name=device, num_requests=num_reqs)), it ends in error as below.
exec_net = ie.load_network(network=net, device_name=device, num_requests=num_reqs)
File "ie_api.pyx", line 336, in openvino.inference_engine.ie_api.IECore.load_network
File "ie_api.pyx", line 345, in openvino.inference_engine.ie_api.IECore.load_network
RuntimeError: MKLDNNGraph::CreateGraph: such topology cannot be compiled for dynamic batch!
But the same code is working in Image classification models like GoogleNet, AlexNet but i need to use the mask rccn model.
Please let me know how to make the mask rcnn model to work with dynamic batching.
Thank you for your question. I noticed you have submitted a duplicate question in the community. I will close this ticket and we will continue providing support from another ticket which is: https://community.intel.com/t5/Intel-Distribution-of-OpenVINO/Not-able-to-use-dynamic-batching-on-ma...