Reading the network and loading it into an executable network takes from 3 to 11 seconds for me, depending on the device. But for my application, I may need to restart my program multiple times and I can't afford this much overhead.
So how can I shorten the time needed for this?
P.S: I also tested exporting the exec_net and then importing it, but importing of the network seems to take even a longer time.
Thanks for reaching out to us.
In order to shorten the load time, I would suggest you compile the IR model into blob file and then import blob file instead of IR model. Just a disclaimer that not all IR models can be compiled into blob file.
You may refer to this article:
This thread will no longer be monitored since we have provided suggestion. If you need any additional information from Intel, please submit a new question.