How to create an Exectuable Network (exec_net) faster?

[HesamSH]

Reading the network and loading it into an executable network takes from 3 to 11 seconds for me, depending on the device. But for my application, I may need to restart my program multiple times and I can't afford this much overhead. 

So how can I shorten the time needed for this?

P.S: I also tested exporting the exec_net and  then importing it, but importing of the network seems to take even a longer time.

[Peh_Intel]

Hi Hesam,

Thanks for reaching out to us.

In order to shorten the load time, I would suggest you compile the IR model into blob file and then import blob file instead of IR model. Just a disclaimer that not all IR models can be compiled into blob file.

You may refer to this article:

Loading a Model on Vision Processing Unit (VPU) May take Longer than Loading on CPU

Regards,

Peh

[Peh_Intel]

Hi Hesam,

This thread will no longer be monitored since we have provided suggestion. If you need any additional information from Intel, please submit a new question. 

Regards,

Peh