Multiple model in NCS

[idata]

Is it possible to get inference from multiple models on NCS?

Either sequentially or parallelly

[idata]

@gauravmoon, the following posts might help you:

1. https://ncsforum.movidius.com/discussion/112/chaining-movidius-sticks/
2. https://ncsforum.movidius.com/discussion/327/executing-multiple-graphs-on-a-stick#latest

The crux is that we can't yet run multiple graphs simultaneously on a single stick, but you can run them sequentially. i.e. Use device.AllocateGraph and graph.DeallocateGraph dynamically to switch between different graphs. The time to allocate and de-allocate should be in the order of ms, so shouldn't me much of a problem to do this a couple times in the code. If you do want to run multiple graphs simultaneously in your application, refer the links above.

[idata]

@AshwinVijayakumar Is that possible to run multiple graphs sequentially on a single stick? based on the link it seems it only works with multiple sticks? I tried to use device.AllocateGraph and graph.DeallocateGraph alternatively on a single stick, but it doesn't work.

basically this is what I didgraph1 = device.AllocateGraph(blob1) # use graph1 here graph1.DeallocateGraph() graph2 = device.AllocateGraph(blob2) # use graph2 here graph2.DeallocateGraph()

[idata]

@ly_ldq Yes, this way of using the stick is not working for now. Probably this will be fixed in next NCSDK versions but currently workaround for this is usage of multiple sticks.