I'm working on inference of three models sequentially in a NCS2.
How can I profile the usage of memory in NCS2 per each model?
Is there any API for this in OpenVINO?
Unfortunately, there is not an API in OpenVINO that will allow you to specify memory allocation per model on the NCS.
Please let me know if you have any further questions.