Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Karmeo
Novice
246 Views

How long does it take to process maskrcnn on neural stick2?

Hi! Please tell me how much time it takes to analyze one image for the maskrcnn model on neural stick 2? My tests showed that it takes about one minute to analyze. Is there any way to reduce the processing time or is this the maximum capability of this device

0 Kudos
4 Replies
Iffa_Intel
Moderator
224 Views

Hi,


This is expected due to the different between device characteristics.

One of the workaround is Myriad optimization for MyriadX ( NCS2 need to have at least 4 inference requests in parallel).


You can refer here: https://docs.openvinotoolkit.org/latest/openvino_docs_optimization_guide_dldt_optimization_guide.htm...


And also here: https://docs.openvinotoolkit.org/latest/openvino_inference_engine_samples_benchmark_app_README.html


Sincerely,

Iffa




Karmeo
Novice
204 Views

Hi! Can you tell me what this parameter VPU_HW_STAGES_OPTIMIZATION is responsible for and how it affects the network load speed? It turned out that if the value is YES, the neural network takes a very long time to load (about 10 minutes)

Iffa_Intel
Moderator
198 Views

Greetings,


This is known as a bug and we might expect this to be fixed soon later.

The option VPU_HW_STAGES_OPTIMIZATION exists for debug purposes. When you turn it off, all the hardware acceleration gets disabled for the model. It might affect various characteristics like accuracy, memory requirements, and performance.


Fow now, it is recommended to turn the function off (set it to "NO")


Sincerely,

Iffa


Iffa_Intel
Moderator
165 Views

Greetings,


Intel will no longer monitor this thread since we have provided a solution. If you need any additional information from Intel, please submit a new question. 


Sincerely,

Iffa


Reply