topic How long does it take to process maskrcnn on neural stick2? in Intel® Distribution of OpenVINO™ Toolkit

How long does it take to process maskrcnn on neural stick2?

Karmeo — Wed, 23 Sep 2020 06:00:34 GMT

Hi! Please tell me how much time it takes to analyze one image for the maskrcnn model on neural stick 2? My tests showed that it takes about one minute to analyze. Is there any way to reduce the processing time or is this the maximum capability of this device

Re:How long does it take to process maskrcnn on neural stick2?

Iffa_Intel — Fri, 02 Oct 2020 06:31:52 GMT

Hi,

This is expected due to the different between device characteristics.

One of the workaround is Myriad optimization for MyriadX ( NCS2 need to have at least 4 inference requests in parallel).

You can refer here: https://docs.openvinotoolkit.org/latest/openvino_docs_optimization_guide_dldt_optimization_guide.html#myriad

And also here: https://docs.openvinotoolkit.org/latest/openvino_inference_engine_samples_benchmark_app_README.html

Sincerely,

Iffa

Re: Re:How long does it take to process maskrcnn on neural stick2?

Karmeo — Thu, 08 Oct 2020 07:23:47 GMT

Hi! Can you tell me what this parameter VPU_HW_STAGES_OPTIMIZATION is responsible for and how it affects the network load speed? It turned out that if the value is YES, the neural network takes a very long time to load (about 10 minutes)

Re:How long does it take to process maskrcnn on neural stick2?

Iffa_Intel — Fri, 09 Oct 2020 13:40:46 GMT

Greetings,

This is known as a bug and we might expect this to be fixed soon later.

The option VPU_HW_STAGES_OPTIMIZATION exists for debug purposes. When you turn it off, all the hardware acceleration gets disabled for the model. It might affect various characteristics like accuracy, memory requirements, and performance.

Fow now, it is recommended to turn the function off (set it to "NO")

Sincerely,

Iffa

Re:How long does it take to process maskrcnn on neural stick2?

Iffa_Intel — Mon, 19 Oct 2020 10:11:22 GMT

Greetings,

Intel will no longer monitor this thread since we have provided a solution. If you need any additional information from Intel, please submit a new question.

Sincerely,

Iffa