gvawatermark unable to adapt the meta information when input source changes its resolution run-time

NikhilP · ‎04-09-2023

Hi,

We are trying to do a "Person / Vehicle / Bike" detection using Intel OpenVINO 2021.4.2 version.
The input source is a 3gp clip of 36 sec duration. For the first 18 sec the resolution is 360p and for the next 18 sec its 720p.

When we try to do a inferencing on the clip, we see that the "gvawatermark" is unable to adapt the meta information when the resolution changes run-time from 360p->720p.

This causes the pipeline to crash eventually.

Steps to reproduce
-------------------------

1) Setting up Environment:
source /opt/intel/openvino_2021.4.752/bin/setupvars.sh
source /opt/intel/openvino_2021.4.752/data_processing/dl_streamer/bin/setupvars.sh

2) Model Files Downloaded from below path:
https://storage.openvinotoolkit.org/repositories/open_model_zoo/2021.4/models_bin/3/person-vehicle-bike-detection-2004/FP32/person-vehicle-bike-detection-2004.xml

https://storage.openvinotoolkit.org/repositories/open_model_zoo/2021.4/models_bin/3/person-vehicle-bike-detection-2004/FP32/person-vehicle-bike-detection-2004.bin

3) Pipeline Command:

gst-launch-1.0 filesrc location=/dsp/gvaWatermarkIssue/PBV_360p_720p.3gp ! decodebin ! queue ! gvadetect model=./model/person-vehicle-bike-detection-2004.xml de
vice=CPU threshold=0.5 inference-interval=5 ! gvatrack tracking-type=short-term-imageless ! gvawatermark ! videoconvert ! fakesink sync=true

NOTE: "PBV_360p_720p.3gp" is archived in the attached zip file.

4) Error thrown by the pipleine:
** (gst-launch-1.0:53): CRITICAL **: 13:44:33.928: gst_video_frame_map_id: assertion 'info->width <= meta->width' failed
ERROR: from element /GstPipeline:pipeline0/GstGvaWatermark:gvawatermark0/GstGvaWatermarkImpl:gvawatermarkimpl: gvawatermark has failed to process frame.
Additional debug info:
/root/gst-video-analytics/gst/elements/gvawatermark/gstgvawatermarkimpl.cpp(266): gst_gva_watermark_impl_transform_ip (): /GstPipeline:pipeline0/GstGvaWatermark:gvawatermark0/GstGvaWatermarkImpl:gvawate
rmarkimpl:
gvawatermark has failed to process frame

While this behaviour of clients changing the resolution on the fly is a common use case, we do see that the gvawatermark is unable to hab=ndle such changes and eventually crashes.

Will this be fixed and such a support be added ?

Thanks,

Nikhil

Iffa_Intel · ‎04-11-2023

Hi,

I don't see that error from my end

Note: it's recommended to use a newer version of OpenVINO as in this guide.

Cordially,

Iffa

NikhilP · ‎04-11-2023

Thank you for your quick response.

I have also checked and the issue is not seen with OpenVINO 2022 version.

The issue can be closed.

Regards,

Nikhil

Iffa_Intel · ‎04-11-2023

Intel will no longer monitor this thread since this issue has been resolved. If you need any additional information from Intel, please submit a new question.

Cordially,

Iffa