Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Duggy
Novice
518 Views

RTSP error and stop : h264 error while decoding MB 32 23

Hi,

I am having this error (or set of errors) when running openvino with RTSP cameras. The demo says finished successfully and halts eventhough I am running RTSP so there should be no reason for it to halt as the feed is still going.

I see the following errors (or combinations thereof) before the halt (not always) so wondering if they are related to ffmpeg453_64.dll:

[h264 @ 0000026b7f490000] mb_type 39 in P slice too large at 33 12
[h264 @ 0000026b7f490000] error while decoding MB 33 12
[h264 @ 0000026b7f68ca40] left block unavailable for requested intra4x4 mode -1
[h264 @ 0000026b7f68ca40] error while decoding MB 0 27
[h264 @ 0000026b7f68c5c0] out of range intra chroma pred mode
[h264 @ 0000026b7f68c5c0] error while decoding MB 10 28

 

Does anyone know what these mean? How to ignore them or deal with them and to keep the system online?

Initially when working with RTSP I had to run the ffmpeg-download.ps1 in the opencv folder to download the file opencv_videoio_ffmpeg453_64.dll or RTSP would not work. Wondering if this is related to the issue.

 

Much appreciated.

Labels (1)
0 Kudos
8 Replies
Wan_Intel
Moderator
498 Views

Hi Duggy,

Thanks for reaching out to us.


Could you please provide the following information for us to investigate further?

·      Which version of OpenVINO™ Toolkit are you using on your local machine?

·      Which Open Model Zoo demos are you using with RTSP as input?

·      Are you using Intel pre-trained models or Public pre-trained models or custom models with Open model zoo demo application?


Regards,

Wan


Duggy
Novice
476 Views

Hi,

 

This is the standard demo  (for 2021.4):

https://docs.openvinotoolkit.org/latest/omz_demos_multi_camera_multi_target_tracking_demo_python.htm...

utilizing :

person-detection-retail-0013\FP16\person-detection-retail-0013.xml

person-reidentification-retail-0277\FP32\person-reidentification-retail-0277.xml

The models are the trained models supplied by OpenVino.

Thanks

 

Maksim_S_Intel
Employee
486 Views

Set environment variables OPENCV_LOG_LEVEL=d and OPENCV_VIDEOIO_DEBUG=1 and run the demo to collect more detailed logs. I assume broken RTSP stream is precieved by the app as an end of video and it exits, maybe it can be modified to make recovery attempt before exiting (trying to read one or more frames from VideoCapture).

Duggy
Novice
456 Views

I am using a python environment  (not Anaconda environment as it is running on windows 7). Is there a way to set environment variables OPENCV_LOG_LEVEL=d and OPENCV_VIDEOIO_DEBUG=1 in the :

C:\Program Files (x86)\Intel\openvino_2021.4.582\bin\setupvars.bat

 

or any other alternative?

Duggy
Novice
436 Views

Here is the debug log from openCV : (I havent a clue what to look for):

 

[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (191) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Builtin backends(8): FFMPEG(1000
); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV_IMAGES(950); CV_MJP
EG(940); UEYE(930)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (215) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Available backends(8): FFMPEG(10
00); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV_IMAGES(950); CV_M
JPEG(940); UEYE(930)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (217) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Enabled backends(8, sorted by pr
iority): FFMPEG(1000); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV
_IMAGES(950); CV_MJPEG(940); UEYE(930)
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (128) cv::VideoCapture::open VIDEOIO(FFMPEG): tryi
ng capture filename='rtsp://admin:Syenap123@192.168.2.33:554/Streaming/Channels/
101' ...
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (380) cv::impl::getPluginCandidates Fou
nd 2 plugin(s) for FFMPEG
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_videoio_ffmpeg453_64.dll => OK
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (50) cv::impl::PluginBackend::initCaptu
reAPI Found entry: 'opencv_videoio_capture_plugin_init_v1'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (169) cv::impl::PluginBackend::checkCom
patibility Video I/O: initialized 'FFmpeg OpenCV Video I/O Capture plugin': buil
t with OpenCV 4.5 (ABI/API = 1/1), current OpenCV version is '4.5.3-openvino' (A
BI/API = 1/1)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (69) cv::impl::PluginBackend::initCaptu
reAPI Video I/O: plugin is ready to use 'FFmpeg OpenCV Video I/O Capture plugin'

[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (84) cv::impl::PluginBackend::initWrite
rAPI Found entry: 'opencv_videoio_writer_plugin_init_v1'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (169) cv::impl::PluginBackend::checkCom
patibility Video I/O: initialized 'FFmpeg OpenCV Video I/O Writer plugin': built
with OpenCV 4.5 (ABI/API = 1/1), current OpenCV version is '4.5.3-openvino' (AB
I/API = 1/1)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (103) cv::impl::PluginBackend::initWrit
erAPI Video I/O: plugin is ready to use 'FFmpeg OpenCV Video I/O Writer plugin'
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_impl.hpp (1025) op
en FFMPEG: stream[0] is video stream with codecID=27 width=1280 height=720
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (140) cv::VideoCapture::open VIDEOIO(FFMPEG): crea
ted, isOpened=1
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (128) cv::VideoCapture::open VIDEOIO(FFMPEG): tryi
ng capture filename='rtsp://admin:Syenap123@192.168.2.31:554/Streaming/Channels/
101' ...
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_impl.hpp (1025) op
en FFMPEG: stream[0] is video stream with codecID=27 width=1280 height=720
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (140) cv::VideoCapture::open VIDEOIO(FFMPEG): crea
ted, isOpened=1
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (107) cv::parallel::createDefaultParall
elForAPI core(parallel): Initializing parallel backend...
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (69) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Builtin backends(3):
ONETBB(1000); TBB(990); OPENMP(980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (94) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Available backends(3)
: ONETBB(1000); TBB(990); OPENMP(980)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (96) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Enabled backends(3, s
orted by priority): ONETBB(1000); TBB(990); OPENMP(980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (65) cv::parallel::createParallelForAPI
core(parallel): trying backend: ONETBB (priority=1000)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (230) cv::impl::get
PluginCandidates Found 2 plugin(s) for ONETBB
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_core_parallel_onetbb453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_core_parallel_onetbb453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (65) cv::parallel::createParallelForAPI
core(parallel): trying backend: TBB (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (230) cv::impl::get
PluginCandidates Found 2 plugin(s) for TBB
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_core_parallel_tbb453_64.dll => OK
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (31) cv::impl::Plug
inParallelBackend::initPluginAPI Found entry: 'opencv_core_parallel_plugin_init_
v0'
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (80) cv::impl::Plug
inParallelBackend::checkCompatibility core(parallel): initialized 'TBB (interfac
e 9107) OpenCV parallel plugin': built with OpenCV 4.5 (ABI/API = 0/0), current
OpenCV version is '4.5.3-openvino' (ABI/API = 0/0)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (48) cv::impl::Plug
inParallelBackend::initPluginAPI core(parallel): plugin is ready to use 'TBB (in
terface 9107) OpenCV parallel plugin'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\include\opencv2/core/parallel/backend/parallel_for.tbb.hpp (54) c
v::parallel::tbb::ParallelForBackend::ParallelForBackend Initializing TBB parall
el backend: TBB_INTERFACE_VERSION=9107
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (77) cv::parallel::createParallelForAPI
core(parallel): using backend: TBB (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (120) cv::highgui_backend::createDefaultUIBack
end UI: Initializing backend...
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (79) cv::highgui_backend::UIBackendRegis
try::UIBackendRegistry UI: Builtin backends(3): GTK(1000); GTK3(990); GTK2(980)
+ BUILTIN(WIN32UI)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (104) cv::highgui_backend::UIBackendRegi
stry::UIBackendRegistry UI: Available backends(3): GTK(1000); GTK3(990); GTK2(98
0) + BUILTIN(WIN32UI)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (106) cv::highgui_backend::UIBackendRegi
stry::UIBackendRegistry UI: Enabled backends(3, sorted by priority): GTK(1000);
GTK3(990); GTK2(980) + BUILTIN(WIN32UI)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK (priority=1000)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK3 (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK3
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk3453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk3453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK2 (priority=980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK2
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk2453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk2453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (106) cv::highgui_backend::createUIBackend UI:
fallback on builtin code: WIN32UI
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (550) cv::VideoWriter::open VIDEOIO(FFMPEG): tryin
g writer with filename='output\output.avi' fourcc=0x44495658 fps=6 sz=1280x718 i
sColor=1...
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (563) cv::VideoWriter::open VIDEOIO(FFMPEG): creat
ed, isOpened=1
Processing frame: 316, fps = 2.2 (avg_fps = 4.3)[h264 @ 00000000756a6080] error
while decoding MB 64 24, bytestream -7
Processing frame: 341, fps = 2.1 (avg_fps = 3.98)

[ INFO:1] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (74) cv::plugin::impl::DynamicLi
b::libraryRelease unload C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv
\bin\opencv_videoio_ffmpeg453_64.dll
[ INFO:1] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (74) cv::plugin::impl::DynamicLi
b::libraryRelease unload C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv
\bin\opencv_core_parallel_tbb453_64.dll

Duggy
Novice
476 Views

Hi, I am almost positive your diagnosis is correct. Not sure how to fix it though, but sounds incredibly plausible. 

Will set the log levels and report.

Wan_Intel
Moderator
342 Views

Hi Duggy,

Thanks for your information.


For your information, I have validated Multi Camera Multi Target Python Demo with RTSP as input and person-detection-retail-0013 as object detection model and person-reidentification-retail-0277 as object re-identification model using OpenVINO™ 2021.4 on Windows 10.


Regarding your error, you may have a look at this discussion:

https://stackoverflow.com/questions/49233433/opencv-read-errorh264-0x8f915e0-error-while-decoding-mb...


Regards,

Wan


Wan_Intel
Moderator
238 Views

Hi Duggy,


This thread will no longer be monitored since we have provided explanations and suggestions.

If you need any additional information from Intel, please submit a new question.


Regards,

Wan


Reply