Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6392 Discussions

RTSP error and stop : h264 error while decoding MB 32 23

Duggy
New Contributor I
9,837 Views

Hi,

I am having this error (or set of errors) when running openvino with RTSP cameras. The demo says finished successfully and halts eventhough I am running RTSP so there should be no reason for it to halt as the feed is still going.

I see the following errors (or combinations thereof) before the halt (not always) so wondering if they are related to ffmpeg453_64.dll:

[h264 @ 0000026b7f490000] mb_type 39 in P slice too large at 33 12
[h264 @ 0000026b7f490000] error while decoding MB 33 12
[h264 @ 0000026b7f68ca40] left block unavailable for requested intra4x4 mode -1
[h264 @ 0000026b7f68ca40] error while decoding MB 0 27
[h264 @ 0000026b7f68c5c0] out of range intra chroma pred mode
[h264 @ 0000026b7f68c5c0] error while decoding MB 10 28

 

Does anyone know what these mean? How to ignore them or deal with them and to keep the system online?

Initially when working with RTSP I had to run the ffmpeg-download.ps1 in the opencv folder to download the file opencv_videoio_ffmpeg453_64.dll or RTSP would not work. Wondering if this is related to the issue.

 

Much appreciated.

Labels (1)
0 Kudos
8 Replies
Wan_Intel
Moderator
9,817 Views

Hi Duggy,

Thanks for reaching out to us.


Could you please provide the following information for us to investigate further?

·      Which version of OpenVINO™ Toolkit are you using on your local machine?

·      Which Open Model Zoo demos are you using with RTSP as input?

·      Are you using Intel pre-trained models or Public pre-trained models or custom models with Open model zoo demo application?


Regards,

Wan


0 Kudos
Duggy
New Contributor I
9,795 Views

Hi,

 

This is the standard demo  (for 2021.4):

https://docs.openvinotoolkit.org/latest/omz_demos_multi_camera_multi_target_tracking_demo_python.html

utilizing :

person-detection-retail-0013\FP16\person-detection-retail-0013.xml

person-reidentification-retail-0277\FP32\person-reidentification-retail-0277.xml

The models are the trained models supplied by OpenVino.

Thanks

 

0 Kudos
Maksim_S_Intel
Employee
9,805 Views

Set environment variables OPENCV_LOG_LEVEL=d and OPENCV_VIDEOIO_DEBUG=1 and run the demo to collect more detailed logs. I assume broken RTSP stream is precieved by the app as an end of video and it exits, maybe it can be modified to make recovery attempt before exiting (trying to read one or more frames from VideoCapture).

0 Kudos
Duggy
New Contributor I
9,775 Views

I am using a python environment  (not Anaconda environment as it is running on windows 7). Is there a way to set environment variables OPENCV_LOG_LEVEL=d and OPENCV_VIDEOIO_DEBUG=1 in the :

C:\Program Files (x86)\Intel\openvino_2021.4.582\bin\setupvars.bat

 

or any other alternative?

0 Kudos
Duggy
New Contributor I
9,755 Views

Here is the debug log from openCV : (I havent a clue what to look for):

 

[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (191) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Builtin backends(8): FFMPEG(1000
); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV_IMAGES(950); CV_MJP
EG(940); UEYE(930)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (215) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Available backends(8): FFMPEG(10
00); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV_IMAGES(950); CV_M
JPEG(940); UEYE(930)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\videoio_registry.cpp (217) cv::`anonymous-namespace'::Vide
oBackendRegistry::VideoBackendRegistry VIDEOIO: Enabled backends(8, sorted by pr
iority): FFMPEG(1000); GSTREAMER(990); INTEL_MFX(980); MSMF(970); DSHOW(960); CV
_IMAGES(950); CV_MJPEG(940); UEYE(930)
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (128) cv::VideoCapture::open VIDEOIO(FFMPEG): tryi
ng capture filename='rtsp://admin:Syenap123@192.168.2.33:554/Streaming/Channels/
101' ...
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (380) cv::impl::getPluginCandidates Fou
nd 2 plugin(s) for FFMPEG
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_videoio_ffmpeg453_64.dll => OK
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (50) cv::impl::PluginBackend::initCaptu
reAPI Found entry: 'opencv_videoio_capture_plugin_init_v1'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (169) cv::impl::PluginBackend::checkCom
patibility Video I/O: initialized 'FFmpeg OpenCV Video I/O Capture plugin': buil
t with OpenCV 4.5 (ABI/API = 1/1), current OpenCV version is '4.5.3-openvino' (A
BI/API = 1/1)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (69) cv::impl::PluginBackend::initCaptu
reAPI Video I/O: plugin is ready to use 'FFmpeg OpenCV Video I/O Capture plugin'

[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (84) cv::impl::PluginBackend::initWrite
rAPI Found entry: 'opencv_videoio_writer_plugin_init_v1'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (169) cv::impl::PluginBackend::checkCom
patibility Video I/O: initialized 'FFmpeg OpenCV Video I/O Writer plugin': built
with OpenCV 4.5 (ABI/API = 1/1), current OpenCV version is '4.5.3-openvino' (AB
I/API = 1/1)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\backend_plugin.cpp (103) cv::impl::PluginBackend::initWrit
erAPI Video I/O: plugin is ready to use 'FFmpeg OpenCV Video I/O Writer plugin'
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_impl.hpp (1025) op
en FFMPEG: stream[0] is video stream with codecID=27 width=1280 height=720
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (140) cv::VideoCapture::open VIDEOIO(FFMPEG): crea
ted, isOpened=1
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (128) cv::VideoCapture::open VIDEOIO(FFMPEG): tryi
ng capture filename='rtsp://admin:Syenap123@192.168.2.31:554/Streaming/Channels/
101' ...
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_impl.hpp (1025) op
en FFMPEG: stream[0] is video stream with codecID=27 width=1280 height=720
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (140) cv::VideoCapture::open VIDEOIO(FFMPEG): crea
ted, isOpened=1
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (107) cv::parallel::createDefaultParall
elForAPI core(parallel): Initializing parallel backend...
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (69) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Builtin backends(3):
ONETBB(1000); TBB(990); OPENMP(980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (94) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Available backends(3)
: ONETBB(1000); TBB(990); OPENMP(980)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\registry_parallel.impl.hpp (96) cv::parallel::Parall
elBackendRegistry::ParallelBackendRegistry core(parallel): Enabled backends(3, s
orted by priority): ONETBB(1000); TBB(990); OPENMP(980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (65) cv::parallel::createParallelForAPI
core(parallel): trying backend: ONETBB (priority=1000)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (230) cv::impl::get
PluginCandidates Found 2 plugin(s) for ONETBB
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_core_parallel_onetbb453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_core_parallel_onetbb453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (65) cv::parallel::createParallelForAPI
core(parallel): trying backend: TBB (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (230) cv::impl::get
PluginCandidates Found 2 plugin(s) for TBB
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_core_parallel_tbb453_64.dll => OK
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (31) cv::impl::Plug
inParallelBackend::initPluginAPI Found entry: 'opencv_core_parallel_plugin_init_
v0'
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (80) cv::impl::Plug
inParallelBackend::checkCompatibility core(parallel): initialized 'TBB (interfac
e 9107) OpenCV parallel plugin': built with OpenCV 4.5 (ABI/API = 0/0), current
OpenCV version is '4.5.3-openvino' (ABI/API = 0/0)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\plugin_parallel_wrapper.impl.hpp (48) cv::impl::Plug
inParallelBackend::initPluginAPI core(parallel): plugin is ready to use 'TBB (in
terface 9107) OpenCV parallel plugin'
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\include\opencv2/core/parallel/backend/parallel_for.tbb.hpp (54) c
v::parallel::tbb::ParallelForBackend::ParallelForBackend Initializing TBB parall
el backend: TBB_INTERFACE_VERSION=9107
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\parallel\parallel.cpp (77) cv::parallel::createParallelForAPI
core(parallel): using backend: TBB (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (120) cv::highgui_backend::createDefaultUIBack
end UI: Initializing backend...
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (79) cv::highgui_backend::UIBackendRegis
try::UIBackendRegistry UI: Builtin backends(3): GTK(1000); GTK3(990); GTK2(980)
+ BUILTIN(WIN32UI)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (104) cv::highgui_backend::UIBackendRegi
stry::UIBackendRegistry UI: Available backends(3): GTK(1000); GTK3(990); GTK2(98
0) + BUILTIN(WIN32UI)
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\registry.impl.hpp (106) cv::highgui_backend::UIBackendRegi
stry::UIBackendRegistry UI: Enabled backends(3, sorted by priority): GTK(1000);
GTK3(990); GTK2(980) + BUILTIN(WIN32UI)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK (priority=1000)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK3 (priority=990)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK3
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk3453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk3453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (78) cv::highgui_backend::createUIBackend UI:
trying backend: GTK2 (priority=980)
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\plugin_wrapper.impl.hpp (231) cv::impl::getPluginCandidate
s Found 2 plugin(s) for GTK2
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv\bin\
opencv_highgui_gtk2453_64.dll => FAILED
[ INFO:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (67) cv::plugin::impl::DynamicLi
b::libraryLoad load opencv_highgui_gtk2453_64.dll => FAILED
[DEBUG:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\highgui\src\backend.cpp (106) cv::highgui_backend::createUIBackend UI:
fallback on builtin code: WIN32UI
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (550) cv::VideoWriter::open VIDEOIO(FFMPEG): tryin
g writer with filename='output\output.avi' fourcc=0x44495658 fps=6 sz=1280x718 i
sColor=1...
[DEBUG:0] global /build/opencv/modules/videoio/src/cap_ffmpeg_hw.hpp (929) HWAcc
elIterator FFMPEG: allowed acceleration types (none): ''
[ WARN:0] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\videoio\src\cap.cpp (563) cv::VideoWriter::open VIDEOIO(FFMPEG): creat
ed, isOpened=1
Processing frame: 316, fps = 2.2 (avg_fps = 4.3)[h264 @ 00000000756a6080] error
while decoding MB 64 24, bytestream -7
Processing frame: 341, fps = 2.1 (avg_fps = 3.98)

[ INFO:1] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (74) cv::plugin::impl::DynamicLi
b::libraryRelease unload C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv
\bin\opencv_videoio_ffmpeg453_64.dll
[ INFO:1] global C:\jenkins\workspace\OpenCV\OpenVINO\2021.4\build\windows\openc
v\modules\core\src\utils\plugin_loader.impl.hpp (74) cv::plugin::impl::DynamicLi
b::libraryRelease unload C:\Program Files (x86)\Intel\openvino_2021.4.582\opencv
\bin\opencv_core_parallel_tbb453_64.dll

0 Kudos
Duggy
New Contributor I
9,795 Views

Hi, I am almost positive your diagnosis is correct. Not sure how to fix it though, but sounds incredibly plausible. 

Will set the log levels and report.

0 Kudos
Wan_Intel
Moderator
9,661 Views

Hi Duggy,

Thanks for your information.


For your information, I have validated Multi Camera Multi Target Python Demo with RTSP as input and person-detection-retail-0013 as object detection model and person-reidentification-retail-0277 as object re-identification model using OpenVINO™ 2021.4 on Windows 10.


Regarding your error, you may have a look at this discussion:

https://stackoverflow.com/questions/49233433/opencv-read-errorh264-0x8f915e0-error-while-decoding-mb-53-20-bytestream


Regards,

Wan


0 Kudos
Wan_Intel
Moderator
9,557 Views

Hi Duggy,


This thread will no longer be monitored since we have provided explanations and suggestions.

If you need any additional information from Intel, please submit a new question.


Regards,

Wan


0 Kudos
Reply