Media (Intel® Video Processing Library, Intel Media SDK)
Access community support with transcoding, decoding, and encoding in applications using media tools like Intel® oneAPI Video Processing Library and Intel® Media SDK
Announcements
The Intel Media SDK project is no longer active. For continued support and access to new features, Intel Media SDK users are encouraged to read the transition guide on upgrading from Intel® Media SDK to Intel® Video Processing Library (VPL), and to move to VPL as soon as possible.
For more information, see the VPL website.

H264 decode problem

Zurab_T_
Beginner
535 Views

When i am transcoding from mpeg2 to h264 everything is working fine, but when I am transcoding from H264 to H264 then I am getting some strange scenario.

Some constant frame keeps showing all the time between some other frames. I can't finalize what happens please help :)
 

0 Kudos
8 Replies
Anthony_P_Intel
Employee
535 Views

Hi,

Are you seeing any issue using sample_multi_transcode example application?

If issue is only with your application, you can use the "mediasdk_tracer"  tool to capture a log that may help us understand what you are asking the Media SDK API to do.

Thanks

0 Kudos
Zurab_T_
Beginner
535 Views

Hi Tony

 

thank you for reply.

I have build my program using libdispatcher-trace.a, but when I am xecuting it I get only

INFO:    MFXInit (impl=MFX_IMPL_HARDWARE, pVer=0.0 session=0x0x7fffe1a8f540
INFO:    invoking LoadLibrary(INFO:    MFXInit(MFX_IMPL_HARDWARE,ver=1.8,session=0x0x708020)


this two line of log. Can you tell me what is necessary to add?

0 Kudos
Zurab_T_
Beginner
535 Views

Here is attached my video file. it is in mkv file I just renamed to mp4 because the upload restriction. and there is one image file which is that wrong frame showing all the time in this sample video.

So when I start transcoding transcoder will catch some frame at the beginning and in transcode process that frame is showing continuously.

0 Kudos
Anthony_P_Intel
Employee
535 Views

Hi,

I have not seen that behavior before.

I'm just guessing, but could be issue with decode, or with frame rate conversion, or with general buffer usage.

Is the output video's framerate the same as the input?

Can you capture the *.Init parameters of Decode, VPP, and Encode ?

Thanks

 

0 Kudos
Zurab_T_
Beginner
535 Views
The frame rate is same. It's 25. Tomorrow I will copy allvmy init commands with parameterset. Thank you.
0 Kudos
Zurab_T_
Beginner
535 Views

Hi Tony,

 

Here is init params of decoder, vpp and encoder.

 

decoder params begin========================

t->dec_params @0x7fffffffe248 mfxVideoParam     
 AsyncDepth 1 mfxU16    
 ExtParam 0x0 mfxExtBuffer **    
 IOPattern 16 mfxU16    
 NumExtParam 0 mfxU16    
 Protected 0 mfxU16    
 mfx @0x7fffffffe258 mfxInfoMFX    
  #10  {...}   
   InterleavedDec 0 mfxU16  
   JPEGChromaFormat 0 mfxU16  
   JPEGColorFormat 0 mfxU16  
   Rotation 0 mfxU16  
   reserved3 @0x7fffffffe2ce mfxU16 [9]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
  #11  {...}   
   Interleaved 0 mfxU16  
   Quality 0 mfxU16  
   RestartInterval 0 mfxU16  
   reserved5 @0x7fffffffe2cc mfxU16 [10]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
    [9] 0 mfxU16
  #5  {...}   
   #6  union {...}  
    Accuracy 0 mfxU16
    InitialDelayInKB 0 mfxU16
    QPI 0 mfxU16
   #7  union {...}  
    ICQQuality 0 mfxU16
    QPP 0 mfxU16
    TargetKbps 0 mfxU16
   #8  union {...}  
    Convergence 0 mfxU16
    MaxKbps 0 mfxU16
    QPB 0 mfxU16
   BufferSizeInKB 0 mfxU16  
   EncodedOrder 0 mfxU16  
   GopOptFlag 0 mfxU16  
   GopPicSize 0 mfxU16  
   GopRefDist 0 mfxU16  
   IdrInterval 0 mfxU16  
   NumRefFrame 0 mfxU16  
   NumSlice 0 mfxU16  
   RateControlMethod 0 mfxU16  
   TargetUsage 0 mfxU16  
  #9  {...}   
   DecodedOrder 0 mfxU16  
   ExtendedPicStruct 0 mfxU16  
   SliceGroupsPresent 0 mfxU16  
   TimeStampCalc 0 mfxU16  
   reserved2 @0x7fffffffe2ce mfxU16 [9]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
  BRCParamMultiplier 0 mfxU16   
  CodecId 541283905 mfxU32   
  CodecLevel 30 mfxU16   
  CodecProfile 77 mfxU16   
  FrameInfo @0x7fffffffe278 mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 0 mfxU16  
   CropW 0 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe290 mfxFrameId  
    #2  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #3  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 0 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe278 mfxU32 [4]  
    [0] 0 mfxU32
    [1] 0 mfxU32
    [2] 0 mfxU32
    [3] 0 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  NumThread 0 mfxU16   
  reserved @0x7fffffffe258 mfxU32 [7]   
   [0] 0 mfxU32  
   [1] 0 mfxU32  
   [2] 0 mfxU32  
   [3] 0 mfxU32  
   [4] 0 mfxU32  
   [5] 0 mfxU32  
   [6] 0 mfxU32  
  reserved4 0 mfxU16   
 reserved @0x7fffffffe248 mfxU32 [3]    
  [0] 0 mfxU32   
  [1] 0 mfxU32   
  [2] 0 mfxU32   
 reserved2 0 mfxU16    
 reserved3 0 mfxU16    
 vpp @0x7fffffffe258 mfxInfoVPP    

decoder params end========================

 

vpp params begin========================

t->vpp_params @0x7fffffffe3e8 mfxVideoParam     
 AsyncDepth 1 mfxU16    
 ExtParam @0x7fffffffe4b8 mfxExtBuffer    
  BufferId 1163089230 mfxU32   
  BufferSz 24 mfxU32   
 IOPattern 17 mfxU16    
 NumExtParam 1 mfxU16    
 Protected 0 mfxU16    
 mfx @0x7fffffffe3f8 mfxInfoMFX    
  #10  {...}   
   InterleavedDec 0 mfxU16  
   JPEGChromaFormat 0 mfxU16  
   JPEGColorFormat 0 mfxU16  
   Rotation 0 mfxU16  
   reserved3 @0x7fffffffe46e mfxU16 [9]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 22094 mfxU16
    [8] 12849 mfxU16
  #11  {...}   
   Interleaved 0 mfxU16  
   Quality 0 mfxU16  
   RestartInterval 0 mfxU16  
   reserved5 @0x7fffffffe46c mfxU16 [10]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 22094 mfxU16
    [9] 12849 mfxU16
  #5  {...}   
   #6  union {...}  
    Accuracy 0 mfxU16
    InitialDelayInKB 0 mfxU16
    QPI 0 mfxU16
   #7  union {...}  
    ICQQuality 0 mfxU16
    QPP 0 mfxU16
    TargetKbps 0 mfxU16
   #8  union {...}  
    Convergence 0 mfxU16
    MaxKbps 0 mfxU16
    QPB 0 mfxU16
   BufferSizeInKB 0 mfxU16  
   EncodedOrder 12849 mfxU16  
   GopOptFlag 0 mfxU16  
   GopPicSize 0 mfxU16  
   GopRefDist 0 mfxU16  
   IdrInterval 0 mfxU16  
   NumRefFrame 22094 mfxU16  
   NumSlice 0 mfxU16  
   RateControlMethod 0 mfxU16  
   TargetUsage 0 mfxU16  
  #9  {...}   
   DecodedOrder 0 mfxU16  
   ExtendedPicStruct 0 mfxU16  
   SliceGroupsPresent 0 mfxU16  
   TimeStampCalc 0 mfxU16  
   reserved2 @0x7fffffffe46e mfxU16 [9]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 22094 mfxU16
    [8] 12849 mfxU16
  BRCParamMultiplier 0 mfxU16   
  CodecId 0 mfxU32   
  CodecLevel 0 mfxU16   
  CodecProfile 0 mfxU16   
  FrameInfo @0x7fffffffe418 mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 576 mfxU16  
   CropW 720 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe430 mfxFrameId  
    #2  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #3  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 0 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe418 mfxU32 [4]  
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  NumThread 0 mfxU16   
  reserved @0x7fffffffe3f8 mfxU32 [7]   
   [0] 0 mfxU32  
   [1] 0 mfxU32  
   [2] 0 mfxU32  
   [3] 0 mfxU32  
   [4] 0 mfxU32  
   [5] 0 mfxU32  
   [6] 0 mfxU32  
  reserved4 0 mfxU16   
 reserved @0x7fffffffe3e8 mfxU32 [3]    
  [0] 0 mfxU32   
  [1] 0 mfxU32   
  [2] 0 mfxU32   
 reserved2 0 mfxU16    
 reserved3 0 mfxU16    
 vpp @0x7fffffffe3f8 mfxInfoVPP    
  In @0x7fffffffe418 mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 576 mfxU16  
   CropW 720 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe430 mfxFrameId  
    #13  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #14  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 0 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe418 mfxU32 [4]  
    [0] 0 mfxU32
    [1] 0 mfxU32
    [2] 0 mfxU32
    [3] 0 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  Out @0x7fffffffe45c mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 576 mfxU16  
   CropW 720 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe474 mfxFrameId  
    #16  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #17  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 1 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe45c mfxU32 [4]  
    [0] 0 mfxU32
    [1] 0 mfxU32
    [2] 0 mfxU32
    [3] 0 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  reserved @0x7fffffffe3f8 mfxU32 [8]   
   [0] 0 mfxU32  
   [1] 0 mfxU32  
   [2] 0 mfxU32  
   [3] 0 mfxU32  
   [4] 0 mfxU32  
   [5] 0 mfxU32  
   [6] 0 mfxU32  
   [7] 0 mfxU32 

vpp params end========================

 

 

 

encoder params begin========================

t->enc_params @0x7fffffffe318 mfxVideoParam     
 AsyncDepth 1 mfxU16    
 ExtParam 0x0 mfxExtBuffer **    
 IOPattern 1 mfxU16    
 NumExtParam 0 mfxU16    
 Protected 0 mfxU16    
 mfx @0x7fffffffe328 mfxInfoMFX    
  #10  {...}   
   InterleavedDec 0 mfxU16  
   JPEGChromaFormat 7 mfxU16  
   JPEGColorFormat 1 mfxU16  
   Rotation 50 mfxU16  
   reserved3 @0x7fffffffe39e mfxU16 [9]  
    [0] 0 mfxU16
    [1] 2 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 4000 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
  #11  {...}   
   Interleaved 7 mfxU16  
   Quality 50 mfxU16  
   RestartInterval 1 mfxU16  
   reserved5 @0x7fffffffe39c mfxU16 [10]  
    [0] 0 mfxU16
    [1] 0 mfxU16
    [2] 2 mfxU16
    [3] 0 mfxU16
    [4] 0 mfxU16
    [5] 4000 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
    [9] 0 mfxU16
  #5  {...}   
   #6  union {...}  
    Accuracy 0 mfxU16
    InitialDelayInKB 0 mfxU16
    QPI 0 mfxU16
   #7  union {...}  
    ICQQuality 4000 mfxU16
    QPP 4000 mfxU16
    TargetKbps 4000 mfxU16
   #8  union {...}  
    Convergence 0 mfxU16
    MaxKbps 0 mfxU16
    QPB 0 mfxU16
   BufferSizeInKB 0 mfxU16  
   EncodedOrder 0 mfxU16  
   GopOptFlag 0 mfxU16  
   GopPicSize 50 mfxU16  
   GopRefDist 1 mfxU16  
   IdrInterval 0 mfxU16  
   NumRefFrame 0 mfxU16  
   NumSlice 0 mfxU16  
   RateControlMethod 2 mfxU16  
   TargetUsage 7 mfxU16  
  #9  {...}   
   DecodedOrder 7 mfxU16  
   ExtendedPicStruct 50 mfxU16  
   SliceGroupsPresent 0 mfxU16  
   TimeStampCalc 1 mfxU16  
   reserved2 @0x7fffffffe39e mfxU16 [9]  
    [0] 0 mfxU16
    [1] 2 mfxU16
    [2] 0 mfxU16
    [3] 0 mfxU16
    [4] 4000 mfxU16
    [5] 0 mfxU16
    [6] 0 mfxU16
    [7] 0 mfxU16
    [8] 0 mfxU16
  BRCParamMultiplier 1 mfxU16   
  CodecId 541283905 mfxU32   
  CodecLevel 0 mfxU16   
  CodecProfile 0 mfxU16   
  FrameInfo @0x7fffffffe348 mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 576 mfxU16  
   CropW 720 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe360 mfxFrameId  
    #2  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #3  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 1 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe348 mfxU32 [4]  
    [0] 0 mfxU32
    [1] 0 mfxU32
    [2] 0 mfxU32
    [3] 0 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  NumThread 0 mfxU16   
  reserved @0x7fffffffe328 mfxU32 [7]   
   [0] 0 mfxU32  
   [1] 0 mfxU32  
   [2] 0 mfxU32  
   [3] 0 mfxU32  
   [4] 0 mfxU32  
   [5] 0 mfxU32  
   [6] 0 mfxU32  
  reserved4 0 mfxU16   
 reserved @0x7fffffffe318 mfxU32 [3]    
  [0] 0 mfxU32   
  [1] 0 mfxU32   
  [2] 0 mfxU32   
 reserved2 0 mfxU16    
 reserved3 0 mfxU16    
 vpp @0x7fffffffe328 mfxInfoVPP    
  In @0x7fffffffe348 mfxFrameInfo   
   AspectRatioH 11 mfxU16  
   AspectRatioW 12 mfxU16  
   BitDepthChroma 0 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 1 mfxU16  
   CropH 576 mfxU16  
   CropW 720 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 842094158 mfxU32  
   FrameId @0x7fffffffe360 mfxFrameId  
    #13  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #14  {...}
     ViewId 0 mfxU16
    PriorityId 0 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 2 mfxU32  
   FrameRateExtN 50 mfxU32  
   Height 576 mfxU16  
   PicStruct 1 mfxU16  
   Shift 0 mfxU16  
   Width 720 mfxU16  
   reserved @0x7fffffffe348 mfxU32 [4]  
    [0] 0 mfxU32
    [1] 0 mfxU32
    [2] 0 mfxU32
    [3] 0 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  Out @0x7fffffffe38c mfxFrameInfo   
   AspectRatioH 0 mfxU16  
   AspectRatioW 0 mfxU16  
   BitDepthChroma 2 mfxU16  
   BitDepthLuma 0 mfxU16  
   ChromaFormat 0 mfxU16  
   CropH 0 mfxU16  
   CropW 0 mfxU16  
   CropX 0 mfxU16  
   CropY 0 mfxU16  
   FourCC 0 mfxU32  
   FrameId @0x7fffffffe3a4 mfxFrameId  
    #16  {...}
     DependencyId 0 mfxU16
     QualityId 0 mfxU16
    #17  {...}
     ViewId 0 mfxU16
    PriorityId 4000 mfxU16
    TemporalId 0 mfxU16
   FrameRateExtD 0 mfxU32  
   FrameRateExtN 0 mfxU32  
   Height 0 mfxU16  
   PicStruct 0 mfxU16  
   Shift 0 mfxU16  
   Width 0 mfxU16  
   reserved @0x7fffffffe38c mfxU32 [4]  
    [0] 541283905 mfxU32
    [1] 0 mfxU32
    [2] 458752 mfxU32
    [3] 65586 mfxU32
   reserved2 0 mfxU16  
   reserved3 0 mfxU16  
   reserved4 0 mfxU16  
  reserved @0x7fffffffe328 mfxU32 [8]   
   [0] 0 mfxU32  
   [1] 0 mfxU32  
   [2] 0 mfxU32  
   [3] 0 mfxU32  
   [4] 0 mfxU32  
   [5] 0 mfxU32  
   [6] 0 mfxU32  
   [7] 65536 mfxU32  

encoder params end========================

0 Kudos
Zurab_T_
Beginner
535 Views

Hi Tony,

I have resolved the problem,

I have removed MFX_BITSTREAM_COMPLETE_FRAME flag from decoder bitsream and the sequence of frames are ok.

0 Kudos
Ramashankar
New Contributor III
535 Views

Hi Zurab, Tony,

In relation with your issue, Recently i had also faced an issue where my output decoded frames from h264 decoder were getting corrupted. Then just by doing hit n trial mechanism i removed this flag  and issue got solved. Then i tried to back track and understand the concept of this flag. As name suggest, i think when this  flag is set, decoder expect a complete frame to be inputted for decoding. But i could not get clarity of how to identify a complete frame or that logical unit of frame which should be provided as input to decoder, specially in case of SPS and PPS. Whether it should be provided to decoder along with a complete frame, or it should be provided separately.

I have two different h264 streams and output behavior is different of both in above two cases and when this flag is set or not set.

So any input from your side??

0 Kudos
Reply