I use the Linux Server Intel Media SDK.
I ported the windows version example of the sample_decode using ffmpeg to linux and found that both the ffmpeg input version and the regular version ran in about the same amount of ticks. The demuxing didn't seem to have much impact at all.
I then used the code from the ffmpeg decode sample to add the ffmpeg input to the sample_multi_transcode sample code. I went from processing ~10k frames of SD in 15 seconds to ~10k frames of SD in 212 seconds. After adding some benchmarking I have determined the exact bottleneck in the source code. Unfortunately the function call is not source code that I have access to and it doesn't explain well what the code is trying to do.
The function is in pipeline_transcode.cpp. CTranscodingPipeline::PutBS(). The line that is running so much slower is:
sts = m_pmfxSession->SyncOperation(pBitstreamEx->Syncp, MSDK_WAIT_INTERVAL);
What I would like to know is:
1) What does this function do?
2) Why would it run drastically slower with a different file reader feeding it?
I see no clear reasons for slowed down execution due to added container splitter Media SDK component pipeline.
Some potential culprits may be related to incompatible stream hear layout (e.g. annexB), your FFmpeg reader wait state handling, or somehow fallback on SW codec instead of HW codec execution.
Not sure what sample you are referring to in the context of FFmpeg integration. The primary sample we have, showcasing this kind of integration is part of the Media SDK tutorial:
The SyncOperation() call locks execution until a frame is ready (processed by decode, VPP or Encode, or a combination).
Do you have that tutorial intel-media-sdk-tutorial-simple-6-transcode-opaque-async-ffmpeg for Linux? I found the windows version and started porting it though its not working quite yet.
The code I was using before I got from the samples directory in the SDK (MSDK/5.0.036-HSW_R3/l_MSDK/samples) and I had modified the sample sample_multi_transcode to have an FFMPEG input instead of the file reader.
We do not yet have a port for the Media SDK Tutorial samples for Linux.
The plan is for a new release of the tutorial shortly, including support for Linux. We will notify the community via this forum when it's available.