Simple Example of how to use Intel Media SDK to Encode/Decode streams with VC++ for starter person.

Mohammad_T_1 · ‎09-13-2015

I am reading about Intel Media SDK from last 5 days but not able to start working with it, to stream frames for Encode/Decode in VC++, please help me with starter example. I have already linked it's lib to VC++ project and included Media SDK headers to it. Guide me please/

Harshdeep_B_Intel · ‎09-14-2015

Hello Mohammad,

Yes, we do have MediaSDK encode/decode samples that can help you get started, steps below

Download and install sample ver 6.0.068 from here: https://software.intel.com/en-us/media-client-solutions-support/code-samples.
Sample_decode.exe/Sample_encode.exe available at (installed path/_bin/x64/) and content at same path (_bin/content)
Example - decode command line : “sample_decode.exe h264 –i inputfile –o outputfile –hw -w -h

Let us know if any further questions:

Thanks,

Mohammad_T_1 · ‎09-14-2015

Hi Harsh,

Error comes when i install Intel@MediaSamples6.0.0.48/49 Setup. Error message is:

The installer has encounter an unexpected error installing this package. This may indicate a problem with this package. The error code is 2503.

Now what is supposed to do.

Mohammad_T_1 · ‎09-15-2015

Hi Harsh

I got samples by installing Intel@MediaSamples6.0.0.49 Setup on other system. But in Project: sample_encode not able to understand how it is filling sInputParams structure from command line.? What parameters it is getting from command line to fill it's structure?

Harshdeep_B_Intel · ‎09-15-2015

HI Mohammad,

Can you send me you system information? Check and verify if you have latest driver installed on your system from here: https://downloadcenter.intel.com/. Share a log for analyzer tool at (Installed folder/media_sdk/tools/media_sdk_analyzer.exe). It will be interesting to investigate cause of error during samples installation.

Now, the version of samples you are downloaded MediaSamples6.0.0.49 is the old version. As I suggested in previous comment, install samples version ver 6.0.068 which are the latest. In sample_encode sInputParams structure accepts many parameters from the command line like target usage, codec, width, height and many more and the parameters accepted from command line by the structure is defined is pipeline_user.cpp file.

Also, samples are bit complex and we have a simplified samples (tutorials) using which you can understand the various parameters calls in mediasdk. Take a look at simple_3_encode tutorial to get started.

Thanks,

Mohammad_T_1 · ‎09-15-2015

Hi Harsh,

Log for analyzer tool at (Installed folder/media_sdk/tools/media_sdk_analyzer.exe) is below:

Intel Media SDK System Analyzer (64 bit)

The following versions of Media SDK API are supported by platform/driver:

        Version Target  Supported       Dec     Enc
        1.0     HW      Yes             X       X
        1.0     SW      Yes             X       X
        1.1     HW      Yes             X       X
        1.1     SW      Yes             X       X
        1.3     HW      Yes             X       X
        1.3     SW      Yes             X       X
        1.4     HW      Yes             X       X
        1.4     SW      Yes             X       X
        1.5     HW      No X X
        1.5     SW      Yes             X       X
        1.6     HW      No X X
        1.6     SW      Yes             X       X
        1.7     HW      No X X
        1.7     SW      No X X

Graphics Devices:
Name Version State
Intel(R) HD Graphics 4400 10.18.14.4170 Active

System info:
        CPU:    Intel(R) Core(TM) i3-4150 CPU @3.50GHz
        OS:     Microsoft Windows 8.1 Pro
        Arch:   64-bit

Installed Media SDK packages (be patient...processing takes some time):
Intel« INDE Media SDK for Windows 6.0.0.349

Installed Media SDK DirectShow filters:
Installed Intel Media Foundation transforms:
Intel<<Hardware M-JPEG Decoder MFT:<Some Hexa-decimal values>

Intel<<Hardware VP9 Sync Decoder MFT:<>

Intel<<Hardware VP9 Decoder MFT:<>

Intel<<Hardware VP8 Sync Decoder MFT:<>

Intel<<Hardware VP8 Decoder MFT:<>

Intel<< Quick Sync Video H.264 Encoder MFT:<>

****************************************************************************************

Hope you will find the cause...

And thanks for the simple example , i am going to understand it.

Thank you so much for helping me.

Harshdeep_B_Intel · ‎09-16-2015

Hi Mohammad,

Thank you for logs. I tried on one of our system and was not able to see the installer issue. Can you try again installing latest samples version 6.0.0.68 after updating your system to latest drivers (15.40.7.4279) from here. Let me know how it goes.

Thanks,

AaronL · ‎09-16-2015

It was earlier suggested to use the sample_encode or sample_decode samples to understand how to create an application that makes use of the Intel Media SDK for encoding/decoding purposes. But, both of these samples are fairly complicated and not necessarily a good starting point for figuring this stuff out.

Instead, the tutorials, available at https://software.intel.com/en-us/articles/media-sdk-tutorials-for-client-and-server , are generally a much better way to learn how to develop software that uses the Media SDK, and then the sample_encode and sample_decode samples can be used for reference purposes but not as a starting point.

Harshdeep_B_Intel · ‎09-16-2015

Hi Aaron,

Thank you for your feedback. Agree, samples are bit complicated to understand as a starting point and we are working on making them simpler. Hence as part of the effort, as you pointed out and as suggested before "Also, samples are bit complex and we have a simplified samples (tutorials) using which you can understand the various parameters calls in mediasdk. Take a look at simple_3_encode tutorial to get started. " tutorials are good starting point for mediaSDK.

Thanks,

Mohammad_T_1 · ‎09-17-2015

Hi Harsh ,

I updated Intel driver but samples code unable to run. But i have created my program from new sample_3_encode which you have provided. Till now i have done these things: 1- Initialize Session, 2- Set Parameters, 3- Done Query, 4- Allocate Surfaces. All this 4 steps successfully done but, now GetFreeSurfaceIndex( , ) function is not supported , i don't know why.

Few functions which are not working are: GetFreeSurfaceIndex( , ), MSDK_CHECK_ERROR( , , ), LoadRawFrame( , ), MSDK_BREAK_ON_ERROR(), MSDK_SLEEP(), MSDK_CHECK_RESULT( , , ).

Help me out about this issue, which Header or Library is required. I have already install INDE Media SDK. and included : #include"mfxaudio++.h"
#include"mfxvideo++.h"
#include "mfxjpeg.h"
#include <iostream>
#include <memory>
#include "mfxastructures.h"

and linked libmfx.lib.

Help me

Mohammad_T_1 · ‎09-17-2015

Hi Harsh

First of all thanks for your valueable reply, help me out with above mentioned problem and why MSDK_......() related function is not supported in my program?

Mohammad_T_1 · ‎09-17-2015

This is all my code , may be you will find something from here:

#include "stdafx.h"
#include"mfxaudio++.h"
#include"mfxvideo++.h"
#include "mfxjpeg.h"
#include <iostream>
#include "mfxplugin++.h"
#include "mfxplugin.h"

int _tmain(int argc, _TCHAR* argv[])
{
MFXVideoSession session;

   mfxStatus sts;
   mfxIMPL impl=MFX_IMPL_HARDWARE_ANY;
   mfxVersion version;
   version.Major=1;
   version.Minor=0;

sts=session.Init(impl,&version);
if (MFX_ERR_NONE != sts)
sts = session.Init((impl & (!MFX_IMPL_HARDWARE_ANY)) | MFX_IMPL_HARDWARE, &version);

   mfxVideoParam Params_in;
   int size=sizeof(Params_in);
   memset(&Params_in,0,sizeof(Params_in));

Params_in.mfx.CodecId=MFX_CODEC_AVC;
   Params_in.mfx.TargetUsage = MFX_TARGETUSAGE_BALANCED;
   Params_in.mfx.TargetKbps = 8000;
   Params_in.mfx.RateControlMethod = MFX_RATECONTROL_VBR;
   Params_in.mfx.FrameInfo.FrameRateExtN = 30;
Params_in.mfx.FrameInfo.FrameRateExtD = 1;
   Params_in.mfx.FrameInfo.FourCC = MFX_FOURCC_NV12;
   Params_in.mfx.FrameInfo.ChromaFormat = MFX_CHROMAFORMAT_YUV420;
   Params_in.mfx.FrameInfo.PicStruct = MFX_PICSTRUCT_PROGRESSIVE;
   Params_in.mfx.FrameInfo.CropX = 0;
Params_in.mfx.FrameInfo.CropY = 0;
Params_in.mfx.FrameInfo.CropW = 352;
Params_in.mfx.FrameInfo.CropH = 288;
Params_in.mfx.FrameInfo.Width = 352;
Params_in.mfx.FrameInfo.Height = 288;
   Params_in.IOPattern=MFX_IOPATTERN_IN_SYSTEM_MEMORY;

sts = MFXQueryIMPL(session,&impl);
sts = MFXQueryVersion((mfxSession)session, &version);

MFXVideoENCODE enc(session);
sts = enc.Query(&Params_in,&Params_in);

mfxFrameAllocRequest Request;
   memset(&Request, 0, sizeof(Request));
   sts = enc.QueryIOSurf(&Params_in,&Request);

   mfxU16 numSurfaces = Request.NumFrameSuggested;

mfxU16 width = (mfxU16) Request.Info.Width;
mfxU16 height = (mfxU16) Request.Info.Height;
mfxU8 bitsPerPixel = (mfxU8)12; // NV12 format is a 12 bits per pixel format
mfxU32 surfaceSize = width * height * bitsPerPixel / 8;
mfxU8* surfaceBuffers = (mfxU8*) new mfxU8[surfaceSize * numSurfaces];

mfxFrameSurface1** pEncSurfaces = new mfxFrameSurface1 *[numSurfaces];

for (int i = 0; i < numSurfaces; i++) {
pEncSurfaces = new mfxFrameSurface1;
memset(pEncSurfaces, 0, sizeof(mfxFrameSurface1));
memcpy(&(pEncSurfaces->Info), &(Params_in.mfx.FrameInfo), sizeof(mfxFrameInfo));
pEncSurfaces->Data.Y = &surfaceBuffers[surfaceSize * i];
pEncSurfaces->Data.U = pEncSurfaces->Data.Y + width * height;
pEncSurfaces->Data.V = pEncSurfaces->Data.U + 1;
pEncSurfaces->Data.Pitch = width;

}

// Initialize the Media SDK encoder
sts = enc.Init(&Params_in);

// Retrieve video parameters selected by encoder.
// - BufferSizeInKB parameter is required to set bit stream buffer size
mfxVideoParam par;
memset(&par, 0, sizeof(par));
sts = enc.GetVideoParam(&par);

// Prepare Media SDK bit stream buffer
mfxBitstream mfxBS;
memset(&mfxBS, 0, sizeof(mfxBS));
mfxBS.MaxLength = par.mfx.BufferSizeInKB * 1000;
mfxBS.Data = new mfxU8[mfxBS.MaxLength];

// ===================================
// Start encoding the frames
//

int nEncSurfIdx = 0;
mfxSyncPoint syncp;
mfxU32 nFrame = 0;

/***********************************************************************************************************************************

Till here code is working fine...*************************************************************************************************/

/********** CONFUSION IN BELOW CODE****** How to find video path? & Why MSDK...() related functions are not working? ***************/

FILE* fSource = NULL;
   fSource=fopen("E:\\'Main Hoon Hero Tera' VIDEO Song - Salman Khan _ Hero _ T-Series_HD.mp4","r");
   if(fSource!=NULL)
   {
       while (MFX_ERR_NONE <= sts || MFX_ERR_MORE_DATA == sts) {
nEncSurfIdx = GetFreeSurfaceIndex(pEncSurfaces, numSurfaces); // Find free frame surface
MSDK_CHECK_ERROR(MFX_ERR_NOT_FOUND, nEncSurfIdx, MFX_ERR_MEMORY_ALLOC);

sts = LoadRawFrame(pEncSurfaces[nEncSurfIdx], fSource);
MSDK_BREAK_ON_ERROR(sts);

for (;;) {
// Encode a frame asychronously (returns immediately)
sts = enc.EncodeFrameAsync(NULL, pEncSurfaces[nEncSurfIdx], &mfxBS, &syncp);

if (MFX_ERR_NONE < sts && !syncp) { // Repeat the call if warning and no output
if (MFX_WRN_DEVICE_BUSY == sts)
MSDK_SLEEP(1); // Wait if device is busy, then repeat the same call
} else if (MFX_ERR_NONE < sts && syncp) {
sts = MFX_ERR_NONE; // Ignore warnings if output is available
break;
} else if (MFX_ERR_NOT_ENOUGH_BUFFER == sts) {
// Allocate more bitstream buffer memory here if needed...
break;
} else
break;
}

if (MFX_ERR_NONE == sts) {
sts = session.SyncOperation(syncp, 60000); // Synchronize. Wait until encoded frame is ready
MSDK_CHECK_RESULT(sts, MFX_ERR_NONE, sts);

sts = WriteBitStreamFrame(&mfxBS, fSink);
MSDK_BREAK_ON_ERROR(sts);

++nFrame;

}
}
}

Sir all function in mentioned in BOLD are showing undefined.

Help me out please

Harshdeep_B_Intel · ‎09-17-2015

Hi Mohammad,

Please consider making following changes to code:

Include "mfxstructures.h" and "mfxdefs.h" header files.
The input file extension is (mp4) which is a container. As input codec ID is set to AVC, using a splitter tool,get the H264 bitstream and provide it as input. Please go through the media-sdk manual for input supported formats for mediasdk.
MSDK_CHECK_ERROR, MSDK_BREAK_ON_ERROR are defined macros, Please define them before there usage or attach "common_utils.h" header file.
I do not see MSDK_SLEEP defined in the code, these are OS- specific type definitions and has to be defined before used.

Please go through the tutorial code simple_3_encode carefully again, and define all the parameters before calling them and attach all required files as shown in tutorial.

Thanks,

Mohammad_T_1 · ‎09-18-2015

Hi Harsh

Thanks for all your reply, now the thinks are working. It's basically i was working on VS2010 now i have installed VS2013 .

Thanks

Harshdeep_B_Intel · ‎09-18-2015

Glad, you got the issues resolved. Please open a new thread, if any further questions.

Thanks,

Chintan_M_ · ‎12-24-2016

How long did it take to learn the Media SDK? I am in a bit of rush for developing a code for Screen Capture using this library.

Chintan_M_ · ‎12-27-2016

I am new to this SDK. I am getting the following error when I run simple_decode on VS 2012 provided under tutorial(mediasdk-tutorials-0.0.3.zip)

The thread 0x9bc8 has exited with code -1 (0xffffffff).
The thread 0x89e8 has exited with code -1 (0xffffffff).
The thread 0x9ff0 has exited with code -1 (0xffffffff).
The program '[22640] simple_decode.exe' has exited with code -1 (0xffffffff).

I have also run the 'mediasdk_system_analyzer_64.exe' whose results are provided below.

The following versions of Media SDK API are supported by platform/driver
[opportunistic detection of MSDK API > 1.19]:

Version Target Supported Dec Enc
1.0 HW Yes X X
1.0 SW Yes X X
1.1 HW Yes X X
1.1 SW Yes X X
1.2 HW Yes X X
1.2 SW Yes X X
1.3 HW Yes X X
1.3 SW Yes X X
1.4 HW Yes X X
1.4 SW Yes X X
1.5 HW Yes X X
1.5 SW Yes X X
1.6 HW Yes X X
1.6 SW Yes X X
1.7 HW Yes X X
1.7 SW Yes X X
1.8 HW Yes X X
1.8 SW Yes X X
1.9 HW Yes X X
1.9 SW Yes X X
1.10 HW Yes X X
1.10 SW Yes X X
1.11 HW Yes X X
1.11 SW Yes X X
1.12 HW Yes X X
1.12 SW Yes X X
1.13 HW Yes X X
1.13 SW Yes X X
1.14 HW Yes X X
1.14 SW Yes X X
1.15 HW Yes X X
1.15 SW Yes X X
1.16 HW Yes X X
1.16 SW Yes X X
1.17 HW No
1.17 SW Yes X X
1.18 HW No
1.18 SW Yes X X
1.19 HW No
1.19 SW Yes X X

Graphics Devices:
Name Version State
Intel(R) HD Graphics 4600 10.18.15.4248 Active
NVIDIA GeForce GT 740M 21.21.13.7633 08

System info:
CPU: Intel(R) Core(TM) i5-4200M CPU @ 2.50GHz
OS: Microsoft Windows 10 Home Single Language
Arch: 64-bit

Installed Media SDK packages (be patient...processing takes some time):
Intel(R) Media Samples 6.0.0.68
Intel(R) Media SDK 2016 R2

Installed Media SDK DirectShow filters:

Installed Intel Media Foundation Transforms:
Intel(R) Hardware M-JPEG Decoder MFT : {00C69F81-0524-48C0-A353-4DD9D54F9A6E}
Intel(R) Hardware VP9 Sync Decoder MFT : {07AB4BD2-1979-4FCD-A697-DF9AD15B34FE}
Intel(R) Hardware VP9 Decoder MFT : {0C69E30B-A112-4A86-B496-35120CD745D5}
Intel(R) Hardware VP8 Sync Decoder MFT : {451E3CB7-2622-4BA5-8E1D-44B3C41D0924}
Intel(R) Hardware VP8 Decoder MFT : {6D856398-834E-4A89-8EE5-071BB3F58BE4}
Intel(R) Quick Sync Video H.264 Encoder MFT : {4BE8D3C0-0515-4A37-AD55-E4BAE19AF471}
Intel(R) Hardware H265 Encoder MFT : {BC10864D-2B34-408F-912A-102B1B867B6C}

Analysis complete... [press ENTER]

Any help is appreciated.