topic Hello, in Software Archive

RealSense SDK for Depth Information

Shrutish_R_ — Wed, 05 Oct 2016 10:52:54 GMT

Hello,

Is there an updated SDK for getting the depth information (distance) of each pixels in an image ? I am using Intel RealSense SR300. Please Help !

I am using C# sdk .I would

Shrutish_R_ — Wed, 05 Oct 2016 12:10:02 GMT

I am using C# sdk .I would like to stream in depth mode and get for every sample the depth of each pixel in my image.

Assuming you already have a

jb455 — Wed, 05 Oct 2016 15:10:22 GMT

Assuming you already have a depth image, this code gives you an array of depth values (rounded to the nearest mm) the size of the depth image:

dImage.AcquireAccess(PXCMImage.Access.ACCESS_READ, PXCMImage.PixelFormat.PIXEL_FORMAT_DEPTH, out ddata);
dwidth = dImage.info.width;
var dheight = dImage.info.height;
dpitch = dwidth; //(int)(mdata.pitches[0] / 2.0);
Get the depth values:
dPixels = ddata.ToShortArray(0, dwidth * dheight);
dImage.ReleaseAccess(mdata);
dImage.Dispose();

So if you want the depth for a specific pixel, say (u, v), it'll be dPixels[v * dpitch + u]

Hello,

Shrutish_R_ — Thu, 06 Oct 2016 07:01:41 GMT

Hello,

I am actually new for the C# . All I want is to get the depth information of each pixels for further processing. Which is the best Framework Sample sources in C# (Provided in the SDK) can be used for getting the data.? Also it would of great help if the code was provided.

Thank you in advance.

The Raw Streams sample is a

jb455 — Thu, 06 Oct 2016 09:42:00 GMT

The Raw Streams sample is a good place to start if you want to learn how it all works.

Be aware, if you want to get depth data for points in the colour image, you'll have to map between the colour and depth images as the two cameras point to different locations and have different fields of view etc. Search the docs and this forum for 'projection' and there's information on most use cases.

Thank you James .But I tried

Shrutish_R_ — Mon, 10 Oct 2016 08:06:16 GMT

Thank you James .But I tried retrieving the data. Was not able to do so . It would be of a great help if you could provide the code for getting the depth data(in mm) of each pixels and storing it in an array using the Raw Streams Sample .

What have you tried doing?

jb455 — Mon, 10 Oct 2016 08:37:09 GMT

What have you tried doing?

If you look at the Raw Streams code, in the main camera streaming loop there's sample = sm.QuerySample(). If you have enabled a depth stream, the depth image (called dImage in my code above) is contained within this sample object (ie, sample.depth).

Is there a definition or a

Shrutish_R_ — Mon, 10 Oct 2016 12:34:05 GMT

Is there a definition or a method for the "AcquireAccess " in the SR300 SDK ?

Have you tried looking in the

jb455 — Tue, 11 Oct 2016 08:15:04 GMT

Have you tried looking in the documentation?

Hai James,

Shrutish_R_ — Tue, 11 Oct 2016 09:01:23 GMT

Hai James,

I tried doing this . Is it possible to get the depth data of each pixels now ?
thank you in advance.

private void button1_Click(object sender, EventArgs e)
{

            PXCMPoint3DF32[] mDepthPoints;
            short[] mDepthBuffer;
            mDepthBuffer = new short[640 * 480];
            mDepthPoints = new PXCMPoint3DF32[640 * 480];

// Create a SenseManager instance

PXCMSenseManager sm = PXCMSenseManager.CreateInstance();

// Select the color and depth streams
sm.EnableStream(PXCMCapture.StreamType.STREAM_TYPE_DEPTH, 320, 240, 30);

// Initialize and Stream Samples

sm.Init();

for (; ; )
{

// This function blocks until both samples are ready

if (sm.AcquireFrame(true).IsError()) break;

// retrieve the samples

PXCMCapture.Sample sample = sm.QuerySample();

if (sample.depth != null)
{

                    PXCMImage.ImageData ddata = new PXCMImage.ImageData();
                    sample.depth.AcquireAccess(PXCMImage.Access.ACCESS_READ, PXCMImage.PixelFormat.PIXEL_FORMAT_DEPTH, out ddata);
                    mDepthBuffer = ddata.ToShortArray(0, mDepthBuffer);

                    int dID = 0;
                    for (int dy = 0; dy < 480; ++dy)
                    {
                        for (int dx = 0; dx < 640; dx++)
                        {
                            PXCMPoint3DF32 dPoint = new PXCMPoint3DF32();
                            dPoint.x = dx;
                            dPoint.y = dy;
                            dPoint.z = (float)mDepthBuffer[dID];
                            mDepthPoints[dID] = dPoint;
                            ++dID;

                        }
                    }

                    sample.depth.ReleaseAccess(ddata);
                }
               // get next samples

sm.ReleaseFrame();

            }
            //release the frame
            sm.Dispose();

}

That looks about right -

jb455 — Tue, 11 Oct 2016 09:16:29 GMT

That looks about right - mDepthBuffer should contain the depth of each pixel in the depth image. Is that not what you wanted?

Hi James, Thank you.

Shrutish_R_ — Tue, 11 Oct 2016 09:44:00 GMT

Hi James, Thank you.
, Yes, This is what I was looking for . But Since I am using the loop , getting the data out is very slow ! any other ideas for this problem ??|

Do you need all the depth

jb455 — Tue, 11 Oct 2016 10:18:58 GMT

Do you need all the depth pixels every frame? Could you do it every 10th frame or something instead? Also your loop to convert the depth points to PXCMPoints is kinda pointless; if you need specific pixels you can use mDepthBuffer[v * 640 * u] to get the depth for (u,v) in the depth image.

Actually I need all the depth

Shrutish_R_ — Tue, 11 Oct 2016 10:52:37 GMT

Actually I need all the depth pixels of Just 1 frame.

Hi,

Shrutish_R_ — Thu, 13 Oct 2016 06:22:32 GMT

Hi,

Can anyone help me with this ? The below is the code for getting the depth data of each pixels. The depth data is available in " depthPixels "

However, printing the values to the console consumes lot of time. Is there any possible way I can do it ?
Thank you

private void button1_Click(object sender, EventArgs e)
{
// Create a SenseManager instance

PXCMSenseManager sm = PXCMSenseManager.CreateInstance();

// Select the color and depth stream
sm.EnableStream(PXCMCapture.StreamType.STREAM_TYPE_DEPTH, 640, 480, 30);

// Initialize and Stream Samples

sm.Init();

for (; ; )
{

                // This function blocks until both samples are ready
                sm.AcquireFrame(true);
                if (sm.AcquireFrame(true).IsError()) break;

// retrieve the samples

PXCMCapture.Sample photo = sm.QuerySample();
PXCMImage depth = photo.depth;

                PXCMImage.ImageData ddata;
                depth.AcquireAccess(PXCMImage.Access.ACCESS_READ, PXCMImage.PixelFormat.PIXEL_FORMAT_DEPTH, out ddata);
                var dwidth = depth.info.width;
                var dheight = depth.info.height;
                var depthPixels = ddata.ToShortArray(0, dwidth * dheight);
                depth.ReleaseAccess(ddata);
                depth.Dispose();
                sm.ReleaseFrame();

// getting each element from the array
                foreach (int i in depthPixels)
                {
                    System.Console.Write(i);
                }

}

What have you tried doing?

Alex_P_5 — Mon, 17 Oct 2016 10:28:52 GMT

What have you tried doing?

You said in your previous

jb455 — Mon, 17 Oct 2016 11:43:30 GMT

You said in your previous reply that you only need the depth data in one frame. Do you have a button or something in your UI which sets a bool to tell the camera that "this is the frame"? I'd suggest doing something like that and putting everything from "PXCMImage.ImageData ddata;" in an if statement based on the bool set by the UI.

Also, why do you want to write every pixel to the console? Will that actually be used by anyone? I don't know what the purpose of your app is but surely having 307,200 numbers written in the console isn't much use?

Hello.

Niyonsaba_E_ — Tue, 18 Oct 2016 07:48:59 GMT

Hello. I want just ask the accuracy of Intel RealSense camera F200 or SR300. With the same test environment, if you execute your code 2 times, you can get same depths of all pixels in the first time and second time. I tried for other depth camera as kinect but i got different distances for the same pixel and in the same environment. How about RealSense camera?

@Niyonsaba

Shrutish_R_ — Wed, 19 Oct 2016 06:03:00 GMT

@Niyonsaba

Hello,

I am using the RealSense SR300. Well, this camera gave me the "SAME" distance for the same pixel in the same environment when I executed the code 10 times ! SR300 has a very good accuracy.

@ James

Shrutish_R_ — Wed, 19 Oct 2016 06:07:07 GMT

@ James

Hello,

Yes. I have a button in my UI. I want the depth information of each pixels to be written to an excel sheet as this data is used by someone for further processing. So, before storing these data to an excel , I just wanted to print these data to the console for my reference.

Now, It works perfectly fine. Thank you for the guidance.