topic Re: The depth quality get worse in the edge of object in Items with no label

The depth quality get worse in the edge of object

zting1 — Sat, 13 Apr 2019 21:23:59 GMT

Hello,

As the issue I open in the github said , The depth quality get worse in the edge of object. I have applied the spatial filter and the temporal filter.

The preset I use is the ShortRangePreset.json. How can I better the point cloud? or Is it the hardware problem?

Re: The depth quality get worse in the edge of object

MartyG — Sat, 13 Apr 2019 22:09:50 GMT

If you use the RealSense Viewer in its 2D mode and observe that you have a broken-up left edge on your image, that could indicate that your problem is due to an 'invalid depth band'.

Page 58 and 59 of the current edition of the data sheet document for the 400 Series cameras have details of this phenomenon.

https://www.intel.co.uk/content/www/uk/en/support/articles/000026827/emerging-technologies/intel-realsense-technology.html

Re: The depth quality get worse in the edge of object

zting1 — Sun, 14 Apr 2019 10:31:04 GMT

Hello,

As the 2D mode image show, the invalid depth band has been removed from the depth image. And the banana is almost in the center of image, It is far from the invalid depth band. And the edge that depth quality get worse is horizontal, the edge of worse depth quality is in the horizontal direction as I draw in the image below:

So I think it's not caused by the invalid depth band. What do you think？

Re: The depth quality get worse in the edge of object

MartyG — Sun, 14 Apr 2019 13:59:07 GMT

There was a past case of loss of edge detail when scanning tomatoes to get a colored point cloud. The image below was taken in a greenhouse with fully natural light.

Your point cloud image of the banana on the GitHub displays the same characteristics as the tomatoes at its edges.

Could you try the 'Default' preset please if you have not done so already to see if you get better results in the side-on view. This preset has "best visual appeal, clean edges and reduced pointcloud spraying"

https://github.com/IntelRealSense/librealsense/wiki/D400-Series-Visual-Presets#preset-table

Re: The depth quality get worse in the edge of object

zting1 — Sun, 14 Apr 2019 15:10:49 GMT

Hello,

I have tested the default preset, but the result is almost equal to the shortRangePreset.

Re: The depth quality get worse in the edge of object

MartyG — Sun, 14 Apr 2019 15:45:20 GMT

Page 3, figure 2 of Intel's post-processing white paper document says that although a post-processing filter that provides smoothing can smooth out edges, it can also cause the edges to become elongated, rounded or overshoot.

https://www.intel.com/content/www/us/en/support/articles/000028866/emerging-technologies/intel-realsense-technology.html

What is the image like with post-processing turned off, please?

Re: The depth quality get worse in the edge of object

zting1 — Sun, 14 Apr 2019 16:45:22 GMT

I test the rs-pointcloud example of relsense sdk. This example have no post-processing, the result is below:

Re: The depth quality get worse in the edge of object

MartyG — Sun, 14 Apr 2019 17:17:31 GMT

It is easier in that image to see the elongation effect that you described, because you can see more of the banana. Thank you very much. The wave effect seems similar to one in the link below. Like in your case, the effect is particularly strong in the side view.

https://github.com/intel-ros/realsense/issues/507

I have not dealt with cases involving this particular effect, so I am not sure what to advise. One of the Intel support team may be able to offer useful insight when they return on Monday. I do apologize for the wait in the meantime.

Re: The depth quality get worse in the edge of object

zting1 — Sun, 14 Apr 2019 18:36:21 GMT

Thanks for your patient help!

Re: The depth quality get worse in the edge of object

zting1 — Tue, 16 Apr 2019 09:35:32 GMT

Is there any update?

Re: The depth quality get worse in the edge of object

Eliza_D_Intel — Wed, 17 Apr 2019 18:55:27 GMT

Hello zting1, Could you please provide us the answer to the below questions? 1. How far away is your object from the camera? Please keep in mind that the farther an object is from the camera, the less accurate the depth data. From the BKMs for tuning: "The depth error scales as the square of the distance away. So where at all possible, try to get as close to the object as possible, but not so close that you are within the minimum operating distance, the MinZ" This will improve depth quality at the edges of the object. 2. What resolution are you streaming at? The optimal resolution is 848x480 at 30 fps. Thank you and best regards, Eliza

Re: The depth quality get worse in the edge of object

zting1 — Thu, 18 Apr 2019 19:46:58 GMT

Hello Eliza,

The distance is 0.85 meter on average.

The resolution is 848x480 at 30fps.

Regards,

Tingda

Re: The depth quality get worse in the edge of object

Sahira_Intel — Sat, 20 Apr 2019 04:45:00 GMT

Hi Tingda, Thanks for your patience! This might be expected behavior with the D435, but let me try a few things in the lab and get back to you. In the meantime, does moving the camera closer or farther to the object have any impact on the edges of the object? Best Regards, Sahira

Re: The depth quality get worse in the edge of object

zting1 — Mon, 22 Apr 2019 20:18:50 GMT

Hello Sahira

It is the problem of distance. When I get closer to the banana(approximate 0.48m), the depth quality better a lot as the image below show:

The image that the distance from object to camera is approximately 0.85m is showed below :

Is it mean the D400 series is not suit for slam on a mobile platform?

Re: The depth quality get worse in the edge of object

Sahira_Intel — Wed, 24 Apr 2019 04:24:00 GMT

Hi Zhuang, If you're trying to use SLAM, other RealSense users have been able to use ORBSLAM2 with the D435. Otherwise, the best option for SLAM projects is the RealSense T265. I hope this was helpful! Best Regards, Sahira

Re: The depth quality get worse in the edge of object

zting1 — Wed, 24 Apr 2019 12:30:44 GMT

Hi Sahira,

In my perspective, the T265 is suit for Localization, but not for mapping.

Regards,

Tingda