Items with no label
3335 Discussions

The depth quality get worse in the edge of object

zting1
New Contributor I
1,589 Views

Hello,

As the issue I open in the github said , The depth quality get worse in the edge of object. I have applied the spatial filter and the temporal filter.

The preset I use is the ShortRangePreset.json. How can I better the point cloud? or Is it the hardware problem?

0 Kudos
15 Replies
MartyG
Honored Contributor III
986 Views

If you use the RealSense Viewer in its 2D mode and observe that you have a broken-up left edge on your image, that could indicate that your problem is due to an 'invalid depth band'.

 

1.png

 

Page 58 and 59 of the current edition of the data sheet document for the 400 Series cameras have details of this phenomenon.

 

https://www.intel.co.uk/content/www/uk/en/support/articles/000026827/emerging-technologies/intel-realsense-technology.html

 

0 Kudos
zting1
New Contributor I
986 Views

Hello,

As the 2D mode image show, the invalid depth band has been removed from the depth image. And the banana is almost in the center of image, It is far from the invalid depth band. And the edge that depth quality get worse is horizontal, the edge of worse depth quality is in the horizontal direction as I draw in the image below:

TIM图片20190414112918.jpg

So I think it's not caused by the invalid depth band. What do you think?

 

0 Kudos
MartyG
Honored Contributor III
986 Views

There was a past case of loss of edge detail when scanning tomatoes to get a colored point cloud. The image below was taken in a greenhouse with fully natural light.

 

1.png

Your point cloud image of the banana on the GitHub displays the same characteristics as the tomatoes at its edges.

 

3.png

 

Could you try the 'Default' preset please if you have not done so already to see if you get better results in the side-on view. This preset has "best visual appeal, clean edges and reduced pointcloud spraying"

 

https://github.com/IntelRealSense/librealsense/wiki/D400-Series-Visual-Presets#preset-table

0 Kudos
zting1
New Contributor I
986 Views

Hello,

I have tested the default preset, but the result is almost equal to the shortRangePreset.

0 Kudos
MartyG
Honored Contributor III
986 Views

Page 3, figure 2 of Intel's post-processing white paper document says that although a post-processing filter that provides smoothing can smooth out edges, it can also cause the edges to become elongated, rounded or overshoot.

 

https://www.intel.com/content/www/us/en/support/articles/000028866/emerging-technologies/intel-realsense-technology.html

 

What is the image like with post-processing turned off, please?

0 Kudos
zting1
New Contributor I
986 Views

I test the rs-pointcloud example of relsense sdk. This example have no post-processing, the result is below:

2019-04-14 17-41-55屏幕截图.png

0 Kudos
MartyG
Honored Contributor III
986 Views

It is easier in that image to see the elongation effect that you described, because you can see more of the banana. Thank you very much. The wave effect seems similar to one in the link below. Like in your case, the effect is particularly strong in the side view.

 

https://github.com/intel-ros/realsense/issues/507

 

I have not dealt with cases involving this particular effect, so I am not sure what to advise. One of the Intel support team may be able to offer useful insight when they return on Monday. I do apologize for the wait in the meantime.

 

0 Kudos
zting1
New Contributor I
986 Views

Thanks for your patient help!

0 Kudos
zting1
New Contributor I
986 Views

Is there any update?​

0 Kudos
Eliza_D_Intel
Employee
986 Views
Hello zting1, Could you please provide us the answer to the below questions? 1. How far away is your object from the camera? Please keep in mind that the farther an object is from the camera, the less accurate the depth data. From the BKMs for tuning: "The depth error scales as the square of the distance away. So where at all possible, try to get as close to the object as possible, but not so close that you are within the minimum operating distance, the MinZ" This will improve depth quality at the edges of the object. 2. What resolution are you streaming at? The optimal resolution is 848x480 at 30 fps. Thank you and best regards, Eliza
0 Kudos
zting1
New Contributor I
986 Views

Hello Eliza,

 

The distance is 0.85 meter on average.

 

The resolution is 848x480 at 30fps.

 

Regards,

Tingda

0 Kudos
Sahira_Intel
Moderator
986 Views
Hi Tingda, Thanks for your patience! This might be expected behavior with the D435, but let me try a few things in the lab and get back to you. In the meantime, does moving the camera closer or farther to the object have any impact on the edges of the object? Best Regards, Sahira
0 Kudos
zting1
New Contributor I
986 Views

Hello Sahira

It is the problem of distance. When I get closer to the banana(approximate 0.48m), the depth quality better a lot as the image below show:

2019-04-22 21-03-24屏幕截图.png

 

The image that the distance from object to camera is approximately 0.85m is showed below :

 2019-04-14 17-41-55屏幕截图.png

Is it mean the D400 series is not suit for slam on a mobile platform?

0 Kudos
Sahira_Intel
Moderator
986 Views
Hi Zhuang, If you're trying to use SLAM, other RealSense users have been able to use ORBSLAM2 with the D435. Otherwise, the best option for SLAM projects is the RealSense T265. I hope this was helpful! Best Regards, Sahira
0 Kudos
zting1
New Contributor I
986 Views

Hi Sahira,

 

In my perspective, the T265 is suit for Localization, but not for mapping.

 

Regards,

Tingda

0 Kudos
Reply