topic Re: Visible image and infrared image registration in Items with no label

Visible image and infrared image registration

idata — Thu, 30 Aug 2018 11:23:28 GMT

I got visible and infrared images of the same resolution using sr300, but I found that the two images have different ranges, and the target has a different image ratio. I want to merge the two images. How can I proceed?

Re: Visible image and infrared image registration

MartyG — Thu, 30 Aug 2018 12:14:56 GMT

RealSense cameras align between depth and some other stream. So I do not believe you would be able to align IR to color. It would have to be depth to color.

In the '2016 R2' SDK, you may be able to do such an operation with the script in the link below:

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_essential_aligned_capturing.html Intel® RealSense™ SDK 2016 R2 Documentation

In the current RealSense SDK 2.0, which is compatible with SR300, there is an Align sample program.

https://github.com/IntelRealSense/librealsense/tree/master/examples/align librealsense/examples/align at master · IntelRealSense/librealsense · GitHub

When the SR300 is used with RealSense SDK 2.0, depth images are always pixel-aligned with IR images, and the depth and IR images have identical intrinsics.

https://github.com/IntelRealSense/librealsense/wiki/Projection-in-RealSense-SDK-2.0# sr300 Projection in RealSense SDK 2.0 · IntelRealSense/librealsense Wiki · GitHub

Re: Visible image and infrared image registration

idata — Thu, 30 Aug 2018 13:03:28 GMT

So you mean that we can't align color and infrared images?

Do you know how to get aligned? Thank you！

Re: Visible image and infrared image registration

MartyG — Thu, 30 Aug 2018 13:13:43 GMT

Although alignment to depth is the method supported by RealSense, a member of Intel's GitHub support team for RealSense offered an approach to try if you really need to find a way to align IR to color.

https://github.com/IntelRealSense/librealsense/issues/1556# issuecomment-389061477 Align infrared frame to color · Issue # 1556 · IntelRealSense/librealsense · GitHub

Re: Visible image and infrared image registration

idata — Thu, 30 Aug 2018 13:36:30 GMT

Do you know other methods? This seems to be a bit problematic. Thank you very much!

Re: Visible image and infrared image registration

MartyG — Thu, 30 Aug 2018 14:03:02 GMT

I researched your question extensively, but everyone everywhere agrees that aligning to depth rather than IR is the appropriate method. There was no alternative to the workaround suggested by Intel's support member that could be found.

Re: Visible image and infrared image registration

idata — Fri, 31 Aug 2018 01:10:41 GMT

Thank you very much!

Re: Visible image and infrared image registration

GYuen — Fri, 08 May 2020 21:55:22 GMT

Hi Marty

We need to align infrared to RGB in the SR305, but found the size of image for ir is much smaller (although both at 640x480), while the depth is same as the RGB,

this means the infrared is certainly not aligned pixel by pixel (it is also offset, see attached), any tips would be much appreciated.

We tried using the difference in POV for ir and RGB and do inverse trigonometry this gets the sizes closer, but we only have the POV for 1920x1080, what POV I should use for the RGB camera for 640x480 ?

thanks a lot,

Geoff

Re: Visible image and infrared image registration

MartyG — Fri, 08 May 2020 22:12:04 GMT

@GYuen Usually, depth is aligned to color or to IR, but depth must be one of the stream types in alignment (and there is not support in the SDK for aligning color to IR).

I hope that the link below will be helpful to you, as it aligns all three stream types.

https://github.com/IntelRealSense/librealsense/issues/5093

Palm or hand print matching by SR300 / 305

GYuen — Sat, 04 Jul 2020 14:57:56 GMT

Hi Marty

Are you aware of anyone using the SR300/SR305 to 'read' the palm/hand print for identification ?

Could be using NIR ...

thanks

Geoff