How to extract depth data from RawStreams app

[GGabr4]

Hi! My team's working on capturing 3D depth data using Intel Realsense R200. Our initial goal is to be able to extract the depth data. We're using the RawStreams app and the output file we're getting from it is in '.rssdk' format. We already tried the ClipEditor app but it still doesn't allow us to extract the depth data. How do you extract the depth data from RawStreams? And is there a way that we can also obtain the x,y,z coordinates? We need help.

[MartyG]

You can map real-world coordinates onto the depth using the instruction ProjectDepthToCamera.

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?projectdepthtocamera_pxcprojection.html Intel® RealSense™ SDK 2016 R2 Documentation

This link, meanwhile, demonstrates how to map the depth onto the color image..

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_essential_coordinates_mapping.html Intel® RealSense™ SDK 2016 R2 Documentation

Regarding getting the depth from the output: for R200 users, the main export alternative to an RSSDK file is to convert the RealSense SDK stream into a .MAT format file. You could use OpenCV to do this conversion with the RealSense SDK..

https://software.intel.com/en-us/forums/realsense/topic/538066 Use openCV with Intel Realsense SDK