Items with no label
3335 Discussions

Does realsense d435 support face gesture recognition

schau9
Beginner
7,381 Views

Hi, I have purchased RealSense D435 currently I am looking to use it with Unity for Gesture Recognition but I am unable to Detect any gesture is there any new SDK which can support face gesture recognition and if it is not yet so when the Intel is going to publish it.

0 Kudos
5 Replies
MartyG
Honored Contributor III
4,314 Views

At present, the RealSense SDK 2.0 needs to be combined with other software platforms such as OpenCV in order to achieve features such as face recognition. SDK 2.0 is a continually evolving product though, so it is possible that a more user-friendly 'middleware' solution from a developer may emerge at some point. In the meantime, OpenCv would be your best option for integrating face detection into your D435 project.

This discussion may be of interest to you:

SDK 2.0's Unity support is also in an early stage. At the moment, its main feature is to stream textures into Unity using the camera. Other features are sure to be added as SDK 2.0's development progresses.

https://github.com/IntelRealSense/librealsense/tree/development/wrappers/unity librealsense/wrappers/unity at development · IntelRealSense/librealsense · GitHub

0 Kudos
schau9
Beginner
4,314 Views

I don't want to use OpenCV it is not accurate as much as i want is there any other option or when sdk will support face detection.

and can i use d435 for background segmentation if yes so how because i am not finding any help for this.

0 Kudos
MartyG
Honored Contributor III
4,314 Views

OpenCV face detection, or ROS software that incorporates OpenCV face detection, is currently the most reliable means of performing face-related activities with the D435.

There is a program called TouchDesigner that can be used to integrate RealSense face tracking into an application with an easy user interface. I believe it only has finger-based gestures though, and it was designed for previous generations of RealSense camera. So it may not work with the D435 model, but it least has a free non-commercial version to download so that you can try it without losing money.

https://www.derivative.ca/wiki088/index.php?title=RealSense RealSense - TouchDesigner 088 Wiki

http://www.derivative.ca/wiki088/index.php?title=TouchDesigner_Non-Commercial TouchDesigner Non-Commercial - TouchDesigner 088 Wiki

0 Kudos
schau9
Beginner
4,314 Views

yesterday i tried opencv but i did not got good result, and please tell me how to use d435 for background segmentation in unity currently i am unable to find any solution regarding this.

0 Kudos
MartyG
Honored Contributor III
4,314 Views

The Unity page that I linked to provides details on how to do background segmentation via a script called AlignImages. The page says: "An example usage of this script is to perform background segmentation between depth and color images by turning each colored pixel that is not within the given range into a grayscale pixel."

https://github.com/IntelRealSense/librealsense/tree/development/wrappers/unity librealsense/wrappers/unity at development · IntelRealSense/librealsense · GitHub

0 Kudos
Reply