Items with no label
3341 Discussions

Jump detection using Intel realsense and unity

MMitt4
Beginner
2,152 Views

I want to know how to detect jump as a gesture in unity using Intel Realsense sensor. Please suggest some tutorials also if possible. Thanks in advance.

0 Kudos
1 Reply
MartyG
Honored Contributor III
1,574 Views

Getting Unity to recognize a camera-powered jump will not be straightforward, unfortunately. The link below has an article about how the problem of jump recognition in Unity was approached using a Kinect camera.

 

https://lightbuzz.com/jump-detection-kinect/

 

In that article, their detection is based on body joint position. To do that with a RealSense 400 Series camera, it would be necessary to use a software package called Nuitrack SDK, which fortunately is integrated very well with Unity and has test samples for it on the Unity Asset Store.

 

Nuitrack SDK

https://nuitrack.com/

 

Nuitrack on the Asset Store

https://assetstore.unity.com/packages/templates/packs/nuitrack-skeleton-tracking-127675

 

A user called Westa who is experienced in both Nuitrack and RealSense suggested an approach for creating a jumping gesture in Nuitrack.

 

https://community.nuitrack.com/t/how-to-update-new-gesture-in-nuitrack-gesturetype-sample-jump-gesture/505

 

In my own work with RealSense and Unity, the approach I took was to control a Unity object with camera inputs and trigger a jump action when lifting my real-world head up high (representing the action of making a physical effort to jump).

 

Edit: I thought it might be useful to show a practical example of jump detection with Kinect, in a Kinect launch game in 2010 called 'Sonic Free Riders'.

 

https://www.youtube.com/watch?v=f2yRBWW9rKc

0 Kudos
Reply