RealSence Integration with VR

[Ankit_V_]

Hi, We were planing to integrated RealSence technology with VR (like oculus VR gera). Th idea behind is that user will be viewing through VR gear and its gesture will be providing access to the cation that he will be performing in that virtual environment. We are more queries to know the intractability factor of this RealSence technology so that it can be utilized in more fluent way.

[Jonathan_M_Intel]

Can you be more specific in your questions?

There are several ways to integrate RealSense with head-mounted displays.  One way is to mount the camera directly onto the headset, facing outwards, and utilizing the depth or gesture information detected.  This method may be challenging to implement for the F200 camera, because of its maximum depth limitation (around 4 feet), and certain libraries may need to be adapted because the hands are being viewed from the rear instead of from their front (may need to swap left/right handedness of the gesture library results).

The other option is to mount the camera facing the user as you normally would.  This will ensure best detection from the gesture libraries, but limits mobility of the user (they must keep their hands within 4 feet of the F200 camera for detection).

[Ankit_V_]

I am more curious toward the second option, mount the camera facing the user. 

The aim is to create a virtual environment where user uses its gesture to communicate to virtual world. Basically user will be having a VR gear mounted on his head which is giving him a feel of a virtual world or a simulate. We are interested in controlling the simulation using the gesture of the user and for doing so we are thinking to use Intel RealSence. 

Basically the gesture will be acting like a input and will be tracked and based on those action of the hands the VR will be running the simulation.

[samontab]

That's actually similar to one idea I had the other day. It would be very nice to be able to see your own hands and body, etc, on the HMD while you are actually watching your hands, body, etc. This would add a lot to the immersion of the VR experience. It is definitely possible to do something like this, and this camera is perfect because it would only need to sense at close distances (less than a meter).