Whilst RealSense does not have full-body skeletal tracking, you can simulate it with hand / face landmark tracking if you think carefully about how the human body moves (though with the R200, you would be limited only to using face tracking).
For example, in my RealSense-powered full body avatar in Unity, the waist bends / rises and the knee joints bend / unbend when the user's head is lowered or raised. This simulates how a person's head dips when crouching or looking towards the ground.
With the F200 camera's hand tracking meanwhile, I was able to develop full elbow and shoulder control as well as hand control using a process of reverse-thinking. Instead of thinking about how the shoulder and elbow joints moved - because RealSense does not track those joints - I thought about how those arm parts are moving when the hand is moved.
For example, when the hand is lifted, both the lower and upper arm lift too, though at different speeds (the upper arm lifting faster than the lower one). So through a combination of movement constraints, inverts and weighting in the TrackingAction script supplied with the SDK's Unity implementation of RealSense, I was able to create a realistic arm with the full range of up-down and left-right movement of a real human arm, just by tracking the hand joints..
The F200's hand tracking can also recognize the knee, foot and toe joints, treating them as though they are a hand palm and finger joints.
Link Copied
Whilst RealSense does not have full-body skeletal tracking, you can simulate it with hand / face landmark tracking if you think carefully about how the human body moves (though with the R200, you would be limited only to using face tracking).
For example, in my RealSense-powered full body avatar in Unity, the waist bends / rises and the knee joints bend / unbend when the user's head is lowered or raised. This simulates how a person's head dips when crouching or looking towards the ground.
With the F200 camera's hand tracking meanwhile, I was able to develop full elbow and shoulder control as well as hand control using a process of reverse-thinking. Instead of thinking about how the shoulder and elbow joints moved - because RealSense does not track those joints - I thought about how those arm parts are moving when the hand is moved.
For example, when the hand is lifted, both the lower and upper arm lift too, though at different speeds (the upper arm lifting faster than the lower one). So through a combination of movement constraints, inverts and weighting in the TrackingAction script supplied with the SDK's Unity implementation of RealSense, I was able to create a realistic arm with the full range of up-down and left-right movement of a real human arm, just by tracking the hand joints..
The F200's hand tracking can also recognize the knee, foot and toe joints, treating them as though they are a hand palm and finger joints.
