Software Archive
Read-only legacy content
17061 Discussions

Face Tracking not working accurately Unity3D using F200

Abdul_A_
Beginner
648 Views

I have been using RealSense Camera(F200) using Unity3D(5.3.1f1) and samples works good except one i.e., Face Tracking Sample (Sample3 - AR Mirror). The face components position changes everytime i play the scene. This is default scene without any external changes. I tried changing position vectors in script but in vain. The components rearrange on enabling the calibration script occasionally. I have also been following the recommended range that is about 30-60cm. Some of the sample test images when i tested for reference. Any help or suggestions are appreciated

http://i.imgur.com/UCrT7z2.png?1

http://i.imgur.com/iUqkaws.png?1

http://i.imgur.com/glPgzOt.png?1

0 Kudos
5 Replies
baolin_s_
Beginner
648 Views

i have the same issue, though sometime it works fine ... 

 

0 Kudos
Lucas_M_2
Beginner
648 Views

Hey Abdul and Baolin,
it seems to me that the cause of your problem is a mirroring issue, as covered by Jacob Pennock on this video:

https://youtu.be/Fj6INtg7VFs?t=48 

Hope this solution works for you guys!

0 Kudos
baolin_s_
Beginner
648 Views

Thanks Lucas, it's good to know such good video tutorials, but it doesn't solve my problem. My issue with this AR Mirror example is that when it augments my face and hands with 3d objects, there's a quite big offset between what it tracks (e.g. eye, mouth etc) and the 3d object. On the other hand, the problem above video solves is to fix the mirroring image in unity and I believe that's why inverting x transform fix it. Any thought on this offset issue?

Thanks for ur help!

-BS 

 

0 Kudos
Lucas_M_2
Beginner
648 Views

It may not suit your purposes, but a work around this problem might be using alternative hand tracking modes. Have you tried that? 
Reference: https://www.youtube.com/watch?v=D_8YvdvRZKI

As for the face tracking, it is very odd this offset, I'll keep trying to think on a solution for it...

@EDIT
I noticed that the face tracking object changes it's position according to your face position on the real world.
I played the scene several times, positioning my head on different positions and angles, the camera gets your landmark angles on scene start, so if you position your head wrong, it will get an offset. 
It's not ideal to ask for the user to position his head perfectly synched with the camera, as F200's should be able to detect user's landmark accordingly.

0 Kudos
baolin_s_
Beginner
648 Views

Many thanks Lucas!! Indeed the offset issue is somehow related with the initial position/direction of my head, but I'm not even able to figure out how it is related ... However after I set the resolution to full HD as suggested by Jacob in his video, things turn out to be better ... Not sure whether it's just I'm lucky this morning ... It would be great to get to the bottom of this and I will keep trying :-). Let me know if you get anything. 

-BS

0 Kudos
Reply