Can gaze tracking be done in C# using Intel realsense SR300?

[Phk]

I am trying to do gaze configuration and tracking using Intel realsense SR300 camera. So ya, I am just wondering if it can be done using C# in visual studio?....or Unity?

[MartyG · Accepted solution]

The '2016 R2' version of RealSense comes with a pre-made C++ sample program called Eye Tracking that allows gaze tracking. There is not a C# version of this sample. Fortunately though, gaze tracking with C# is supported, and there is a documentation page with a script for creating your own test program.

https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_face_gaze_tracking_data.html https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_face_gaze_track…

If you are also interested in the C++ sample (which comes with the source code so that you can modify it for your own needs), you can find it in the Sample Browser application, which is loaded by going to the 'Intel RealSense SDK Gold' folder on your desktop (placed there when '2016 R2' is installed) and running the 'Sample Browser' program. The Eye Tracking sample is in the SR300 section of the Browser, or you can find it faster by typing 'eye tracking' into the Browser's search box.

Regarding Unity: it is very easy to create a gaze tracking application using the pre-made 'TrackingAction' script that comes with the '2016 R2' SDK's Unity Toolkit. This enables you to set up a gaze tracking application without programming knowledge, just by defining menu settings.

You can find out more about using RealSense with Unity, including the use of TrackingAction and other types of pre-made 'Action' script, by browsing the wide range of step by step how-to guides that I have created for it.

https://software.intel.com/en-us/forums/realsense/topic/676139 Index of Marty G's RealSense Unity How-To Guides

[Phk]

Hi, Thanks for the reply. I have tried clicking the links you just provide. However, the pop-ups say that "For security reasons, I am not allowed to view the links". Can you help me to view those links in some ways?

[MartyG]

Oh yes, sorry. Intel are doing some work on their website. They should start restoring access to the links today.

In the meantime, I will provide the links in plain text that you can copy and paste into a browser window instead of clicking on them. They should open then.

software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_face_gaze_tracking_data.html

software.intel.com/en-us/forums/realsense/topic/676139

[Phk]

Oh, okay, thanks a lot, mate.

[idata]

Hey MartyG do you think it makes sense to develop with the dicontinued sdks (2016 R2 / R3)? I came across this statement from Intel (post 37) about sdk support on windows 10. Now i am confused wether it is a good idea to use modules of the old sdk's or wait for similiar ones in the sdk 2.0. Or just try writing my own with openCV (EmguCV for C# ).

[MartyG]

The new SDK 2.0 uses the same Windows camera drivers as the previous R2 and R3 SDKs, so using 2.0 will not make a difference to the camera's functionality if you are already having driver-related problems with it when using the camera with Windows 10.

I would though recommend looking into transitioning to the new SDK 2.0, simply because the old ones will no longer receive updates.

[Phk]

Where can I check the new SDK 2.0 you were talking about?

[MartyG]

New releases and download links appear on this page. So you can keep checking it for the latest versions with new features and fixes.

https://github.com/IntelRealSense/librealsense/releases/ Releases · IntelRealSense/librealsense · GitHub