Gaze tracking with the Intel realsense

[ARich1]

Hello,

I need to get the position of the gaze on the screen.

I'm using an Intel realsense D415. I have already implement the eye like code (https://github.com/trishume/eyeLike GitHub - trishume/eyeLike: A webcam based pupil tracking implementation. ) to have the eye and the pupil tracking in C++. But now, I don't know how to get the gaze position and do the gaze tracking.

Does someone have some experience on it?

Thanks in advance,

Adèle

[MartyG · Accepted solution]

I researched your question very carefully and located an open-source eye tracking system called PyGaze that is based on the Python language. RealSense SDK 2.0 has Python integration via a wrapper program, so you may be able to link eye tracking to your D415 camera that way.

http://www.pygaze.org/ PyGaze | Open source eye-tracking software and more.

[ARich1]

Thank you for your research. I will try to see what I get with PyGaze.

Is there anyway to do it in C++ ? Because all my application has to be on QT.

[MartyG]

There was a program with gaze tracking called 3D Eye Tracker created a couple of years ago that uses C++ and OpenCV. It is distributed under an MIT licence, meaning you can modify it however you want so long as you keep the copyright message in the project.

https://github.com/YutaItoh/3D-Eye-Tracker GitHub - YutaItoh/3D-Eye-Tracker

[Eyeware]

@ARich1  Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.

[RIgna1]

Hi Adèle, we've developed a commercial software called GazeSense (www.eyeware.tech/gazesense) that might help you using the D415 as an eye tracker. GazeSense is officially supported by the Intel RealSense independent software vendor page. Please have a look at our product page and let me know if you have any questions.

[Eyeware]

Hi Adèle,

Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.