Items with no label
3326 Discussions

Gaze tracking with the Intel realsense

ARich1
Beginner
3,125 Views

Hello,

I need to get the position of the gaze on the screen.

I'm using an Intel realsense D415. I have already implement the eye like code (https://github.com/trishume/eyeLike GitHub - trishume/eyeLike: A webcam based pupil tracking implementation. ) to have the eye and the pupil tracking in C++. But now, I don't know how to get the gaze position and do the gaze tracking.

Does someone have some experience on it?

Thanks in advance,

Adèle

0 Kudos
1 Solution
MartyG
Honored Contributor III
1,324 Views

I researched your question very carefully and located an open-source eye tracking system called PyGaze that is based on the Python language. RealSense SDK 2.0 has Python integration via a wrapper program, so you may be able to link eye tracking to your D415 camera that way.

http://www.pygaze.org/ PyGaze | Open source eye-tracking software and more.

View solution in original post

6 Replies
MartyG
Honored Contributor III
1,325 Views

I researched your question very carefully and located an open-source eye tracking system called PyGaze that is based on the Python language. RealSense SDK 2.0 has Python integration via a wrapper program, so you may be able to link eye tracking to your D415 camera that way.

http://www.pygaze.org/ PyGaze | Open source eye-tracking software and more.

ARich1
Beginner
1,324 Views

Thank you for your research. I will try to see what I get with PyGaze.

Is there anyway to do it in C++ ? Because all my application has to be on QT.

MartyG
Honored Contributor III
1,324 Views

There was a program with gaze tracking called 3D Eye Tracker created a couple of years ago that uses C++ and OpenCV. It is distributed under an MIT licence, meaning you can modify it however you want so long as you keep the copyright message in the project.

https://github.com/YutaItoh/3D-Eye-Tracker GitHub - YutaItoh/3D-Eye-Tracker

Eyeware
Beginner
319 Views

@ARich1  Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.

 

RIgna1
Beginner
1,324 Views

 

Hi Adèle, we've developed a commercial software called GazeSense (www.eyeware.tech/gazesense) that might help you using the D415 as an eye tracker. GazeSense is officially supported by the Intel RealSense independent software vendor page. Please have a look at our product page and let me know if you have any questions.

Eyeware
Beginner
319 Views

Hi Adèle,

Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.

Reply