Items with no label
3335 Discussions

Gaze tracking with the Intel realsense

ARich1
Beginner
4,848 Views

Hello,

I need to get the position of the gaze on the screen.

I'm using an Intel realsense D415. I have already implement the eye like code (https://github.com/trishume/eyeLike GitHub - trishume/eyeLike: A webcam based pupil tracking implementation. ) to have the eye and the pupil tracking in C++. But now, I don't know how to get the gaze position and do the gaze tracking.

Does someone have some experience on it?

Thanks in advance,

Adèle

0 Kudos
1 Solution
MartyG
Honored Contributor III
3,047 Views

I researched your question very carefully and located an open-source eye tracking system called PyGaze that is based on the Python language. RealSense SDK 2.0 has Python integration via a wrapper program, so you may be able to link eye tracking to your D415 camera that way.

http://www.pygaze.org/ PyGaze | Open source eye-tracking software and more.

View solution in original post

0 Kudos
6 Replies
MartyG
Honored Contributor III
3,048 Views

I researched your question very carefully and located an open-source eye tracking system called PyGaze that is based on the Python language. RealSense SDK 2.0 has Python integration via a wrapper program, so you may be able to link eye tracking to your D415 camera that way.

http://www.pygaze.org/ PyGaze | Open source eye-tracking software and more.

0 Kudos
ARich1
Beginner
3,047 Views

Thank you for your research. I will try to see what I get with PyGaze.

Is there anyway to do it in C++ ? Because all my application has to be on QT.

0 Kudos
MartyG
Honored Contributor III
3,047 Views

There was a program with gaze tracking called 3D Eye Tracker created a couple of years ago that uses C++ and OpenCV. It is distributed under an MIT licence, meaning you can modify it however you want so long as you keep the copyright message in the project.

https://github.com/YutaItoh/3D-Eye-Tracker GitHub - YutaItoh/3D-Eye-Tracker

0 Kudos
Eyeware
Beginner
2,042 Views

@ARich1  Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.

 

0 Kudos
RIgna1
Beginner
3,047 Views

 

Hi Adèle, we've developed a commercial software called GazeSense (www.eyeware.tech/gazesense) that might help you using the D415 as an eye tracker. GazeSense is officially supported by the Intel RealSense independent software vendor page. Please have a look at our product page and let me know if you have any questions.

0 Kudos
Eyeware
Beginner
2,042 Views

Hi Adèle,

Eyeware (eyeware.tech) is the official eye-tracking solution provider for Intel RealSense cameras. Please have a look at the Intel RealSense developers page under the segment eye tracking.

Our eye tracking SDK (GazeSense app and SDK) should help you get the gaze tracking data that you are looking for.

0 Kudos
Reply