3D Gaze Estimation Headset Using Eye and Scene Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaze tracking technologies are limited by high costs and proprietary nature, and they primarily provide 2D point of gaze estimation, which is not applicable to 3D environments, hindering their use in mobile applications and human-robot interaction.
Innovation Solution
A wearable headset system integrating an eye tracking camera and an RGB-D scene camera to estimate 3D point of gaze by combining pupil tracking algorithms with 3D processing and computer vision techniques, allowing for accurate identification of objects in the user's visual field.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If commercial eye tracking equipment is used, then measurement precision is improved, but cost increases
Solution Approach 1:
The patent replaces expensive commercial eye tracking equipment with inexpensive off-the-shelf components including a standard USB camera, infrared LED, and open-source software algorithms. This substitution achieves acceptable gaze tracking precision while dramatically reducing hardware costs, making the system accessible for widespread use in mobile and assistive applications.
Solution Approach 2:
The patent uses open-source software implementations that replicate the functionality of proprietary gaze tracking algorithms. By copying and adapting publicly available algorithms rather than relying on proprietary software, the system achieves comparable measurement precision without the associated licensing costs and proprietary restrictions.
2Device complexity
If 2D point of gaze estimation is used, then device complexity is reduced, but adaptability to 3D environments deteriorates
Solution Approach 1:
The patent transitions from 2D gaze estimation to 3D point of gaze estimation by incorporating depth information from an RGB-D camera. This dimensional enhancement allows the system to accurately track gaze in three-dimensional space, enabling applications in virtual reality, augmented reality, and mobile environments where objects and users occupy 3D space, while maintaining reasonable system complexity through efficient algorithms.
3Quantity of substance
If low-cost off-the-shelf components are used, then cost is reduced, but measurement precision deteriorates
Solution Approach 1:
The patent combines multiple inexpensive components—an eye tracking camera, infrared LED illumination, RGB-D scene camera, and open-source processing software—into an integrated system. The synergistic combination of these components compensates for the limitations of individual low-cost parts, achieving measurement precision comparable to commercial systems while maintaining low overall cost.
Solution Approach 2:
The patent replaces complex mechanical or proprietary optical systems with software-based processing of images from standard cameras. By using computer vision algorithms to extract gaze information from camera images rather than relying on specialized optical hardware, the system achieves high measurement precision using inexpensive off-the-shelf components.
4Measurement precision
If proprietary eye tracking systems are used, then measurement precision is improved, but ease of operation deteriorates
Solution Approach 1:
The patent employs open-source software that can be freely downloaded, installed, and modified by users without requiring proprietary licenses or specialized training. The system includes comprehensive documentation and calibration procedures that enable users to independently operate and customize the gaze tracking software, greatly improving ease of operation while maintaining measurement precision through robust algorithms.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides accurate 3D point of gaze estimation and object identification, enhancing interactive experiences in 3D environments and facilitating the development of intelligent human spaces by integrating eye tracking with environmental data modalities.
Implementation Method 1
The illumination source may be an infrared light emitting diode
Implementation Method 2
tracking the movements of a user's eye, wherein the illumination source illuminates the user's eye
Data Source
AI summary
An apparatus, system, and method for a mobile, low-cost headset for 3D point of gaze estimation. A point of gaze apparatus may include an eye tracking camera configured to track the movements of a user's eye and a scene camera configured to create a three-dimensional image and a two-dimensional image in the direction of the user's gaze. The point of gaze apparatus may include an image processing module configured to identify a point of gaze of the user and identify an object located at the user's point of gaze by using information from the eye tracking camera and the scene camera.