3D User-Aware Eye Modeling for Accurate Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual and mixed reality systems rely on generic human eye models for gaze tracking and biometric authentication, which lack accuracy and user-specific adaptability, leading to suboptimal user experiences and design limitations.
Innovation Solution
An imaging system captures images of a user's eyes in multiple orientations and brightness levels to generate a user-aware eye model, eliminating the need for ground truth targets and utilizing dynamic pupil modeling for improved accuracy in gaze tracking and biometric authentication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If generic human eye models are used for gaze tracking and biometric authentication, then device complexity is reduced, but measurement precision and reliability deteriorate
Solution Approach 1:
The system performs preliminary enrollment by capturing images of the user's eye at multiple orientations and brightness levels before actual use. This preliminary action creates a customized eye model specific to each user, which is stored and used during subsequent gaze tracking and authentication operations, eliminating the need for complex real-time adjustments
Solution Approach 2:
The system captures eye images under varying parameters (different orientations and brightness levels) to build a comprehensive eye model. By collecting data across multiple parameter states during enrollment, the system creates a robust user-specific model that accurately represents eye behavior under diverse conditions, improving measurement precision without requiring complex real-time processing
2Ease of manufacture
If generic human eye models are used for gaze tracking and biometric authentication, then ease of manufacture is improved, but adaptability deteriorates
Solution Approach 1:
The system performs preliminary enrollment by capturing images of the user's eye at multiple orientations and brightness levels before actual use. This preliminary action creates a customized eye model specific to each user, which is stored and used during subsequent gaze tracking and authentication operations, eliminating the need for complex real-time adjustments
Solution Approach 2:
The system creates a digital copy or model of the user's specific eye characteristics through the enrollment process. This copied eye model, derived from multiple images taken at different orientations and brightness levels, replicates the user's unique eye geometry and optical properties, enabling high adaptability without requiring physical customization of the device
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The user-aware eye model enhances gaze tracking precision and biometric authentication by accurately modeling the user's cornea and pupil features, providing a better user experience and design flexibility.
Implementation Method 1
An imaging system may include two or more illumination sources (e.g., point light sources such as light-emitting diodes (LEDs)) that illuminate a person's eye or eye region, and at least one camera configured to capture images of light from the illumination sources reflected by the eye when illuminated
Data Source
AI summary
Methods and apparatus for generating user-aware eye models. During an enrollment process, images of a user's eye are captured by one or more cameras when the eye is in two or more different orientations and at two or more different levels of display brightness. The captured images are processed to generate a 3-dimensional, user-aware eye model, for example a model of at least the eye's cornea and pupil features. The generated user-aware eye model may be used in other processes, for example in a gaze tracking process. The enrollment process may be an iterative process to optimize the eye model, or a continuous process performed while the user is using the system.