Projection Point Alignment Using 3D Eye Tracking in AR Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality head-up display systems fail to accurately align projected information with the user's field of view due to fixed projection points, causing confusion when the user's eye position changes.
Innovation Solution
A system and method that integrates 3D eye tracking models to estimate the user's gaze direction and position, allowing the projection point to be dynamically adjusted to align with the user's eyes, using a combination of eyeball tracking, depth estimation, and gaze tracking models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the projection point is fixed at a certain point on the transparent display, then the device complexity is reduced, but the alignment accuracy between projected information and user's field of view deteriorates
Solution Approach 1:
The patent implements dynamic projection point adjustment based on real-time eye position detection. The system transitions from a fixed projection point to a dynamically adjustable one that moves according to the user's eye position, thereby maintaining accurate alignment without requiring complex manual calibration procedures
Solution Approach 2:
The system employs feedback mechanisms by continuously detecting the user's eye position through cameras and sensors, then using this information to adjust the projection point position. This closed-loop control ensures the projected information remains accurately aligned with the user's field of view despite changes in eye position
2Measurement precision
If the projection point is dynamically adjusted to align with user's eyes, then the projection alignment accuracy is improved, but the device complexity increases
Solution Approach 1:
The patent replaces complex mechanical adjustment mechanisms with software-based algorithms that process eye position data and calculate optimal projection points. This substitution reduces mechanical complexity while maintaining or improving alignment accuracy through computational methods
Solution Approach 2:
The system integrates multiple functions into a unified framework: eye position detection, projection point calculation, and real-time rendering adjustment all work together within a single system architecture. This multi-functionality approach reduces overall system complexity by eliminating the need for separate adjustment mechanisms
3Ease of operation
If the projection point is fixed, then the ease of operation is improved, but the adaptability to different user eye positions deteriorates
Solution Approach 1:
The system provides self-service by automatically detecting eye position and adjusting the projection point without requiring user intervention. This maintains operational simplicity while achieving high adaptability, as the system adapts itself to different user positions and viewing conditions
Data Source
AI summary
The projection point locating system includes: an image reception unit which receives an image including a target object to be located at a projection point and a face image of a user; a 3D eye tracking model management unit which generates and trains a 3D eye tracking model for optimally locating the projection point of the target object; an image processing unit which receives the 3D eye tracking model from the 3D eye tracking model management unit, and analyzes a face image of the user and estimates a position and a gaze direction of user's eyes, so as to process the target object such that the target objects appears at optimal coordinates aligned with the position and the gaze direction of the user's eyes; and an image output unit which displays the target object by projecting the target object at the optimal coordinates.