AR Eyewear Perception Control Using Eye Tracking and Scene Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality display systems face challenges in providing a comfortable and natural integration of virtual image elements within real-world environments, as they struggle to effectively manage user focus and perception, especially in dynamic scenarios like driving, where real-time adjustments to virtual objects are necessary for enhanced safety.
Innovation Solution
A head-mounted display system that projects light into the user's eye, utilizing environmental sensors and processing electronics to alter the perception of virtual or real objects within the user's vision field by adjusting image content such as contrast, opacity, and location, based on user focus and intent, and incorporating features like depth sensors and eye tracking for precise control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If augmented reality image content is projected to enhance user perception and safety, then user safety and situational awareness are improved, but visual comfort and natural perception deteriorate due to the complexity of human visual perception system
Solution Approach 1:
The system dynamically adjusts the presentation of augmented reality content based on real-time detection of user focus states. When the eye tracking system detects increased focus (reduced pupil diameter), the system automatically modifies the appearance, location, or presentation of AR objects to reduce visual distraction. This dynamic adaptation resolves the contradiction by making the AR system responsive to the user's physiological state, enhancing safety when needed while preserving visual comfort during normal viewing.
Solution Approach 2:
The system implements a feedback loop using eye tracking data to monitor user focus and adjust AR content delivery accordingly. The eye tracking system continuously provides feedback on pupil diameter and focus state, which the processing electronics use to modify AR object presentation in real-time. This closed-loop feedback mechanism allows the system to balance safety enhancement with visual comfort by adapting to the user's perceptual state.
2Loss of information
If augmented reality content is displayed to provide virtual objects integrated into real world, then information richness is improved, but natural perception deteriorates due to challenge in producing comfortable and natural-feeling presentation
Solution Approach 1:
The system applies different presentation qualities to different AR objects based on their relevance and the user's focus state. When the user is focused on a particular area, AR objects in that region are presented with enhanced information richness, while objects in peripheral regions are presented more subtly. This local differentiation allows the system to provide rich information where needed while maintaining natural perception in other areas.
Solution Approach 2:
The system changes presentation parameters of AR objects (such as opacity, size, color, or position) based on detected focus states. When reduced pupil diameter indicates increased focus, the system adjusts parameters to reduce the prominence of AR content, making it less intrusive while preserving information availability. This parameter modulation resolves the contradiction between information richness and natural perception.
3Adaptability or versatility
If environmental sensors and processing electronics are used to alter user perception dynamically, then adaptability is improved, but device complexity increases
Solution Approach 1:
The eye tracking system serves multiple functions: it monitors user focus state for safety purposes, guides AR content presentation adjustments, and provides input for natural user interaction. This multi-functionality allows the system to achieve high adaptability through a single sensor subsystem rather than requiring separate systems for each function, thereby reducing overall device complexity while maintaining dynamic adjustment capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user safety by dynamically adjusting virtual object perception in real-time, improving focus on critical elements in the environment, such as during driving, by altering image content and location, thereby reducing distractions and enhancing situational awareness.
Implementation Method 1
a display configured to project light into the user's eye to present image content to the user's vision field
Implementation Method 2
at least a portion of the display being transparent and disposed at a location in front of the user's eye such that the transparent portion transmits light from a portion of the environment in front of the user to the user's eye
Data Source
AI summary
A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.