AR Head-Up Display Depth Rendering With Eye-Tracked Focal Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems, particularly in vehicle heads-up displays, are limited to two-dimensional projections, constraining the relationship between virtual and real-world environments, especially in moving scenarios, and lack effective mechanisms for providing world-locked and viewer-locked virtual images.
Innovation Solution
A three-dimensional augmented reality display system using optical elements and eye-tracking technology to create stereoscopic images that can be positioned anywhere in a user's field of view, combined with movable optical components to adjust depth and reduce power consumption, and adjustable lens configurations to enhance image quality and integration with the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If two-dimensional projection is used in heads-up display, then device complexity is reduced, but adaptability of augmented reality experience to three-dimensional environment is limited
Solution Approach 1:
The patent transitions from two-dimensional projection to three-dimensional volumetric rendering by introducing depth encoding techniques. The system renders images at multiple depth planes and uses optical elements to create genuine 3D spatial representation, allowing virtual objects to be positioned anywhere in a volumetric space rather than constrained to flat planes.
Solution Approach 2:
The patent employs nested optical elements including microlens arrays positioned within the display stack, with multiple layers of optical components working together. The microlens arrays are integrated into the display structure, creating a compact nested configuration that achieves 3D functionality without proportionally increasing overall device complexity.
2Adaptability or versatility
If fixed depth planes are used for projection, then manufacturing precision requirements are reduced, but adaptability to user focal point and environmental changes is limited
Solution Approach 1:
The patent implements dynamic depth adjustment by rendering content at multiple adjustable depth planes and using eye-tracking feedback to continuously adapt the focal distance of virtual objects to match the user's natural focal point. The system can dynamically shift objects between near and far planes, and adjust vergence-accommodation coupling in real-time based on user gaze and environmental conditions.
Solution Approach 2:
The patent incorporates eye-tracking sensors that provide feedback on user gaze direction and focal point. This feedback is used to dynamically adjust the depth and positioning of virtual objects, creating a closed-loop system that adapts to user preferences and reduces visual strain by matching virtual object depth to user accommodation state.
3Adaptability or versatility
If multiple image planes are rendered to provide depth, then adaptability to different viewing conditions is improved, but power consumption increases
Solution Approach 1:
The patent employs time-multiplexed rendering where multiple depth planes are displayed in rapid succession rather than simultaneously. The display alternates between different depth planes at frequencies above the flicker threshold, creating the perception of continuous 3D content while reducing the instantaneous power required compared to rendering all planes at full brightness simultaneously.
Solution Approach 2:
The patent applies local dimming and selective brightness adjustment to different depth planes based on their relevance to the user's current focal point. The system dims or disables depth planes that are not currently needed, concentrating power consumption on the most relevant planes while maintaining adaptability to different viewing conditions through selective activation.
4Use of energy by moving object
If transmissive display technology is used, then power efficiency is improved, but image quality in bright environments may be compromised
Solution Approach 1:
The patent incorporates ambient light sensors that detect environmental brightness conditions in advance and pre-adjust display parameters accordingly. When bright conditions are detected, the system proactively increases backlight intensity and adjusts contrast settings before the user would notice any degradation, maintaining image quality while minimizing power consumption through intelligent preprocessing of display parameters.
Solution Approach 2:
The patent dynamically changes multiple display parameters including backlight luminance, contrast ratio, gamma correction, and local dimming zones based on ambient light conditions. The system adjusts these parameters in real-time to optimize the balance between power efficiency and image brightness, using transmissive technology's advantages while compensating for its limitations in bright environments through multi-parameter optimization.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables dynamic, three-dimensional augmented reality experiences that adapt to user focus and environmental changes, providing enhanced user comfort and reduced power consumption, while maintaining image quality and integration with the real-world environment.
Implementation Method 1
an optical element to split the left and right eye image for every pixel of the image
Implementation Method 2
using eye tracking, ties the left and right eye image back to where a user's eyes are focused
Implementation Method 3
impinging light upon a transparent plane to generate a three-dimensional image on a continuous plane that is based on a user focal point
Data Source
AI summary
Embodiments are disclosed for display configurations for providing an augmented reality heads up display. In one example, a method of operating a display system includes adjusting an output of image light from a display to pass through an optical element positioned between the display and at least one micro lens array, including impinging light upon a transparent plane to generate a three-dimensional image on a continuous plane that is based on a user focal point determined by an eye-tracking module.