See-Through AR Display Adaptation for Complex Background Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems face challenges in maintaining the visibility and interpretability of graphical content due to variable lighting, visual complexity, and individual differences in user perception, leading to distortions, color shifts, and reduced contrast, especially when presented over complex backgrounds.
Innovation Solution
An augmented reality system that determines the relative position of each user's eye with respect to an optical combiner, adjusts the color, luminance, and iconographic parameters of graphical elements based on real-world light field conditions using a tracker, camera, and processor to enhance visibility and distinguishability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If graphical content is displayed using see-through displays in augmented reality systems, then users can have visual access to the real-world environment while viewing graphical content, but the visibility of graphical content is reduced due to light from the real-world environment causing distortions, color shifts, and reduced contrast
Solution Approach 1:
The system applies different adjustments to different regions of the display based on the local background characteristics. The processor analyzes the background behind each region and applies specific color, brightness, or contrast adjustments to that region to enhance graphical content visibility while maintaining natural appearance in other areas.
Solution Approach 2:
The system dynamically changes display parameters such as color temperature, brightness, and contrast based on the real-world lighting conditions and background characteristics. The processor continuously monitors environmental light and adjusts display parameters to optimize graphical content visibility against varying backgrounds.
2Adaptability or versatility
If conventional accessibility settings are used to accommodate individual differences in visual perception, then users with color vision deficiency or reduced contrast sensitivity can perceive graphical content, but the system requires pre-configured settings that do not adapt to dynamic real-world environments
Solution Approach 1:
The system automatically detects and adapts to each user's visual characteristics and the current environmental conditions without requiring manual configuration. The processor continuously analyzes background conditions and adjusts display parameters in real-time, enabling the system to serve itself by adapting to changing conditions rather than relying on pre-configured settings.
Solution Approach 2:
The system transitions from static pre-configured accessibility settings to dynamic real-time adaptation. The display parameters are continuously adjusted based on real-world lighting conditions, background complexity, and user viewing angles, allowing the system to adapt dynamically rather than relying on fixed configurations.
3Ease of operation
If the augmented reality system uses fixed rendering parameters for graphical content, then the system operation is simple, but the graphical content becomes indistinguishable from complex or brightly illuminated backgrounds in variable lighting conditions
Solution Approach 1:
The system continuously monitors the real-world background conditions through the see-through display and uses this feedback to dynamically adjust rendering parameters. The processor analyzes the background behind graphical elements and adjusts color, brightness, and contrast to ensure distinguishability, creating a closed-loop system that adapts to changing environmental conditions.
Solution Approach 2:
The system performs preliminary analysis of the background conditions before rendering graphical content. By detecting the characteristics of the background area where graphical content will be displayed, the system pre-adjusts rendering parameters to ensure optimal visibility and distinguishability before the graphical content is actually rendered.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system improves visibility and perceptual consistency of graphical elements by dynamically adapting to real-world lighting and user-specific visual characteristics, ensuring the graphical elements remain distinguishable across varying environments and viewing conditions.
Implementation Method 1
an optical combiner arranged on an optical path of the display and on an optical path of a real-world light field of a real-world environment
Implementation Method 2
optically combining the corresponding portion of the synthetic light field with said portion of the real-world light field
Data Source
AI summary
A system including a tracker, a display, an optical combiner arranged on an optical path of the display and of a real-world light field of a real-world environment, at least one real-world facing camera, and at least one processor. The processor is configured to determine a relative position of each eye of at least one user with respect to the optical combiner using the tracker, generate or retrieve an image to be displayed based on the relative position of each eye of the at least one user with respect to the optical combiner, and determine a corresponding portion of the optical combiner for a given region of the image. The processor is further configured to capture at least one real-world image, calculate a colour difference and a luminance difference, adjust the graphical element based on the differences, and display the image while optically combining it with the real-world light field.