Direct Light Compensation for Opaque Overlapping AR Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In optical see-through augmented reality systems, virtual objects appear transparent or translucent when overlapping real objects due to the combination of light from the real and virtual worlds, which compromises the user's perception of the real world experience.
Innovation Solution
The augmented reality system employs a display system with a projection subsystem and sensors to detect head and eye movements, analyze real object characteristics, and adjust virtual object opacity by displaying interference images or modifying virtual image data to reduce contrast with real objects in overlap regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If light from the real world is combined with light from the virtual world in optical see-through AR display, then the user can directly view ambient light from the real-world environment, but the virtual objects appear transparent or translucent when overlapping real objects
Solution Approach 1:
The patent applies local quality by making different regions of the display have different optical properties. Specifically, the display surface is configured to be transparent in regions showing real-world content while being opaque in regions displaying virtual objects. This spatial differentiation of transparency allows simultaneous viewing of ambient light and ensures virtual objects appear opaque when overlapping real objects, resolving the contradiction between real-world visibility and virtual object opacity.
2Reliability
If virtual objects are made opaque to obscure real objects behind them, then the user perceives complete obstruction for a realistic experience, but the light from the real world is blocked and the optical see-through capability is compromised
Solution Approach 1:
The display system implements local quality by configuring different optical properties for different display regions. The transparent element (combiner) is made transparent in regions where real-world content is displayed to allow light transmission, while opaque regions are created specifically where virtual objects are rendered. This enables the system to maintain optical see-through capability for real-world viewing while ensuring virtual objects appear opaque without blocking real-world light in non-virtual regions.
3Loss of information
If contrast between virtual image and background features is increased to enhance virtual image perception, then the virtual image becomes more visible, but the perceived realism of the augmented scene decreases
Solution Approach 1:
The patent applies local quality by dynamically adjusting the transparency of the display surface based on the type of content being displayed. When virtual objects are rendered, the display surface becomes opaque in those regions to ensure complete visibility of virtual elements without contrast issues. When displaying real-world content, the surface remains transparent to maintain scene realism. This localized transparency control ensures both virtual image visibility and scene realism are maintained in their respective regions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Ensures that virtual objects appear opaque over real objects, providing a clear and immersive augmented reality experience by minimizing perceived contrast through interference imaging or virtual data modification.
Implementation Method 1
as opposed to being blocked by the virtual world, the light from the real world is combined with the light from the virtual world
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An augmented reality system and method of operating the same is provided. An end user is allowed to visualize direct light from a three-dimensional scene in an ambient environment, generating virtual image data from the point of the view of the end user. A region of spatial overlap between a real object in the three-dimensional scene and a virtual object in the virtual image data is determined. Color characteristics of the real object in the overlap region are determined. A perceived contrast between the real object and the virtual object in the overlap region is decreased based on the determined color characteristics of the real object in the overlap region. The virtual image data is displayed as a virtual image after the perceived contrast between the real object and the virtual object has been decreased that, along with the visualized direct light, creates a three-dimensional augmented scene.