AR Virtual Object Depth Alignment Using Range Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems face challenges in accurately placing virtual objects in relation to real-world objects, particularly in stereoscopic displays, where virtual content may appear too far away to be readable and not correspond to the distance of associated real-world objects, leading to issues with depth perception and legibility.
Innovation Solution
The system uses techniques such as range imaging to calculate the distance between real-world objects and the AR display device, generating separate images for each eye to match the apparent distance, and applies selective blurring based on the user's vergence plane to enhance depth perception and maintain relevant virtual objects at a consistent distance, while adjusting text renderings for legibility by modifying textual and image properties.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If virtual objects are displayed at a fixed apparent distance, then the display is simple to implement, but the virtual objects become unreadable when too far away and do not correspond to the distance of associated real-world objects
Solution Approach 1:
The patent applies dynamics by making the virtual object's apparent distance adjustable rather than fixed. The system dynamically modifies the depth parameter of virtual objects based on real-world conditions, allowing the apparent distance to change adaptively. This resolves the contradiction by enabling precise depth placement that corresponds to real-world object distances while maintaining implementation feasibility through automated adjustment mechanisms.
Solution Approach 2:
The patent changes the depth parameter of virtual objects to match the distance of associated real-world objects. By modifying this critical parameter dynamically, the system achieves accurate depth placement and readability without requiring complex manual intervention, thus resolving the contradiction between precision and complexity.
2Reliability
If virtual objects are placed to correspond to real-world object distances, then depth perception is improved, but the system complexity increases due to need for continuous depth calculation and adjustment
Solution Approach 1:
The patent employs feedback mechanisms where the system continuously monitors the depth information of real-world objects and automatically adjusts virtual object parameters accordingly. This closed-loop approach improves depth perception accuracy while managing complexity through automated feedback-driven adjustments rather than manual configuration.
Solution Approach 2:
The system performs self-service by automatically calculating and adjusting depth parameters without requiring user intervention. The AR system independently processes depth information and modifies virtual object placement, reducing the operational complexity burden on the user while maintaining high depth perception accuracy.
3Loss of information
If text renderings are enlarged to improve legibility, then readability is improved, but the virtual objects appear too far away and depth perception is compromised
Solution Approach 1:
The patent applies dynamics by simultaneously adjusting both the size and apparent distance of virtual objects. The system dynamically modifies these parameters in coordination, allowing text to be enlarged for legibility while maintaining appropriate depth placement that corresponds to the associated real-world object. This resolves the contradiction through coordinated dynamic adjustment of multiple parameters.
Solution Approach 2:
The patent changes multiple parameters including both size and depth simultaneously. By coordinating changes in these parameters, the system achieves improved legibility without compromising depth perception accuracy, resolving the contradiction through multi-parameter adjustment rather than single-parameter modification.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves the placement and visibility of virtual objects, ensuring they appear at the correct depth and are legible, enhancing the overall AR experience by aligning virtual content with real-world objects and emulating natural focus and perception.
Implementation Method 1
the AR system generates for simultaneous display a first separate image of the virtual object on the left display of the AR device and a second separate image of the virtual object on the right display of the AR device. The location of the separate image on each respective display is selected in such a way that, when viewed by a user with appropriate eye vergence, the apparent virtual-world distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated real-world distance between the identified object and the AR display device
Implementation Method 2
applies selective blurring based on the user's vergence plane to enhance depth perception and maintain relevant virtual objects at a consistent distance
Implementation Method 3
when viewed by a user with appropriate eye vergence, the apparent virtual-world distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated real-world distance between the identified object and the AR display device
Data Source
AI summary
An augment reality (AR) system captures an image of a physical environment. The AR system identifies an object in the captured image to serve as an anchor point. The AR system calculates a distance between the identified object and an AR display device that comprises left and right displays. The AR system identifying a virtual object associated with the anchor point. The AR system then generates for simultaneous display: (a) a first separate image of the virtual object on the left display of the AR device, and (b) a second separate image of the virtual object on the right display of the AR device, such that apparent distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated distance between the identified object and the AR display device.