Stereoscopic AR Virtual Object Rendering for Depth Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems face challenges in accurately placing virtual objects at appropriate depths within a scene, ensuring they are readable and aligned with real-world objects, particularly in stereoscopic displays where user eye vergence and accommodation must be considered.
Innovation Solution
The AR system calculates the distance between an identified anchor point and the display device using techniques like parallax imaging or laser ranging, generates separate images for each eye to match this distance, and applies selective blurring or adjusts virtual object properties to maintain alignment with the user's vergence plane.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual objects are displayed at a fixed distance in AR, then the display is simple, but the virtual objects may appear too far away to be readable or at incorrect depth relative to real-world objects
Solution Approach 1:
The system dynamically adjusts the rendering distance of virtual objects based on the user's vergence distance to real-world objects. Instead of using a fixed display distance, the virtual object's apparent distance is continuously modified to match the depth of the anchored real-world object, creating a dynamic depth alignment that improves perceived accuracy without requiring complex hardware changes
Solution Approach 2:
The system changes the depth parameter (apparent distance) of virtual objects based on measured vergence distances. By adjusting the rendering distance parameter to match the user's actual viewing distance to the anchored object, the system achieves accurate depth perception while maintaining a relatively simple display architecture
2Loss of information
If virtual objects are placed close to real-world objects, then they are more readable, but they may block key objects in the real-world scene
Solution Approach 1:
The system places virtual objects in the depth dimension rather than overlaying them directly on the 2D display plane. By positioning virtual objects at the apparent depth of the anchored real-world object, the system creates a three-dimensional spatial relationship that allows both the virtual object and the real-world object to be visible simultaneously, eliminating occlusion while maintaining readability
Solution Approach 2:
The system uses the real-world object as an intermediary anchor point to position the virtual object. The virtual object is not placed arbitrarily close to the user or at a fixed distance, but rather at the intermediate depth plane of the anchored object, which serves as a mediator between the user and the virtual content, ensuring visibility without blocking the real-world scene
3Measurement precision
If stereoscopic display is used for better depth perception, then depth accuracy improves, but the complexity of ensuring proper vergence-accommodation matching increases
Solution Approach 1:
The system uses feedback from the user's actual vergence behavior (where they are looking at in the real world) to adjust the rendering distance of virtual objects. By measuring the vergence distance to the anchored real-world object and using that as feedback to position the virtual object, the system achieves natural vergence-accommodation matching without complex control algorithms
Solution Approach 2:
The system allows the user's natural vergence to real-world objects to automatically determine the correct rendering distance for virtual objects. Instead of requiring the system to actively control and adjust vergence, the user's own vergence behavior serves the system by providing the depth information needed for accurate virtual object placement, simplifying the overall control mechanism
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach ensures that virtual objects appear at the correct depth and remain legible, providing a more consistent and natural-looking augmented reality experience by aligning with the user's eye vergence and accommodating real-world depth perception.
Implementation Method 1
The AR system then calculates the distance between the identified object and augmented reality (AR) display device that comprises left and right displays (e.g., using parallax in the images captured by two cameras, or using a laser ping)
Data Source
AI summary
An augment reality (AR) system captures an image of a physical environment. The AR system identifies an object in the captured image to serve as an anchor point. The AR system calculates a distance between the identified object and an AR display device that comprises left and right displays. The AR system identifying a virtual object associated with the anchor point. The AR system then generates for simultaneous display: (a) a first separate image of the virtual object on the left display of the AR device, and (b) a second separate image of the virtual object on the right display of the AR device, such that apparent distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated distance between the identified object and the AR display device.