Stereo Image Generation for Augmented Reality Depth Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems face challenges in generating realistic 3D scenes for stereoscopic viewing, including stereoscopic depth illusion consistency, geometrical consistency, motion consistency, and photometry consistency, especially when integrating virtual objects with real-world objects.
Innovation Solution
A system and method for generating and displaying stereo pairs of images using a processor that positions virtual scenes in a 3D space, rotates them about predetermined axes, and projects these images onto a 2D viewing surface to create left and right images for display on a headset, ensuring accurate depth perception and integration with real-world environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If parallel left and right lines-of-sight are used to obtain stereoscopic images, then the system must be separated by a distance corresponding to the inter-pupillary distance, but the object cannot be positioned beyond the point of intersection and the eyes cannot focus on objects in front of or beyond the intersection
Solution Approach 1:
The patent implements dynamic adjustment of the baseline distance between left and right cameras based on the depth of the target object. The system automatically modifies the separation distance according to the object's distance from the viewer, enabling accurate depth perception across varying viewing distances without requiring manual recalibration or fixed geometry constraints
2Adaptability or versatility
If the virtual object is freely moved in a real-world image, then geometrically correct integration should be generated during the free motion, but maintaining consistent size and occlusion effects throughout motion is challenging
Solution Approach 1:
The system continuously tracks the position, orientation, and depth of virtual objects during free motion and dynamically adjusts rendering parameters including size, occlusion relationships, and perspective projection. This real-time feedback mechanism ensures geometric consistency is maintained throughout the object's movement trajectory by constantly recalculating the correct geometric transformations based on current spatial relationships
3Stability of the object's composition
If a virtual object is integrated into an image sequence, then the motion of the virtual object should be consistent with that of the real-world objects, but achieving natural motion parallax and perspective changes is difficult
Solution Approach 1:
The patent combines multiple motion tracking systems (inertial sensors, visual tracking, depth sensing) into a unified motion estimation algorithm that simultaneously tracks both real-world and virtual objects. The system merges these data streams to compute consistent motion parallax and perspective transformations, applying the same geometric transformations to virtual objects that govern real object motion, thereby achieving natural motion consistency without requiring separate complex tracking systems
4Measurement precision
If the stereoscopic system uses parallel left and right lines-of-sight, then the images must be presented separated by the inter-pupillary distance, but this creates constraints on object positioning and eye focusing
Solution Approach 1:
The system dynamically adjusts the baseline distance between left and right camera viewpoints based on the depth of the captured scene and the user's viewing distance. This dynamic baseline adjustment maintains accurate stereoscopic depth perception while adapting to different viewing conditions, eliminating the need for fixed geometry constraints and improving viewing comfort across various scenarios
Data Source
AI summary
A method and system for generating a stereo pair of images of a 3D virtual space and presenting the images to a user. The system includes a display unit configured to displaying a stereo pair of images to the user and a processor for generating the stereo pair of images. The method of the invention, carried out by the processor includes positioning virtual scenes S1, . . . Sn, . . . SN in the virtual 3D space. The scenes are subjected to a first manipulation and then a left 2D image is obtained by projecting the space onto a viewing surface positioned in the 3D space. The scenes are then subjected to a second manipulation and the right 2D image is obtained by projecting the space onto the viewing surface.