Stereoscopic Image Mesh Update via Depth Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional stereoscopic-image-generating devices face significant computational burdens when recalculating virtual-reality scenes due to changes in user position or line of sight, leading to processor overload.
Innovation Solution
A stereoscopic-image playback device equipped with a processor and graphics processing unit that creates a three-dimensional mesh, performs image preprocessing, and uses depth estimation to update the mesh based on eye-tracking results, generating side-by-side images efficiently by projecting images onto the updated mesh.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the processor recalculates the virtual-reality scene when user position or line of sight changes, then the stereoscopic image quality is maintained, but the computational burden on the processor increases significantly
Solution Approach 1:
The system divides the virtual-reality scene into a three-dimensional mesh structure with discrete vertices and faces. When user position or line of sight changes, only the necessary portions of the mesh are updated rather than recalculating the entire scene, reducing computational burden while maintaining image quality.
Solution Approach 2:
The system pre-calculates and stores the three-dimensional mesh structure, including vertex positions and face definitions, before rendering. This preliminary preparation allows for rapid updates when user position changes, as the base mesh structure is already available and only needs minor adjustments rather than complete recalculation.
2Measurement precision
If the processor recalculates the virtual-reality scene to maintain image quality, then the stereoscopic image accuracy is preserved, but the processing time increases
Solution Approach 1:
The system implements dynamic mesh updating where the three-dimensional mesh is adjusted in real-time based on user position and line of sight changes. The mesh structure remains flexible and can be rapidly modified without complete recalculation, preserving rendering accuracy while reducing processing time through selective updates.
Solution Approach 2:
The system uses the pre-existing three-dimensional mesh as a template or copy that can be quickly replicated and adjusted for different viewing angles. Instead of recalculating the entire scene geometry, the system copies the base mesh structure and applies transformations, maintaining geometric accuracy while significantly reducing computation time.
Data Source
AI summary
A method for generating stereoscopic images is provided. The method includes: creating a three-dimensional mesh to obtain a stereoscopic scene and capturing a two-dimensional image of the stereoscopic scene; performing image preprocessing to obtain a first image in response to the two-dimensional image not being a side-by-side image; utilizing a graphics processing pipeline to perform depth estimation on the first image to obtain a depth image, to update the three-dimensional mesh according to a depth setting of the depth image, and to map the three-dimensional mesh to a corresponding coordinate system; utilizing the graphics processing pipeline to project the first image onto the mapped three-dimensional mesh to obtain an output three-dimensional mesh, and to capture an output side-by-side image from the output three-dimensional mesh; and utilizing the graphics processing pipeline to weave a left-eye and right-eye image into an output image, and to display the output image.