3D Scene Generation on Standard 2D Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D scene generation methods require specialized display devices for binocular parallax, limiting 3D perception to autostereoscopic or wearable devices, and do not allow for 3D viewing on standard 2D display devices.
Innovation Solution
A method for generating 3D scenes using a computer device that creates a 3D mesh, estimates depth information from a raw image, updates the mesh, projects vertices onto a 3D coordinate system based on user position, and colors the mesh with texture information to produce a 3D scene that can be displayed on standard 2D devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If binocular parallax is used for 3D scene generation, then depth perception is achieved, but specialized display devices are required
Solution Approach 1:
The patent creates a single 3D mesh model that represents the scene geometry, which is then rendered from multiple viewpoints to generate both left and right eye images. This single mesh copy serves both eyes, eliminating the need for separate display devices while maintaining depth perception through computed parallax differences
Solution Approach 2:
The patent transitions from requiring specialized 3D display hardware to using standard 2D displays by adding computational dimensionality - generating multiple 2D images from a 3D mesh model that simulate different viewing angles, thereby creating perceived depth through software rather than hardware
2Measurement precision
If binocular parallax method is used, then 3D effect is achieved, but computing resources are consumed and vergence accommodation conflict may occur
Solution Approach 1:
The patent performs preliminary action by pre-computing the 3D mesh model and depth information from a single image, then uses this pre-processed data to efficiently generate multiple viewpoint images. This preliminary processing reduces the computational burden during real-time rendering and viewing
Solution Approach 2:
The patent changes parameters by using a single 3D mesh model with modified vertex positions to generate images for different viewpoints, rather than maintaining separate complex models. This parameter modification approach reduces computational resources while achieving the same 3D effect
Data Source
AI summary
A method for three-dimensional (3D) scene generation is provided. The method includes the step of creating a 3D mesh. The 3D mesh has a plurality of mesh vertices. The method further includes the step of receiving a raw image. The method further includes the step of estimating the depth information of the raw image. The method further includes the step of updating the 3D mesh based on the estimated depth information. The method further includes the step of projecting each of the mesh vertices of the 3D mesh onto a coordinate system of a 3D scene based on user position information. The method further includes the step of obtaining the 3D scene by coloring the 3D mesh projected onto the coordinate system based on the texture information that is associated with the raw image.