Partial 3D Meshes for VR Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual reality content rendering technologies require significant computing resources, bandwidth, and processing power due to the need for generating and transmitting complete 3D models of scenes, limiting scalability and real-time streaming capabilities.
Innovation Solution
A method and system that utilizes 2D color data, depth data, and metadata to generate, accumulate, and blend partial 3D meshes to form an image view of a virtual 3D space without constructing a complete 3D model, using existing video processing technologies and graphics hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If complete 3D models are generated and transmitted for virtual reality content, then visualization quality is improved, but bandwidth requirements and computing resources increase significantly
Solution Approach 1:
The patent segments the complete 3D model into multiple 2D depth maps captured from different viewpoints. Instead of transmitting a single comprehensive 3D model, the system divides the scene into multiple 2D representations that can be independently processed and reassembled at the client device, reducing individual file sizes while maintaining overall visualization quality.
Solution Approach 2:
The patent uses 2D depth maps as simplified copies of the 3D scene rather than transmitting the complete 3D model data. These 2D depth maps serve as efficient representations that capture essential spatial information with significantly reduced data requirements, allowing the client to reconstruct the virtual reality experience from these compressed representations.
2Measurement precision
If complete 3D models are generated and transmitted for virtual reality content, then visualization quality is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary action by capturing and preprocessing depth information from multiple viewpoints before transmission. The depth maps are prepared in advance in a compact 2D format, so that when received at the client device, they can be quickly assembled into the final 3D visualization without requiring time-consuming complete model reconstruction.
Solution Approach 2:
The patent uses partial action by transmitting only the essential depth information needed for virtual reality visualization rather than complete 3D model data. The system sends 2D depth maps that contain the critical spatial information required for reconstruction, omitting redundant data that would increase processing time without adding significant visual value.
3Measurement precision
If complete 3D models are generated for virtual reality content, then scene representation accuracy is improved, but computing resources required increase significantly
Solution Approach 1:
The patent substitutes the mechanical process of generating and transmitting complete 3D models with an optical/mathematical approach using 2D depth maps. Instead of computationally intensive 3D model construction and transmission, the system uses 2D image processing techniques that leverage existing video processing hardware, replacing complex mechanical computation with more efficient optical processing methods.
Solution Approach 2:
The patent changes the parameter representation from complete 3D model coordinates and geometry data to 2D depth map parameters. This parameter transformation converts the data structure from high-dimensional 3D information requiring significant processing power to 2D spatial parameters that can be handled by standard video processing hardware, maintaining scene accuracy while reducing computational demands.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An exemplary method includes a virtual reality content rendering system receiving two-dimensional ("2D") color data and depth data captured by a plurality of capture devices disposed at different vantage points in relation to a three-dimensional ("3D") scene, receiving metadata, generating, for each vantage point associated with each respective capture device included in the plurality of capture devices, and based on the metadata and the depth data, a partial 3D mesh projected into a virtual 3D space to produce a partial representation of the 3D scene in the virtual 3D space, and generating, based on the partial 3D meshes projected into the virtual 3D space, and from an arbitrary viewpoint within the virtual 3D space, an image view of the virtual 3D space. The generating of the image view may comprise accumulating the partial 3D meshes projected into the virtual 3D space.