3D Mesh Transmission Using Patch Segmentation and 2D Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of efficiently transmitting and receiving mesh data is exacerbated by the large amount of data required for 3D content, particularly in applications like virtual reality, augmented reality, and self-driving services, due to the complexity of encoding and decoding processes.
Innovation Solution
A method involving pre-processing of mesh data through decimation, generating texture coordinates, and subdividing to create fitted mesh data, followed by encoding and transmitting a bitstream, which includes segmenting polygons or vertices with similar characteristics and packing them onto a 2D image based on previous frame data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mesh data is transmitted with high detail to ensure 3D content quality, then the visual quality is improved, but the data transmission bandwidth and storage requirements increase significantly
Solution Approach 1:
The patent segments the 3D mesh data into multiple patches and processes each patch independently through UV mapping and 2D projection. This segmentation allows the system to transmit only essential geometric features of each patch rather than the complete high-resolution mesh, reducing overall data quantity while maintaining local visual quality.
Solution Approach 2:
The patent transforms 3D mesh data into 2D projected views through UV mapping and orthographic/projectional projection. By converting three-dimensional geometric information into two-dimensional representations, the system significantly reduces the data dimensionality and corresponding data volume while preserving the essential visual characteristics needed for rendering.
2Productivity
If mesh data is heavily compressed to reduce transmission bandwidth, then the data transmission efficiency is improved, but the decoding complexity and latency increase
Solution Approach 1:
The patent performs preliminary processing of mesh data during the encoding phase by pre-calculating UV coordinates, projecting 3D vertices to 2D space, and organizing mesh patches into a structured format. These preprocessing steps prepare the data in advance for efficient compression and enable the decoder to reconstruct the mesh using simpler operations, reducing decoding complexity despite the compression ratio.
3Quantity of substance
If the mesh data is decimated to reduce data amount, then the transmission requirements are reduced, but the manufacturing precision of the 3D model deteriorates
Solution Approach 1:
The patent applies different processing qualities to different regions of the mesh by segmenting it into patches and applying UV mapping selectively. Critical regions maintain higher fidelity through careful UV coordinate calculation and 2D projection, while less critical areas undergo greater simplification. This local quality approach ensures that overall mesh accuracy is preserved despite decimation, as important geometric features are retained in their respective local regions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A 3D data transmission method according to embodiments may comprise the steps of: preprocessing input mesh data; encoding the preprocessed mesh data; and transmitting a bitstream including the encoded mesh data.