3D Mesh Compression Using Deduced Texture Coordinates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D media processing technologies face challenges in efficiently compressing and transmitting large 3D models due to the significant data resources required for creation and consumption, particularly in immersive experiences.
Innovation Solution
The use of mesh coding techniques that decode 3D coordinates and connectivity information from a bitstream, deduce texture coordinates, and reconstruct 3D meshes using lossless or lossy codecs, along with parameterization and temporal alignment to optimize texture mapping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If texture coordinates are explicitly encoded in the bitstream, then texture mapping accuracy is improved, but data transmission requirements increase
Solution Approach 1:
The patent extracts texture coordinate information from the explicit bitstream data and instead derives it from the decoded 3D mesh geometry and connectivity information. This removes the redundant texture coordinate data from the transmitted bitstream while maintaining the capability to reconstruct accurate texture mappings at the decoder side through geometric parameterization.
Solution Approach 2:
The patent creates texture coordinates by copying and transforming the 3D vertex position information into 2D UV space through parameterization algorithms. Instead of transmitting separate texture coordinate data, the system generates them as a derived copy from the existing 3D mesh data, reducing overall data requirements while preserving mapping accuracy.
2Reliability
If detailed 3D mesh data is transmitted with high fidelity, then immersive quality is improved, but data storage and transmission resources increase
Solution Approach 1:
The patent enables the decoded 3D mesh data to serve its own purpose of generating texture coordinates without requiring separate transmitted texture coordinate data. The geometry and connectivity information contained in the decoded mesh self-generates the necessary UV mapping information through parameterization, making the system self-sufficient and reducing external data requirements.
Solution Approach 2:
The patent transforms the 3D spatial parameters (vertex positions and connectivity) into 2D texture space parameters through mathematical parameterization. This parameter transformation allows the system to maintain high-fidelity visual representation while using the same underlying geometric data for both 3D reconstruction and 2D texture mapping, thereby reducing overall data requirements.
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for mesh coding (encoding and/or decoding). In some examples, an apparatus for coding mesh includes processing circuitry. The processing circuitry decodes, three dimensional (3D) coordinates of vertices in a first 3D mesh frame and connectivity information of the vertices from a bitstream that carries the first 3D mesh frame. The first 3D mesh frame represents a surface of an object with polygons. The processing circuitry deduces texture coordinates associated with the vertices, and decodes a texture map for the first 3D mesh frame from the bitstream. The texture map includes first one or more 2D charts with 2D vertices having the texture coordinates. The processing circuitry reconstructs the first 3D mesh frame based on the 3D coordinates of the vertices, the connectivity information of the vertices, the texture map and the texture coordinates.