Chart-Based 3D Mesh Compression for Efficient Model Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D media processing technologies face challenges in efficiently compressing and transmitting large 3D models due to the significant data resources required for creation and consumption, which hinders immersive experiences across various platforms.
Innovation Solution
The use of mesh coding techniques that parameterize 3D meshes into 2D UV atlases, employing chart-based coding modes such as sampling, reordering, and raw chart coding, along with video codecs for efficient compression and decompression of 3D mesh frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 3D meshes are represented with high detail and complexity to achieve immersive experiences, then the quality and realism of 3D content is improved, but the data resources required for creation, transmission, and consumption increase significantly
Solution Approach 1:
The patent divides the 3D mesh representation into multiple 2D chart sections within a UV atlas. Each chart corresponds to a specific region of the 3D surface, allowing selective compression and processing of different areas. This segmentation enables the system to maintain high detail where needed while compressing less critical areas, thus reducing overall data requirements while preserving visual quality.
Solution Approach 2:
The patent transforms the 3D mesh data into a 2D UV atlas representation. By mapping three-dimensional surface geometry onto a two-dimensional parameterized space, the system enables the use of efficient 2D image compression techniques while maintaining the ability to reconstruct the original 3D structure. This dimensional transformation significantly reduces data requirements while preserving the essential geometric information needed for immersive experiences.
2Productivity
If traditional compression methods are used for 3D mesh data, then the data transmission efficiency is improved, but the complexity of the compression and decompression processes increases
Solution Approach 1:
The patent introduces a UV atlas as an intermediary representation between the original 3D mesh and the compressed data format. This UV atlas serves as a bridge that allows standard 2D image compression algorithms to be applied to 3D mesh data. The intermediary structure simplifies the compression process by converting complex 3D geometric data into a format that can be efficiently processed by existing 2D compression tools, thereby reducing implementation complexity while maintaining transmission efficiency.
3Productivity
If multiple coding modes are implemented for different chart regions, then the compression efficiency is improved, but the device complexity for determining and decoding coding modes increases
Solution Approach 1:
The patent applies different coding modes to different chart regions within the UV atlas based on local characteristics. Each chart section can be processed with the most appropriate compression technique for its specific content requirements. This local quality approach allows the system to optimize compression efficiency for each region independently while maintaining a manageable overall system complexity through modular processing of individual charts.
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for mesh coding. In some examples, an apparatus for mesh coding includes processing circuitry. The processing circuitry receives a bitstream carrying a 3D mesh frame. The 3D mesh frame represents a surface of an object with polygons, the polygons are defined by vertices and edges connecting the vertices, the 3D mesh frame is parameterized into a plurality of 2D charts in a 2D UV atlas. The processing circuitry determines respective chart based coding modes for the plurality of 2D charts according to one or more indices decoded from the bitstream, and decodes, from the bitstream, at least respective geometry information associated with the plurality of 2D charts according to the respective chart based coding modes. The processing circuitry reconstructs the 3D mesh frame according to the respective geometry information associated with the plurality of 2D charts.