Mesh Patch Zippering for Boundary-Accurate 3D Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D media processing technologies face challenges in efficiently compressing and decompressing complex 3D models like point clouds and meshes, which require significant data resources for storage and transmission, leading to inefficiencies in immersive experiences.
Innovation Solution
The implementation of patch-based coding techniques, such as V-PCC, which segments point clouds into patches, converts them into image-based representations, and uses video coding standards to compress and decompress these patches efficiently, minimizing data requirements while maintaining quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If mesh data is compressed using traditional methods, then data storage and transmission requirements are reduced, but the complexity of handling and reconstructing the mesh increases
Solution Approach 1:
The mesh is divided into multiple patches, each of which can be independently compressed and processed. This segmentation allows the data to be handled in smaller, more manageable units while maintaining the overall mesh structure through boundary matching.
Solution Approach 2:
The patent transforms the 3D mesh data into a 2D parameter space (UV coordinates) for compression, then reconstructs it back to 3D. This dimensional transformation enables the application of 2D image compression techniques to 3D mesh data, reducing complexity while maintaining data integrity.
2Productivity
If patch-based coding is used to compress mesh data, then transmission efficiency is improved, but the difficulty of ensuring boundary continuity between patches increases
Solution Approach 1:
The patent implements a feedback mechanism where boundary information from each patch is used to adjust and refine the parameterization of adjacent patches. This ensures that boundary vertices and edges match correctly during reconstruction, maintaining continuity while allowing efficient independent compression of each patch.
Solution Approach 2:
The patent introduces boundary information as an intermediary element that mediates between adjacent patches. This boundary information contains vertex and edge data that serves as a bridge, ensuring proper matching and continuity when patches are reassembled after compression.
3Measurement precision
If detailed boundary information is stored for each patch, then reconstruction accuracy is improved, but the data size increases
Solution Approach 1:
The patent merges boundary information from adjacent patches by identifying and consolidating duplicate vertices and edges. Instead of storing complete boundary data for each patch, the system combines shared boundary elements, reducing redundant data while maintaining the precision needed for accurate reconstruction.
Solution Approach 2:
The patent uses copying techniques where boundary information from one patch can be reused for adjacent patches. By copying and referencing shared boundary data rather than storing it multiple times, the system maintains reconstruction accuracy while significantly reducing the total data size.
Data Source
AI summary
In some examples, an apparatus for mesh coding includes processing circuitry. The processing circuitry receives a bitstream carrying encoded information of a mesh that is partitioned into patches. The bitstream includes a first portion and a second portion, the first portion includes patch information, the second portion includes patch boundary information that indicates at least a first edge of a first patch and a second edge of a second patch are a pair of edge mates. The processing circuitry decodes the first portion to obtain the patch information, and decodes the second portion to obtain the patch boundary information. The processing circuitry generates a reconstructed mesh based on the patch information and the patch boundary information, the first edge and the second edge are mapped into a same edge in the reconstructed mesh to connect the first patch with the second patch.