Dynamic Mesh Compression via Base-Displacement Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The storage and transmission of large volumetric content files, such as those from LIDAR systems and 3D visual content, are costly and time-consuming due to their size, limiting their use in real-time applications and requiring significant storage capacity.
Innovation Solution
A system that encodes three-dimensional meshes by separating them into base meshes and displacement information, using coding units like tiles and patches to efficiently compress and decompress the data, reducing the need for repeated signaling of zero values and leveraging dependencies between sub-meshes for improved compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If volumetric content files are stored and transmitted in their original format, then complete spatial and attribute information is preserved, but storage capacity requirements and transmission time increase significantly
Solution Approach 1:
The mesh is divided into multiple patches, and each patch is further divided into sub-meshes. This segmentation allows the encoder to process and compress different regions independently, reducing the overall data size while maintaining complete spatial information across all segments
Solution Approach 2:
The patent extracts only the essential displacement information needed to represent mesh geometry changes, rather than transmitting complete vertex coordinates. By separating the base mesh from displacement data and encoding only significant deviations, the transmission time is reduced while preserving the necessary spatial information
2Quantity of substance
If volumetric content files are compressed to reduce storage and transmission costs, then file size decreases, but compression efficiency and data processing complexity increase
Solution Approach 1:
By dividing the mesh into patches and sub-meshes, the compression process becomes more manageable and efficient. Each sub-mesh can be processed independently with optimized algorithms, reducing the overall computational complexity compared to compressing the entire mesh as a single unit
Solution Approach 2:
The patent applies different encoding strategies to different regions of the mesh based on their importance and characteristics. Critical regions receive higher precision encoding while less important areas use more aggressive compression, optimizing the balance between data size reduction and processing complexity
3Measurement precision
If displacement information is encoded with high precision to maintain mesh accuracy, then spatial information fidelity is improved, but the amount of data to be transmitted increases
Solution Approach 1:
The patent extracts only the significant displacement information from the base mesh, encoding only the deviations that are necessary to reconstruct the mesh with sufficient accuracy. By removing redundant zero values and focusing on essential geometric variations, transmission data volume is reduced while maintaining spatial fidelity
Solution Approach 2:
Instead of encoding all displacement values with uniform high precision, the patent applies precision selectively - using higher precision only where geometric features require it and lower precision in regions where small variations are imperceptible. This partial application of high precision reduces overall data volume while maintaining necessary fidelity
Data Source
AI summary
A system comprises an encoder configured to compress and encode data for a three-dimensional dynamic mesh. The three-dimensional dynamic mesh is compressed and signaled using a base-mesh sub-bitstream and a displacement sub-bitstream. The displacement sub-bitstream comprises displacement information to be applied at sub-division points of the base mesh to recreate the three-dimensional dynamic mesh at a given moment in time. A separate data unit type is used to signal the displacement sub-bitstream that allows for efficient signaling of sub-blocks that are only partially occupied or empty. Also, a separate patch type may be used in an atlas bitstream to signal the displacement data units. A complimentary decoder decodes a compressed bitstream for the three-dimensional dynamic mesh, encoded such as by the encoder.