3D Mesh Displacement Signaling for Efficient Volumetric Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The capture and storage of volumetric content, such as point clouds and three-dimensional meshes, result in large data files that are costly and time-consuming to transmit and store, limiting real-time applications and device storage capacity.
Innovation Solution
A system for encoding three-dimensional meshes by generating patches and using coding units like tiles and sub-meshes, with displacement values signaled in separate sub-bitstreams, allowing for efficient compression and out-of-order decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If volumetric content is captured and stored in high detail, then quality and accuracy are improved, but storage space and transmission costs increase significantly
Solution Approach 1:
The mesh is divided into multiple patches, and each patch is further divided into sub-meshes. This segmentation allows the encoder to process and compress different regions with appropriate precision levels, reducing overall storage requirements while maintaining quality where needed.
Solution Approach 2:
Different encoding parameters are applied to different coding units (tiles, patches, sub-meshes). This allows high precision in important regions and lower precision in less critical areas, optimizing the trade-off between quality and storage space.
2Measurement precision
If complete mesh data is transmitted, then accuracy is improved, but transmission time increases
Solution Approach 1:
The mesh data is segmented into multiple independent coding units (tiles, patches, sub-meshes) that can be transmitted in parallel or selectively. This reduces the time required to transmit complete mesh data while maintaining accuracy through efficient compression of each segment.
Solution Approach 2:
The mesh is pre-processed into a hierarchical structure with base meshes and displacement data before transmission. This preliminary organization enables faster transmission by allowing selective decoding of only the necessary precision level needed for the application.
3Device complexity
If encoding parameters are standardized across the entire mesh, then device complexity is reduced, but adaptability to different regions decreases
Solution Approach 1:
The patent enables different encoding parameters to be applied to different coding units (tiles, patches, sub-meshes). This provides adaptability to handle different mesh regions with appropriate precision while maintaining manageable device complexity through a structured parameter system.
Solution Approach 2:
The encoder can dynamically adjust encoding parameters for different regions of the mesh based on importance, detail level, or application requirements. This parameter flexibility enhances adaptability without significantly increasing device complexity due to the organized hierarchical structure.
4Measurement precision
If displacement data is encoded with high precision, then mesh accuracy is improved, but data size increases
Solution Approach 1:
Displacement data is organized into hierarchical levels corresponding to different mesh refinement levels. This segmentation allows the encoder to transmit only the necessary displacement precision for each region, reducing overall data size while maintaining accuracy where required.
Solution Approach 2:
The patent enables selective transmission of displacement data at different precision levels. Applications can receive full precision displacement data when needed, or partial precision data when sufficient for their purposes, optimizing the balance between accuracy and data size.
Data Source
AI summary
A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines displacements to be applied to sub-division locations of a base mesh. The displacement values may be signaled in their own sub-bitstream, e.g., a dedicated displacement data sub-bitstream, or may be signaled, at least in part, in an atlas data sub-bitstream that includes patch data. In some embodiments, the displacements may also be signaled, at least in part, in a video sub-bitstream or in a base-mesh sub-bitstream.