Displacement Coding for Dynamic Mesh Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mesh compression standards fail to efficiently handle dynamic meshes with time-varying connectivity information and attribute maps, particularly in real-time applications like virtual reality and augmented reality, where existing standards do not support constant connectivity dynamic meshes effectively.
Innovation Solution
The proposed solution involves a new mesh compression standard that includes displacement coding, where a base mesh and displacement field are encoded and decoded using wavelet coefficients packed into 2D blocks based on levels of detail, allowing for efficient compression and transmission of dynamic meshes with time-varying connectivity and attribute maps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current mesh compression standards are used, then existing mesh data can be compressed, but dynamic meshes with time-varying connectivity information and attribute maps cannot be handled efficiently
Solution Approach 1:
The mesh data is segmented into base mesh information and displacement information, with the displacement field encoded using wavelet coefficients organized in 2D blocks. This segmentation allows independent optimization of different mesh components and enables efficient handling of dynamic connectivity changes.
Solution Approach 2:
The displacement field is transformed from a traditional 1D representation to a 2D block structure organized by levels of detail. This dimensional change enables more efficient packing and coding of displacement information, particularly for dynamic meshes requiring real-time processing.
2Quantity of substance
If mesh compression is applied, then data transmission size is reduced, but real-time processing capability is compromised
Solution Approach 1:
The mesh data is pre-processed into a standardized format with base mesh and displacement field separation before compression. This preliminary organization enables faster decoding and real-time reconstruction without compromising compression ratios, as the structure is optimized for both compression and rapid decompression.
3Measurement precision
If lossless compression is used, then original mesh quality is preserved, but compression efficiency and file size are compromised
Solution Approach 1:
The compression system applies different quality levels to different regions of the mesh based on local importance. Displacement coefficients at different levels of detail can be selectively retained or discarded, allowing lossless compression for critical regions and lossy compression for less important areas, optimizing the balance between quality and compression ratio.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables efficient lossy and lossless compression of dynamic meshes, supporting real-time communications and providing scalable and progressive coding, while maintaining a faithful approximation of the original mesh structure.
Implementation Method 1
A wavelet transform can be applied on the displacement to generate a set of wavelet coefficients
Data Source
AI summary
An apparatus includes processing circuitry. The processing circuitry is configured to receive a bitstream that includes displacement information and base mesh information of a mesh in a current mesh frame. The processing circuitry is configured to determine a plurality of wavelet coefficients packed in a plurality of two-dimensional (2D) blocks of a 2D image based on the displacement information. The processing circuitry is configured to unpack the plurality of wavelet coefficients packed from the plurality of 2D blocks based on levels of detail of the plurality of wavelet coefficients. The processing circuitry is configured to determine a plurality of displacements of the mesh in the current mesh frame based on the unpacked plurality of wavelet coefficients. The plurality of displacements is associated with a base mesh and the mesh in the current mesh frame, and the base mesh includes a subset of a plurality of vertices of the mesh.