Dynamic Mesh Coding With Joint Texture-Displacement Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing dynamic mesh coding systems require separate encoders/decoders for texture and displacement data, inefficiently use 4:4:0 and 4:2:0 formats, and lack optimal coding methods for displacement data, leading to increased resource usage and suboptimal coding efficiency.
Innovation Solution
Jointly encode texture and displacement data in a single bitstream, converting displacement data to 4:2:0 format, using different quantization parameters, and optimizing coding methods for improved efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If displacement data is coded in 4:4:4 format, then coding precision is improved, but resource usage increases
Solution Approach 1:
The patent applies parameter changes by converting displacement data from 4:4:4 chroma format to 4:2:0 chroma format. This changes the sampling parameters from full-resolution chroma to subsampled chroma, reducing the quantity of data while maintaining acceptable coding precision for displacement information. The conversion is performed using standard chroma subsampling techniques where the U and V components are downsampled by a factor of 2 in both horizontal and vertical directions.
2Measurement precision
If separate encoders/decoders are used for texture and displacement data, then coding precision is maintained, but device complexity increases
Solution Approach 1:
The patent merges the encoding and decoding of texture and displacement data into a single unified process. By combining both data types into one bitstream using the same encoder/decoder infrastructure, the system eliminates the need for separate encoding/decoding devices while maintaining coding precision through format conversion. This reduces device complexity by consolidating multiple processing paths into one.
Solution Approach 2:
The patent makes the encoder/decoder universal by enabling it to handle both texture and displacement data through a single interface. The same encoding device processes both data types by converting displacement data to compatible formats (4:2:0), allowing one device to perform multiple functions that previously required separate specialized devices.
3Quantity of substance
If displacement data is converted to 4:2:0 format, then resource usage is reduced, but coding efficiency decreases
Solution Approach 1:
The patent applies parameter changes by converting displacement data from 4:4:4 to 4:2:0 format, which reduces resource usage through chroma subsampling. The conversion changes the data representation parameters to use fewer bits per pixel for the chroma components, thereby reducing overall resource requirements while maintaining sufficient precision for mesh displacement coding.
Data Source
AI summary
A mechanism for processing video data is disclosed. The mechanism includes determining that the displacement data is coded in a 4:2:0 format. A conversion is performed between the visual media data and a bitstream based on the displacement data as coded in the 4:2:0 format.