Video Decoding With Adaptive Color Transform for 4:4:4 Chroma
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards, such as VVC, are inefficient for 4:4:4 chroma format videos due to insufficient consideration of correlations among the three color components, leading to suboptimal use of coding tools and reduced compression efficiency.
Innovation Solution
Implementing adaptive color-space transform (ACT) for decoding residuals, enabling tools like 8-tap interpolation filters, position-dependent intra prediction combination (PDPC), multi-reference line (MRL), and sub-partition prediction (ISP) specifically for chroma components, and using a unified design for both luma and chroma components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If existing video coding standards are used for 4:4:4 chroma format, then device compatibility is maintained, but compression efficiency is reduced due to insufficient consideration of color component correlations
Solution Approach 1:
The patent applies parameter changes by transforming the color space from RGB to YCgCo for residual coding. This parameter transformation exploits the correlations among color components by converting to a color space where the chroma components (Cg and Co) have reduced inter-component correlation, thereby improving compression efficiency for 4:4:4 chroma format videos while maintaining compatibility with existing coding frameworks.
Solution Approach 2:
The patent implements dynamic adaptation by enabling the adaptive color-space transform (ACT) only when beneficial. The encoder dynamically determines whether to apply ACT based on the specific video content and coding conditions, allowing flexible adjustment between different color spaces (RGB or YCgCo) depending on the correlation structure of the residual data, thus optimizing compression efficiency adaptively.
2Productivity
If adaptive color-space transform is applied to exploit color component correlations, then compression efficiency improves, but coding complexity increases
Solution Approach 1:
The patent applies universality by designing a unified coding framework that handles both luma and chroma components through the same ACT mechanism. The transform is applied consistently across all color components (Y, Cg, Co), allowing a single set of transform matrices and processing logic to serve multiple purposes, thereby reducing overall coding complexity while maintaining the compression efficiency benefits.
Solution Approach 2:
The patent segments the color space transformation into separate operations for different color components. By independently transforming the Y, Cg, and Co components through dedicated transform matrices, the system manages complexity through modular processing. Each component can be transformed using optimized matrices tailored to its specific correlation characteristics, making the overall system more manageable while achieving high compression efficiency.
3Ease of manufacture
If unified design is used for luma and chroma components, then implementation simplicity improves, but loss of fidelity in chroma processing may occur
Solution Approach 1:
The patent applies local quality by applying different transform matrices tailored to each color component (Y, Cg, Co). While the overall framework is unified, the specific transform parameters and matrices are optimized for each component's unique correlation structure. This allows high-fidelity processing for chroma components through component-specific matrices while maintaining the simplicity of a unified processing architecture.
Data Source
AI summary
An electronic apparatus performs a method of decoding video data that includes: receiving a first syntax element, wherein the first syntax element indicates whether residuals of the coding unit have been coded using adaptive color transform), in accordance with a determination that the residuals of the coding unit have not been coded using the ACT, receiving a second syntax element, wherein the second syntax element indicates that whether block differential pulse coded modulation is applied for chroma components of the coding unit or not; and in accordance with a determination that the residuals of the coding unit have been coded using the ACT, assigning a default value to the second syntax element, wherein, when the second syntax element has the default value, inverse transform is applied for decoding the data of the coding unit.