Joint Chroma Coding Frequency Domain Mode Decision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding methods require separate processing pipelines for chroma components Cb and Cr, leading to increased hardware and software resource usage, which can result in higher latency and reduced coding throughput.

Innovation Solution

Implementing a joint chroma coding mode that processes chroma residuals in the frequency domain using a pixelwise linear combination, allowing for joint coding and reconstruction of Cb and Cr residuals, thereby reducing the need for separate pipelines and optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate processing pipelines are used for chroma components Cb and Cr, then coding accuracy is maintained, but hardware overhead and device complexity increase

Engineering Contradiction:
Improvecoding accuracyVSAvoidhardware overhead
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the separate processing pipelines for Cb and Cr chroma components into a single joint processing pipeline. The encoder and decoder are configured to perform joint chroma residual coding, where both chroma components are processed together through shared transform, quantization, and inverse transform operations, eliminating the need for duplicate separate pipelines while maintaining coding accuracy through coordinated processing of both components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The joint chroma coding pipeline is designed to handle both Cb and Cr components universally through the same processing stages. The encoder and decoder use a unified set of processing blocks that can process either or both chroma components simultaneously, making the system multi-functional rather than requiring dedicated separate pipelines for each component type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If separate processing pipelines are used for chroma components Cb and Cr, then processing reliability is maintained, but coding latency increases

Engineering Contradiction:
Improveprocessing reliabilityVSAvoidcoding latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By combining the processing of Cb and Cr components into a single pipeline, the patent eliminates the sequential execution overhead of separate pipelines. Both chroma components are processed concurrently through shared computational blocks, reducing the total processing time and latency while maintaining reliability through coordinated error handling and synchronized processing states.

Inventive Principle:
Principle #5Merging (Combining)

3Stability of the object's composition

If separate processing pipelines are used for chroma components Cb and Cr, then processing stability is maintained, but coding throughput decreases

Engineering Contradiction:
Improveprocessing stabilityVSAvoidcoding throughput
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

The joint processing pipeline merges the handling of Cb and Cr components, allowing both to be processed in parallel through shared computational resources. This increases coding throughput by utilizing hardware resources more efficiently and reducing the total number of processing operations required, while stability is maintained through synchronized processing and consistent application of transform and quantization parameters to both components.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11785204B1Frequency domain mode decision for joint chroma coding
Publication Date: 2023.10.10 MEDIATEK INC
  • US11785204B1 patent drawing
  • US11785204B1 patent drawing
  • US11785204B1 patent drawing

AI summary

Various schemes for realizing JCCR mode decision in frequency domain are described. An apparatus receives first and second pixel data of a current block of a picture and transform the pixel data into first and second transformed data in frequency domain. The apparatus generates joint pixel data comprising a pixelwise linear combination of the first and second transformed data. The apparatus generates reconstructed joint pixel data based on the joint pixel data by quantization and inverse quantization operations. The apparatus derives first and second reconstructed pixel data based on the reconstructed joint pixel data. The apparatus accordingly calculates first and second distortion values in frequency domain, based on which a preferred mode may be determined to code the current block.