Flexible Residual Transform Coding for Lower Signaling Overhead

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in efficiently reducing redundancy in residual signals, leading to increased bandwidth and storage requirements for video data.

Innovation Solution

Implementing short distance intra prediction modes in the residual domain, such as line-by-line and bi-prediction, to generate refined residue blocks, which are then used for transform coding, reducing the need for explicit signaling of transform block sizes and enhancing coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional transform coding is used without short distance intra prediction, then the coding process is simpler, but the number of bits required to signal residuals increases

Engineering Contradiction:
Improvenumber of bits required to signal residualsVSAvoidcoding process complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies short distance intra prediction modes (line-by-line prediction and bi-prediction) to the residual domain before transform coding. This preliminary prediction step refines the residue blocks by exploiting local correlations, thereby reducing the magnitude and variability of the residuals that need to be encoded. By performing this prediction action beforehand, the patent reduces the number of bits required to signal the residuals without requiring complex adaptive structures during the main coding process.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If transform block sizes are explicitly signaled, then transform precision is improved, but bandwidth requirements increase

Engineering Contradiction:
Improvetransform precisionVSAvoidbandwidth requirements
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent enables the decoder to autonomously determine transform block sizes by inferring them from the coded block size and the applied transform coding mode, without requiring explicit signaling in the bitstream. The decoder uses predefined rules and relationships between coding block sizes and transform block sizes, combined with the selected transform mode information, to self-determine the appropriate transform block dimensions. This self-service mechanism maintains transform precision while eliminating the bandwidth overhead of explicit signaling.

Inventive Principle:
Principle #25Self-service

3Productivity

If multiple transform coding modes are supported, then coding efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtransform coding mode selection complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the transform coding process by introducing distinct transform coding modes (e.g., horizontal transform, vertical transform, identity transform) that can be selectively applied to different residue blocks based on their characteristics. Each transform coding mode represents a segmented approach to handling different types of residual patterns. By dividing the transform coding into these manageable segments or modes, the patent achieves improved coding efficiency through mode-specific optimization while keeping the complexity of each individual mode relatively simple and manageable.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12368892B2Flexible transform scheme for residual blocks
Publication Date: 2025.07.22 TENCENT AMERICA LLC
  • US12368892B2 patent drawing
  • US12368892B2 patent drawing
  • US12368892B2 patent drawing

AI summary

The various implementations described herein include methods and systems for coding video. In one aspect, a method of video decoding includes receiving video data including a first block and a syntax element, from a video bitstream, where the syntax element is signaled at a first processing unit level. The method further includes selecting a transform coding mode based on the syntax element and performing a transform process for the first block using the selected transform coding mode, where the transform process is performed on a transform block at a second processing unit level, and where the second processing unit level is not signaled (e.g., is inferred from coded information).