Mode-Dependent Transform Signaling for Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies, such as HEVC, face inefficiencies in transform selection and signaling due to the need to test all intra prediction modes with Enhanced Multiple Transform (EMT) and Non-Separable Secondary Transform (NSST) combinations, leading to increased complexity and bit requirements.

Innovation Solution

Implement a mode-dependent transform signaling scheme where transform types are only signaled when specific conditions are met, using default transforms like DCT-2 or DST-7 when conditions are not satisfied, and optimizing transform selection based on intra prediction modes and block characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all intra prediction modes are tested with EMT and NSST combinations, then compression efficiency is improved, but encoding complexity and time consumption increase

Engineering Contradiction:
Improvecompression efficiencyVSAvoidencoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by differentiating the treatment of intra prediction modes based on their specific characteristics. Instead of uniformly testing all modes with EMT and NSST, the patent identifies specific modes (angular modes vs. non-angular modes) and applies transforms selectively. This allows optimized compression for modes that benefit from EMT/NSST while avoiding unnecessary complexity for modes where default transforms suffice.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics through adaptive transform selection based on intra prediction mode characteristics. The system dynamically decides whether to apply EMT, NSST, or default transforms by evaluating the prediction mode type. This dynamic approach enables the encoder to adjust its behavior based on local characteristics of each prediction mode, balancing compression efficiency with encoding complexity.

Inventive Principle:
Principle #15Dynamics

2Reliability

If transform types are signaled for all intra prediction modes, then compression efficiency is improved, but bit requirements increase

Engineering Contradiction:
Improvecompression efficiencyVSAvoidbit requirements
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies local quality by differentiating signaling requirements based on intra prediction mode characteristics. Transform type signaling is selectively applied only to specific modes (angular modes) that benefit from it, while default transforms are used for other modes (non-angular modes) without requiring explicit signaling. This selective approach reduces the overall bit requirements while maintaining compression efficiency for the most beneficial cases.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying transform type signaling only to a subset of intra prediction modes rather than all modes. Specifically, signaling is applied partially to angular modes while default transforms are used for non-angular modes. This partial application reduces the total number of bits required for signaling while still providing optimized compression where most needed.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If EMT and NSST are applied to all intra prediction modes, then compression efficiency is improved, but computational overhead increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidcomputational overhead
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating computational processing based on intra prediction mode characteristics. Instead of uniformly applying EMT and NSST to all modes, the patent selectively applies these computationally intensive transforms only to angular modes that benefit from them, while using simpler default transforms for non-angular modes. This reduces overall computational overhead while maintaining compression efficiency for the most beneficial cases.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying complex transforms (EMT and NSST) only to a subset of intra prediction modes rather than all modes. Specifically, these computationally intensive transforms are applied partially to angular modes while simpler transforms are used for non-angular modes. This partial application significantly reduces computational overhead while still providing optimized compression where most needed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10701358B2Mode dependent primary and secondary transforms
Publication Date: 2020.06.30 TENCENT AMERICA LLC
  • US10701358B2 patent drawing
  • US10701358B2 patent drawing
  • US10701358B2 patent drawing

AI summary

A method and apparatus for signaling a transform type used to encode a current block in an encoded video bitstream includes determining an intra prediction mode of the current block, and determining whether the intra prediction mode satisfies a predetermined condition, wherein in response to determining that the predetermined condition is satisfied, the transform type is signaled in the encoded video bitstream, and in response to determining that the predetermined condition is not satisfied, the transform type comprises a default transform type, and the transform type is not signaled in the encoded video bitstream.