Extended Transform Selection in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques, such as those in the High Efficiency Video Coding (HEVC) standard, limit the number of transforms to DCT-2, DST-7, and DCT-8, excluding other transforms that could provide more flexibility with competitive computation complexity and memory usage, thereby potentially reducing coding efficiency.

Innovation Solution

Incorporating additional transforms like DCT-3, DST-2, DST-3, DCT-4, DST-4, DST-5, DST-6, and an identity transform into the transform coding scheme, allowing for more flexible transform selection without increasing computation complexity or memory usage, by using a set of inverse and discrete cosine transforms and discrete sine transforms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If additional transforms (DCT-3, DST-2, DST-3, DCT-4, DST-4, DST-5, DST-6) are included in the transform coding scheme, then coding flexibility and efficiency are improved, but device complexity increases

Engineering Contradiction:
Improvecoding flexibilityVSAvoidtransform selection complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The transform selection process is segmented into two stages: first selecting between DST and DCT based on prediction mode, then selecting specific transform types based on block size. This segmentation reduces the overall complexity by breaking down the transform selection into manageable decision trees rather than evaluating all transform options simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The transform selection is made dynamic and adaptive based on coding conditions. The encoder dynamically selects transforms from the extended set based on prediction mode and block size, allowing the system to adapt to different coding scenarios while maintaining manageable complexity through conditional selection rules.

Inventive Principle:
Principle #15Dynamics

2Productivity

If a larger set of transforms is used for transform coding, then compression performance is improved, but computation complexity increases

Engineering Contradiction:
Improvecompression performanceVSAvoidcomputation complexity
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

Different transforms are assigned to different local coding conditions (prediction modes and block sizes). Specifically, DST transforms are used for certain prediction modes while DCT transforms are used for others, and specific transform types are selected based on block dimensions. This local optimization allows the system to achieve better compression performance by matching transforms to local characteristics without requiring all transforms to be evaluated everywhere.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of using all available transforms for all blocks, the system applies transforms selectively based on coding conditions. The extended transform set provides more options, but only the appropriate transforms are applied to each block based on prediction mode and size, avoiding unnecessary computation while maintaining the ability to achieve superior compression when needed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11259052B2Transform variations of multiple separable transform selection
Publication Date: 2022.02.22 QUALCOMM INC
  • US11259052B2 patent drawing
  • US11259052B2 patent drawing
  • US11259052B2 patent drawing

AI summary

This disclosure describes examples of extending the number of available discrete cosine transform (DCT) and discrete sine transform (DST) for encoding and decoding. A video coder may determine one or more transforms or inverse transforms to apply from a set of transforms or inverse transforms that includes DCT-2 or inverse DCT-2, DST-7 or inverse DST-7, DST-8 or inverse DST-8, DCT-3 or inverse DCT-3, DST-2 or inverse DST-2, DST-3 or inverse DST-3, DCT-4 or inverse DCT-4, DST-4 or inverse DST-4, DST-5 or inverse DST-5, DST-6 or inverse DST-6, and identity transform an inverse identity transform (IDT).