Video Encoder Transform Selection Based on Block Size and Prediction Mode

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in efficiently reducing redundancy in video signals through compression, particularly in inter-picture prediction modes, which affects bandwidth and storage requirements.

Innovation Solution

A modified implicit transform method and an implicit transform selection method for inter position-dependent prediction combination (PDPC) prediction mode are introduced, where the primary transform type is determined based on block size and neighboring block coding modes, applying discrete sine transforms (DST) or discrete cosine transforms (DCT) to optimize prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If traditional video coding techniques are used for inter-picture prediction, then bandwidth and storage requirements are high, but compression efficiency is insufficient

Engineering Contradiction:
Improvebandwidth and storage requirementsVSAvoidcompression efficiency
Core Design Contradiction:
Loss of energyVSProductivity

Solution Approach 1:

The patent applies different primary transform types (DST-7, DCT-2, transform skip) based on block size and prediction mode parameters. By dynamically selecting transform parameters according to specific conditions (e.g., using DST-7 for small blocks in certain prediction modes), the coding efficiency is improved while reducing bitrate requirements

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies different transform types to different regions (blocks) based on their local characteristics such as block size and prediction mode. This localized approach allows optimal transform selection for each block, improving overall compression efficiency without uniformly increasing complexity across the entire video stream

Inventive Principle:
Principle #3Local quality

2Productivity

If transform types are fixed for all blocks, then processing is simple, but coding efficiency is reduced

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtransform selection complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces dynamic transform selection where the primary transform type is determined based on block size and prediction mode. This dynamic adaptation allows the system to optimize coding efficiency for different block characteristics while maintaining a limited set of transform options, balancing complexity and performance

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If filtering is applied to all blocks, then prediction accuracy improves, but computational complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies filtering operations selectively to specific blocks based on their characteristics (block size, prediction mode) rather than uniformly to all blocks. This partial application of filtering maintains prediction accuracy for blocks that benefit from it while reducing unnecessary computational complexity for blocks where filtering provides minimal gain

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12143636B2Method and apparatus for performing primary transform based on filtering of blocks
Publication Date: 2024.11.12 TENCENT AMERICA LLC
  • US12143636B2 patent drawing
  • US12143636B2 patent drawing
  • US12143636B2 patent drawing

AI summary

A method of video encoding for an encoder includes generating first information included in prediction information for a current block, the first information indicating whether a filtering process is applied on the current block. The filtering process adjusts inter prediction samples of the current block based on neighboring reconstructed samples of the current block. The method further includes generating second information included in the prediction for the current block, the second information corresponding to a primary transform for a transform block that is partitioned from the current block. The method further includes generating a bitstream including the prediction information for the current block, the prediction information including the first information and the second information, the prediction information being indicative of the inter prediction mode.