Non-Separable Video Transform for Inter Prediction Luminance Shifts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The non-separable transform technique in existing video coding schemes is ineffective for inter prediction blocks where luminance change occurs, limiting its application to intra prediction blocks with high pixel correlation.

Innovation Solution

A video decoding apparatus and coding apparatus that performs inverse non-separable transform, specifically for inter prediction, without altering the DC component and using a transform matrix with zero edge components, and selects a transform matrix based on intra prediction modes for weighted sums of prediction images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If non-separable transform is applied to inter prediction blocks, then coding efficiency is improved, but luminance change causes transform effectiveness to deteriorate

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtransform effectiveness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies different transform strategies to different frequency components locally. The DC component (top-left coefficient) is preserved without transformation when luminance change is detected, while other frequency components continue to undergo non-separable transform. This local differentiation maintains transform effectiveness for AC components while preserving DC component accuracy in inter prediction blocks with luminance variation.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes the transform parameter (whether to transform the DC component) based on the prediction mode. For inter prediction modes, the DC component transformation is disabled, while for intra prediction modes, it remains enabled. This parameter adaptation allows the system to optimize transform effectiveness for each specific prediction scenario.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If non-separable transform is applied to all prediction blocks, then coding efficiency is improved for intra prediction, but it fails to adapt to inter prediction blocks with luminance change

Engineering Contradiction:
Improvecoding efficiencyVSAvoidadaptability to different prediction modes
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic adaptability by making the transform behavior dependent on the prediction mode. The system automatically adjusts its transform application based on whether the block uses intra or inter prediction, enabling it to adapt to different luminance characteristics. This dynamic approach allows the same transform mechanism to serve multiple prediction scenarios effectively.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a universal transform framework that handles both intra and inter prediction modes through a single adaptive mechanism. By incorporating prediction-mode-based conditional logic, the non-separable transform becomes a multi-functional tool that can effectively process both intra prediction blocks (with high pixel correlation) and inter prediction blocks (with luminance change), eliminating the need for separate transform strategies.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12532028B2Video decoding apparatus and video coding apparatus
Publication Date: 2026.01.20 SHARP KK
  • US12532028B2 patent drawing
  • US12532028B2 patent drawing
  • US12532028B2 patent drawing

AI summary

A video coding/decoding apparatus that can enhance coding efficiency using non-separable transform is provided. A video decoding apparatus according to an aspect of the present invention includes a prediction image generation unit configured to generate a prediction image, and an inverse non-separable transform processing unit configured to perform inverse non-separable transform. The non-separable transform processing unit does not change a specific frequency component of a transform coefficient.