Non-Separable Video Transform for Inter Prediction Luminance Shifts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The non-separable transform technique in existing video coding schemes is ineffective for inter prediction blocks where luminance change occurs, limiting its application to intra prediction blocks with high pixel correlation.
Innovation Solution
A video decoding apparatus and coding apparatus that performs inverse non-separable transform, specifically for inter prediction, without altering the DC component and using a transform matrix with zero edge components, and selects a transform matrix based on intra prediction modes for weighted sums of prediction images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If non-separable transform is applied to inter prediction blocks, then coding efficiency is improved, but luminance change causes transform effectiveness to deteriorate
Solution Approach 1:
The patent applies different transform strategies to different frequency components locally. The DC component (top-left coefficient) is preserved without transformation when luminance change is detected, while other frequency components continue to undergo non-separable transform. This local differentiation maintains transform effectiveness for AC components while preserving DC component accuracy in inter prediction blocks with luminance variation.
Solution Approach 2:
The patent dynamically changes the transform parameter (whether to transform the DC component) based on the prediction mode. For inter prediction modes, the DC component transformation is disabled, while for intra prediction modes, it remains enabled. This parameter adaptation allows the system to optimize transform effectiveness for each specific prediction scenario.
2Productivity
If non-separable transform is applied to all prediction blocks, then coding efficiency is improved for intra prediction, but it fails to adapt to inter prediction blocks with luminance change
Solution Approach 1:
The patent introduces dynamic adaptability by making the transform behavior dependent on the prediction mode. The system automatically adjusts its transform application based on whether the block uses intra or inter prediction, enabling it to adapt to different luminance characteristics. This dynamic approach allows the same transform mechanism to serve multiple prediction scenarios effectively.
Solution Approach 2:
The patent creates a universal transform framework that handles both intra and inter prediction modes through a single adaptive mechanism. By incorporating prediction-mode-based conditional logic, the non-separable transform becomes a multi-functional tool that can effectively process both intra prediction blocks (with high pixel correlation) and inter prediction blocks (with luminance change), eliminating the need for separate transform strategies.
Data Source
AI summary
A video coding/decoding apparatus that can enhance coding efficiency using non-separable transform is provided. A video decoding apparatus according to an aspect of the present invention includes a prediction image generation unit configured to generate a prediction image, and an inverse non-separable transform processing unit configured to perform inverse non-separable transform. The non-separable transform processing unit does not change a specific frequency component of a transform coefficient.


