Colour-Component MIP Signaling for Efficient Video Block Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently handling high-resolution video data, particularly in terms of bandwidth demand and coding efficiency, especially with the increasing number of connected devices capable of receiving and displaying video.
Innovation Solution
Implementing matrix-based intra prediction methods, including affine linear weighted intra prediction (ALWIP) and secondary transform tools, to enhance video coding efficiency by optimizing the conversion between video blocks and bitstream representations, decoupling signaling of secondary transforms from luminance matrix-based intra prediction, and applying filtering stages with varying precision in upsampling processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional video coding methods are used, then implementation is simpler, but coding efficiency is insufficient for high-resolution video
Solution Approach 1:
The patent segments the intra-prediction process into distinct stages: boundary downsampling to extract key samples, matrix-vector multiplication for prediction calculation, and selective upsampling for resolution restoration. This segmentation allows each stage to be optimized independently, improving overall coding efficiency while maintaining manageable implementation complexity through modular processing.
Solution Approach 2:
The patent introduces matrix-based intra prediction that operates in a transformed mathematical space using matrix-vector multiplication, rather than traditional spatial-domain filtering. This dimensional transformation enables more efficient representation of prediction relationships, achieving better compression ratios for high-resolution video while the standardized matrix operations keep implementation complexity controlled.
2Measurement precision
If matrix-based intra prediction with upsampling is used, then prediction accuracy improves, but computational complexity increases
Solution Approach 1:
The patent applies selective upsampling rather than full upsampling to all prediction blocks. By determining which blocks require upsampling based on specific criteria (such as block size or content characteristics), the method achieves high prediction accuracy where needed while avoiding unnecessary computational complexity in blocks that don't require it, thus balancing accuracy and complexity.
Solution Approach 2:
The patent applies different processing qualities to different regions or blocks of video data. Boundary downsampling extracts key samples at strategic locations, matrix-vector multiplication is applied with appropriate matrix selection based on block characteristics, and upsampling is selectively applied only where beneficial. This local adaptation optimizes prediction accuracy for each block while controlling overall computational complexity.
Data Source
AI summary
Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes generating, for a conversion between a current video block of a video including multiple video blocks and a bitstream representation of the video, a most probable mode (MPM) list for a matrix based intra prediction (MIP) tool based on a rule, where, the MIP tool includes determining, during the conversion, a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, and where the rule specifies a mapping between a number of MIP modes and dimensions of the multiple video blocks; and performing the conversion based on the generating.