Matrix-Based Intra Prediction for High-Resolution Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently handling high-resolution video data, particularly in terms of bandwidth demand and coding efficiency, especially with the increasing number of connected devices capable of receiving and displaying video content.
Innovation Solution
Implementing matrix-based intra prediction methods, including affine linear weighted intra prediction (ALWIP) modes, which involve boundary downsampling, matrix vector multiplication, and optional upsampling operations to enhance video coding efficiency in existing standards like HEVC and future standards like VVC.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional intra prediction methods are used, then implementation is simpler, but coding efficiency is insufficient for high-resolution video
Solution Approach 1:
The patent changes the parameters of intra prediction by introducing matrix-based prediction with multiple matrix types (first type for blocks with width greater than height, second type for blocks with height greater than or equal to width) and different boundary downsampling configurations, thereby improving coding efficiency while maintaining manageable complexity through parameterized adaptation to block characteristics
Solution Approach 2:
The patent applies different matrix types and prediction configurations to different local regions based on block dimensions (width vs height relationships), allowing the prediction method to adapt locally to the specific geometry of each video block, improving overall coding efficiency without requiring complex global processing
2Loss of energy
If high-resolution video is processed with conventional methods, then bandwidth demand increases, but coding efficiency remains limited
Solution Approach 1:
The patent uses boundary samples from previously coded video blocks as reference data for prediction, creating a copied reference framework that enables efficient prediction of current blocks without transmitting redundant information, thereby reducing bandwidth consumption while maintaining high compression efficiency for high-resolution video
3Measurement precision
If matrix operations are applied to all blocks, then prediction accuracy improves, but computational complexity increases
Solution Approach 1:
The patent applies matrix-based prediction operations selectively based on block characteristics (dimension relationships) rather than uniformly to all blocks, performing the computationally intensive matrix operations only where they provide the most benefit, thereby balancing prediction accuracy with computational complexity
Solution Approach 2:
The patent segments the prediction process into different matrix types (first type and second type) based on block geometry, allowing simplified or optimized matrix operations for specific block categories while applying more complex operations only where necessary, thus reducing overall computational complexity while maintaining accuracy
Data Source
AI summary
Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block according to a rule, where the rule specifies a relationship between samples of the current video block and matrices or offset values applied in a matrix weighted intra prediction (MIP) mode during the conversion, and where the MIP mode includes determining a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.