Matrix-Based Intra Prediction With Filtering for Efficient Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently handling high-resolution video data, particularly in terms of bandwidth demand and coding efficiency, especially with the increasing number of connected devices capable of receiving and displaying video content.
Innovation Solution
Implementing matrix-based intra prediction methods, including affine linear weighted intra prediction (ALWIP), which involves boundary downsampling operations followed by matrix vector multiplication and optional upsampling, to enhance video coding efficiency in standards like HEVC and VVC.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If complex algorithms are used to improve video coding efficiency, then coding efficiency improves, but computational complexity increases
Solution Approach 1:
The patent changes the parameters of the prediction process by using matrix-based intra prediction with multiple filtering stages. Instead of using a single complex filtering operation, the patent applies a sequence of filtering stages with different filter kernels and parameters, transforming the prediction process into a multi-stage parameter-driven approach that achieves high coding efficiency while managing computational complexity through systematic parameter variation
Solution Approach 2:
The patent segments the intra prediction process into multiple distinct filtering stages, where each stage performs a specific filtering operation with its own kernel and parameters. This segmentation allows the complex prediction task to be divided into manageable stages, improving coding efficiency through cumulative refinement while keeping each individual stage computationally tractable
2Loss of energy
If high-resolution video is compressed to reduce bandwidth, then bandwidth demand decreases, but coding efficiency deteriorates
Solution Approach 1:
The patent applies preliminary filtering operations to the reference samples before they are used in the prediction process. By pre-processing the reference samples through multiple filtering stages with different kernels, the patent prepares higher-quality prediction data in advance, which improves coding efficiency for high-resolution video compression and reduces the bandwidth required for transmitting compressed video data
Data Source
AI summary
Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on reference boundary samples located to a left of the current video block and located to a top of the current video block, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, where instead of reduced boundary samples calculated from the reference boundary samples of the current video block in the boundary downsampling operation, the reference boundary samples are directly used for a prediction process in the upsampling operation.