Matrix-Based Intra Prediction for Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing demand for high-resolution and high-quality images/videos, such as 4K and 8K UHD, leads to higher transmission and storage costs due to increased data amounts, and there is a need for efficient compression techniques to handle immersive media like VR and AR content.
Innovation Solution
The implementation of a matrix-based intra prediction method for image coding, which includes receiving flag information to determine the use of matrix-based intra prediction, deriving intra prediction samples through downsampling and upsampling processes, and encoding these samples to reduce data requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional image coding techniques are used for high-resolution images/videos, then image quality is maintained, but transmission cost and storage cost increase due to increased data amount
Solution Approach 1:
The patent applies parameter changes by using matrix-based intra prediction with different matrix sets (first, second, and third matrix sets) for different block sizes and prediction modes. The encoding apparatus selects appropriate matrices from these sets to transform prediction samples, thereby achieving better compression efficiency while maintaining image quality. This resolves the contradiction by changing the mathematical transformation parameters rather than simply reducing data quantity.
2Measurement precision
If matrix-based intra prediction is applied to all blocks, then prediction performance improves, but device complexity and implementation complexity increase
Solution Approach 1:
The patent applies local quality by differentiating the application of matrix-based intra prediction across different regions and block sizes. Specifically, the encoding apparatus uses different matrix sets for different block size ranges (e.g., 4×4 to 16×16 blocks use one set, while larger blocks use another). This selective application optimizes prediction performance for each local region while avoiding unnecessary complexity in regions where simpler methods suffice.
Solution Approach 2:
The patent segments the intra prediction process into multiple stages: standard intra prediction first, then selective application of matrix-based refinement. The encoding apparatus divides the prediction process into base prediction and enhancement prediction, where only certain blocks receive the computationally intensive matrix transformation. This segmentation reduces overall device complexity while maintaining prediction performance where it matters most.
3Productivity
If multiple matrix sets are used for different block sizes, then compression efficiency improves, but encoding complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-defining three matrix sets with predetermined matrices before the actual encoding process. The encoding apparatus stores these matrix sets in advance and selects from them based on block size and prediction mode, rather than computing optimal matrices in real-time. This preliminary preparation significantly reduces encoding complexity while maintaining the compression efficiency benefits of having multiple matrix sets available.
Data Source
AI summary
An image decoding method according to the present document can comprise the steps of: on the basis of first flag information indicating whether or not matrix-based intra prediction (MIP) can be applied to a current block, receiving second flag information indicating whether or not the MIP is used for the current block; receiving matrix-based intra prediction (MIP) mode information on the basis of the second flag information; generating intra prediction samples for the current block on the basis of the MIP mode information; and generating reconstructed samples for the current block on the basis of the intra prediction samples.