Matrix-Based Intra Prediction Signaling for Lower VVC Complexity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high computational complexity and storage requirements of Matrix-based Intra Prediction (MIP) in Versatile Video Coding (VVC) lead to inefficiencies in encoding and decoding processes, making it difficult to implement on devices with limited resources.
Innovation Solution
A method is introduced where a MIP mode parameter is set and signaled in the bitstream to indicate the use of the MIP mode, allowing decoders to determine the MIP mode and prediction values, simplifying the prediction process and reducing complexity and storage needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If MIP mode is used for intra prediction, then encoding and decoding performance is improved, but computational complexity and storage requirements are greatly increased
Solution Approach 1:
The patent changes the parameters of the prediction process by using downsampled reference blocks instead of full-resolution blocks in the matrix multiplication operation. This parameter change reduces the computational complexity and storage requirements while maintaining the essential functionality of MIP mode for improved encoding and decoding performance.
2Measurement precision
If MIP mode is used for intra prediction, then prediction accuracy is improved, but overall time required for encoding and decoding is greatly increased
Solution Approach 1:
The patent performs downsampling of reference blocks before the matrix multiplication operation. This preliminary action reduces the data size that needs to be processed in subsequent steps, thereby reducing the overall processing time while maintaining prediction accuracy through the preserved essential features in the downsampled blocks.
Solution Approach 2:
The patent divides the prediction process into distinct stages: downsampling of reference blocks, matrix multiplication with downsampled blocks, and interpolation to generate final prediction values. This segmentation allows optimization at each stage, particularly reducing time consumption in the computationally intensive matrix multiplication phase by using smaller downsampled blocks.
3Manufacturing precision
If MIP mode is used for intra prediction, then prediction quality is improved, but storage space required is greatly increased
Solution Approach 1:
The patent changes the resolution parameter of reference blocks from full-resolution to downsampled resolution. This parameter change significantly reduces the storage space required for storing reference block data and intermediate calculation results, while the downsampled blocks still contain sufficient information to maintain good prediction quality.
Data Source
AI summary
A picture prediction method, encoder, decoder and storage medium are provided. If a current block uses an MIP mode to determine its intra prediction value, the encoder sets a value of an MIP mode parameter as indicating use of the MIP mode and signals into a bitstream; determines the MIP mode of the current block and signals into the bitstream; determines, based on the MIP mode, prediction values for luma and chroma components of the current block. The decoder parses the bitstream and determines an MIP mode parameter of the current block; if its value indicates that the current block uses the MIP mode to determine its intra prediction value, parses the bitstream, determines the MIP mode of the current block and prediction values of luma and chroma components of the current block based on the MIP mode; decodes the current block based on prediction values.