MIP Intra Prediction Signaling for Lower-Complexity VVC Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high complexity and increased storage space and time requirements of the Matrix-based Intra Prediction (MIP) mode in Versatile Video Coding (VVC) reduce encoding and decoding efficiency.
Innovation Solution
A method is introduced to signal the MIP mode parameter in the bitstream, allowing the encoder to determine and signal the MIP mode for a current block, and the decoder to parse and determine the MIP mode accordingly, simplifying the prediction process and reducing complexity and storage space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If MIP mode is used for intra prediction, then encoding and decoding performance is improved, but complexity and storage space requirements increase
Solution Approach 1:
The patent extracts the MIP mode parameter signaling from the complex MIP prediction process, separating the mode selection and signaling from the actual prediction computation. This allows the decoder to identify when MIP mode is used without fully executing the complex MIP algorithm, thereby reducing unnecessary computational complexity while maintaining the performance benefits where needed.
Solution Approach 2:
The patent implements partial MIP mode processing by signaling only the essential MIP mode parameter in the bitstream rather than transmitting full prediction data. This partial action approach reduces the storage space and processing requirements while preserving the core functionality of MIP mode for improving encoding and decoding performance.
2Measurement precision
If MIP mode is used for intra prediction, then prediction accuracy is improved, but overall time required for encoding and decoding increases
Solution Approach 1:
The patent performs preliminary action by signaling the MIP mode parameter in advance during the encoding phase. This allows the decoder to prepare for MIP mode processing beforehand, reducing the overall time required during decoding by avoiding last-minute computations and enabling more efficient time management of the prediction process.
Solution Approach 2:
The patent changes the parameter representation by using a compact MIP mode parameter that can be efficiently signaled in the bitstream. This parameter change from full prediction data to a concise mode indicator reduces the time required for data transmission and processing while maintaining the accuracy benefits of MIP mode prediction.
3Ease of operation
If MIP mode parameter is signaled in bitstream, then decoder can determine MIP mode efficiently, but bitstream overhead increases
Solution Approach 1:
The patent applies local quality by signaling the MIP mode parameter selectively rather than universally. The parameter is included in the bitstream only when MIP mode is actually used for a given block, allowing the decoder to efficiently determine MIP mode usage without incurring overhead for all blocks. This localized approach balances decoder efficiency with bitstream economy.
Data Source
AI summary
A picture prediction method, encoder, decoder and storage medium are provided. If a current block uses an MIP mode to determine its intra prediction value, the encoder sets a value of an MIP mode parameter as indicating use of the MIP mode and signals into a bitstream; determines the MIP mode of the current block and signals into the bitstream; determines, based on the MIP mode, prediction values for luma and chroma components of the current block. The decoder parses the bitstream and determines an MIP mode parameter of the current block; if its value indicates that the current block uses the MIP mode to determine its intra prediction value, parses the bitstream, determines the MIP mode of the current block and prediction values of luma and chroma components of the current block based on the MIP mode; decodes the current block based on prediction values.