MIP Intra Prediction Signaling for Lower Video Codec Complexity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high computational complexity and storage requirements of the Matrix-based Intra Prediction (MIP) mode in video encoding and decoding processes hinder efficient implementation, particularly in devices with limited computational capacity or storage, reducing overall efficiency.
Innovation Solution
A method is introduced where a MIP mode parameter is signaled in the bitstream to indicate the use of the MIP mode, allowing decoders to determine and apply the appropriate prediction values, simplifying the prediction process and reducing complexity and storage needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If MIP mode is used for intra prediction, then encoding and decoding performance is improved, but computational complexity and storage space requirements are greatly increased
Solution Approach 1:
The patent segments the MIP mode implementation by introducing a flag mechanism that divides the encoding/decoding process into two paths: simple mode (flag=0) and MIP mode (flag=1). This allows the system to selectively apply the complex MIP algorithm only when necessary, rather than always executing it, thereby reducing average computational complexity while preserving the performance benefits when MIP is actually used.
Solution Approach 2:
The patent makes the MIP mode implementation dynamic by using a configurable flag that can be set at different granularities (sequence, picture, slice, or block level). This dynamic control mechanism allows the system to adaptively switch between simple and MIP-based prediction based on content characteristics and resource availability, optimizing the balance between performance and complexity in real-time.
2Reliability
If MIP mode is used for intra prediction, then encoding and decoding performance is improved, but storage space required is greatly increased
Solution Approach 1:
The patent extracts the MIP mode activation status into a separate flag parameter that is signaled in the bitstream. This extraction allows the decoder to know in advance whether MIP mode will be used, enabling efficient memory allocation and avoiding the need to store pre-computed MIP data structures for all blocks, thereby reducing storage space requirements while maintaining performance when MIP is applied.
3Reliability
If MIP mode is used for intra prediction, then encoding and decoding performance is improved, but overall time required is greatly increased
Solution Approach 1:
The patent applies partial action by using MIP mode selectively rather than universally. The flag mechanism enables the system to apply the time-consuming MIP algorithm only to specific blocks where it provides performance benefits, while using simpler prediction methods for other blocks, thereby reducing the overall processing time while maintaining improved performance where needed.
Data Source
AI summary
A picture prediction method, encoder, decoder and storage medium are provided. If a current block uses an MIP mode to determine its intra prediction value, the encoder sets a value of an MIP mode parameter as indicating use of the MIP mode and signals into a bitstream; determines the MIP mode of the current block and signals into the bitstream; determines, based on the MIP mode, prediction values for luma and chroma components of the current block. The decoder parses the bitstream and determines an MIP mode parameter of the current block; if its value indicates that the current block uses the MIP mode to determine its intra prediction value, parses the bitstream, determines the MIP mode of the current block and prediction values of luma and chroma components of the current block based on the MIP mode; decodes the current block based on prediction values.