Combined Inter-Intra Prediction for Low-Complexity Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing video coding technologies, such as VVC, face challenges in efficiently combining inter and intra prediction methods due to high computational complexity, interdependency on neighboring block reconstruction, and non-unified treatment of prediction modes, which hinder real-time decoding and coding efficiency.
Innovation Solution
The proposed methods simplify the combined inter and intra prediction (CIIP) by disabling bi-directional optical flow, converting bi-prediction to uni-prediction for memory and computational efficiency, and harmonizing intra modes for unified MPM candidate lists, reducing complexity and improving throughput.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If combined inter and intra prediction is implemented with bi-directional optical flow, then prediction accuracy is improved, but computational complexity increases significantly
Solution Approach 1:
The patent extracts and removes the bi-directional optical flow (BDOF) component from the combined inter and intra prediction process. By taking out this computationally intensive element, the implementation achieves real-time decoding capability while maintaining the essential CIIP functionality through simplified uni-prediction based merging of inter and intra prediction modes.
2Measurement precision
If bi-prediction is used in CIIP, then prediction quality is improved, but memory bandwidth and computational resources are excessively consumed
Solution Approach 1:
The patent removes bi-prediction from the CIIP process and replaces it with uni-prediction. This extraction of the bi-prediction component significantly reduces memory bandwidth consumption and computational resource usage while preserving the core functionality of combining inter and intra prediction modes for improved prediction quality.
3Adaptability or versatility
If non-unified treatment of prediction modes is applied, then flexibility in mode selection is improved, but decoder complexity and processing time increase
Solution Approach 1:
The patent applies homogeneity by treating all prediction modes (inter and intra) in a unified manner within the CIIP framework. Instead of non-unified treatment with different processing paths, the invention uses a consistent uni-prediction based merging approach for all modes, which reduces decoder complexity and processing time while maintaining adaptability through the unified mode selection mechanism.
4Measurement precision
If dependent reconstruction of neighboring blocks is required, then prediction accuracy is improved, but real-time decoding capability deteriorates
Solution Approach 1:
The patent extracts the strong interdependency on neighboring block reconstruction and replaces it with a more independent processing approach. By using uni-prediction based CIIP that relies less on fully reconstructed neighboring blocks, the invention maintains prediction accuracy while significantly improving decoding throughput and enabling real-time decoding capability.
Data Source
AI summary
A method for video encoding is provided. The method includes: generating, by an encoder, an inter prediction of a current coding block based on an inter prediction mode; generating, by the encoder, an intra prediction of the current coding block based on an intra prediction mode; generating, by the encoder, a final prediction of the current coding block based on the inter prediction and the intra prediction; determining, by the encoder, that a prediction mode of the current coding block is treated as one unified mode when constructing a most probable mode (MPM) list of a neighboring coding block, the unified mode being predefined as an inter mode, or being predefined as an intra mode; and forming, by the encoder, a video bit-stream with information that a combined inter and intra prediction mode is applied to the current coding block.