Adaptive Combined Inter-Intra Prediction for Coding Complexity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in efficiently managing bandwidth and line buffers due to the complexity of hybrid video coding structures, particularly with the introduction of advanced prediction methods like affine and sub-block based predictions, which can lead to increased computational demands and inefficiencies.
Innovation Solution
Implementing various video processing techniques that include determining size constraints and conditions for motion vectors, affine models, bi-prediction coding, and combined inter and intra prediction modes to optimize encoding and decoding processes, thereby reducing bandwidth and line buffer requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If advanced prediction methods like affine and sub-block based predictions are used, then prediction accuracy is improved, but bandwidth and line buffer requirements increase
Solution Approach 1:
The current block is divided into multiple sub-blocks, with each sub-block using its own motion vector for prediction. This segmentation allows independent optimization of prediction accuracy for each sub-block while managing bandwidth requirements through selective application of the technique
Solution Approach 2:
Different prediction methods and parameters are applied to different regions of the video block based on local characteristics. The affine model with six parameters is used selectively in regions requiring higher prediction accuracy, while simpler methods are used elsewhere, optimizing the trade-off between accuracy and resource usage
2Adaptability or versatility
If combined inter and intra prediction (CIIP) is applied to all blocks, then encoding flexibility is improved, but computational complexity increases
Solution Approach 1:
CIIP is applied partially rather than universally - specifically to blocks where it provides significant benefit. The patent applies CIIP to blocks with certain characteristics (e.g., blocks where both inter and intra predictions are viable), avoiding its application to blocks where it would add unnecessary complexity
Solution Approach 2:
The prediction mode is made dynamic and adaptive, allowing the encoder to select between inter prediction, intra prediction, and CIIP based on block characteristics and coding conditions. This dynamic selection optimizes the balance between flexibility and computational complexity
Data Source
AI summary
Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.