Combined Inter-Intra Prediction for Lower-Complexity Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in efficiently managing bandwidth and line buffers due to the complexity of hybrid video coding structures, particularly with the introduction of advanced prediction methods like affine and sub-block based predictions, which can lead to increased computational demands and inefficiencies.
Innovation Solution
The proposed methods involve determining various constraints and conditions for video blocks to apply coding tools such as affine models, bi-prediction, and combined inter-intra prediction, while optimizing motion vector precision and using simplified affine merge candidates to reduce computational complexity and buffer requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If advanced prediction methods like affine and sub-block based predictions are used, then prediction accuracy is improved, but computational complexity and bandwidth usage increase
Solution Approach 1:
The current block is divided into multiple sub-blocks, and affine prediction is applied independently to each sub-block. This segmentation allows the patent to achieve high prediction accuracy for complex motion patterns while managing computational complexity by processing smaller, independent regions rather than the entire block at once.
Solution Approach 2:
Different prediction methods are applied to different regions of the video block based on local characteristics. The patent uses affine prediction for sub-blocks where complex motion is detected and simpler prediction methods for other regions, optimizing the trade-off between accuracy and computational load in different local areas.
2Measurement precision
If advanced prediction methods like affine and sub-block based predictions are used, then prediction accuracy is improved, but bandwidth usage increases
Solution Approach 1:
The patent extracts and transmits only the essential affine parameters (control point motion vectors) rather than complete motion information for each sub-block. This extraction approach reduces the bandwidth required to transmit prediction data while maintaining sufficient accuracy for reconstruction.
Solution Approach 2:
The patent uses differential encoding for affine parameters, where only the differences from reference values are transmitted. This parameter transformation reduces the number of bits required to represent the same prediction information, thereby reducing bandwidth usage while preserving prediction accuracy.
3Productivity
If combined inter-intra prediction is used, then coding efficiency is improved, but device complexity increases
Solution Approach 1:
The patent dynamically selects between inter prediction, intra prediction, and their combination based on the characteristics of the current block and surrounding context. This dynamic adaptation allows the system to achieve high coding efficiency for diverse content types while managing device complexity through conditional logic rather than always employing the most complex method.
Solution Approach 2:
The patent uses a mode selection mechanism that changes the prediction parameters based on block characteristics, neighboring block modes, and rate-distortion optimization results. This parameter adaptation enables efficient coding by selecting the appropriate prediction strategy for each block while keeping the overall system complexity manageable through standardized decision logic.
Data Source
AI summary
Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CHIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.