Intra Block Copy and Template Matching for Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding methods, such as Intra Block Copy (IBC) and Intra Template Matching Prediction (TMP), face inefficiencies in compressing digital video data, leading to suboptimal bit rate usage and video quality degradation.
Innovation Solution
Enhancements to IBC and TMP methods through geometric partitioning modes, combined inter-intra prediction, and motion vector difference techniques, along with history-based motion vector predictors, to improve prediction accuracy and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If Intra Block Copy (IBC) and Intra Template Matching Prediction (TMP) are used for video compression, then bit rate is reduced, but video quality degrades
Solution Approach 1:
The current block is divided into multiple sub-blocks for independent prediction. Each sub-block can use different prediction modes (IBC or TMP), allowing localized optimization of prediction accuracy while maintaining overall compression efficiency. This segmentation enables the system to achieve better video quality at the same bit rate by adapting prediction strategies to local content characteristics.
Solution Approach 2:
The patent combines IBC and TMP methods into a unified prediction framework. The decoder can select between IBC prediction (using reconstructed samples from the same picture) and TMP prediction (using template matching with reference pictures), or combine both approaches. This merging allows the system to leverage the strengths of both methods, improving prediction accuracy and reducing the bitrate-quality trade-off.
2Measurement precision
If Geometric Partitioning Mode (GPM) and Combined Inter-Intra Prediction (CIIP) are applied, then prediction accuracy is improved, but decoding complexity increases
Solution Approach 1:
The patent implements dynamic mode selection where the decoder adaptively chooses between GPM, CIIP, IBC, and TMP modes based on picture type, block characteristics, and available reference data. This dynamic approach allows the system to use complex methods like GPM only when beneficial (e.g., in inter-predicted blocks), while simpler methods are used elsewhere, balancing accuracy and complexity.
Solution Approach 2:
Different prediction modes are applied to different regions of the picture based on local characteristics. GPM and CIIP are primarily used for inter-predicted blocks where motion compensation is beneficial, while IBC and TMP are used for intra-predicted blocks. This localized application of complex algorithms minimizes overall decoding complexity while maintaining high prediction accuracy where needed.
3Productivity
If History-based Motion Vector Predictor (HMVP) candidates are reordered using template matching, then prediction efficiency is improved, but computational load increases
Solution Approach 1:
The patent applies template matching reordering selectively rather than universally. HMVP candidates are reordered using template matching only when the picture type and block characteristics indicate potential benefit (e.g., when reference pictures are available and motion compensation is expected to be effective). This partial application reduces computational load while maintaining prediction efficiency in scenarios where it matters most.
Data Source
AI summary
Methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one method for video decoding, a decoder may obtain a current coding unit (CU) that is coded based on one of Geometric Partitioning Mode (GPM) or Combined Inter-Intra Prediction (CIP) mode. Additionally, the decoder may obtain an Intra Block Copy (IBC) prediction and an intra Template Matching Prediction (TMP) prediction for the current CU. Further, the decoder may obtain a final prediction for the current CU based on the IBC prediction and the intra TMP prediction.