IBC Merge Candidate Template Matching for Video Block Vector Refinement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently reducing redundancy in video signals, particularly in intra prediction, where traditional methods do not effectively utilize reference data from neighboring blocks.
Innovation Solution
The proposed solution involves an apparatus for video decoding that performs template matching based on an initial block vector to determine a refined block vector for intra block copy (IBC) mode, allowing for more accurate prediction and reconstruction of video blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional intra prediction methods are used, then device complexity is reduced, but coding efficiency and compression ratio deteriorate
Solution Approach 1:
The patent introduces an intermediary template matching process between the initial block vector determination and the final reference block selection. This intermediary step refines the block vector by comparing templates from multiple candidates, improving prediction accuracy without requiring complete reconstruction of the traditional complex intra prediction pipeline
Solution Approach 2:
The patent performs preliminary actions by constructing a list of IBC merge candidates and determining an initial block vector before the actual prediction process. This preliminary preparation enables the template matching to operate on pre-processed data, improving coding efficiency while managing device complexity through staged processing
2Measurement precision
If template matching with multiple candidates is performed, then prediction accuracy is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent segments the candidate selection process into distinct stages: constructing IBC merge candidates, determining initial block vector, performing template matching on candidates, and selecting the final reference block. This segmentation allows template matching to focus computational resources on refining a manageable set of candidates rather than searching the entire picture
Solution Approach 2:
The patent applies local quality by performing template matching only on specific IBC merge candidates that are locally relevant to the current block, rather than comparing against all possible blocks in the picture. This localized approach maintains prediction accuracy while reducing computational complexity by focusing on the most promising candidates
3Productivity
If IBC merge mode is used, then compression ratio is improved, but processing overhead increases
Solution Approach 1:
The patent merges the block vector determination and reference block selection processes into a unified IBC merge mode operation. By combining these steps and using template matching to simultaneously evaluate multiple candidates, the system achieves better compression ratios while managing processing overhead through integrated rather than separate operations
Data Source
AI summary
A method of video processing in a decoder includes determining, by a processor, an initial block vector for predicting a current block in a current coding tree unit (CTU) in response to the current block being predicted in an intra block copy (IBC) mode. The initial block vector is determined based on a merge index included in a coded video bitstream. The method further includes performing, by the processor, template matching based on the initial block vector indicated by the merge index in the video bitstream to determine a refined block vector that points to a reference block in a picture as the current block, and reconstructing, by the processor, the current block based on the reference block.