Intra Block Copy Vector Refinement for Finer Video Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face inefficiencies in intra prediction and motion vector prediction, leading to suboptimal compression ratios and increased bandwidth requirements due to the use of less likely prediction directions and coarse motion vector resolution.
Innovation Solution
Implementing a template matching based block vector refinement method for intra block copy (IBC) and intra template matching prediction (IntraTMP) modes, which refine block vectors using finer precision and adaptive motion vector resolution, enhancing the accuracy of prediction by applying template matching techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional intra prediction techniques are used with coarse motion vector resolution, then device complexity is reduced, but video coding efficiency and compression ratio deteriorate
Solution Approach 1:
The patent implements adaptive motion vector resolution where the precision of motion vectors is dynamically adjusted based on block characteristics and prediction mode. The system uses different precision levels (e.g., 1/4-pixel, 1/8-pixel, 1/16-pixel) adaptively selected for different blocks, allowing finer precision when needed for better compression while maintaining coarser precision for simple blocks to reduce complexity.
Solution Approach 2:
The patent changes the precision parameter of motion vectors from fixed coarse resolution to variable fine resolution. By adjusting the motion vector precision parameter based on template matching results and block characteristics, the system achieves better compression ratios for complex blocks while maintaining acceptable performance for simple blocks, thus improving overall video coding efficiency without uniformly increasing device complexity.
2Measurement precision
If template matching based block vector refinement with finer precision is implemented, then prediction accuracy is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent applies local quality by performing template matching and fine precision refinement only on specific blocks where it is most beneficial. The system identifies blocks with high complexity or significant motion and applies refined block vector prediction with template matching to these blocks, while using simpler prediction methods for other blocks. This localized application of high-precision techniques improves prediction accuracy for critical blocks without uniformly increasing computational complexity across the entire video stream.
3Productivity
If adaptive motion vector resolution is used, then compression ratio is improved, but bandwidth and storage requirements may increase due to additional precision data
Solution Approach 1:
The patent uses dynamic adaptive motion vector resolution where the precision level is adjusted based on block characteristics and prediction mode. The system selectively applies different precision levels (1/4-pixel, 1/8-pixel, 1/16-pixel) to different blocks, transmitting only the necessary precision data for each block. This dynamic adaptation improves compression ratio by using finer precision only when it provides significant benefit, while maintaining coarser precision for simple blocks to minimize bandwidth consumption.
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry extracts, from a bitstream, a signal indicative of an application of a template matching based block vector refinement for coding a current block in a current picture referencing (CPR) mode. The processing circuitry derives a first refined block vector associated with the current block according to the template matching based block vector refinement. The first refined block vector includes a first block vector refinement offset applied on a first block vector associated with the current block. The processing circuitry reconstructs the current block according to a first reference block in a same picture as the current block, the first reference block being indicated by the first refined block vector.