Video Block Template Matching for Higher Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies, such as MPEG-2, MPEG-4, AVC, HEVC, and VVC, require further improvements in coding efficiency and effectiveness.
Innovation Solution
Implementing intra block copy (IBC) and intra template matching prediction (IntraTMP) techniques for video processing, including template matching based on block vectors (BV) and IBC merge modes tailored for different content types, and utilizing different block vector difference (BVD) offsets for various directions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If template matching is applied to video blocks with block vectors, then coding efficiency is improved, but processing complexity increases
Solution Approach 1:
The patent performs template matching and block vector determination in advance during the encoding process, establishing prediction models before actual video processing occurs. This preliminary computation of template matches and BV derivation enables more efficient real-time processing while managing complexity through pre-computation.
Solution Approach 2:
The patent implements feedback mechanisms where block vectors derived from template matching are fed back into the system to refine subsequent predictions. The IntraTMP mode uses the block vector from the matched template to generate improved predictions, creating a feedback loop that enhances coding efficiency while the structured feedback process manages computational complexity.
2Productivity
If content-specific IBC merge modes are implemented, then coding effectiveness is improved, but algorithm complexity increases
Solution Approach 1:
The patent applies different IBC merge modes tailored to specific content types (natural content vs. screen content) rather than using a uniform approach. This local quality approach optimizes coding effectiveness for each content type while managing overall complexity by only activating the relevant complex algorithms when needed, rather than always using the most sophisticated method.
Solution Approach 2:
The patent dynamically selects between different IBC merge modes based on content type detection. The system adapts its behavior by switching between natural content processing and screen content processing modes, allowing the algorithm complexity to be dynamically adjusted rather than fixed, thereby optimizing effectiveness without permanently increasing complexity.
3Measurement precision
If multiple BVD offsets are used for different directions, then prediction accuracy is improved, but computational load increases
Solution Approach 1:
The patent segments the prediction process by using different BVD offsets for different spatial directions (horizontal, vertical, diagonal). This segmentation allows the system to optimize prediction accuracy for each direction independently, applying the appropriate offset values that minimize computational load for each specific directional prediction rather than using a uniform high-cost approach for all directions.
Data Source
AI summary
Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, a process is applied to the current video block based on template matching. At least one reference sample of a current template of the current video block is determined based on a block vector (BV) of the current video block during the process. The conversion is performed based on the applying.