Template-Matched Motion Vector Derivation in Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face inefficiencies in deriving motion information, particularly in inter prediction, where signaling motion vectors can be complex and resource-intensive, and existing methods do not effectively optimize the tradeoff between coding performance and complexity.
Innovation Solution
The proposed solution involves template-matched motion vector derivation, where motion information is not signaled but rather derived at the decoder side using template matching, allowing for adaptive template sizes and refinement based on template matching costs, optimizing the search order and precision for improved coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion information is signaled in the bitstream, then motion vector accuracy is improved, but bitstream complexity and transmission overhead increase
Solution Approach 1:
The patent uses template matching to copy motion patterns from reference blocks to derive motion vectors at the decoder side, eliminating the need to signal motion information in the bitstream while maintaining accurate motion compensation
Solution Approach 2:
The decoder performs self-service by deriving motion vectors locally using template matching algorithms, reducing dependency on signaled motion information and minimizing bitstream overhead
2Measurement precision
If template matching is performed with high precision, then motion vector accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent performs template matching only on selected candidate blocks rather than all possible blocks, and uses adaptive template sizes that are smaller than the full video block, reducing computational complexity while maintaining sufficient accuracy
Solution Approach 2:
The patent dynamically adjusts template size parameters based on block characteristics and motion complexity, using smaller templates for simple regions and larger templates for complex motion areas, optimizing the tradeoff between accuracy and computational cost
3Productivity
If adaptive template sizes are used, then coding efficiency is improved, but processing complexity increases
Solution Approach 1:
The patent applies different template sizes to different regions and blocks based on their local characteristics, using larger templates for blocks with complex motion patterns and smaller templates for blocks with simple motion, thereby improving coding efficiency without uniformly increasing processing complexity across the entire video
Data Source
AI summary
Embodiments of the present disclosure provide methods, apparatuses and computer storage media for video processing. One example method comprises determining, during a conversion between a current video block of a video and a bitstream of the video, at least one set of motion candidates for the current video block, each motion candidate comprising predicted motion information determined from neighboring video blocks of the current video block; determining, based on a template of the current video block and from the at least one set of motion candidates, a target motion candidate for the current video block by using a template matching cost rule; and performing the conversion based on the target motion candidate.