DMVR Block Size Restrictions for Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards face challenges in efficiently managing bandwidth demand due to the growing need for digital video transmission, particularly in decoding and encoding processes, where decoder-side motion vector derivation methods are complex and resource-intensive.
Innovation Solution
The implementation of decoder-side motion vector refinement techniques, such as bilateral template matching, which refines motion vectors without additional syntax element transmission, and enables/disables refinement based on video block size and shape conditions to optimize processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If decoder-side motion vector refinement is applied to all video blocks, then motion estimation accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent applies motion vector refinement selectively based on local block characteristics. The refinement process is enabled only for video blocks that meet specific criteria (e.g., block size, motion complexity), rather than uniformly applying it to all blocks. This localized approach maintains high motion estimation accuracy for blocks that benefit from refinement while reducing overall computational complexity.
Solution Approach 2:
The patent changes the parameter of refinement application from a fixed global setting to a dynamic condition-based setting. By introducing conditional parameters (block size thresholds, motion vector differences, reference picture differences), the system adapts the refinement process to match the actual characteristics of each video block, optimizing the balance between accuracy and complexity.
2Manufacturing precision
If motion vector refinement is applied to small video blocks, then coding precision is improved, but processing overhead increases
Solution Approach 1:
The patent implements different refinement strategies for different block sizes. For small blocks (e.g., 4x4, 8x8), refinement is applied selectively based on motion characteristics, while larger blocks receive refinement more consistently. This local differentiation ensures coding precision is improved where needed without incurring excessive processing overhead for all block sizes.
Solution Approach 2:
For small video blocks, the patent applies partial refinement action by using simplified refinement processes or limiting the refinement scope. Instead of fully refining all small blocks, the system applies refinement only to those that exhibit specific motion patterns or exceed certain complexity thresholds, reducing processing overhead while maintaining adequate coding precision.
3Productivity
If decoder-side motion vector refinement is disabled, then processing speed is improved, but video quality deteriorates
Solution Approach 1:
The patent introduces dynamic control of the refinement process based on video content characteristics. The refinement process is not statically enabled or disabled but dynamically adjusted according to block-level metrics such as motion vector differences, reference picture differences, and block size. This dynamic approach ensures video quality is maintained for complex regions while allowing faster processing for simpler regions.
Solution Approach 2:
The system uses feedback from motion estimation results to control the refinement process. By evaluating intermediate results (motion vector differences, template matching scores), the system decides whether to apply refinement, creating a feedback loop that adapts processing speed and quality based on actual video content requirements rather than fixed settings.
Data Source
AI summary
Methods of enabling and disabling a decoder-side motion vector refinement (DMVR) video decoder and/or encoder are described. One example method includes determining a width (W) and a height (H) of a video block, making a determination, based on a condition of the video block, between enabling and disabling a decoder side motion vector refinement step for a conversion between the video block and a coded representation of the video block, in a case that the determination is enabling, performing the conversion by enabling the decoder side motion vector refinement step; and in a case that the determination is disabling, performing the conversion by disabling the decoder side motion vector refinement step, wherein the decoder side motion vector refinement step includes refining value of a motion vector signaled in the coded representation and using the refined value during the conversion.