Sub-Block Motion Prediction With Iterative Vector Refinement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in efficiently predicting motion vectors for video blocks, particularly in handling sub-blocks within a coding unit, leading to inefficiencies in encoding and decoding processes.
Innovation Solution
The proposed solution involves splitting video blocks into sub-blocks and refining motion information using a motion refinement process, which can be one-step or iterative, and performing video processing based on the refined motion information for each sub-block.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion compensation is performed on the entire video block as a single unit, then the encoding process is simple and fast, but the motion prediction accuracy is insufficient for blocks with complex motion patterns
Solution Approach 1:
The video block is divided into multiple sub-blocks, and motion compensation is performed independently for each sub-block. This segmentation allows the encoder to capture different motion patterns within different regions of the block, significantly improving motion prediction accuracy for complex motion scenarios while maintaining a manageable encoding complexity through systematic processing
2Measurement precision
If motion information is refined using an iterative multi-step refinement process, then the motion compensation accuracy is improved, but the computational time and complexity increase
Solution Approach 1:
The patent implements an optional iterative refinement process where the encoder can choose to perform motion refinement for one or more iterations depending on the complexity of the motion pattern detected in the block. For simple motion patterns, only one refinement step is performed, while for complex patterns, multiple iterations are applied. This selective approach ensures high accuracy for difficult cases while minimizing processing time for easier cases
3Reliability
If the video block is split into multiple sub-blocks for motion compensation, then the motion prediction accuracy improves, but the encoding complexity and processing overhead increase
Solution Approach 1:
The patent dynamically adjusts the number of sub-blocks and the level of motion refinement based on the characteristics of each video block. For blocks with simple motion patterns, fewer sub-blocks are used or even a single block is processed as one unit. For blocks with complex motion patterns, the block is divided into more sub-blocks with iterative refinement. This dynamic adaptation optimizes the balance between reliability and complexity for each specific case
Data Source
AI summary
A method for video processing includes: determining, that the video block is split into a plurality of sub-blocks based on a condition associated with the video block, refining motion information of each sub-block using a motion refinement process, the motion refinement process being a one-step or an iterative multi-step refinement process; and performing a video processing on the video block based on the refined motion information of each sub-block.