Control-Point Motion Refinement from Coded Samples for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/MPEG-4 AVC, ITU-T.265 HEVC, and VVC, face challenges in improving coding efficiency and effectiveness, particularly in handling complex motions like zoom, rotation, and perspective in video encoding/decoding.
Innovation Solution
The proposed method refines affine motion compensation information by refining control point motion vectors (CPMVs) through processes like non-adjacent spatial candidates, history-parameter-based models, and regression-based methods to enhance affine motion prediction in video coding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If existing video coding technologies (MPEG-2, MPEG-4, H.263, AVC, HEVC, VVC) are used for video encoding/decoding, then video compression is achieved, but coding efficiency and effectiveness are insufficient for handling complex motions like zoom, rotation, and perspective
Solution Approach 1:
The patent divides the video block into multiple subblocks, each with its own motion compensation parameters. This segmentation allows different regions to handle complex motions independently, improving both coding efficiency and effectiveness for zoom, rotation, and perspective transformations.
Solution Approach 2:
The patent introduces dynamic motion compensation where motion parameters are not fixed but can be refined based on actual content characteristics. The system dynamically adjusts motion models and parameters to adapt to complex motion patterns, enhancing coding effectiveness while maintaining efficiency.
2Reliability
If affine motion compensation is applied to handle complex motions, then motion prediction improves, but the complexity of motion modeling increases
Solution Approach 1:
By segmenting the video block into subblocks, the patent simplifies the overall motion modeling complexity. Each subblock can use simpler motion models while collectively capturing complex motion patterns, reducing the computational burden compared to a single complex model for the entire block.
Solution Approach 2:
The patent applies different motion compensation strategies to different subblocks based on their specific motion characteristics. This local quality approach allows simple regions to use simple models while complex regions receive enhanced modeling, optimizing the balance between prediction accuracy and modeling complexity.
3Reliability
If refinement processes are applied to motion compensation information, then coding effectiveness improves, but processing time increases
Solution Approach 1:
The patent applies refinement processes selectively to only those subblocks or motion parameters that require it, rather than uniformly refining the entire video block. This partial action approach maintains coding effectiveness for complex motion regions while minimizing processing time for simpler regions.
Solution Approach 2:
The refinement process dynamically adjusts its intensity and scope based on the complexity of motion detected in different regions. Simple regions skip refinement or use minimal processing, while complex regions receive intensive refinement, optimizing the trade-off between coding effectiveness and processing time.
Data Source
AI summary
Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, affine motion compensation information of the current video block; preforming a refinement process on the affine motion compensation information based on at least one sample previously coded to obtain refined affine motion compensation information; and performing the conversion based on the refined affine motion compensation information.


