Control-Point Motion Refinement from Coded Samples for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/MPEG-4 AVC, ITU-T.265 HEVC, and VVC, face challenges in improving coding efficiency and effectiveness, particularly in handling complex motions like zoom, rotation, and perspective in video encoding/decoding.

Innovation Solution

The proposed method refines affine motion compensation information by refining control point motion vectors (CPMVs) through processes like non-adjacent spatial candidates, history-parameter-based models, and regression-based methods to enhance affine motion prediction in video coding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing video coding technologies (MPEG-2, MPEG-4, H.263, AVC, HEVC, VVC) are used for video encoding/decoding, then video compression is achieved, but coding efficiency and effectiveness are insufficient for handling complex motions like zoom, rotation, and perspective

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcoding effectiveness for complex motions
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent divides the video block into multiple subblocks, each with its own motion compensation parameters. This segmentation allows different regions to handle complex motions independently, improving both coding efficiency and effectiveness for zoom, rotation, and perspective transformations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic motion compensation where motion parameters are not fixed but can be refined based on actual content characteristics. The system dynamically adjusts motion models and parameters to adapt to complex motion patterns, enhancing coding effectiveness while maintaining efficiency.

Inventive Principle:
Principle #15Dynamics

2Reliability

If affine motion compensation is applied to handle complex motions, then motion prediction improves, but the complexity of motion modeling increases

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoidmotion modeling complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

By segmenting the video block into subblocks, the patent simplifies the overall motion modeling complexity. Each subblock can use simpler motion models while collectively capturing complex motion patterns, reducing the computational burden compared to a single complex model for the entire block.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different motion compensation strategies to different subblocks based on their specific motion characteristics. This local quality approach allows simple regions to use simple models while complex regions receive enhanced modeling, optimizing the balance between prediction accuracy and modeling complexity.

Inventive Principle:
Principle #3Local quality

3Reliability

If refinement processes are applied to motion compensation information, then coding effectiveness improves, but processing time increases

Engineering Contradiction:
Improvecoding effectivenessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies refinement processes selectively to only those subblocks or motion parameters that require it, rather than uniformly refining the entire video block. This partial action approach maintains coding effectiveness for complex motion regions while minimizing processing time for simpler regions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The refinement process dynamically adjusts its intensity and scope based on the complexity of motion detected in different regions. Simple regions skip refinement or use minimal processing, while complex regions receive intensive refinement, optimizing the trade-off between coding effectiveness and processing time.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250280145A1Method, apparatus, and medium for video processing
Publication Date: 2025.09.04 DOUYIN VISION CO LTD
  • US20250280145A1 patent drawing
  • US20250280145A1 patent drawing
  • US20250280145A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, affine motion compensation information of the current video block; preforming a refinement process on the affine motion compensation information based on at least one sample previously coded to obtain refined affine motion compensation information; and performing the conversion based on the refined affine motion compensation information.