History-Based Motion Vector Prediction Using Affine Control Points

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face challenges in efficiently compressing high-quality video data, leading to increased demands on communication networks and storage devices, as they struggle to balance bit rate reduction with maintaining video quality.

Innovation Solution

The implementation of history-based motion vector prediction using affine motion information, which estimates a translational motion vector for a block based on control points and populates a history-based motion vector predictor table, expanding the type of motion information included in the table and improving prediction efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video coding techniques use traditional motion prediction methods, then implementation complexity is low, but video compression efficiency and quality are insufficient

Engineering Contradiction:
Improvevideo compression efficiencyVSAvoidmotion prediction complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The motion model is segmented into multiple control points (e.g., top-left, top-right, bottom-left control points) that independently define motion parameters for different regions of the block. This allows the system to capture complex motion patterns within each block while maintaining manageable computational complexity through localized parameter estimation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extends traditional translational motion models by adding affine transformation dimensions, introducing rotation and scaling parameters alongside translation. This dimensional expansion enables more accurate representation of complex motion patterns such as object rotation and perspective changes, thereby improving compression efficiency for high-quality video.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of substance

If video data is compressed with higher bit rate reduction, then storage and transmission demands decrease, but video quality degradation increases

Engineering Contradiction:
Improvebit rateVSAvoidvideo quality
Core Design Contradiction:
Loss of substanceVSManufacturing precision

Solution Approach 1:

The patent changes the parameters used in motion compensation from simple translational vectors to affine transformation parameters including rotation and scaling. By estimating control point positions and deriving affine parameters (a11, a12, a21, a22, b1, b2) from these control points, the system achieves more accurate motion compensation that maintains video quality even at reduced bit rates.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional block-matching mechanical search methods with analytical affine transformation-based motion estimation. Instead of exhaustively searching reference frames for matching blocks, the system uses control point geometry and affine mathematics to directly compute motion parameters, achieving both computational efficiency and high prediction accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If traditional motion vector prediction is used, then processing speed is high, but prediction accuracy for complex motion patterns is low

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent performs preliminary estimation of control point positions and affine parameters before actual motion compensation. By pre-calculating control point coordinates and deriving affine transformation parameters in advance, the system prepares accurate motion models that can be efficiently applied during encoding/decoding, balancing prediction accuracy with processing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses self-service by deriving affine motion parameters from the video data's own geometric structure (control points within blocks) rather than relying on external reference block matching. This self-contained approach using internal block geometry enables accurate motion estimation for complex patterns while maintaining processing efficiency.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11582475B2History-based motion vector prediction
Publication Date: 2023.02.14 QUALCOMM INC
  • US11582475B2 patent drawing
  • US11582475B2 patent drawing
  • US11582475B2 patent drawing

AI summary

Systems, methods, and computer-readable media are provided for updating history-based motion vector tables. In some examples, a method can include obtaining one or more blocks of video data; determining a first motion vector derived from a first control point of a block of the one or more blocks, the block being coded using an affine motion mode; determining a second motion vector derived from a second control point of the block; based on the first motion vector and the second motion vector, estimating a third motion vector for a predetermined location within the block; and populating a history-based motion vector predictor (HMVP) table with the third motion vector.