UMVE Motion Vector Candidate Expansion for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies, such as HEVC, face challenges in improving coding performance and reducing complexity related to Inter prediction, particularly in the UMVE expansion process.

Innovation Solution

The method involves selecting a base candidate from an original Inter candidate list and deriving extended candidates by adding offsets in multiple directions, including horizontal, vertical, and diagonal directions, to form an extended Inter candidate list for encoding or decoding motion information, with the UMVE mode flag enabling additional motion information signaling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the UMVE candidate list is expanded by adding offset vectors in multiple directions, then motion vector prediction accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improvemotion vector prediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The candidate list generation process is segmented into multiple stages: first generating base candidates from neighboring blocks, then selectively expanding with offset vectors in specific directions (horizontal, vertical, diagonal) based on motion characteristics. This segmentation allows the system to achieve comprehensive coverage without uniformly processing all possible directions, thus reducing overall complexity while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of exhaustively searching all possible motion vector directions, the patent applies partial action by selecting and expanding only in the most promising directions (typically 3-4 key directions) based on preliminary motion analysis. This partial expansion achieves sufficient prediction accuracy without the excessive computational cost of complete directional coverage.

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If multiple offset vectors are added to expand the candidate list, then coding performance is improved, but signaling overhead increases

Engineering Contradiction:
Improvecoding performanceVSAvoidsignaling overhead
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent performs preliminary action by pre-defining a set of standard offset vectors with common magnitudes and directions before the actual candidate list construction. These pre-defined offsets are stored in lookup tables or configuration structures, allowing the encoder and decoder to reconstruct the same candidate lists without transmitting the offset values explicitly, thereby reducing signaling overhead while maintaining coding performance.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11539977B2Method and apparatus of merge with motion vector difference for video coding
Publication Date: 2022.12.27 HFI INNOVATION INC
  • US11539977B2 patent drawing
  • US11539977B2 patent drawing
  • US11539977B2 patent drawing

AI summary

A method and apparatus of Inter prediction for video coding using UMVE (Ultimate Motion Vector Expression) are disclosed. According to this method, a base candidate is selected from an original Inter candidate list, where the base candidate has a base prediction direction. One or more extended candidates are derived by adding one or more offsets to the base candidate, where said one or more extended candidates have a same prediction direction as the base prediction direction. The extended candidates are then inserted into the original Inter candidate list to form an extended Inter candidate list for encoding or decoding. According to another method, the UMVE mode is treated as an additional AMVP (Advanced Motion Vector Prediction) mode.