Staged Motion Vector Search Space Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video codecs face inefficiencies in motion vector estimation, which affects coding efficiency and complexity, particularly in accurately predicting motion between video frames while minimizing signaling overhead.

Innovation Solution

A scheme is introduced to construct a search space for motion vector refinement, involving a first and second search space, where the number and positions of candidate motion vectors in the second search space are determined based on a cost function, allowing for reduced candidate vectors tested while maintaining high coding performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a large number of candidate motion vectors are tested during refinement, then motion vector estimation accuracy is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improvemotion vector estimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The search space is divided into a first search space containing a first plurality of candidate motion vectors and a second search space containing a second plurality of candidate motion vectors. The first search space is determined based on an initial estimate, while the second search space is determined based on candidate motion vectors from the first search space, enabling staged refinement without testing all possible vectors simultaneously

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An initial estimate of the motion vector is obtained first, and a first search space comprising multiple candidate motion vectors is determined based on this initial estimate before performing the final refinement. This preliminary action reduces the search space for the final refinement stage

Inventive Principle:
Principle #10Preliminary action

2Reliability

If motion vector refinement is performed with extensive search spaces, then coding performance is improved, but signaling overhead increases

Engineering Contradiction:
Improvecoding performanceVSAvoidsignaling overhead
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent extracts and signals only the necessary information (first and second search spaces or candidate motion vectors) rather than signaling all possible candidate motion vectors. This selective extraction maintains coding performance while reducing the amount of information that needs to be transmitted

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of signaling all possible candidate motion vectors (excessive action), the patent signals only the first and second search spaces which contain the necessary candidate vectors for refinement (partial action). This partial signaling is sufficient to achieve the desired coding performance

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11736718B2Search region for motion vector refinement
Publication Date: 2023.08.22 HUAWEI TECH CO LTD
  • US11736718B2 patent drawing
  • US11736718B2 patent drawing
  • US11736718B2 patent drawing

AI summary

The embodiments disclosed herein relate to the construction of a search space for determining a motion vector for a current block of a picture in a video sequence. The search space construction is split into in two main stages, wherein a first and a second partial search space are respectively determined. Based on an initial estimate of a motion vector, a first search space is first constructed. A first and a second candidate motion of the first search space are identified according to a cost function. Based on the first and the second candidate motion vectors, a second search space is constructed. The motion vector for the current block is selected from the candidate motion vectors of the first search space and the second search space.