Motion Estimation Block Candidate Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The computational complexity of determining motion vectors for inter-frame prediction techniques in image data encoding hinders real-time or near real-time transmission and display, as it requires searching a large amount of image data to find candidate motion vectors.

Innovation Solution

A motion estimation block is dynamically configured based on operational parameters like image frame resolution, display refresh rate, and power consumption, allowing for efficient setup and reduced operating duration by selecting initial candidate inter-frame prediction modes that minimize pixel search overlap and adjust the search area accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a motion estimation block performs exhaustive search to determine motion vectors for inter-frame prediction, then prediction accuracy is improved, but computational complexity increases and real-time processing capability deteriorates

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by determining a set of candidate motion vectors before the exhaustive search process. These candidate motion vectors are generated based on motion vectors from previously decoded picture blocks, allowing the system to limit the search space to only relevant candidates, thus reducing computational complexity while maintaining prediction accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies local quality by using different strategies for different picture blocks. Instead of applying the same exhaustive search to all blocks, the system uses locally adapted candidate motion vectors specific to each block's characteristics and position, optimizing the balance between accuracy and complexity for local regions

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the motion estimation block searches a large area to find optimal motion vectors, then encoding quality is improved, but processing time increases and real-time transmission capability deteriorates

Engineering Contradiction:
Improveencoding qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-determining candidate motion vectors based on historical motion data before the actual exhaustive search. This preliminary step reduces the effective search area from the entire reference frame to a limited set of promising candidates, thereby reducing processing time while preserving encoding quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies segmentation by dividing the motion estimation process into distinct stages: candidate generation based on previous blocks, and then exhaustive search limited to these candidates. This segmentation allows the system to manage processing time effectively while maintaining quality

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the motion estimation block evaluates multiple candidate prediction modes, then prediction accuracy is improved, but the number of operations increases and operational efficiency deteriorates

Engineering Contradiction:
Improveprediction accuracyVSAvoidoperational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-selecting a limited set of candidate motion vectors based on motion vectors from previously decoded blocks. This preliminary selection reduces the number of candidates that require exhaustive evaluation, thereby improving operational efficiency while maintaining the ability to achieve accurate predictions through subsequent limited exhaustive search

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10477233B2Predictor candidates for motion estimation search systems and methods
Publication Date: 2019.11.12 APPLE INC
  • US10477233B2 patent drawing
  • US10477233B2 patent drawing
  • US10477233B2 patent drawing

AI summary

System and method for improving operational efficiency of a video encoding pipeline used to encode image data. The video encoding pipeline includes a mode decision block, which selects a first inter-frame prediction mode used to prediction encode a first prediction unit, and a motion estimation block, which receives the first inter-frame prediction mode as feedback from the mode decision block when processing a second prediction unit; determines an initial candidate inter-frame prediction mode of the second prediction unit based at least in part on the first inter-frame prediction mode; and determines a final candidate inter-frame prediction mode of the second prediction unit by performing a first motion estimation search based at least in part on the initial candidate inter-frame prediction mode. The mode decision block determines a rate-distortion cost associated with the final candidate inter-frame prediction mode and a prediction mode used to prediction encode the second prediction unit based at least in part on the rate-distortion cost.