Early Termination in Video Encoder Motion Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Motion estimation in video encoding is computationally intensive, particularly due to the need for exhaustive searches in variable block size motion estimation, which hinders efficient encoding and decoding processes.

Innovation Solution

Implementing early termination methods in motion estimation by flagging section sizes that can skip computationally intensive stages based on pre-computed thresholds and distortion metrics, allowing for efficient encoding by skipping unnecessary calculations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If exhaustive search is performed in variable block size motion estimation, then motion estimation accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-computing thresholds based on distortion metrics before the actual motion estimation process. These thresholds are calculated in advance and stored, allowing the encoder to quickly compare against them during processing without performing complex calculations in real-time, thus reducing computational complexity while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements skipping by using early termination criteria that allow the motion estimation process to skip unnecessary calculations. When the distortion metric indicates that further search will not improve the result, the algorithm terminates early and skips the remaining exhaustive search steps, significantly reducing computational complexity while preserving sufficient accuracy.

Inventive Principle:
Principle #21Skipping (Rushing through)

2Measurement precision

If variable block size motion estimation is performed, then encoding accuracy is improved, but encoding time increases

Engineering Contradiction:
Improveencoding accuracyVSAvoidencoding time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-computes thresholds for different block sizes based on distortion metrics before encoding. These pre-computed thresholds are stored and quickly referenced during encoding, eliminating the need for real-time complex calculations and reducing encoding time while maintaining accuracy across different block sizes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses early termination criteria that allow the encoder to skip unnecessary motion estimation calculations for certain block sizes. By comparing distortion metrics against pre-computed thresholds, the encoder can quickly determine when further search is unnecessary and terminate early, significantly reducing encoding time while preserving encoding accuracy.

Inventive Principle:
Principle #21Skipping (Rushing through)

3Reliability

If motion estimation calculations are performed for all section sizes, then completeness is improved, but computational load increases

Engineering Contradiction:
ImprovecompletenessVSAvoidcomputational load
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary computation of thresholds for different section sizes before the actual encoding process. These thresholds are pre-calculated and stored, allowing the encoder to quickly determine which section sizes can be skipped during processing. This preliminary action reduces the computational load during encoding while maintaining completeness by ensuring that only section sizes requiring full analysis are processed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements skipping by using early termination criteria that allow the encoder to skip unnecessary motion estimation calculations for certain section sizes. When distortion metrics indicate that further search will not improve the result, the algorithm terminates early and skips the remaining calculations, significantly reducing computational load while preserving completeness for section sizes that require full analysis.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS8848799B2Utilizing thresholds and early termination to achieve fast motion estimation in a video encoder
Publication Date: 2014.09.30 SONY INTERACTIVE ENTERTAINMENT LLC
  • US8848799B2 patent drawing
  • US8848799B2 patent drawing
  • US8848799B2 patent drawing

AI summary

Fast motion estimation in video encoding may be implemented using early termination. One or more section sizes in a current video picture may be determined for which a portion of motion estimation can be skipped during encoding of the current video picture. The portion of motion estimation may be performed on the current video picture on a section-by-section basis only for one or more section sizes not skipped. The picture may be encoded using the motion estimation performed in b) to produce an encoded picture. The resulting encoded picture may be stored or transmitted. The speedup achieved by skipping part of motion estimation may be regulated by selection of a quality control value.