Unified Search Window for Multi-Standard Video Motion Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video encoding, particularly motion estimation, is resource-intensive and requires significant data bandwidth and processor computation, making it challenging to achieve high quality and real-time encoding compatible with multiple encoding formats.

Innovation Solution

A unified search window approach for hierarchical motion searches is implemented, allowing the same hardware motion estimation search processing unit to process multiple video formats efficiently by performing motion estimations using different block sizes in parallel, reducing computational resources and data bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If motion estimation is performed for multiple video formats using separate processing units, then compatibility with multiple encoding formats is improved, but device complexity and computational resources increase

Engineering Contradiction:
Improvecompatibility with multiple encoding formatsVSAvoidcomputational resources
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a unified search window that serves multiple video encoding formats (H.264, H.265, etc.) through a single processing unit. The search window is configured with dimensions that accommodate the largest format requirements, and the same hardware unit dynamically adjusts its operation to support different block sizes and partition configurations across various codecs, eliminating the need for separate dedicated processing units for each format.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The search processing unit employs dynamic configuration capabilities, adjusting its operational parameters such as search window size, block dimensions, and partitioning schemes based on the target video format being encoded. This dynamic adaptability allows the same hardware to efficiently handle different encoding standards without requiring static dedicated structures for each format.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If motion estimation search range is increased to improve search accuracy, then measurement precision is improved, but data bandwidth and processing time increase

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the large search window into multiple smaller search regions or zones, each processed independently or in parallel. This segmentation allows the system to maintain a large overall search range for accuracy while breaking down the computational task into manageable segments, reducing the time complexity from examining every position in a large window to processing smaller regions systematically.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary motion estimation at lower resolutions or with coarser search steps before refining the search in the final high-precision stage. This multi-stage approach allows the large search window to be explored efficiently by first identifying candidate regions with broader steps, then concentrating detailed search efforts only in promising areas, thereby maintaining accuracy while reducing overall processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11558637B1Unified search window to support multiple video encoding standards
Publication Date: 2023.01.17 META PLATFORMS INC
  • US11558637B1 patent drawing
  • US11558637B1 patent drawing
  • US11558637B1 patent drawing

AI summary

A system comprises a memory storage configured to store at least a portion of a frame of a video and a hardware motion estimation search processing unit configured to perform at least a portion of a motion estimation search for the video for a plurality of different block sizes. The hardware motion estimation search processing unit is configured to perform the motion estimation search using a plurality of source sub-blocks of a first block size to determine a first type of comparison evaluation values for the first block size. A combination of values included in the first type of comparison evaluation values is utilized to determine at least one second type of comparison evaluation values for a second block size, wherein the second block size is larger than the first block size.