Shared Motion Estimation for Video Transcoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high computational complexity of newer video encoding formats, such as AV1, poses a challenge for existing servers and edge devices, which struggle to support these formats due to resource limitations, leading to delayed adoption and inefficient transcoding processes.

Innovation Solution

Implementing a system that shares motion estimation and mode decision processing results across different codecs, allowing for reduced computational requirements and facilitating the deployment of multiple video encoding formats by using a common motion estimation block and mode decision block, with optional mapping modules to adapt outputs to compatible formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If newer video encoding formats (e.g., AV1) are implemented, then video compression efficiency and quality are improved, but computational complexity and processing requirements increase significantly

Engineering Contradiction:
Improvevideo encoding qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the video encoding process into distinct functional blocks: motion estimation block, mode decision block, and codec-specific encoding blocks. This segmentation allows the computationally intensive motion estimation and mode decision to be performed once and shared across multiple codec outputs, reducing overall computational complexity while maintaining encoding quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a universal motion estimation block and mode decision block that serve multiple codec formats simultaneously. These blocks perform motion estimation and mode decision for the input video once, and their results are reused across different codec encoding processes (e.g., AV1, VP9, H.264), making the system multi-functional and reducing redundant computations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple video encoding formats are supported simultaneously, then system versatility and adaptability are improved, but processing time and resource consumption increase

Engineering Contradiction:
Improvecodec format supportVSAvoidtranscoding speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs motion estimation and mode decision as preliminary actions before the actual codec-specific encoding. By completing these computationally intensive tasks once and storing their results, the system prepares reusable data that can be quickly applied to multiple codec formats, significantly reducing the time required for transcoding to different formats.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the motion estimation and mode decision functions into shared blocks that serve all codec formats. Instead of having separate motion estimation and mode decision blocks for each codec, the system combines these functions into universal blocks whose outputs are combined and reused across multiple encoding pipelines, improving productivity while maintaining multi-format support.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11425402B2Cross-codec encoding optimizations for video transcoding
Publication Date: 2022.08.23 META PLATFORMS INC
  • US11425402B2 patent drawing
  • US11425402B2 patent drawing
  • US11425402B2 patent drawing

AI summary

A method for sharing the motion estimation and mode decision results and decisions of one codec with another codec is disclosed. A video is received to be transcoded into a plurality of different output encodings of a plurality of different codecs. Each codec has a different video encoding format. A shared motion estimation and a shared mode decision processing of the video are performed. One or more results of the shared mode decision processing shared across the plurality of different codecs are used to encode the video into the plurality of different output encodings of the plurality of different codecs.