Parallel Video Encoder Using Original Reference Pictures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Advanced Video Coding (AVC) encoding is computationally intense and challenging for real-time processing, particularly due to dependencies in motion estimation using encoded and reconstructed reference pictures, which hinder parallel processing efficiency.

Innovation Solution

A system with multiple encoders and a master controller that estimates data for encoding video pictures in parallel, using original pictures for motion estimation and adjusting quantization parameters based on content sensitivity and complexity, with the master controlling the compression rate and distributing video data among encoders to achieve efficient lossy compression.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If AVC encoding is performed using encoded and reconstructed reference pictures for motion estimation, then encoding accuracy is improved, but processing dependency increases and parallel processing efficiency deteriorates

Engineering Contradiction:
Improveencoding accuracyVSAvoidparallel processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system segments the encoding process into independent parallel encoders, each handling different video pictures. By using original reference pictures instead of encoded/reconstructed ones, motion estimation in each encoder becomes independent, allowing simultaneous execution without waiting for previous encoding results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by using original reference pictures that are already available in the buffer before encoding begins. This eliminates the need to wait for encoding and reconstruction of reference pictures, allowing motion estimation to proceed immediately in parallel with other encoding operations.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple hardware instances are used for parallel processing, then throughput is increased, but operational complexity increases due to data distribution and synchronization requirements

Engineering Contradiction:
ImprovethroughputVSAvoidoperational complexity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The video data stream is segmented and distributed to multiple independent encoder instances. Each encoder operates autonomously on its assigned pictures using original reference pictures from the buffer, eliminating the need for complex inter-encoder communication and synchronization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The buffer acts as an intermediary that stores original reference pictures and makes them available to all parallel encoders. This centralized storage mechanism simplifies data distribution by providing a single source that all encoders can access independently without direct peer-to-peer communication.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If original pictures are used for motion estimation instead of encoded and reconstructed reference pictures, then parallel processing capability is improved, but information loss increases due to bypassing the encoding loop

Engineering Contradiction:
Improveparallel processing capabilityVSAvoidinformation loss
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system applies partial action by using original reference pictures only for motion estimation purposes, while still performing full encoding and reconstruction for the final output. This selective use of original pictures provides the parallel processing benefit without completely bypassing the encoding loop, maintaining quality where it matters most.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system applies different quality standards to different parts of the encoding process. Motion estimation uses high-quality original reference pictures for accuracy and parallel processing, while the final output goes through the complete encoding loop to ensure overall quality. Each stage uses the appropriate quality level for its specific purpose.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8687710B2Input filtering in a video encoder
Publication Date: 2014.04.01 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US8687710B2 patent drawing
  • US8687710B2 patent drawing
  • US8687710B2 patent drawing

AI summary

Presented herein are systems, methods, and apparatus for real-time high definition television encoding. In one embodiment, there is a method for encoding video data. The method comprises performing motion estimation in parallel of a plurality of pictures using original reference pictures associated with the plurality of pictures; examining the plurality of pictures to determine whether their content is complex; and low pass filtering pictures with complex content to smooth them before proceeding to continue with the encoding process.