Video Encoder Pipeline Parallel Mode Decision and Bitstream Packing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The video encoding process is hindered by interdependencies between mode decision and bitstream packing operations, leading to inefficiencies due to sequential processing, which impacts user experience by increasing the time required for encoding.

Innovation Solution

Implementing parallel processing of mode decision and bitstream packing for various frames, allowing mode decision processing to use original or reconstructed frames from previous frames instead of waiting for the completion of bitstream packing, thereby reducing idle time and enhancing overall efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If sequential processing is used for mode decision and bitstream packing, then processing simplicity is maintained, but encoding speed decreases

Engineering Contradiction:

Improveencoding speedVSAvoidprocessing pipeline complexity

Core Design Contradiction:

SpeedVSDevice complexity

Solution Approach 1:

The video encoding process is divided into two independent but coordinated segments: mode decision processing and bitstream packing processing. Each segment operates on different frames simultaneously, with mode decision processing frame N while bitstream packing processes frame N-1. This segmentation allows parallel execution without requiring complex inter-dependency management within each segment.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension to the processing pipeline by implementing multi-frame parallel processing. Instead of processing frames sequentially in a single dimension, the system processes multiple frames across different stages simultaneously, effectively adding a time dimension to the processing architecture. This allows mode decision for frame N to proceed while bitstream packing for frame N-1 completes, reducing overall encoding time.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Reliability

If mode decision waits for bitstream packing completion, then reference frame accuracy is ensured, but processing time increases

Engineering Contradiction:

Improvereference frame accuracyVSAvoidprocessing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

Bitstream packing for frame N-1 is performed in advance while mode decision for frame N is正在进行. The system prepares reference frames and completes packing operations before they are strictly needed for subsequent processing stages, allowing mode decision to proceed without waiting for previous frame packing to complete.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The processing pipeline maintains continuous useful action by eliminating idle waiting periods. Mode decision processing and bitstream packing processing both operate continuously on different frames, ensuring that processing resources are always productive. The overlap of operations ensures that no processor remains idle while maintaining the necessary reference frame accuracy.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS10602185B2Systems, methods, and computer program products for a video encoding pipeline

Publication Date: 2020.03.24 INTEL CORP

AI summary

Methods, systems and computer program products that may improve the efficiency of the video encoding process. Mode decision processing and bit stream packing may be performed in parallel for various frames in a sequence. This reduces the amount of idle time for both the mode decision processing logic and the bit stream packing logic, improving the overall efficiency of the video encoder.