Parallel Bypass and Regular Bin Coding for Video Encoding Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image data encoding techniques face reduced throughput due to the complexity of encoding regular bins, which is exacerbated by frequent context updates, especially at high bit rates where residual syntax consumes a significant portion of the bit rate, making real-time or near real-time image data transmission and display challenging.

Innovation Solution

Implementing parallel bin encoding techniques within the video encoding pipeline, where bins are grouped and encoded simultaneously using a bin serialization block, allowing for parallel processing of multiple bins, thereby reducing the complexity and increasing operational efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If regular bins are encoded based upon their associated context with frequent context updates, then encoding accuracy is improved, but encoding complexity increases and throughput decreases

Engineering Contradiction:
Improveencoding accuracyVSAvoidthroughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent segments the bin encoding process into two independent parallel paths: (1) regular bins encoded with context updates for high accuracy, and (2) bypass bins encoded without context updates for high throughput. This segmentation allows each path to be optimized independently, resolving the contradiction between encoding accuracy and throughput by processing different bin types through different encoding strategies simultaneously.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If context is updated after each encoding operation, then encoding precision is improved, but serialization of the bin encoding process increases

Engineering Contradiction:
Improveencoding precisionVSAvoidprocess serialization
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the encoding process into segmented streams where context-update-dependent operations (regular bins) and context-update-independent operations (bypass bins) are separated. This segmentation eliminates serialization between different bin types, allowing parallel processing while maintaining encoding precision for regular bins through controlled context updates within their specific stream.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts the context update mechanism from the overall encoding process and applies it selectively only to regular bins, while bypass bins use a simplified encoding path without context updates. This extraction reduces process serialization by removing the context update bottleneck from the bypass bin path, enabling parallel processing of both bin types.

Inventive Principle:
Principle #2Taking out (Extraction)

3Loss of information

If residual syntax is encoded at high bit rates, then data fidelity is improved, but the percentage of bit rate consumed by residual syntax increases

Engineering Contradiction:
Improvedata fidelityVSAvoidbit rate consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts residual syntax encoding into a dedicated bypass bin stream that uses context-independent encoding. This allows residual syntax to be encoded at high bit rates with full data fidelity while consuming a manageable portion of the total bit rate, as the bypass encoding path is more efficient and does not require frequent context updates that would otherwise consume additional bits.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10158874B2Parallel bypass and regular bin coding
Publication Date: 2018.12.18 APPLE INC
  • US10158874B2 patent drawing
  • US10158874B2 patent drawing
  • US10158874B2 patent drawing

AI summary

System and method for improving operational efficiency of a video encoding pipeline used to encode image data. In embodiments, the video encoding pipeline includes a transcode pipeline that provides entropy encoding of binarized syntax elements. More specifically, multiple bins may be encoded in parallel, resulting in increased encoding throughput.