Bit Count Estimation for Parallel Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing Rate Distortion Optimization (RDO) process for encoding arrays of data elements, such as video frames, faces complexity in determining bit count costs for encoding non-zero frequency domain coefficients, particularly in video encoding standards like HEVC, which can prevent parallel processing and increase computational resources.

Innovation Solution

A method and apparatus that estimate the bit count value for encoding non-zero quantized frequency domain coefficients based on the number of non-zero coefficients, allowing for a simplified bit cost calculation that can be performed independently for each block or sub-array, enabling parallel processing without requiring continuous tracking of encoding states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the existing RDO process is used to determine bit count costs for encoding non-zero frequency domain coefficients, then encoding accuracy is improved, but device complexity and processing resources increase

Engineering Contradiction:
Improvebit count cost determination accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a simplified, approximate bit count estimation method that can be discarded and recalculated for each block independently, rather than maintaining complex continuous state tracking. This allows each block to be processed with a fresh, simple estimation without carrying forward complex encoding state information, reducing device complexity while maintaining sufficient accuracy for RDO purposes.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent divides the video stream into independent blocks that can be processed separately. Each block's bit count is estimated independently based on its own characteristics (number of non-zero coefficients), allowing parallel processing and reducing overall system complexity. This segmentation eliminates the need for complex continuous state tracking across the entire video stream.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the existing RDO process with continuous encoding state tracking is used, then bit count accuracy is improved, but processing speed and productivity decrease

Engineering Contradiction:
Improvebit count cost accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

By dividing the video stream into independent processable blocks where each block's bit count can be estimated independently, the patent enables parallel processing of multiple blocks simultaneously. This segmentation removes the sequential dependency caused by continuous state tracking, dramatically improving processing speed while maintaining sufficient bit count accuracy for effective RDO.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary counting of non-zero coefficients within each block before performing the full RDO calculation. This preliminary action provides a quick bit count estimate that can be used immediately for encoding decisions, eliminating the need for complex continuous state tracking and significantly speeding up the processing pipeline.

Inventive Principle:
Principle #10Preliminary action

3Use of energy by moving object

If simplified bit count estimation is used, then processing resources are reduced, but encoding optimization effectiveness may deteriorate

Engineering Contradiction:
Improveprocessing resourcesVSAvoidencoding optimization effectiveness
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent changes the parameter used for bit count determination from complex continuous state-based calculations to a simpler parameter based on the number of non-zero coefficients in each block. This parameter change reduces computational complexity and resource consumption while maintaining sufficient accuracy for encoding optimization, as the number of non-zero coefficients is a strong predictor of actual bit count requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10924738B2Selecting encoding options
Publication Date: 2021.02.16 ARM LTD
  • US10924738B2 patent drawing
  • US10924738B2 patent drawing
  • US10924738B2 patent drawing

AI summary

When encoding an array of data elements using an encoding process that generates an array of quantized frequency domain coefficients corresponding to an array of difference values between a source block of data elements of the array of data elements being encoded and a reference block of data elements, a bit count value for encoding an array of quantized frequency domain coefficients to be used to select whether to encode the source block in accordance with a particular set of encoding options is estimated by estimating a bit count value for encoding the locations of the non-zero quantized frequency domain coefficients in the array of quantized frequency domain coefficients based on the number of non-zero frequency domain coefficients in the array of quantized frequency domain coefficients.