Hardware Video Encoder Conditional Multi-Pass Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hardware video encoders, particularly those without programmable engines, face challenges in achieving efficient real-time compression and adaptive encoding, especially in handling scene changes and network packetization, which affects performance and quality.

Innovation Solution

The implementation of a core algorithm for motion estimation, mode decision, and subjective quality enhancements, along with conditional multi-pass encoding, speculative search centers, external override processes, and adaptive slice termination, enables reduced latency and improved encoding efficiency without programmable engines.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If fixed function encoding is used in hardware video encoders, then device complexity is reduced and ease of manufacture is improved, but adaptability and versatility deteriorate

Engineering Contradiction:
Improveease of manufactureVSAvoidadaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements conditional multi-pass encoding that dynamically adapts the encoding process based on detected scene changes. The encoder switches between single-pass and multi-pass modes depending on whether a scene change is detected, providing adaptability while maintaining fixed-function hardware architecture. This resolves the contradiction by introducing dynamic behavior through conditional logic rather than programmable engines.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes encoding parameters (such as rate control settings, quantization parameters, and buffer management) based on detected scene changes and encoding progress. By dynamically adjusting these parameters within the fixed-function architecture, the system achieves adaptability without requiring programmable engines, thus resolving the contradiction between ease of manufacture and adaptability.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If conditional multi-pass encoding is implemented, then encoding quality and adaptability are improved, but processing time and latency increase

Engineering Contradiction:
ImproveadaptabilityVSAvoidlatency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary actions during the first pass by collecting statistics and detecting scene changes, which are then used to optimize the second pass. By preparing encoding parameters and identifying critical frames in advance, the system reduces the processing time required during the actual encoding passes, thus mitigating the latency increase while maintaining adaptability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements speculative search centers that allow the encoder to skip certain processing steps for frames that are likely to be similar to previous frames. By rushing through redundant processing and only performing full analysis when necessary, the system reduces overall processing time and latency while maintaining encoding quality and adaptability.

Inventive Principle:
Principle #21Skipping (Rushing through)

3Productivity

If speculative search centers are used, then processing speed and productivity are improved, but measurement precision and encoding accuracy may deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidencoding accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms where the results of speculative search centers are validated and compared against actual encoding outcomes. The encoder uses this feedback to refine future speculative decisions, ensuring that processing speed improvements do not compromise encoding accuracy. This resolves the contradiction by continuously optimizing the balance between speed and precision through learned patterns.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies speculative search centers selectively to certain frames or regions rather than uniformly across all data. By performing partial analysis where full precision is needed and using speculative methods where approximate results suffice, the system achieves high processing speed while maintaining encoding accuracy in critical areas, thus resolving the contradiction between productivity and measurement precision.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10715818B2Techniques for hardware video encoding
Publication Date: 2020.07.14 INTEL CORP
  • US10715818B2 patent drawing
  • US10715818B2 patent drawing
  • US10715818B2 patent drawing

AI summary

An apparatus of video encoding is described herein. The apparatus includes an encoder and a hardware bit packing unit. The encoder comprises at least a fixed function dual hierarchical motion estimation search units, dual integer motion estimation search units, and a fractional motion estimation search unit. Moreover, the hardware bit packing unit is to pack bits as coded according to the final macroblock coding decision into a data format.