Video Encoding Adapted to Decoder Complexity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data encoding methods do not consider the dynamic state of decoders, leading to potential degradation in decoding performance and compromised playback quality if the decoding resources are insufficient.

Innovation Solution

Encoding data based on knowledge of the target decoder's current, past, and predicted states, using customized encoding schemes that take into account the decoder's available resources and complexity constraints to optimize decoding performance and quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If encoding schemes are selected without consideration of decoder state, then encoding flexibility and speed are improved, but decoding performance and playback quality deteriorate when decoder resources are insufficient

Engineering Contradiction:
Improveencoding speedVSAvoiddecoding performance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The encoder performs preliminary actions by determining the current state of the decoder (buffer occupancy, processing speed) before encoding each frame. This allows the encoder to proactively adjust encoding parameters to match decoder capabilities, preventing buffer underflow/overflow and ensuring smooth playback without real-time feedback loops

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The encoding scheme is made dynamic by continuously adapting encoding parameters (quantization, resolution, compression ratio) based on the decoder's current state. The encoder transitions between different encoding modes depending on decoder buffer levels and processing speed, optimizing both encoding efficiency and decoding performance in real-time

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If minimum decoder requirements are specified, then system compatibility is improved, but adaptability to different decoder capabilities deteriorates

Engineering Contradiction:
Improvedecoder compatibilityVSAvoidsystem requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by tailoring the encoding quality and complexity to match the specific capabilities of different decoder segments. High-end decoders receive higher quality encoding with more complex features, while lower-end decoders receive optimized encoding that matches their processing capabilities, ensuring each decoder operates at its optimal performance level without unnecessary complexity

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP2070331B1Video encoding adapted to the complexity of the encoding tools and of the target decoder
Publication Date: 2017.07.19 APPLE INC
  • EP2070331B1 patent drawingFigure 1A
  • EP2070331B1 patent drawingFigure 1B
  • EP2070331B1 patent drawingFigure 2

AI summary

Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.