Adaptive Video Decoding for Multi-Layer Systems

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Multi-layered video systems face challenges in efficient decoding and streaming due to high compute resource demands and bandwidth variations, particularly in delivering stereoscopic video across heterogeneous networks.

Innovation Solution

An adaptive decoding and streaming system that includes a base layer decoder, enhancement layer decoders, and a decoding adaptor, which selects decoding modes based on decoding time and complexity, allowing for simplified or skipped decoding processes to manage compute resources and bandwidth, ensuring seamless video delivery across varying networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If full decoding is performed for all layers, then video quality is improved, but compute resource consumption increases

Engineering Contradiction:

Improvevideo qualityVSAvoidcompute resource consumption

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts decoding complexity based on available compute resources and network conditions. The decoder can operate in different modes (e.g., full decoding for quality, simplified decoding for performance) and switch between them adaptively, allowing the same system to serve both high-quality and resource-constrained scenarios without requiring separate hardware implementations.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes decoding parameters such as complexity level, decoding mode, and processing depth based on system state. By modifying these parameters dynamically, the system optimizes the trade-off between video quality and compute consumption, enabling efficient resource utilization across heterogeneous platforms.

Inventive Principle:

Principle #35Parameter changes

2Manufacturing precision

If all layers are transmitted, then video quality is improved, but bandwidth consumption increases

Engineering Contradiction:

Improvevideo qualityVSAvoidbandwidth consumption

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system transmits only the necessary layers based on network conditions and decoder capabilities. When bandwidth is limited or compute resources are constrained, the system may transmit only base layers or select important enhancement layers, avoiding unnecessary data transmission and reducing overall bandwidth consumption while maintaining acceptable quality.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The transmission parameters such as layer selection and packetization are adjusted dynamically based on network conditions. The system can change the amount of data transmitted by selecting different layer combinations, optimizing the balance between video quality and bandwidth efficiency.

Inventive Principle:

Principle #35Parameter changes

3Manufacturing precision

If complex decoding is used, then video quality is improved, but decoding time increases

Engineering Contradiction:

Improvevideo qualityVSAvoiddecoding time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The decoding process is made dynamic by allowing real-time adjustment of complexity based on time constraints and quality requirements. The system can switch between fast but lower-quality decoding modes and slower high-quality modes depending on the application scenario, enabling adaptive performance tuning.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

When time is critical, the system performs partial decoding of only essential components, skipping less important processing steps. This partial action approach reduces decoding time significantly while maintaining acceptable quality for real-time applications.

Inventive Principle:

Principle #16Partial or excessive action

4Use of energy by moving object

If simplified decoding is used, then compute resource consumption is reduced, but video quality deteriorates

Engineering Contradiction:

Improvecompute resource consumptionVSAvoidvideo quality

Core Design Contradiction:

Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The system applies different decoding qualities to different parts of the video stream based on importance. Critical layers or frames receive full decoding treatment while less important components receive simplified processing. This localized quality adjustment maintains acceptable overall quality while significantly reducing average compute consumption.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

Decoding parameters are adjusted to change the quality-compute trade-off point dynamically. By modifying parameters such as decoding depth, filter application, and processing precision, the system can optimize for quality when resources are available and switch to quality-preserving simplifications when resources are constrained.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentEP3145189B1Complexity-adaptive scalable decoding and streaming for multi-layered video systems

Publication Date: 2019.06.19 DOLBY LABORATORIES LICENSING CORP

Figure 1A~1B
Figure 2A
Figure 2B

AI summary

Adaptive decoding and streaming multi-layer video systems and methods are described. The decoding systems comprise a base layer decoder and one or more enhancement layer decoders. The streaming systems comprise a base layer packetizer and one or more enhancement layer packetizers. A decoding adaptor controls operation of the base layer and/or enhancement layer decoders. A packetizing adaptor controls operation of the base layer and/or enhancement layer packetizers.