Layered EDR Video Coding for Multi-Format Distribution

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current technologies face challenges in efficiently distributing and decoding multi-format video images with enhanced dynamic range (EDR) across various devices, as they often require significant computational resources and are not backward compatible with legacy systems, limiting their ability to support high dynamic range displays.

Innovation Solution

The proposed solution involves a layered coding approach where an encoder generates a base layer and an enhancement layer, allowing for multiple coding formats, bit rates, and resolutions, enabling efficient distribution and computation-scalable decoding. This includes a reconfigurable decoder system that minimizes scaling operations by configuring scalers based on the target display resolution, ensuring optimal performance across different devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multi-format EDR video is distributed using conventional coding methods, then image quality and dynamic range are improved, but computational resources and device complexity increase significantly

Engineering Contradiction:

Improveimage qualityVSAvoiddecoder complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The video signal is segmented into multiple layers: a base layer compatible with legacy devices and enhancement layers for advanced EDR displays. This segmentation allows decoders to process only the necessary layers based on device capabilities, reducing computational complexity while maintaining image quality for capable devices.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The coding system dynamically adapts to different device capabilities by providing multiple representation formats. Decoders can selectively activate enhancement layers based on the target display's EDR support, making the system flexible and adaptable rather than requiring all devices to handle full EDR complexity.

Inventive Principle:

Principle #15Dynamics

2Manufacturing precision

If high-precision EDR video formats are used, then dynamic range and color accuracy are improved, but bit rate and storage requirements increase

Engineering Contradiction:

Improvecolor accuracyVSAvoidbit rate

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

Instead of encoding full high-precision EDR data for all delivery scenarios, the system uses partial action by providing base layer content at standard precision and adding enhancement layers only where needed. This reduces overall bit rate while maintaining color accuracy for devices that can utilize it.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The enhancement layers are nested within the base layer structure, allowing legacy devices to use only the base layer while advanced devices can access nested enhancement layers for improved color accuracy and dynamic range, optimizing storage efficiency.

Inventive Principle:

Principle #7Nested doll (Nesting)

3Adaptability or versatility

If legacy playback devices are supported, then backward compatibility is improved, but support for advanced EDR displays is limited

Engineering Contradiction:

Improvebackward compatibilityVSAvoidEDR display support

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The layered coding system provides multi-functionality by enabling the same encoded stream to serve both legacy SDR devices and advanced EDR displays. The base layer ensures universal compatibility while enhancement layers extend capability to modern devices, making the system universally applicable across the device spectrum.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If multiple coding formats are used to support various devices, then adaptability is improved, but device complexity and processing overhead increase

Engineering Contradiction:

Improvedevice compatibilityVSAvoidmulti-format processing

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Multiple coding formats are segmented into a hierarchical structure with a common base layer and device-specific enhancement layers. This segmentation allows decoders to process only the relevant enhancement layers for their device type, reducing processing overhead compared to handling multiple complete formats independently.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS11146803B2Distribution of multi-format high dynamic range video using layered coding

Publication Date: 2021.10.12 DOLBY LABORATORIES LICENSING CORP

AI summary

An encoder receives an input enhanced dynamic range (EDR) image to be stored or transmitted using multiple coding formats in a layered representation. A layer decomposer generates a lower dynamic range (LDR) image from the EDR image. One or more base layer (BL) encoders encode the LDR image to generate a main coded BL stream and one or more secondary coded BL streams, where each secondary BL stream is coded in a different coding format than the main coded BL stream. A single enhancement layer (EL) coded stream and related metadata are generated using the main coded BL stream, the LDR image, and the input EDR image. An output coded stream includes the coded EL stream, the metadata, and either the main coded BL stream or one of the secondary coded BL streams. Computation-scalable decoding and display management processes for EDR images are also described.