Enhancement Decoder for Video Signals with Multi-Level Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The incompatibility of newer HDR coding standards with legacy decoding equipment and the bandwidth limitations pose challenges for content distributors who need to serve a wide audience with varying device capabilities, leading to increased costs and complexity in maintaining multiple encoding formats.

Innovation Solution

A hierarchical coding scheme is introduced that allows for the encoding and decoding of HDR-type signals, enabling compatibility with both HDR and SDR formats, using an enhancement decoder that includes an interface for receiving video streams, de-multiplexing enhancement data, and converting between different signal element coding formats to ensure backwards compatibility and flexible streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If content is encoded in multiple different encoding formats to serve various devices, then compatibility with different devices is improved, but device complexity and distribution costs increase

Engineering Contradiction:
ImprovecompatibilityVSAvoidcomplexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The enhancement decoder is designed to handle multiple signal formats (SDR, HDR, different bit depths) through a single unified architecture. The decoder can selectively activate different processing paths based on the input signal type, making one device capable of handling what previously required multiple specialized decoders. This multi-functionality directly addresses the contradiction by improving compatibility without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The decoding process is divided into separate functional modules: base decoder, enhancement data processor, tone mapping module, and upscaling module. Each module handles a specific aspect of the conversion process, allowing the system to process different signal types independently through appropriate module activation. This segmentation enables flexible handling of multiple formats while keeping each individual module relatively simple.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If HDR video is transmitted using native 10-bit formats, then HDR quality is improved, but compatibility with legacy 8-bit decoders is lost

Engineering Contradiction:
ImprovequalityVSAvoidcompatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system uses an intermediary conversion process where 10-bit HDR video is first decoded to an intermediate representation, then converted to 8-bit SDR format through tone mapping and gamma correction. This intermediate step acts as a bridge between the high-quality HDR source and legacy 8-bit decoders, allowing HDR content to be transmitted in a format that maintains quality while ensuring broad compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes key signal parameters (bit depth, transfer function, luminance range) to transform HDR signals into SDR-compatible formats. By adjusting these parameters through tone mapping and gamma correction, the system preserves the essential visual quality of HDR content while making it compatible with legacy 8-bit decoders that cannot natively process HDR signals.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If content distributors provide content in many different encoding formats, then audience coverage is improved, but distribution costs increase

Engineering Contradiction:
Improveaudience coverageVSAvoidcosts
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The enhancement decoder provides a universal solution that can process multiple encoding formats through a single device. By making the decoder multi-functional, content distributors can reduce the number of separate encoding versions they need to produce and maintain, as a single enhanced video stream can be adapted by various decoder implementations to serve different audience segments.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system employs dynamic format adaptation where the decoder adjusts its processing based on the capabilities of the connected display device. This dynamic behavior allows a single encoded stream to serve multiple purposes - HDR-capable devices receive full HDR processing while legacy devices automatically receive SDR-converted output, eliminating the need for distributors to manually create and manage multiple format versions.

Inventive Principle:
Principle #15Dynamics

4Manufacturing precision

If legacy decoders are replaced with newer HDR-capable technology, then HDR quality is improved, but adoption difficulty increases due to widespread legacy device usage

Engineering Contradiction:
ImprovequalityVSAvoidadoption
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The enhancement decoder acts as an intermediary that allows legacy devices to access HDR content through software-based conversion. Instead of requiring hardware replacement, the system mediates between the HDR content source and legacy display capabilities, enabling gradual adoption of HDR technology while maintaining compatibility with existing device parks. This significantly lowers the adoption barrier compared to mandatory hardware replacement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The HDR-to-SDR conversion and tone mapping operations are performed in advance during the decoding process, preparing the signal in a format suitable for legacy displays before it reaches the final output stage. This preliminary processing ensures that when HDR content is delivered, legacy devices can immediately display it without requiring real-time conversion or hardware upgrades, facilitating smoother adoption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20230412813A1Enhancement decoder for video signals with multi-level enhancement and coding format adjustment
Publication Date: 2023.12.21 V NOVA INT LTD
  • US20230412813A1 patent drawing
  • US20230412813A1 patent drawing
  • US20230412813A1 patent drawing

AI summary

An enhancement decoder for video signals, comprising an interface to receive a first video stream using a first signal element coding format from a standard decoder, an interface to receive an enhancement data stream and a de-multiplexer to decompose the enhancement data stream into a first set of enhancement data, a second set of enhancement data and a range data. A first decoder video stream derived from the first video stream at a first resolution is enhanced by a first enhancer using the first set of enhancement data. A second decoder video stream derived from an output of the first enhancer is converted by an up-sampler to a second resolution. The second resolution being higher than the first resolution. A third decoder video stream derived from an output of the up-sampler at the second resolution is enhanced by a second enhancer using the second set of enhancement data. A coding format adjustment module converts one of the first to third decoder video streams from a first signal element coding format to a second signal element coding format using the range data.