LDR to HDR Video Conversion via Metadata-Driven Display Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for up-converting low dynamic range (LDR) video content to high dynamic range (HDR) are inefficient, requiring significant computing power and time, and often result in chroma noise amplification and distortion of artistic intent, failing to fully utilize modern display capabilities.

Innovation Solution

A lightweight, display-side renderer operates in hue-based polar coordinate color space to de-noise and remap saturation, leveraging human visual system chromatic discrimination for gamut expansion, enabling real-time processing and preservation of artistic intent.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional LDR to HDR conversion methods are used, then HDR content can be generated, but significant computing power and time are required

Engineering Contradiction:
ImproveHDR conversion qualityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts only the essential enhancement parameters (transfer characteristics, tone mapping parameters) from complex HDR processing and embeds them as metadata in the LDR video stream. This allows the display device to perform selective enhancement only where needed, rather than processing the entire video frame at full HDR complexity, thus reducing computing power requirements while maintaining conversion quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary analysis of the LDR video content to generate HDR transfer characteristics and tone mapping parameters before playback. These parameters are pre-calculated and embedded as metadata, allowing the display device to quickly apply enhancements during playback without performing complex real-time conversions, thereby improving processing speed while maintaining reliability.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If traditional LDR to HDR conversion methods are used, then HDR content can be generated, but chroma noise amplification occurs

Engineering Contradiction:
ImproveHDR conversion qualityVSAvoidchroma noise
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different enhancement strategies to different regions of the video based on local characteristics. By analyzing local chroma noise levels and applying selective tone mapping and saturation adjustment only where necessary, the system avoids uniform amplification of chroma noise across the entire image, thus improving conversion quality while reducing harmful chroma noise artifacts.

Inventive Principle:
Principle #3Local quality

3Reliability

If traditional LDR to HDR conversion methods are used, then HDR content can be generated, but distortion of artistic intent occurs

Engineering Contradiction:
ImproveHDR conversion qualityVSAvoidartistic intent
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent incorporates feedback mechanisms where the system analyzes the original LDR video's artistic characteristics (color grading, contrast patterns, saturation levels) and uses this information to guide the HDR conversion process. The generated HDR content is evaluated against the original artistic intent, and tone mapping parameters are adjusted accordingly to preserve the creator's vision while achieving reliable HDR conversion quality.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11756173B2Real-time video enhancement and metadata sharing
Publication Date: 2023.09.12 REALNETWORKS LLC
  • US11756173B2 patent drawing
  • US11756173B2 patent drawing
  • US11756173B2 patent drawing

AI summary

Embodiments are directed towards video enhancement in accordance with time constraint. An example method includes determining a time constraint for transforming low dynamic range (LDR) video content to high dynamic range (HDR) video content, processing the LDR video content to generate instructions for transforming to HDR video content in accordance with the time constraint, rendering the HDR video content based on executing the generated instructions; and producing metadata including the generated instructions for sharing.