Hue-Based Video Enhancement for LDR to HDR Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional methods for up-converting low dynamic range (LDR) video content to high dynamic range (HDR) are costly, time-consuming, and often distort artistic intent, amplifying chroma noise, and fail to utilize modern display capabilities effectively.

Innovation Solution

A lightweight, display-side renderer operating in hue-based polar coordinate color space (HSY) for real-time processing, utilizing chromatic discrimination to de-noise and remap video content, ensuring gamut expansion aligns with human visual system capabilities, thus enhancing user experience without overloading modern displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional LDR to HDR up-conversion methods are used, then HDR content can be generated, but the process is costly, time-consuming, and amplifies chroma noise

Engineering Contradiction:
ImproveHDR conversion qualityVSAvoidchroma noise amplification
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent transforms the video data from traditional RGB color space to HSY (Hue, Saturation, Y) color space, changing the parameter representation. This transformation allows independent manipulation of hue, saturation, and luminance parameters, enabling selective enhancement of HDR properties while preserving original chroma information and avoiding noise amplification in the chroma channels.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the video processing into distinct stages: LDR to HSY conversion, selective HDR parameter application, and HSY back to RGB conversion. By separating the luminance enhancement from chroma preservation, the method applies HDR effects only where needed while maintaining original color fidelity and avoiding unnecessary chroma noise amplification.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If traditional LDR to HDR up-conversion methods are used, then HDR content can be generated, but artistic intent is distorted

Engineering Contradiction:
ImproveHDR conversion qualityVSAvoidartistic intent distortion
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

By changing to HSY color space, the patent allows independent control of luminance (Y) while preserving saturation (S) and hue (H) parameters. This enables HDR conversion that adjusts only the brightness range without altering the artistic color choices made during original content creation, thereby preserving artistic intent while achieving HDR quality.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies HDR enhancement selectively to the luminance component while maintaining original chroma characteristics. This local quality approach ensures that enhancement is applied where needed (luminance dynamics) without affecting other aspects (color fidelity) that carry artistic intent, thus avoiding overall distortion.

Inventive Principle:
Principle #3Local quality

3Productivity

If real-time processing is implemented on display-side, then processing speed improves, but computational complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidrenderer complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The use of HSY color space simplifies the mathematical transformations required for HDR conversion compared to traditional methods. The parametric nature of HSY allows for efficient real-time computation of hue, saturation, and luminance adjustments, reducing the computational burden while enabling real-time processing capability on display-side renderers.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11544827B2Hue-based video enhancement and rendering
Publication Date: 2023.01.03 REALNETWORKS LLC
  • US11544827B2 patent drawing
  • US11544827B2 patent drawing
  • US11544827B2 patent drawing

AI summary

Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.