Display-Side Renderer for LDR to HDR Video Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods for up-converting low dynamic range (LDR) video content to high dynamic range (HDR) are costly, time-consuming, and often distort artistic intent due to reliance on heavy-weight pre-processing and Cartesian color spaces, which amplify chroma noise and fail to utilize modern display capabilities effectively.
Innovation Solution
A lightweight, display-side renderer operates in hue-based polar coordinate color space (HSY) to de-noise and remap saturation, leveraging human visual system chromatic discrimination for gamut expansion, enabling real-time processing and preserving artistic intent while enhancing video content for modern displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If heavy-weight pre-processing is used for LDR to HDR conversion, then conversion quality is improved, but processing time and computational cost increase
Solution Approach 1:
The patent pre-computes and stores tone mapping operators and lookup tables during content encoding, so that during playback the heavy computational work is already done and only lightweight operations are needed. This shifts the computational burden from runtime to encoding time, enabling real-time conversion without requiring heavy pre-processing during playback.
Solution Approach 2:
The patent uses lookup tables and pre-computed tone mapping operators as copies of complex processing results. Instead of performing heavy computations in real-time, the system retrieves pre-computed data from tables, significantly reducing processing time while maintaining conversion quality.
2Device complexity
If Cartesian color spaces are used for processing, then computational simplicity is maintained, but chroma noise is amplified and artistic intent is distorted
Solution Approach 1:
The patent transforms the color space from Cartesian (RGB) to polar coordinate (HSY) representation. This parameter change allows the system to operate in a color space where hue, saturation, and luminance are separated, enabling independent control of chroma and luma channels. This prevents chroma noise amplification while maintaining computational feasibility through the structured nature of polar coordinates.
Solution Approach 2:
The patent applies different processing characteristics to different components of the color space. By separating hue, saturation, and luminance into independent channels, the system can apply localized processing to each component, preserving chroma information without amplifying noise and maintaining artistic intent through selective enhancement.
3Temperature
If traditional tone mapping is applied, then dynamic range is expanded, but gamut distortion occurs and display capabilities are not fully utilized
Solution Approach 1:
The patent implements adaptive tone mapping that dynamically adjusts processing parameters based on the content characteristics and display capabilities. The system can switch between different tone mapping operators and adjust lookup tables in real-time to optimize both dynamic range expansion and color accuracy for different scenes and display devices.
Solution Approach 2:
The patent incorporates feedback mechanisms that monitor display output and content characteristics to continuously optimize the tone mapping process. This feedback loop ensures that gamut distortion is minimized while fully utilizing display capabilities, allowing the system to adapt to different display devices and content types automatically.
Data Source
AI summary
Embodiments are directed towards metadata service for video enhancement. An example method includes receiving a request for metadata applicable to instruct a display device to transform low dynamic range (LDR) video content to high dynamic range (HDR) video content, determining availability of candidate metadata, and responsive to determining that no candidate metadata is available, providing options for generating the metadata applicable to instruct the display device. The example method can also include causing generation of the metadata based at least one of the options, and providing the generated metadata to the display device.