Overlay Appearance Mapping for HDR Video Compositing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current display systems struggle to effectively overlay and render high dynamic range (HDR) and variable dynamic range (VDR) images onto legacy displays, often resulting in visually unpleasant experiences due to mismatched luminance and color gamut, which can cause discomfort for viewers.
Innovation Solution
A system and method for overlaying a second image/video data onto a first image/video data, involving appearance mapping based on the dynamic range and characteristics of both images, as well as the display capabilities, to create a composite image that is visually pleasing by adjusting luminance, color gamut, and dynamic range, using a Display Management module, Compositor module, and Mixing module.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If overlay graphics are rendered with high luminance and saturation to be visually striking, then the overlay appears more prominent and attractive, but it creates luminance mismatch and viewer discomfort on displays with limited dynamic range
Solution Approach 1:
The system dynamically adjusts overlay rendering parameters (luminance, saturation, contrast) based on the underlying video content and display capabilities. By changing these parameters adaptively, the overlay remains visually prominent while avoiding excessive luminance that would cause discomfort on LDR displays.
Solution Approach 2:
The overlay rendering is made dynamic rather than static. The system continuously adapts overlay appearance based on real-time analysis of video luminance statistics and display characteristics, allowing the overlay to maintain visual prominence across varying scene conditions while preventing luminance mismatch discomfort.
2Illumination intensity
If overlay graphics use high saturation and contrast to stand out, then the overlay is more visually prominent, but it causes color gamut mismatch and visual discomfort on displays with limited color capabilities
Solution Approach 1:
The system adjusts overlay color parameters (saturation, contrast, color space) based on the display's color gamut capabilities and the underlying video content. This adaptive parameter adjustment ensures the overlay remains visually prominent while preventing color gamut mismatch on displays with limited color capabilities.
Solution Approach 2:
Different regions of the overlay are rendered with different color characteristics based on the local video content and display capabilities. The system applies localized color adjustments to ensure the overlay adapts to both the underlying scene and the display's color reproduction abilities, preventing visual discomfort from color gamut mismatch.
3Productivity
If the overlay is designed to be visually striking with high luminance and saturation, then it achieves promotional effectiveness, but it creates visual discomfort and luminance banding on legacy displays
Solution Approach 1:
The overlay rendering parameters are dynamically adjusted based on the display type and video content characteristics. This dynamic adaptation maintains promotional effectiveness by keeping the overlay visually prominent while preventing luminance banding and other artifacts on legacy displays with limited dynamic range.
Solution Approach 2:
The system introduces an intermediate processing stage that adapts the overlay between its original high-impact design and the constraints of the target display. This intermediary transformation layer ensures promotional effectiveness is maintained while preventing visual discomfort and luminance banding on displays with limited capabilities.
Data Source
AI summary
Systems and methods for overlaying a second image/video data onto a first image/video data are described herein. The first image/video data may be intended to be rendered on a display with certain characteristics—e.g., HDR, EDR, VDR or UHD capabilities. The second image/video data may comprise graphics, closed captioning, text, advertisement—or any data that may be desired to be overlaid and/or composited onto the first image/video data. The second image/video data may be appearance mapped according to the image statistics and/or characteristics of the first image/video data. In addition, such appearance mapping may be made according to the characteristics of the display that the composite data is to be rendered. Such appearance mapping is desired to render a composite data that is visually pleasing to a viewer, rendered upon a desired display.