Energy-Preserving Bloom Operator for HDR Video Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional HDR video processing methods often result in loss of details for bright highlights due to content mastering operations, which can adversely affect the viewing experience, as they typically reduce the dynamic range and color gamut to match a reference display device, leading to clipped or compressed sample values.
Innovation Solution
The proposed solution involves skipping or scaling content mastering operations before encoding, retaining metadata for bright highlights, and performing content mastering during playback using an energy-preserving bloom operator, lens flare operator, and alternative tone mapping operators to enhance the perceptual quality of HDR video on the actual display device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If content mastering operations are performed before encoding to optimize HDR video for a reference display device, then the video can be adapted to typical display capabilities, but details in bright sample values are lost due to clipping or compression
Solution Approach 1:
The patent applies preliminary action by performing content mastering operations during playback rather than before encoding. The playback system performs tone mapping and other content mastering operations at the time of playback, allowing the system to adapt to the actual display device capabilities without having compressed the bright highlight details during initial encoding. This temporal shift enables preservation of highlight details while still achieving adaptation to display constraints.
Solution Approach 2:
The patent uses an intermediary approach by introducing a bloom operator as a mediator between the high dynamic range source and the display device. The bloom operator processes the bright highlight regions separately, simulating optical bloom effects to preserve detail information while adapting to display constraints. This intermediary processing layer allows the system to maintain information fidelity while achieving display adaptation.
2Reliability
If bright sample values above the display device peak brightness are clipped or compressed during content mastering, then the video can be displayed without artifacts, but the perceptual quality and realism of bright highlights are degraded
Solution Approach 1:
The patent applies local quality by treating bright highlight regions differently from the rest of the image. The bloom operator identifies and processes only the high-intensity pixel regions, applying special handling to preserve their perceptual quality and realism. This localized processing maintains display compatibility for the entire image while preserving the manufacturing precision (perceptual quality) of the bright highlights through selective bloom effect application.
Solution Approach 2:
The patent uses parameter changes by dynamically adjusting the bloom effect strength and other content mastering parameters based on the actual display device capabilities and the specific image content. The system changes parameters such as bloom intensity, threshold values, and processing strength to optimize both display compatibility and perceptual quality for each specific playback scenario, rather than using fixed compression parameters.
3Manufacturing precision
If content mastering operations are performed during playback using an energy-preserving bloom operator, then bright highlights can be rendered with improved realism, but additional processing complexity is introduced
Solution Approach 1:
The patent applies segmentation by dividing the content mastering process into distinct operational stages: decoding the HDR video, identifying bright highlight regions, applying the bloom operator to those regions, and final rendering. This segmentation allows the complex processing to be broken down into manageable steps that can be efficiently implemented in the playback system, reducing the practical complexity burden while maintaining high realism.
Solution Approach 2:
The patent uses partial action by applying the bloom operator only to the bright highlight regions rather than processing the entire image uniformly. This selective processing reduces the overall computational burden compared to applying bloom effects globally, making the enhanced realism achievable without excessive processing complexity. The system processes only the necessary portions of the image data.
4Adaptability or versatility
If conventional tone mapping operators are used during content mastering, then dynamic range can be reduced for display compatibility, but energy is not preserved and bright highlight details are lost
Solution Approach 1:
The patent converts the harmful effect of energy loss in conventional tone mapping into a beneficial visual effect. Instead of simply compressing bright values and losing energy, the system uses the bloom operator to redistribute that energy in a controlled manner, creating a bloom effect that preserves the perception of bright highlight energy while adapting to display constraints. The harmful energy loss is transformed into a useful visual enhancement.
Data Source
AI summary
Innovations in content mastering operations performed during playback of high dynamic range (“HDR”) video on a display device are described. When content mastering is performed during playback on a display device, a video playback system can use details retained for input HDR video (e.g., retained in metadata) and the properties of the display device to improve the perceptual quality of the HDR video as shown on that display device. For example, the video playback system can use an energy-preserving bloom operator to make bright highlights “bloom” into adjacent areas, thereby accentuating the bright highlights in the HDR video while operating within the constraints of the display device. The video playback system can also perform various other types of operations when content mastering is deferred until playback, including application of a lens flare operator as well as alternative tone mapping operators and alternative color gamut mapping operators selected according to metadata.