HDR Multi-Window Tone Mapping With Scaling Order Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for processing high dynamic range (HDR) images with multiple windows in each frame are inefficient, leading to increased power consumption when scaling is performed after decoding, and there is a lack of methods for optimizing tone mapping in such images.
Innovation Solution
The method involves converting the positions of windows in HDR images and applying tone mapping based on metadata, considering the image size, and adjusting tone mapping coefficients according to viewing distance, angle, and illuminance, while performing scale-up or scale-down operations in a different order to reduce power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If scaling is performed after decoding HDR image, then image size is adjusted to match display requirements, but power consumption increases
Solution Approach 1:
The patent applies tone mapping before scaling operations on HDR images. By performing the computationally intensive tone mapping operation first, while the image is still at its original resolution, the subsequent scaling operation requires fewer computational resources. This preliminary action optimizes the processing sequence to reduce overall power consumption while achieving the desired display size.
2Ease of manufacture
If tone mapping is applied uniformly to entire image sequence, then processing is simplified, but image quality is compromised for multi-window displays
Solution Approach 1:
The patent implements differential tone mapping for multi-window HDR displays by identifying boundary regions between windows and applying different tone mapping coefficients to different windows. This allows each window to be optimized for its specific content and display requirements, maintaining high image quality while still providing a systematic processing approach that is manageable.
Solution Approach 2:
The patent segments the HDR image into multiple windows based on metadata information, allowing separate tone mapping processing for each window. By dividing the image into distinct regions with different tone mapping parameters, the system achieves high image quality for multi-window displays while maintaining organized and manageable processing through automated segmentation.
3Adaptability or versatility
If multiple windows are displayed in HDR image, then display flexibility is improved, but tone mapping processing becomes complex
Solution Approach 1:
The patent uses metadata to pre-identify window boundaries and characteristics before tone mapping processing. By having window position and size information available in advance through metadata, the system can prepare appropriate tone mapping coefficients for each window, reducing the complexity of real-time processing while maintaining flexible multi-window display capabilities.
Data Source
AI summary
Ann electronic device includes: a display; a memory storing instructions; and a processor operably coupled to the display and the memory, the processor being configured to execute the instructions to: obtain a first image to which high dynamic range (HDR) is applied and metadata corresponding to the first image, scale up or down, using a scaling ratio based on size information about a first size of the first image and a second size of a second image to be displayed on the display, the first image to a third image, obtain, based on the metadata, first information about a plurality of first areas of the first image, obtain second information about a plurality of second areas of the third image, based on the scaling ratio and the first information, and obtain the second image by performing tone mapping on the plurality of second areas using a tone mapping coefficient included in the metadata.