HDR Image Display Tone Mapping for Double-Layer Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing methods are inadequate for high dynamic range (HDR) images, as they are based on single-layer bitstreams, which are not applicable to HDR images.
Innovation Solution
An image display method and apparatus that processes a double-layer bitstream, merging a base image and an enhancement image to create a composite image, and performs tone mapping based on metadata and display information to adapt to the device's capabilities, allowing for seamless integration with existing interfaces and improved display quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single-layer bitstream processing method is used, then the processing flow is simple, but it is not applicable to HDR images
Solution Approach 1:
The patent segments the HDR image processing into two distinct layers: a base layer (first bitstream) containing SDR-compatible content and an enhancement layer (second bitstream) containing HDR-specific information. This segmentation allows the system to process HDR images while maintaining compatibility with existing single-layer processing pipelines, thereby improving adaptability without proportionally increasing complexity.
Solution Approach 2:
The patent implements a nested structure where the enhancement layer is embedded within the overall bitstream structure alongside the base layer. The enhancement layer contains HDR-specific data that supplements the base layer, allowing HDR functionality to be nested within the existing single-layer processing framework. This enables HDR support while reusing existing processing interfaces and reducing overall system complexity.
2Loss of information
If two image buffers are maintained for double-layer bitstream, then HDR information is preserved, but memory usage increases
Solution Approach 1:
The patent implements dynamic buffer management where the system can adaptively switch between maintaining one or two image buffers based on the specific processing stage and requirements. During certain operations, both base and enhancement layer buffers are maintained to preserve HDR information, while during other stages, the system dynamically consolidates to a single buffer, thereby reducing memory usage while preventing information loss.
Solution Approach 2:
The patent applies local quality optimization by maintaining separate buffers only where and when HDR information preservation is critical, rather than uniformly maintaining two buffers throughout all processing stages. This allows the system to preserve HDR information in specific regions or processing phases while reducing overall memory consumption in other phases.
3Adaptability or versatility
If tone mapping is performed early in the processing chain, then display adaptation is achieved, but processing flexibility is reduced
Solution Approach 1:
The patent performs preliminary tone mapping operations on the enhancement layer data before final composite image generation, but maintains the option to adjust or refine tone mapping parameters at later stages. This preliminary action prepares the data for display adaptation while preserving flexibility for subsequent adjustments based on actual display characteristics and user preferences.
Solution Approach 2:
The patent implements dynamic tone mapping where the tone mapping parameters and processing intensity can be adjusted at different stages of the processing chain based on the specific requirements of the display device and content characteristics. This allows the system to perform tone mapping early when needed for basic adaptation while maintaining the flexibility to refine or modify tone mapping behavior in later processing stages.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
This application provides an image display method and apparatus. The method includes: obtaining a double-layer bitstream including first encoded data, second encoded data, and metadata, where the first encoded data represents a base image, and the second encoded data represents an enhancement image; obtaining the base image and the enhancement image based on the first encoded data and the second encoded data; merging the base image and the enhancement image, to obtain a composite image; performing tone mapping on the composite image based on first tone mapping information, to obtain a first target image, where the first tone mapping information is determined based on the metadata and first display information of an electronic device; and displaying the first target image. In this way, an image display method applicable to a double-layer bitstream is provided, and tone mapping information applicable to a current display capability of the electronic device can be determined based on the display information of the electronic device, to obtain a target image that meets a current display requirement of the electronic device. This improves display effect of the electronic device, and improves visual experience of a user.