HDR Image Display Tone Mapping for Double-Layer Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing methods for high dynamic range (HDR) images using single-layer bitstreams are inapplicable, leading to challenges in adapting display capabilities and ambient environments.
Innovation Solution
An image display method and apparatus that processes a double-layer bitstream, merging a base image and an enhancement image to form a composite image, and performs tone mapping based on metadata and display information to adapt to current display capabilities and environments, allowing reuse of existing interfaces and improving visual experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single-layer bitstream processing method is used for HDR images, then the processing flow is simple, but it is inapplicable to HDR images and cannot achieve proper display adaptation
Solution Approach 1:
The patent segments the HDR image processing into two distinct layers: a base layer processed with conventional SDR methods and an enhancement layer processed with HDR-specific methods. This segmentation allows the system to maintain compatibility with existing single-layer processing infrastructure while incorporating HDR capabilities through the enhancement layer, thus resolving the contradiction between processing simplicity and HDR adaptability.
Solution Approach 2:
The patent creates a dual-mode processing architecture where the base layer processing can handle both SDR and HDR content universally. The enhancement layer is conditionally applied based on display capabilities, allowing the same processing pipeline to serve multiple functions (SDR and HDR output) without requiring complete redesign, thereby achieving adaptability while controlling complexity.
2Ease of operation
If two separate image buffers are maintained for base image and enhancement image, then decoding can be performed independently, but it increases memory usage and buffer management complexity
Solution Approach 1:
The patent merges the base image buffer and enhancement image buffer into a single composite buffer after independent decoding. The base layer is decoded first and stored in the buffer, then the enhancement layer is decoded and combined with the existing buffer content. This merging approach maintains the benefit of independent decoding while reducing memory footprint and simplifying buffer management compared to maintaining completely separate buffers throughout the processing pipeline.
Solution Approach 2:
The patent performs preliminary decoding of the base layer and stores it in the buffer before decoding the enhancement layer. This preliminary action allows the enhancement layer to be decoded independently with reference to the already-decoded base layer, enabling independent decoding capability while using a single shared buffer rather than requiring separate buffers for each layer throughout the entire process.
3Productivity
If tone mapping is performed without considering display information, then processing is faster, but the display effect does not adapt to current display capabilities and environment
Solution Approach 1:
The patent implements a conditional tone mapping approach where full adaptive tone mapping considering display information is performed only when necessary (when display capability information is available and HDR output is required). In cases where such information is unavailable or SDR output is sufficient, a simplified or skipped tone mapping is applied. This partial action approach maintains high processing speed for common cases while enabling adaptive display effect when conditions permit.
Solution Approach 2:
The patent dynamically changes tone mapping parameters based on available display information such as display luminance range, color gamut, and environmental lighting conditions. When display capability information is available, the tone mapping algorithm adjusts its parameters (mapping curves, contrast enhancement factors, etc.) to optimize for the specific display device and environment. When such information is unavailable, default parameters are used, maintaining processing speed while providing reasonable default adaptation.
Data Source
AI summary
This disclosure provides an image display method and apparatus. The method includes: obtaining a double-layer bitstream including first encoded data, second encoded data, and metadata; obtaining a base image and an enhancement image based on the first encoded data and the second encoded data; merging the base image and the enhancement image, to obtain a composite image; performing tone mapping on the composite image based on first tone mapping information, to obtain a first target image, where the first tone mapping information is determined based on the metadata and first display information of an electronic device; and displaying the first target image. In this way, an image display method applicable to a double-layer bitstream is provided, and tone mapping information applicable to a current display capability of the electronic device can be determined, to obtain a target image that meets a current display requirement of the electronic device.