View-Dependent Tone Mapping for HDR to SDR Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current High Dynamic Range (HDR) cameras and displays are expensive, limiting their accessibility to consumers, and most consumers still use Standard Dynamic Range (SDR) displays, making it challenging to effectively display HDR content.
Innovation Solution
A method and apparatus for view-dependent tone mapping of virtual reality images, which includes a user equipment with sensors and processors that determine viewpoint information to render media by deriving an overall tone mapping function based on the viewport and applying it to the media, allowing HDR content to be displayed on SDR devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If HDR cameras and displays are used to capture and display high dynamic range content, then the quality and dynamic range of images are improved, but the cost of the equipment increases significantly
Solution Approach 1:
The patent introduces tone mapping as an intermediary process that translates HDR content into SDR displays. The tone mapping function acts as a mediator between the HDR source material and the SDR display device, allowing HDR content to be effectively displayed on SDR screens without requiring expensive HDR display hardware.
Solution Approach 2:
The patent dynamically adjusts tone mapping parameters based on viewport information and scene characteristics. By changing the parameters of the tone mapping function according to the user's viewpoint and the specific content being displayed, the system optimizes the conversion from HDR to SDR, preserving as much visual quality as possible within the constraints of SDR display capabilities.
2Adaptability or versatility
If HDR content is displayed on SDR displays using traditional tone mapping, then compatibility with SDR devices is improved, but the visual quality and dynamic range perception deteriorate
Solution Approach 1:
The patent implements dynamic tone mapping that adapts in real-time based on viewport information obtained from sensors. As the user moves their head or changes their viewpoint, the system dynamically adjusts the tone mapping function to optimize the display of different portions of the HDR content, thereby maintaining higher visual quality across the entire 360-degree environment.
Solution Approach 2:
The patent applies different tone mapping strategies to different regions of the HDR content based on local characteristics. By analyzing the viewport and identifying which portions of the scene are currently visible to the user, the system applies optimized tone mapping parameters locally to those regions, preserving visual quality where it matters most while maintaining compatibility with SDR displays.
3Illumination intensity
If view-dependent tone mapping is implemented in real-time, then the visual quality of HDR content on SDR displays is improved, but the computational complexity and processing requirements increase
Solution Approach 1:
The patent performs preliminary processing of the HDR content to prepare tone mapping data that can be efficiently applied in real-time. By pre-calculating certain aspects of the tone mapping and organizing the data in an optimized format, the system reduces the computational burden during real-time rendering, making it feasible to implement view-dependent tone mapping on consumer-grade devices.
Data Source
AI summary
A user equipment (UE) includes a receiver, at least one sensor, and a processor. The receiver is configured to receive a bit stream including at least one encoded image and metadata. The sensor is configured to determine viewpoint information of a user. The processor is configured to render the at least one encoded image based on the metadata and the viewpoint.