Ambient Adaptive Local Tone Mapping for Display Readability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern display systems using active display technology face difficulties in bright ambient environments, as they struggle to maintain clear image visibility and contrast, leading to reduced readability and increased power consumption.

Innovation Solution

The implementation of ambient and content adaptive local tone mapping operations, which involve de-gamma operations, local histogram generation, and spatio-temporal filtering to enhance contrast and brightness of dark image content while preserving bright areas, using a system architecture that partitions images into regions and applies local tone maps represented as look-up tables, reducing computational resources and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If ambient light adaptation techniques are applied to improve visibility in bright environments, then image contrast and readability are improved, but power consumption increases

Engineering Contradiction:
Improveimage contrastVSAvoidpower consumption
Core Design Contradiction:
Illumination intensityVSUse of energy by moving object

Solution Approach 1:

The patent applies local tone mapping operations that process different regions of the image with different contrast enhancement parameters. Bright regions receive minimal processing while dark regions receive aggressive contrast enhancement, optimizing visibility where needed while minimizing unnecessary processing power consumption in already visible areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs partial tone mapping by selectively applying contrast enhancement only to specific image regions that require it, rather than processing the entire image uniformly. This partial action approach reduces computational load and power consumption while still achieving the desired visibility improvement in critical dark regions.

Inventive Principle:
Principle #16Partial or excessive action

2Loss of information

If local tone mapping operations are applied to enhance dark regions, then image readability is improved, but computational resources increase

Engineering Contradiction:
Improveimage readabilityVSAvoidcomputational resources
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple regions and applies different tone mapping parameters to each region based on local characteristics. This segmentation allows the system to focus computational resources only on regions that need enhancement, rather than processing the entire image with uniform high computational cost.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system pre-calculates tone mapping parameters based on ambient light conditions and image content analysis before applying the full processing pipeline. This preliminary action allows the system to prepare optimization strategies in advance, reducing the real-time computational burden during actual image rendering.

Inventive Principle:
Principle #10Preliminary action

3Illumination intensity

If contrast enhancement is applied to dark regions, then visibility in bright environments is improved, but bright areas may become overprocessed

Engineering Contradiction:
Improvedark region visibilityVSAvoidbright area preservation
Core Design Contradiction:
Illumination intensityVSStability of the object's composition

Solution Approach 1:

The patent implements region-specific tone mapping where bright regions are identified and excluded from aggressive contrast enhancement operations. Different processing parameters are applied to dark versus bright regions, ensuring that dark areas gain visibility while bright areas maintain their natural appearance without overprocessing artifacts.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10504487B2Ambient and content adaptive pixel manipulation
Publication Date: 2019.12.10 APPLE INC
  • US10504487B2 patent drawing
  • US10504487B2 patent drawing
  • US10504487B2 patent drawing

AI summary

Systems, methods, and computer readable media to improve the operation of display systems are described herein. In general, techniques are disclosed for ambient and content adaptive local tone mapping operations that improve display readability under bright ambient light conditions. More particularly, techniques disclosed herein improve contrast and brightness of dark image content while preserving bright areas. The disclosed architecture and operational methodologies generate high contrast images (e.g., amplifying dark regions while preserving bright content), preserve uniform backgrounds (e.g., static background pixels), are stabile in the face of local and global histogram changes (e.g., background not affected by small moving objects such as a mouse pointer), and provide near seamless fade-in and fad-out transitions.