See-through Display Color Correction for Ambient Light Interference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality (AR) experiences with see-through displays are degraded due to unaccounted ambient light from the physical environment, which interferes with computer-generated content, as previous color correction techniques fail to effectively address chromaticity and luminance issues.

Innovation Solution

An electronic device with a see-through display determines chromaticity values of ambient light and adjusts image data using corresponding color correction values to satisfy perceptual criteria, ensuring effective color correction by modifying display data to account for ambient light characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If see-through display is used to show computer-generated content, then transparency and visibility of physical environment is improved, but ambient light from physical environment interferes with content visibility

Engineering Contradiction:
Improvevisibility of computer-generated contentVSAvoidinterference from ambient light
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent applies parameter changes by detecting chromaticity values of ambient light and dynamically adjusting color correction parameters (tint and tone mapping) to compensate for ambient light interference. The system modifies display parameters based on measured environmental conditions to maintain content visibility.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements feedback by using sensors to continuously measure ambient light chromaticity and luminance, then using this information to adjust color correction parameters in real-time. The system creates a closed-loop control where display output is continuously optimized based on environmental conditions.

Inventive Principle:
Principle #23Feedback

2Ease of manufacture

If previous color correction techniques are applied, then some color adjustment is achieved, but chromaticity and luminance issues from ambient light are not effectively addressed

Engineering Contradiction:
Improvesimplicity of color correction implementationVSAvoidaccuracy of color correction
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent replaces traditional mechanical or fixed color correction methods with an automated sensor-based system. Instead of manual adjustment or fixed correction curves, the system uses chromaticity sensors and algorithms to automatically determine and apply appropriate color corrections, achieving both ease of implementation and high accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary measurement system (chromaticity sensors and processing algorithms) between the ambient light and the color correction process. This intermediary layer accurately characterizes the ambient light conditions and translates them into appropriate correction parameters, bridging the gap between simple implementation and precise correction.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If ambient light is not accounted for in color correction, then device complexity is reduced, but AR experience quality deteriorates

Engineering Contradiction:
Improvesimplicity of color correction systemVSAvoidquality of AR experience
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent applies self-service by enabling the display system to automatically measure and correct for ambient light conditions without requiring manual intervention. The system uses integrated sensors and algorithms to autonomously adapt to environmental conditions, maintaining high AR experience quality while keeping the system relatively simple through automation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11955099B2Color correction based on perceptual criteria and ambient light chromaticity
Publication Date: 2024.04.09 APPLE INC
  • US11955099B2 patent drawing
  • US11955099B2 patent drawing
  • US11955099B2 patent drawing

AI summary

Various implementations disclosed herein include methods, electronic devices, and systems for performing perceptual-based color correction based on chromaticity values. To that end, in some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a chromaticity value associated with ambient light from a physical environment. The chromaticity value quantifies the ambient light. The method includes determining a set of color correction values based on a function of the chromaticity value and image data. The set of color correction values and the chromaticity value together satisfy one or more perceptual criteria. The method includes modifying the image data in order to generate display data based on a function of the set of color correction values. The method includes displaying the display data on the see-through display.