See-through Display Chroma Correction for Ambient Light

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mountable devices (HMDs) with see-through displays struggle to effectively perform color correction due to the interference of ambient light from the physical environment, which degrades the extended reality (XR) experience by altering the chromaticity and luminance of displayed computer-generated content.

Innovation Solution

An electronic device with a see-through display determines light superposition values associated with ambient light and applies a color correction function, utilizing a combination of chromatic adaptation transforms and transparency models to modify pixel values and enhance chroma characteristics, thereby accounting for the ambient light's impact on displayed content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If color correction is performed without accounting for ambient light, then the display can show computer-generated content, but the ambient light interferes with the displayed content and degrades the XR experience

Engineering Contradiction:
Improvecolor accuracyVSAvoidambient light interference
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary measurement of ambient light characteristics using light sensors before displaying content. The chromaticity values of ambient light are measured and stored, then used to guide the color correction process. This preliminary action allows the display to pre-compensate for ambient light interference, ensuring accurate color reproduction despite the harmful ambient light conditions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system converts the harmful effect of ambient light into a beneficial correction mechanism. By measuring the ambient light's chromaticity values, the system calculates complementary color corrections that actively counteract the ambient light's interference. The harmful ambient light becomes the basis for generating correction data that improves color accuracy, transforming the problem into a solution.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Adaptability or versatility

If the see-through display allows ambient light to pass through, then users can see the physical environment, but the ambient light alters the chromaticity and luminance of displayed content

Engineering Contradiction:
Improvesee-through capabilityVSAvoidcolor fidelity
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system implements a feedback loop where light sensors continuously measure the ambient light conditions affecting the display. These measurements are fed back to the processing system, which calculates appropriate color corrections based on the measured chromaticity values. The corrected display data is then rendered, creating a closed-loop system that adapts to changing ambient light conditions while maintaining color fidelity despite the see-through display's inherent light transmission.

Inventive Principle:
Principle #23Feedback

3Device complexity

If no color correction is applied, then the display system is simpler, but the XR experience is degraded due to ambient light interference

Engineering Contradiction:
Improvecolor correction systemVSAvoidXR experience quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system introduces intermediary components (light sensors and color correction processing) that mediate between the ambient light environment and the display output. These intermediaries measure and characterize the ambient light, then translate these measurements into correction data that improves display accuracy. This intermediary approach enables effective color correction without requiring fundamental changes to the see-through display architecture, balancing added complexity with significant improvements in XR experience quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively corrects color and luminance issues caused by ambient light, enhancing the XR experience by ensuring accurate and vivid representation of computer-generated content, even in varying environmental conditions.

Implementation Method 1

a see-through display, which in turn, allows light from a physical environment to pass to eyes of the user

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

determining, via a color correction function, a second chroma value based on the first chroma value and the light superposition value

Methodology Applied
Scientific EffectChromatic adaptation:

Implementation Method 3

determining a light superposition value that quantifies ambient light from a physical environment

Methodology Applied
Scientific EffectLight superposition: Interference

Data Source

PatentUS11715405B1Chroma modification based on ambient light characteristics
Publication Date: 2023.08.01 RATNASINGAM SIVALOGESWARAN
  • US11715405B1 patent drawing
  • US11715405B1 patent drawing
  • US11715405B1 patent drawing

AI summary

A method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a light superposition value that quantifies ambient light from a physical environment. The method includes obtaining image data that is associated with a color characteristic vector. The color characteristic vector includes a first chroma value. The method includes determining, via a color correction function, a second chroma value based on the color characteristic vector and the light superposition value. The first chroma value is different from the second chroma value. The method includes generating, from the image data, display data that is associated with the second chroma value. The method includes displaying the display data on the see-through display.