See-through Display Ambient Light Correction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In augmented reality (AR) systems, ambient light from the physical environment interferes with computer-generated content, degrading the AR experience by limiting contrast and color composition, and the use of graphics processing units (GPUs) to address these issues is computationally expensive and introduces latency.

Innovation Solution

An electronic device senses light superposition characteristic values from the physical environment and generates display data to correct for these effects, using sensors like ambient light and image sensors to modify rendered image data without relying on high computational demands of GPUs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If per-pixel modification is performed using a graphics processing unit (GPU), then the interference from ambient light is corrected and display quality is improved, but power consumption increases and heat dissipation occurs

Engineering Contradiction:

Improvedisplay qualityVSAvoidpower consumption

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts the essential correction parameters (ambient light characteristics, contrast ratios, color compositions) from the complex per-pixel modification process, allowing correction to be performed using simplified algorithms on standard processors rather than requiring full GPU processing power

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes the approach from modifying individual pixel values to adjusting overall display parameters such as brightness, contrast, and color temperature based on sensed ambient light conditions, thereby reducing computational complexity while maintaining correction effectiveness

Inventive Principle:

Principle #35Parameter changes

2Manufacturing precision

If per-pixel modification is performed using a graphics processing unit (GPU), then the interference from ambient light is corrected and display quality is improved, but latency increases

Engineering Contradiction:

Improvedisplay qualityVSAvoidlatency

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary sensing of ambient light characteristics and pre-calculates correction parameters before display content is rendered, allowing real-time correction without adding latency to the display pipeline

Inventive Principle:

Principle #10Preliminary action

3Reliability

If ambient light correction is applied to computer-generated content, then visibility and noticeability are improved, but device complexity increases

Engineering Contradiction:

ImprovevisibilityVSAvoiddevice complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a universal ambient light sensing and correction system that can be integrated into various AR display devices regardless of their specific display technology or form factor, using standardized sensors and processing approaches

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces an intermediary correction layer that processes ambient light characteristics and applies corrections to the composite image without requiring fundamental changes to the underlying display hardware or rendering pipeline

Inventive Principle:

Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves the visibility and noticeability of computer-generated content by adjusting its brightness and color composition to match the ambient light conditions, enhancing the AR experience while reducing power consumption and latency.

Implementation Method 1

a see-through display, which, in turn, allows the pass-through of light from the user's physical environment to the user's eyes

Methodology Applied

Scientific EffectLight transmission: Light

Implementation Method 2

directly at the user's retinas, where pass-through light from the physical environment and the projected light of the AR content concurrently reach the retinas

Methodology Applied

Scientific EffectLight projection: Light

Data Source

PatentUS12057089B2Modifying rendered image data based on ambient light from a physical environment

Publication Date: 2024.08.06 APPLE INC

AI summary

A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.