AR Eyepiece Illumination Flicker Mitigation via Sensor Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in providing immersive experiences due to user-perceptible changes in display light when toggling eyepiece illumination, leading to distractions and reduced immersion.

Innovation Solution

Incorporating an ambient light sensor and a display light sensor to determine if turning off the light source will result in a user-perceptible change, using criteria based on luminance and chromaticity to decide when it is safe to shut off the light source, ensuring seamless transitions and maintaining immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If the light source for the eyepiece display is turned off to conserve power, then energy consumption is reduced, but user-perceptible changes in display light occur causing distractions and reduced immersion

Engineering Contradiction:
Improvepower consumptionVSAvoidimmersion continuity
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system uses ambient light sensors and display light sensors to continuously monitor lighting conditions and provide feedback to the controller. This feedback loop enables the system to determine when turning off the light source will not be perceptible to the user, allowing power savings without compromising immersion continuity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes operational parameters by adjusting when the light source is turned off based on measured ambient light levels and display light characteristics. By evaluating luminance and chromaticity parameters, the system identifies safe windows for power savings that maintain user immersion.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the light source is kept on continuously to maintain immersion, then immersion continuity is preserved, but power consumption increases

Engineering Contradiction:
Improveimmersion continuityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary evaluation using ambient light sensors and display light sensors to determine in advance when turning off the light source will not be perceptible. This preliminary assessment allows the controller to safely turn off the light source during appropriate intervals, reducing power consumption while maintaining immersion continuity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of continuous operation, the light source is turned off during periodically identified safe intervals when ambient lighting conditions indicate the transition will not be perceptible. This periodic on-off operation reduces overall power consumption while preserving immersion continuity.

Inventive Principle:
Principle #19Periodic action

3Use of energy by moving object

If ambient light sensing is implemented to control light source timing, then power consumption is reduced through intelligent control, but device complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidsensor and control system complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The system uses the device's own display light as a reference for controlling the light source. By comparing ambient light levels with the display light characteristics measured by the sensors, the system self-determines when power savings are appropriate, reducing the need for complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The ambient light sensors and display light sensors serve multiple functions: they monitor ambient conditions, measure display light characteristics, and provide feedback for power management decisions. This multi-functionality reduces the need for separate dedicated components, thereby limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively minimizes user-perceptible changes in display light, enhancing the immersive experience by allowing for seamless transitions in augmented reality systems, reducing distractions, and conserving power.

Implementation Method 1

an ambient light sensor operable to detect a luminance of the ambient light

Methodology Applied
Scientific EffectPhotodetection: Photoelectric Effect

Implementation Method 2

a display light sensor operable to measure a luminance of the display light emitted from the eyepiece display

Methodology Applied
Scientific EffectPhotodetection: Photoelectric Effect

Data Source

PatentUS11538227B2Flicker mitigation when toggling eyepiece display illumination in augmented reality systems
Publication Date: 2022.12.27 MAGIC LEAP INC
  • US11538227B2 patent drawing
  • US11538227B2 patent drawing
  • US11538227B2 patent drawing

AI summary

An augmented reality display system can include a partially transparent eyepiece, an ambient light sensor, and an image input device. The image input device can include a light source and a spatial light modulator. The system can also include a controller that determines that no virtual content is being displayed to the user and compares the ambient light to display light to determine if a light source shutoff criterion is satisfied. If the light source shutoff criterion is satisfied, the controller can turn off the light source.