AR Display Adaptive Brightness via Eye State Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) brightness controls in display devices fail to accommodate physiological adjustments made by the user's eyes, leading to discomfort or pain when the eyes reopen after being closed, as they do not dynamically adjust to the changed light conditions.

Innovation Solution

An AR display device with a controller that uses camera sensors to detect ambient light and eye openness, dynamically adjusting the brightness of AR imagery by activating electrochromatic lenses to maintain user comfort, reducing brightness when eyes are closed for a threshold period and ramping it back up when opened.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If manual or automatic brightness controls are used to approximate the same brightness of natural imagery and AR imagery, then the brightness matching between natural and AR imagery is improved, but the system cannot accommodate physiological adjustments made by the user's eyes when closed for extended periods

Engineering Contradiction:
Improvebrightness matchingVSAvoidphysiological adaptation
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The brightness control system transitions from static manual/automatic controls to a dynamic system that continuously monitors eye state and ambient light conditions. The controller adjusts AR imagery brightness in real-time based on detected eye closure duration and ambient light levels, enabling the system to adapt to physiological changes in the user's eyes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms by using camera sensors to detect eye state (open/closed) and ambient light conditions. This feedback loop allows the controller to continuously adjust brightness settings based on actual user physiological state and environmental conditions, resolving the contradiction between brightness matching and physiological adaptation.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the eyes are closed for a period sufficient for pupil dilation, then the pupils dilate in response to reduced light, but upon reopening the light from natural and AR imagery becomes uncomfortable or painful

Engineering Contradiction:
Improveuser comfortVSAvoidlight discomfort
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary action by detecting eye closure and proactively reducing AR imagery brightness before the user opens their eyes. When eye closure is detected, the controller reduces brightness of the AR display, preparing the optical environment in advance so that when the user opens their eyes, the light intensity is already adjusted to prevent discomfort or pain.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies preliminary anti-action by counteracting the harmful effect of bright light before it occurs. By detecting eye closure and preemptively reducing brightness, the system prevents the harmful condition (painful light upon eye opening) from happening in the first place.

Inventive Principle:
Principle #9Preliminary anti-action

3Device complexity

If current AR brightness controls are used, then the system maintains simple control mechanisms, but the system lacks contextual adjustment capability and cannot detect eye state changes

Engineering Contradiction:
Improvecontrol mechanism simplicityVSAvoidcontextual adjustment
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The camera sensors serve multiple functions: they detect both ambient light conditions and eye state (open/closed). This multi-functionality allows the system to gain contextual awareness without adding separate dedicated sensors, thereby maintaining relative simplicity while enabling adaptive brightness control.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses its existing camera sensors to self-monitor its operating conditions (light levels and user eye state) and automatically adjusts brightness without requiring external input or complex additional hardware. The system serves itself by using its own resources for detection and control.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution provides contextual adaptive brightness control, ensuring that the AR imagery and natural imagery remain in comfortable brightness levels, mitigating discomfort and pain caused by sudden light changes.

Implementation Method 1

The AR display device includes one or more electrochromatic lenses that dynamically change a property of the electrochromatic lenses in response to a control signal

Methodology Applied
Scientific EffectElectrochromism: Electrochromism

Data Source

PatentUS11908356B2Augmented reality display device having contextual adaptive brightness
Publication Date: 2024.02.20 MOTOROLA MOBILITY LLC
  • US11908356B2 patent drawing
  • US11908356B2 patent drawing
  • US11908356B2 patent drawing

AI summary

An electronic device, computer program product, and method present augmented reality (AR) imagery at an AR display device with contextual, adaptive brightening control. The AR display device includes eyeglasses having lenses positioned in front of eyes of a person. A first camera sensor detects ambient light. An AR projector displays AR imagery on the lenses. A second camera sensor is configured to detect whether the eyes of the person are open or closed. A controller of the electronic device is communicatively coupled to the AR display device. The controller detects brightness of the ambient light. The controller dynamically adjusts brightness of the AR imagery in relation to the brightness of the ambient light. The controller reduces the brightness of the AR imagery in response to determining a brightness context that the eyes of the person have been closed for longer than threshold period of time.