Head-Mounted Display Low-Light Sensing via Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In low-light conditions, human vision shifts to scotopic or mesopic vision, resulting in reduced color vision, sensitivity to different wavelengths, lower acuity, and increased motion blur, making it difficult for individuals to effectively view their environment.

Innovation Solution

A head-mounted display system equipped with infrared, depth, and ultrasonic sensors, which senses the environment and processes the data to determine graphical content, enhancing visibility in low-light conditions by providing contrast-enhanced images and object renderings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional visible light sensors are used in low-light conditions, then the system structure remains simple, but the ability to detect the environment deteriorates due to reduced human vision quality

Engineering Contradiction:
Improveenvironment detection capabilityVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensor types (infrared sensors, ultrasonic sensors, depth sensors) into a unified sensing system that operates cooperatively. The controller integrates data from all sensor types to create a comprehensive environmental representation, allowing the system to maintain reliable detection capability while managing complexity through coordinated operation of complementary sensors.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensing system is designed to function effectively across multiple lighting conditions (photopic, mesopic, and scotopic vision ranges). By incorporating sensors that detect different wavelengths and physical phenomena, the system provides universal environmental awareness regardless of ambient light levels, with each sensor type contributing to the overall detection reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple sensor types are added to improve low-light detection, then the environment sensing capability improves, but the processing complexity increases

Engineering Contradiction:
Improveenvironmental sensing accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The processing system segments the environmental sensing task by assigning different sensor types to detect specific aspects of the environment. Infrared sensors handle thermal and distance information, ultrasonic sensors provide distance and object detection, and depth sensors contribute spatial mapping. This segmentation allows the controller to process data from multiple sources systematically, improving measurement precision while managing processing complexity through specialized data handling for each sensor type.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller acts as an intermediary that coordinates and integrates data from multiple sensor types. By processing and fusing information from infrared, ultrasonic, and depth sensors, the controller creates a unified environmental model that improves sensing accuracy without overwhelming complexity, as the intermediary manages the integration process systematically.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Illumination intensity

If the display provides enhanced graphical content in low light, then visibility and contrast improve, but the energy consumption increases

Engineering Contradiction:
Improvedisplay brightness and contrastVSAvoiddisplay energy consumption
Core Design Contradiction:
Illumination intensityVSUse of energy by moving object

Solution Approach 1:

The display system dynamically adjusts its operation based on ambient light conditions detected by the sensors. In low-light conditions, the display increases brightness and contrast enhancement to compensate for poor visibility. The system continuously monitors environmental conditions and adapts display parameters accordingly, providing enhanced illumination intensity when needed while avoiding constant high-energy consumption during normal lighting conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The display system changes operational parameters (brightness, contrast, color temperature) based on the detected lighting environment. By monitoring ambient light levels and adjusting display parameters dynamically, the system optimizes visibility and contrast in low-light conditions while managing energy consumption, as the display operates at reduced intensity levels during photopic vision conditions.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system significantly improves the user's ability to see and interact with their environment in low-light conditions by providing real-time graphical content that enhances contrast and object visibility, thereby mitigating the limitations of scotopic and mesopic vision.

Implementation Method 1

The sensors include one or more of an infrared sensor for sensing the environment with infrared electromagnetic radiation

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

The sensors include an ultrasonic sensor for sensing the environment with ultrasonic sound waves

Methodology Applied
Scientific EffectUltrasonic sound waves: Ultrasound

Data Source

PatentUS12242064B2Head-mounted display with low light operation
Publication Date: 2025.03.04 APPLE INC
  • US12242064B2 patent drawing
  • US12242064B2 patent drawing
  • US12242064B2 patent drawing

AI summary

A display system includes a controller and a head-mounted display. The head-mounted display includes a display, a head support coupled to the display for supporting the display on a head of a user to be viewed by the user, and sensors coupled to the head support for sensing an environment from the head-mounted display unit in low light. The sensors include one or more of an infrared sensor for sensing the environment with infrared electromagnetic radiation, or a depth sensor for sensing distances to objects of the environment, and also include an ultrasonic sensor for sensing the environment with ultrasonic sound waves. The controller determines graphical content according to the sensing of the environment with the one or more of the infrared sensor or the depth sensor and with the ultrasonic sensor, and operates the display to provide the graphical content concurrent with the sensing of the environment.