Head-Mounted Display Low-Light Sensing via Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In low-light conditions, human vision shifts to scotopic or mesopic vision, resulting in reduced color vision, sensitivity to different wavelengths, lower acuity, and increased motion blur, making it difficult for individuals to effectively view their environment.
Innovation Solution
A head-mounted display system equipped with infrared, depth, and ultrasonic sensors, which senses the environment and processes the data to determine graphical content, enhancing visibility in low-light conditions by providing contrast-enhanced images and object renderings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional visible light sensors are used in low-light conditions, then the system structure remains simple, but the ability to detect the environment deteriorates due to reduced human vision quality
Solution Approach 1:
The patent combines multiple sensor types (infrared sensors, ultrasonic sensors, depth sensors) into a unified sensing system that operates cooperatively. The controller integrates data from all sensor types to create a comprehensive environmental representation, allowing the system to maintain reliable detection capability while managing complexity through coordinated operation of complementary sensors.
Solution Approach 2:
The sensing system is designed to function effectively across multiple lighting conditions (photopic, mesopic, and scotopic vision ranges). By incorporating sensors that detect different wavelengths and physical phenomena, the system provides universal environmental awareness regardless of ambient light levels, with each sensor type contributing to the overall detection reliability.
2Measurement precision
If multiple sensor types are added to improve low-light detection, then the environment sensing capability improves, but the processing complexity increases
Solution Approach 1:
The processing system segments the environmental sensing task by assigning different sensor types to detect specific aspects of the environment. Infrared sensors handle thermal and distance information, ultrasonic sensors provide distance and object detection, and depth sensors contribute spatial mapping. This segmentation allows the controller to process data from multiple sources systematically, improving measurement precision while managing processing complexity through specialized data handling for each sensor type.
Solution Approach 2:
The controller acts as an intermediary that coordinates and integrates data from multiple sensor types. By processing and fusing information from infrared, ultrasonic, and depth sensors, the controller creates a unified environmental model that improves sensing accuracy without overwhelming complexity, as the intermediary manages the integration process systematically.
3Illumination intensity
If the display provides enhanced graphical content in low light, then visibility and contrast improve, but the energy consumption increases
Solution Approach 1:
The display system dynamically adjusts its operation based on ambient light conditions detected by the sensors. In low-light conditions, the display increases brightness and contrast enhancement to compensate for poor visibility. The system continuously monitors environmental conditions and adapts display parameters accordingly, providing enhanced illumination intensity when needed while avoiding constant high-energy consumption during normal lighting conditions.
Solution Approach 2:
The display system changes operational parameters (brightness, contrast, color temperature) based on the detected lighting environment. By monitoring ambient light levels and adjusting display parameters dynamically, the system optimizes visibility and contrast in low-light conditions while managing energy consumption, as the display operates at reduced intensity levels during photopic vision conditions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system significantly improves the user's ability to see and interact with their environment in low-light conditions by providing real-time graphical content that enhances contrast and object visibility, thereby mitigating the limitations of scotopic and mesopic vision.
Implementation Method 1
The sensors include one or more of an infrared sensor for sensing the environment with infrared electromagnetic radiation
Implementation Method 2
The sensors include an ultrasonic sensor for sensing the environment with ultrasonic sound waves
Data Source
AI summary
A display system includes a controller and a head-mounted display. The head-mounted display includes a display, a head support coupled to the display for supporting the display on a head of a user to be viewed by the user, and sensors coupled to the head support for sensing an environment from the head-mounted display unit in low light. The sensors include one or more of an infrared sensor for sensing the environment with infrared electromagnetic radiation, or a depth sensor for sensing distances to objects of the environment, and also include an ultrasonic sensor for sensing the environment with ultrasonic sound waves. The controller determines graphical content according to the sensing of the environment with the one or more of the infrared sensor or the depth sensor and with the ultrasonic sensor, and operates the display to provide the graphical content concurrent with the sensing of the environment.


