Head-Mounted Display Obstruction Removal Using Line-of-Sight Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of maintaining a clear line of sight and situational awareness in vehicle operations is hindered by obstructions within the field of view, such as vehicle components, which can lead to missed information and disorientation.
Innovation Solution
Employing line of sight tracking and mapping of vehicle objects, combined with additional sensor capabilities to generate an unobstructed view by extracting and overlaying unobstructed pixels or regions of interest from sensors positioned to avoid these obstructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If additional sensors are added to capture unobstructed views, then the clarity of the outside scene is improved, but the device complexity increases
Solution Approach 1:
The system divides the viewing function across multiple sensors positioned at different locations within the vehicle. Each sensor captures a specific portion of the external scene from its unique vantage point, and the computing device segments and integrates these views to reconstruct the complete unobstructed scene, thereby improving clarity without requiring a single complex sensor
Solution Approach 2:
The HMD system serves multiple functions: it tracks the user's line of sight, processes sensor data from multiple sources, removes obstructions computationally, and displays the reconstructed scene. This multi-functional approach consolidates what would otherwise require separate systems into a single integrated platform, improving reliability while managing device complexity
2Reliability
If real-time obstruction removal is implemented, then situational awareness is improved, but the processing time and computational resources increase
Solution Approach 1:
The system pre-maps the locations of obstructing objects within the vehicle and pre-determines which sensors can capture unobstructed views of specific scene portions. This preliminary setup allows the computing device to quickly retrieve and composite appropriate sensor data in real-time without performing complex obstruction analysis during critical moments, thereby improving situational awareness while minimizing processing delays
Data Source
AI summary
A method and a system for displaying a scene to a user wearing ahead mounted display (HMD) while removing obstructions in a field of view (FOV) of the user are provided herein. The method may include: capturing by a sensor a vehicle image of the scene wherein the first sensor is mounted on the vehicle; tracking a position and orientation of the HMD in a specified coordinate system, to yield a line of sight (LOS) of the user wearing the HMD; obtaining a database containing obstacles data indicating at least one physical object located within the vehicle and affecting the FOV of the user; calculating an obstructed portion in the FOV of the user, based on the LOS and the database; generating from the vehicle image, an un-obstructed view which includes a portion of the scene overlapping the obstructed portion; and displaying in the HMD the un-obstructed view.