Situational Awareness Headset With Avatar-Based Crew Location Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Maintenance crew members in aircraft face challenges in ensuring situational awareness of each other's locations during routine checks, which can lead to safety hazards, and there is a need for expert assistance that may be delayed due to availability issues.
Innovation Solution
A headset equipped with cameras, processors, and display screens provides situational awareness by calibrating the user's position using virtual indicators, generating visual representations of the environment, and allowing communication with other users or remote experts, integrating avatars to indicate locations and enabling real-time assistance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If maintenance crew members perform routine checks at different areas of the aircraft without location awareness systems, then maintenance tasks can be performed independently, but safety risks increase due to lack of situational awareness of other crew members' locations
Solution Approach 1:
The system creates virtual copies (avatars) of maintenance crew members in a digital twin representation of the aircraft. Each crew member wearing a headset is represented by an avatar that tracks their real-time location, allowing other crew members to see where their colleagues are positioned without direct visual contact. This copying approach solves the situational awareness problem by projecting physical locations into the virtual environment.
Solution Approach 2:
The digital twin environment acts as an intermediary between crew members, providing indirect awareness of each other's locations. Instead of requiring direct line-of-sight or communication between crew members, the system uses the virtual representation as a mediator to convey location information, enabling situational awareness without direct interaction.
2Productivity
If expert assistance is provided remotely rather than having experts physically present at the aircraft, then maintenance can proceed without waiting for expert availability, but communication and guidance effectiveness may be reduced
Solution Approach 1:
The system creates a virtual presence of the expert within the digital twin environment, allowing remote experts to visualize the aircraft and crew member locations as if they were physically present. This virtual copy enables effective remote guidance by providing the expert with spatial context and the ability to communicate with crew members seeing their avatar in the environment.
Solution Approach 2:
The system transitions the expert assistance interaction from physical space to a virtual digital dimension. By moving the expert's presence into the digital twin environment, the system enables remote experts to provide guidance with spatial awareness and visual context that would be unavailable through traditional remote communication methods.
3Reliability
If a digital twin environment with real-time tracking is implemented, then situational awareness and safety are improved, but system complexity and computational requirements increase
Solution Approach 1:
The headset device performs multiple functions: it tracks the user's location in the physical environment, communicates with the digital twin system, displays virtual information, and enables communication with other crew members. By consolidating these functions into a single multi-functional device, the system reduces overall complexity compared to having separate systems for each function.
Data Source
AI summary
A method includes calibrating, at a headset, a position of a headset user in a physical environment based on one or more virtual position indicators designated by the headset user in image data captured by one or more cameras of the headset. The method includes generating a visual representation of the physical environment based at least in part on the position. The visual representation schematically represents one or more structures of the physical environment and includes an avatar positioned in the visual representation to represent a location of a second headset user. The method includes displaying the visual representation of the physical environment at one or more display screens of the headset. The method also includes initiating a communication with the second headset user in response to a detection that the headset user selected the avatar from the visual representation displayed via the one or more display screens.