AR Instrument Overlay for Flight Crew Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Aircraft flight crews face difficulties in efficiently operating complex aircraft systems due to varying instrument layouts and information displays, requiring additional training and manual reference to operation manuals, which can be time-consuming and inadequate for specific conditions.
Innovation Solution
A method and apparatus that uses a data processing system with an image sensor to generate an image of flight deck instruments and provide assistance information, displayed on a device, to help crews understand and manage flight operations more effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If flight crews refer to operation manuals for additional information about flight instruments, then they can obtain comprehensive information, but the process takes longer than desired
Solution Approach 1:
The system creates a visual copy of the flight instrument display and overlays it with augmented reality assistance information. This allows the flight crew to view both the original instrument information and the augmented assistance information simultaneously, eliminating the need to switch between manuals and instruments, thus reducing time loss while maintaining information completeness
Solution Approach 2:
The augmented reality system acts as an intermediary between the flight instruments and the flight crew. It captures the instrument display, processes the information, and presents enhanced assistance information through a wearable device, serving as a bridge that provides comprehensive information without requiring the crew to manually consult manuals
2Loss of information
If the flight deck includes numerous flight instruments to display comprehensive information, then the aircraft can provide detailed flight information, but flying the aircraft becomes more difficult
Solution Approach 1:
The system merges the flight instrument information with augmented reality assistance information by overlaying graphical indicators and text annotations directly on the instrument display. This combination allows the flight crew to access both the original instrument data and additional assistance information simultaneously, reducing the cognitive load and operational difficulty while maintaining comprehensive information availability
Solution Approach 2:
The system adds a new dimensional layer of information presentation by using augmented reality overlays on the instrument display. Instead of requiring the flight crew to physically move between multiple instruments or consult separate manuals, the assistance information is superimposed on the existing instrument view, providing additional information in a different dimensional space without increasing physical complexity
3Adaptability or versatility
If the flight crew needs additional training for different aircraft types due to varying instrument layouts, then they can adapt to different aircraft, but additional training time is required
Solution Approach 1:
The augmented reality system provides self-service information delivery by automatically capturing the instrument display, identifying the specific instrument or message, and presenting relevant assistance information through the wearable device. This eliminates the need for flight crew to manually consult manuals or receive extensive training on different aircraft types, as the system adapts to the specific instrument layout in real-time
Solution Approach 2:
The system changes the parameter of information delivery from static manual references to dynamic augmented reality overlays that adapt to the specific instrument display being viewed. By capturing and processing the actual instrument image, the system can provide context-specific assistance information that adjusts to different aircraft types and instrument layouts, enabling rapid adaptability without additional training time
Data Source
AI summary
A method and apparatus for providing assistance to a flight crew during flight. An image of a group of instruments on a flight deck of an aircraft is generated with an image sensor in a data processing system. Assistance information configured to assist the flight crew from flight information displayed by the group of instruments in the image is generated. The assistance information is displayed on a display device in the data processing system.