ATC Communication Monitoring via Speech Recognition and Visual Augmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Commercial pilots face distractions and delays in monitoring voice-based air traffic control communications, which can lead to missed instructions due to the need to focus on current tasks, and existing systems do not effectively convey instructions to surrounding aircraft changes in real-time.
Innovation Solution
A system and method for processing voice-based air traffic control communications to identify and display augmented flight information for surrounding aircraft, using a speech recognition module to extract call signs and instructions, and visually indicating target aircraft with icons and alphanumeric data on a cockpit display, allowing pilots to review instructions without diverting attention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If pilots monitor ATC communications to maintain situational awareness of surrounding aircraft, then situational awareness is improved, but pilot distraction and interruption of critical mental activities increase
Solution Approach 1:
The system introduces an intermediary display interface that translates voice-based ATC communications into visual representations on the cockpit display. Instead of pilots directly processing voice communications while managing multiple tasks, the system mediates this information through automated speech recognition and visual rendering, allowing pilots to view surrounding aircraft instructions at their own pace without auditory distraction.
Solution Approach 2:
The system creates a visual copy of the voice-based ATC communication information on the display screen. The speech recognition module transcribes voice instructions into text, which is then displayed alongside aircraft icons, providing a static visual record that pilots can review without the time-pressure and distraction of real-time voice monitoring.
2Productivity
If pilots focus on current tasks to avoid distraction, then operational efficiency is improved, but ATC instructions for surrounding aircraft may be missed
Solution Approach 1:
The system performs preliminary processing of ATC communications by continuously monitoring voice instructions and pre-displaying them on the cockpit display before pilots need to review them. The speech recognition module processes communications in advance, and the visual information is ready for immediate viewing, allowing pilots to maintain focus on current tasks while having surrounding aircraft instructions readily available.
Solution Approach 2:
The display interface acts as an intermediary that bridges the gap between pilot focus on current tasks and the need to be aware of surrounding aircraft instructions. The visual display serves as a stationary reference that pilots can glance at without diverting attention from their primary task, eliminating the need to choose between task focus and communication monitoring.
3Productivity
If voice-based ATC communications are used for party-line monitoring, then communication efficiency is improved, but information processing complexity and potential for errors increase
Solution Approach 1:
The system replaces the manual mechanical process of listening and parsing voice communications with an automated speech recognition system. The computer automatically transcribes voice instructions into text data, eliminating the cognitive load and error-prone manual processing that pilots would otherwise perform while maintaining situational awareness.
Solution Approach 2:
The speech recognition module serves as an intermediary between the voice-based ATC communication system and the pilot's decision-making process. It automatically processes the complex voice information, extracts relevant instructions, and presents them in a simplified visual format, reducing the information processing complexity burden on the pilot.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances situational awareness by providing pilots with real-time, visually clear information about surrounding aircraft instructions, reducing the risk of missed communications and improving safety by integrating voice-based ATC communications with digital flight data.
Implementation Method 1
processing the received ATC communication indicating speech with a speech recognition module to ascertain the augmented flight information
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
The present disclosure is generally directed to processing air traffic controller ("ATC") communication directed to aircraft (150) other than the current aircraft (105). ATC communication is processed using speech recognition and the call sign and augmented flight information (152) for other aircraft (150) is identified. The corresponding aircraft icon (155) on the display (100) representing the aircraft (150) on the display (100) may be augmented by emphasizing the icon and displaying augmented flight information (152), along with an insignia. This information is displayed for a configurable time duration, after which the display (100) reverts to displaying a conventional aircraft icon and associated flight information on the display (100). The pilot can subsequently select the aircraft icon and may be presented with a log of past ATC communications for the aircraft.