Cockpit Speech Recognition for ATC Query Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current air traffic control (ATC) communication systems, including voice and Controller Pilot Data Link Communication (CPDLC), pose challenges for pilots due to miscommunication, transmission errors, and the need to manually recall instructions, leading to increased workload and potential pilot errors, especially during high-stress situations.

Innovation Solution

A speech recognition system integrated into the cockpit that decodes and transcribes ATC communications, allowing pilots to query the transcribed information using voice commands, reducing the need for manual recall and enabling efficient access to critical flight data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If pilots manually monitor and recall ATC instructions, then they can execute flight commands, but workload increases and pilot errors may occur

Engineering Contradiction:
Improvepilot execution accuracyVSAvoidpilot workload
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces an automated speech recognition system as an intermediary between ATC communications and the pilot. The system transcribes ATC voice communications, stores them with timestamps, and allows pilots to query and retrieve instructions without manual monitoring. This intermediary handles the memory and recall functions, reducing pilot workload while maintaining execution accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a digital copy of ATC voice communications by transcribing them into text form with metadata (timestamps, frequency information). These copies are stored and can be queried by the pilot, eliminating the need to mentally retain and recall instructions. The copy serves as a reliable reference that reduces cognitive load.

Inventive Principle:
Principle #26Copying

2Speed

If voice communication is used for ATC communications, then real-time interaction is enabled, but miscommunication and transmission errors occur

Engineering Contradiction:
Improvecommunication response timeVSAvoidcommunication accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system creates a text-based copy of the voice communication through speech recognition. This text copy can be stored, queried, and reviewed, providing a reliable record that reduces miscommunication and transmission errors while maintaining the real-time interaction capability of voice communication.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system provides feedback to the pilot by displaying transcribed ATC communications and allowing queries about specific instructions. This feedback mechanism ensures that the pilot can verify received instructions against the transcription, reducing miscommunication and enabling correction of potential errors.

Inventive Principle:
Principle #23Feedback

3Reliability

If CPDLC is used instead of voice communication, then transmission errors are reduced, but it cannot handle urgent voice communications effectively

Engineering Contradiction:
Improvecommunication accuracyVSAvoidcommunication flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system is designed to handle both voice and data communications universally. It can process ATC voice communications through speech recognition, store them with metadata, and allow querying. This multi-functional approach combines the real-time capability of voice communication with the accuracy and record-keeping benefits of data communication, making it adaptable to both urgent and non-urgent scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3882889A1Methods and systems for querying for parameter retrieval
Publication Date: 2021.09.22 HONEYWELL INTERNATIONAL INC
  • EP3882889A1 patent drawingFigure 1
  • EP3882889A1 patent drawingFigure 2A~2B
  • EP3882889A1 patent drawingFigure 3

AI summary

Systems and methods to identify a query parameter in an incoming flight voice or data communication to respond to a request. A processing system configured to: in response to receipt of a clearance message, decode the clearance message to determine whether the clearance message contains a command instruction or clearance data for a flight, and to present the command instruction to a pilot as notice to execute the command instruction or if available, obtain at least one query parameter from the clearance data to configure in a query operation to present in response to a pilot question about the command instruction. In response to receipt of the voice or data communication, determine further an intent within the voice or data communication of a question or instruction voiced by applying an acoustic model for tagging identified parts about the question or instruction voiced with query parameters in response to the pilot.