Aircraft Cockpit Camera Monitoring for Instrument Mismatch Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Aircraft cockpit instruments and flight displays can malfunction, leading to incorrect information and impaired pilot control due to sensor malfunctions, necessitating a system to monitor and correct discrepancies between observed and sensed states of these components.

Innovation Solution

A camera-based monitoring system that processes images of cockpit instruments, flight displays, and operator input devices to determine their states, comparing them with sensed states from flight control data and generating notifications for mismatches, thereby ensuring accurate operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional sensor-based monitoring is used, then the system is simple, but it cannot detect instrument or display malfunctions that present incorrect information

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses camera imaging to create a visual copy of the instrument panel and flight displays, allowing the system to analyze the displayed information optically rather than relying solely on electronic sensor data. This copying approach enables detection of incorrect information presented on malfunctioning displays.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary processing system that compares sensor data with visual information from camera images. This intermediary layer reconciles discrepancies between electronic sensors and optical observations, improving reliability without requiring complete system redesign.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If sensor malfunction is not detected, then the system operates normally, but the pilot's ability to control the aircraft is limited

Engineering Contradiction:
Improvepilot control abilityVSAvoidcontrol reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the camera system continuously monitors the operator manipulated input device and provides real-time information about its position and state. This feedback loop allows the system to detect sensor malfunctions and alert the pilot, maintaining control reliability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary detection of input device position using camera imaging before relying on sensor data. By establishing the actual position through visual confirmation, the system can identify sensor failures before they compromise control reliability.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If visual monitoring of instruments is implemented, then incorrect information can be detected, but the monitoring process becomes more complex

Engineering Contradiction:
Improveinformation accuracyVSAvoidmonitoring complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a multi-functional camera system that serves multiple purposes: monitoring instrument panels, tracking flight displays, and observing operator manipulated input devices. This universal approach consolidates multiple monitoring functions into a single system, reducing overall complexity while maintaining measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3403938B1System and method for monitoring a cockpit of an aircraft
Publication Date: 2020.02.12 GENERAL ELECTRIC CO
  • EP3403938B1 patent drawingFigure 1
  • EP3403938B1 patent drawingFigure 2
  • EP3403938B1 patent drawingFigure 3

AI summary

A method 400 of monitoring a cockpit 40 of an aircraft 10 includes receiving 402, by one or more controllers 210, an image 260 depicting an operator manipulated input device 60 located within the cockpit 40. The method 400 can include determining 404, by the one or more controllers 210, an observed state of the operator manipulated input device 60. In particular, the observed state can be based on the image 260. The method 400 can include determining 406, by the one or more controllers, a sensed state of the operator manipulated input device 60. In particular, the sensed state can be based on data from a sensor. The method 400 can include determining 408, by the one or more controllers 210, a mismatch between the observed and sensed states of the operator manipulated input device 60.