Cockpit Gaze Verification Using 3D Tasking Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Pilots often fail to visually check important systems and surroundings during high workload situations, leading to a significant safety risk, especially in reduced crew or single-pilot operations.
Innovation Solution
A gaze-assisted verification system using a camera to monitor the pilot's eye and head position, comparing it with a 3D model of the cockpit and a database of visual taskings to alert the pilot when visual checks are missed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pilots rely on manual visual monitoring during high workload situations, then operational flexibility is maintained, but visual checks are frequently omitted leading to safety risks
Solution Approach 1:
The patent replaces the mechanical human visual monitoring system with an automated optical monitoring system. Cameras capture images of the cockpit environment and instrument panels, and image processing algorithms automatically verify whether pilots have performed required visual checks, eliminating reliance on human attention during high workload periods
Solution Approach 2:
The system introduces an intermediary automated verification layer between the pilot and the instruments. The image processing system acts as a mediator that objectively records and verifies visual check completion, providing an independent safety net that does not compete for the pilot's attention
2Reliability
If more crew members are added to improve safety monitoring, then visual check verification improves, but operational cost and complexity increase
Solution Approach 1:
The system enables self-service verification where the cockpit environment itself provides the verification data. Images captured by cameras of the instrument panels and cockpit surroundings serve as self-evident proof of visual check completion, eliminating the need for additional crew members to monitor or verify pilot actions
3Loss of information
If pilots continuously monitor all systems visually, then situational awareness is maintained, but attention is divided leading to missed checks
Solution Approach 1:
The system performs preliminary capture of visual evidence before the pilot completes the check. By continuously capturing images of the cockpit environment and instrument panels, the system has the verification data ready before needing to assess whether the pilot has performed the required visual checks
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system and method for verification of a pilot's activities in an aircraft cockpit has been developed. The system includes a camera located in the aircraft cockpit that monitors the pilot's eye position, head position and direction of gaze in the cockpit during aircraft operations. A computer system is located onboard the aircraft has a retrievable electronic memory that stores a three-dimensional (3D) model of the aircraft cockpit. The 3D model of the aircraft cockpit includes the location of aircraft instrumentation indicators. The retrievable electronic memory also stores a database of visual taskings for the pilot. The computer system determines the completion of the visual taskings for the pilot by comparing the pilot's eye and head position and gaze direction with location of relevant aircraft instrumentation indicators and a notification system that alerts the pilot when a visual tasking is not completed.