Cockpit Gaze Verification for Missed Pilot Visual Checks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Pilots often fail to visually check important systems and surroundings during high workload situations, leading to a significant safety risk, especially in reduced crew or single-pilot operations.
Innovation Solution
A gaze-assisted verification system using a camera to monitor the pilot's eye and head position, comparing it with a 3D model of the cockpit and a database of visual taskings to alert the pilot when visual checks are missed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pilots rely on manual visual monitoring during high workload situations, then operational flexibility is maintained, but visual checks are frequently skipped leading to safety risks
Solution Approach 1:
The system continuously monitors pilot gaze direction using eye-tracking cameras and provides immediate feedback by comparing actual gaze position with required check positions. When a visual check is missed or incomplete, the system generates alerts to notify the pilot, creating a closed-loop feedback mechanism that ensures checklist compliance without adding manual monitoring burden.
Solution Approach 2:
The system automatically performs the verification function that would otherwise require a second pilot or crew member. By using automated eye-tracking technology to monitor and verify visual checks, the system enables single-pilot operations while maintaining the safety benefits of dual-crew verification, allowing the pilot to serve both as operator and self-verifier.
2Reliability
If a second pilot is added to verify visual checks, then safety is improved, but operational cost and crew complexity increase
Solution Approach 1:
The system replaces the need for a second pilot by enabling the primary pilot to self-verify visual checks through automated gaze monitoring. The eye-tracking system objectively records whether the pilot looked at required positions for sufficient duration, providing self-verification capability that eliminates the need for additional crew members while maintaining verification reliability.
Solution Approach 2:
The patent replaces the mechanical/physical presence of a second pilot with an automated optical sensing system. Instead of relying on human-to-human verification, the system uses cameras and image processing to detect and verify pilot gaze direction, substituting a technological system for the human verifier role.
3Reliability
If automated gaze monitoring is implemented, then visual check compliance is improved, but system complexity and cost increase
Solution Approach 1:
The system uses multi-functional integrated components where cameras serve both as flight recording devices and eye-tracking sensors. The same optical sensors that record cockpit video footage are also used to detect pupil position and gaze direction, eliminating the need for separate dedicated eye-tracking hardware and reducing overall system complexity.
Solution Approach 2:
The system creates a digital copy or model of the cockpit layout and checklist requirements, then compares the pilot's actual gaze position against this digital representation. By working with digital models and data rather than physical verification, the system simplifies the verification process while maintaining accuracy.
Data Source
AI summary
A system and method for verification of a pilot's activities in an aircraft cockpit has been developed. The system includes a camera located in the aircraft cockpit that monitors the pilot's eye position, head position and direction of gaze in the cockpit during aircraft operations. A computer system is located onboard the aircraft has a retrievable electronic memory that stores a three-dimensional (3D) model of the aircraft cockpit. The 3D model of the aircraft cockpit includes the location of aircraft instrumentation indicators. The retrievable electronic memory also stores a database of visual taskings for the pilot. The computer system determines the completion of the visual taskings for the pilot by comparing the pilot's eye and head position and gaze direction with location of relevant aircraft instrumentation indicators and a notification system that alerts the pilot when a visual tasking is not completed.