Pilot Gaze Scan Monitoring for Context-Aware Cockpit Alerts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Pilots face challenges in maintaining situational awareness due to poor focus and distractions during flight, leading to potential missed alerts and catastrophic situations, despite advancements in visual intelligence systems like HUDs.
Innovation Solution
An aircraft-based pilot safety system (PSS) that monitors and assesses the pilot's scan patterns by tracking gaze direction and comparing it to context-specific reference patterns, prompting redirection via visual or auditory alerts when deviations or distractions are detected.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If pilots rely on visual intelligence systems like HUD to improve situational awareness, then access to visual information is increased, but pilots remain susceptible to poor situational awareness and missed alerts due to distraction and loss of focus
Solution Approach 1:
The system continuously monitors the pilot's scan pattern via eye tracking and provides feedback by comparing actual scan patterns against reference scan patterns. When deviations are detected (indicating distraction or loss of focus), the system generates alerts to prompt the pilot to restore proper situational awareness, creating a closed-loop feedback mechanism that addresses the reliability issue
Solution Approach 2:
The system enables the pilot to self-monitor their own attention state through the scan pattern analysis. By tracking their own eye movements and comparing them to expected patterns, the pilot receives immediate feedback about their attention status, allowing them to self-correct before critical situations arise
2Reliability
If the system monitors pilot gaze continuously to detect scan pattern deviations, then pilot safety is improved, but system complexity and computational requirements increase
Solution Approach 1:
The monitoring system is divided into distinct functional modules: eye tracking component, scan pattern recognition component, reference pattern storage, and alert generation component. This segmentation allows each module to be optimized independently and simplifies the overall system architecture while maintaining high reliability
Solution Approach 2:
The system transforms the complex problem of continuous gaze monitoring into a parameter-based comparison task. By defining reference scan patterns as sequences of gaze targets with expected dwell times and transition patterns, the system reduces the complexity of analysis to comparing actual gaze parameters against predefined thresholds and patterns
3Measurement precision
If the system uses role-specific reference scan patterns for PIC and co-pilot to improve accuracy, then scan pattern assessment precision is increased, but data requirements and system configuration complexity increase
Solution Approach 1:
The system implements local quality by creating specialized reference scan patterns tailored to each pilot role (PIC vs. co-pilot) and potentially each seat position. Each role-specific pattern library contains customized sequences of gaze targets and expected behaviors appropriate to that role's responsibilities, improving assessment accuracy without requiring a completely separate system for each role
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
An aircraft-based pilot safety system (PSS) includes cameras or other gaze sensors (118) fixed at an aircraft pilot and configured to capture an image stream focused on the pilot's eyes. The gaze sensors continually assess the gaze direction of the pilot (e.g., toward a display, instrument panel, and/or indicator within the cockpit that the pilot is currently looking at or focusing on) and thereby can establish when the pilot is executing a scan pattern and if that scan pattern is nominal for the current flight context by comparing the scan pattern to context-specific reference scan patterns. If, for example, the pilot's gaze deviates from where it should be (e.g., as determined by the current flight segment) or the current scan pattern is interrupted, the system may prompt the pilot to redirect their gaze or resume the scan pattern.