Vigilance Estimation via Eye Tracking and EEG Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Measuring situation awareness in real-time during training or simulation exercises is challenging due to the need for time-consuming self-report surveys, and existing pilot monitoring systems often mistake sustained attention for fixation or attention tunneling.
Innovation Solution
A computer system that records eye tracking data, correlates it with task-specific requirements, and uses physiological data like EEG and fNIRs to differentiate between appropriate vigilance and fixation, providing remedial actions when necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If self-report surveys are used to measure situation awareness, then measurement accuracy is improved, but training time is lost and simulation realism is reduced
Solution Approach 1:
The patent replaces the mechanical survey administration process with an automated optical and physiological sensing system. Eye tracking cameras, EEG sensors, and fNIRS devices continuously collect data without interrupting training, substituting the manual survey mechanism with an automated physiological monitoring system that operates in real-time.
Solution Approach 2:
The system enables self-measurement of situation awareness through physiological indicators. The trainee's own eye movements, brain waves, and neural activity serve as automatic indicators of their cognitive state, eliminating the need for external survey administration and response from the trainee.
2Measurement precision
If pilot monitoring systems evaluate sustained attention, then attention monitoring is improved, but false positives increase by mistaking sustained attention for fixation
Solution Approach 1:
The patent merges multiple measurement modalities (eye tracking, EEG, fNIRS) into a unified monitoring system. By combining data from these different sources, the system cross-validates attention states and distinguishes between legitimate sustained attention and problematic fixation, reducing false positives through multi-modal correlation.
Solution Approach 2:
The system provides continuous feedback by correlating physiological data with task requirements in real-time. When sustained attention patterns are detected, the system cross-references them with current task demands and neuroactivity levels to determine whether the attention pattern is appropriate or represents fixation, adjusting monitoring thresholds dynamically.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with a current task and predetermined vigilance requirements. The system determines if the user is exhibiting an appropriate level of vigilance based on the task or is becoming fixated. When fixation is detected, the system may engage in remedial action. A task flow diagram represents the operator tasks. Interactions between the user and the instrumentation are used to estimate the probability distribution of the task the user is currently conducting. The system correlates eye tracking data and physiological data such as electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRs) to determine neuroactivity. Monitoring neuroactivity reduces the probability of a false positive for fixation.