Eye-Tracked Situation Awareness Monitoring for Remote Vehicle Operators
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of remotely operated vehicles face challenges in maintaining awareness of the control state due to high workload, stress, and fatigue, particularly when managing multiple vehicles, increasing the risk of accidents.
Innovation Solution
A method and system using an eye tracker to monitor the operator's point-of-gaze and compare real-time control instrument values with previously inspected values, alerting the operator and activating a fail-safe mode if awareness is insufficient, with customizable thresholds for alerts and fail-safe activation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single operator manages multiple remotely operated vehicles, then productivity increases, but situation awareness deteriorates due to increased workload and competition for attention resources
Solution Approach 1:
The system continuously monitors operator gaze behavior and provides feedback about their attention allocation. By tracking where the operator looks and comparing it with the current state of vehicle parameters, the system detects when the operator has missed important changes in vehicle status, enabling timely alerts to restore situation awareness.
Solution Approach 2:
The patent replaces manual monitoring and cognitive assessment of operator awareness with an automated eye-tracking system. Instead of relying on the operator's own cognitive resources to maintain awareness across multiple vehicles, the system uses optical tracking technology to objectively measure and assess operator attention and detect awareness failures.
2Reliability
If the operator focuses attention on high-priority information, then situation awareness improves, but the ability to manage workload and scan all indicators deteriorates
Solution Approach 1:
The system applies different monitoring thresholds and alert priorities to different indicators based on their importance. High-priority parameters receive continuous monitoring and lower alert thresholds, while less critical parameters have higher thresholds, allowing the operator to focus attention strategically without missing important changes.
Solution Approach 2:
The system provides feedback to the operator about their attention patterns and alerts them when important parameters have changed since their last inspection, enabling efficient workload management while maintaining awareness of critical vehicle states.
3Reliability
If the operator scans all indicators frequently, then situation awareness improves, but time available for other tasks decreases
Solution Approach 1:
The system performs preliminary analysis of operator gaze patterns and parameter changes continuously in the background, so that when the operator does look at an indicator, the system has already detected and can immediately alert them to any significant changes, eliminating the need for frequent deliberate scanning.
Solution Approach 2:
The system provides targeted feedback only when necessary - alerting the operator to specific parameter changes that occurred since their last inspection - rather than requiring them to systematically check all indicators, thus reducing time loss while maintaining awareness.
4Reliability
If the system provides frequent alerts to the operator, then situation awareness improves, but operator stress and distraction increase
Solution Approach 1:
The system applies different alert thresholds and priorities to different parameters, providing alerts only for significant changes in critical parameters rather than notifying the operator of every minor fluctuation, thus maintaining awareness while reducing unnecessary stress.
Solution Approach 2:
The system provides feedback about parameter changes that occurred since the operator's last inspection of each indicator, allowing the operator to quickly assess what has changed without being overwhelmed by continuous notifications about all system states.
Data Source
AI summary
A system and method that detect situation awareness failures in operators of remotely operated vehicles and consequently alert the operators and/or activate a fail-safe mode in the vehicles to reduce potential for an accident. Real-time values of indicators displayed on a control station are periodically stored in a database and compared to inspected values of each indicator stored when the operator last viewed each indicator to determine if there is a difference representing an operator's level of awareness. An eye-tracking system is used to monitor the operator's point-of-gaze and awareness of each indicator. If there is a difference beyond an acceptable level of deviation between the real-time value and the inspected value, the system alerts the operator and/or commands the remotely operated vehicle to commence a fail-safe operation.