Human-Machine Interface Eye Tracking for Peripheral Vision Alerts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Aircraft pilots often face information overload in the cockpit, leading to missed critical alerts due to stress or distraction, and existing human-machine interfaces are inadequate in managing cognitive load and peripheral vision effectively.

Innovation Solution

A computer-implemented method that adjusts the display of a human-machine interface based on the pilot's eye position, gaze direction, and cognitive load, using eye tracking and physiological data to optimize information presentation and interaction, allowing for visual alerts and hands-free control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If information is displayed in the central field of view, then the pilot can perceive it clearly, but the pilot's attention is drawn away from the external environment and situational awareness deteriorates

Engineering Contradiction:
Improveinformation perception accuracyVSAvoidsituational awareness
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent moves information display from the central field of view to the peripheral field of view, utilizing a different spatial dimension. This allows the pilot to perceive information without shifting attention from the external environment, as peripheral vision processes information independently of focused attention.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent applies different display strategies to different regions of the visual field. Critical information is presented in the peripheral field with specific visual characteristics (such as simplified graphics or icons) that are optimized for peripheral perception, while maintaining high-quality detailed information availability when the pilot deliberately shifts attention.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If multiple alerts and information are presented simultaneously, then comprehensive information is provided, but cognitive load increases and critical information may be missed

Engineering Contradiction:
Improveinformation quantityVSAvoidcognitive load
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent segments information display by spatial location in the peripheral field and by information type. Different regions of the peripheral display are dedicated to different types of information (e.g., navigation, system status, warnings), allowing the pilot to process multiple information streams simultaneously without cognitive overload, as each segment can be processed independently by different attention channels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the mechanical cognitive processing system with an optimized information presentation system. By using peripheral vision display with simplified visual encodings, icons, and spatial organization, the system reduces the cognitive processing burden while maintaining comprehensive information delivery, substituting complex cognitive analysis with perceptual processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If the pilot focuses attention on critical tasks, then task performance is optimized, but peripheral visual information is not detected

Engineering Contradiction:
Improvetask performanceVSAvoidperipheral information detection
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent places critical alert information in the peripheral field of view in advance, where it can be detected without requiring the pilot to shift attention from the current task. The information is pre-positioned in the visual periphery, ready to be perceived as soon as the pilot's attentional state allows, without interrupting ongoing task performance.

Inventive Principle:
Principle #10Preliminary action

4Quantity of substance

If traditional audio alerts are used, then information is conveyed, but the pilot may not perceive them under stress or cognitive load

Engineering Contradiction:
Improveinformation transmissionVSAvoidinformation perception reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent implements dynamic display characteristics in the peripheral field that adapt to the pilot's attentional state and the criticality of information. Visual alerts can change intensity, size, or position in the peripheral field based on urgency, creating a dynamic presentation that maintains effectiveness under varying cognitive load conditions, unlike static audio alerts.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Reduces cognitive load and improves aeronautical safety by ensuring critical information is noticed without distracting the pilot, enabling more efficient interaction and maintaining situational awareness.

Implementation Method 1

receiving information relating to the position of the eyes and the direction of gaze of a user on the interface

Methodology Applied
Scientific EffectEye tracking:

Implementation Method 2

receiving physiological information from the user; determining a level of cognitive load as a function of the physiological information received

Methodology Applied
Scientific EffectPhysiological detection:

Data Source

PatentEP3525066B1Peripheral vision in a human machine interface
Publication Date: 2024.05.08 THALES SA
  • EP3525066B1 patent drawingFigure 1~2
  • EP3525066B1 patent drawingFigure 3
  • EP3525066B1 patent drawingFigure 4

AI summary

The invention relates to a computer-implemented method for managing a human-machine graphical interface, comprising the steps of receiving information about the user's eye position and gaze direction on the interface; receiving physiological information from the user; determining a cognitive load level based on the received physiological information; and adjusting the interface display according to the gaze direction and/or the determined cognitive load level. Further developments describe the management of display areas (foveal area and peripheral areas), the selection of one or more displays, the management of the distance between the display of messages and the current gaze location, the management of message criticality, various graphical modalities for attracting attention, the management of the flight context in the avionics case, the management of visual density, etc.System aspects are described (virtual and/or augmented reality).