Cockpit Touch Event Validation Using Gaze and Body Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Flight displays in aviation often incorrectly register touch points due to inadvertent touches, leading to extended task times and unintended aircraft system inputs.

Innovation Solution

A system and method that utilizes eye tracking sensors and body movement sensors to validate touch events by comparing spatial-temporal touch data with a signature database, adjusting display settings based on confidence levels to reduce inadvertent touches.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touchscreen interface is used in cockpit display, then ease of operation is improved, but reliability deteriorates due to inadvertent touch events

Engineering Contradiction:
Improveease of operationVSAvoidreliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces eye tracking sensors and body movement sensors as intermediary devices that mediate between the user and the touchscreen interface. These sensors detect whether the user is looking at and interacting with the display, serving as a verification layer before registering touch inputs. This intermediary system prevents inadvertent touches from being processed while maintaining the ease of touchscreen operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If touch event validation through eye and body tracking is implemented, then reliability is improved by reducing inadvertent touches, but device complexity increases

Engineering Contradiction:
ImprovereliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent integrates multiple sensing functions (eye tracking, body movement detection, and touch event validation) into a unified system that serves multiple purposes. The same sensor array that monitors user presence and attention can also validate touch inputs, reducing the need for separate dedicated validation hardware. This multi-functionality approach improves reliability while limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If spatial-temporal touch event data is monitored and compared with signature database, then measurement precision is improved for detecting inadvertent touches, but loss of time occurs due to additional processing

Engineering Contradiction:
Improvemeasurement precisionVSAvoidloss of time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-establishes a database of valid touch event signatures before operation. During actual use, the system compares incoming touch events against this pre-computed database rather than performing complex analysis in real-time. This preliminary preparation of reference data enables rapid comparison and validation, improving measurement precision while minimizing the time loss during critical flight operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12430022B2System and method for monitoring touch events in a cockpit display
Publication Date: 2025.09.30 ROCKWELL COLLINS INC
  • US12430022B2 patent drawing
  • US12430022B2 patent drawing
  • US12430022B2 patent drawing

AI summary

A system for monitoring touch events in a cockpit display includes one or more user monitoring devices including eye tracking sensors and body tracking sensors. The system includes a controller including a touch event algorithm configured to determine inadvertent touch events. The controller may receive eye gaze and body movement data of the user viewing the display. The controller may receive the spatial-temporal touch event data and compare the spatial-temporal touch event data with touch event signature data in a touch event signature database. The controller may determine whether the received user touch input is an inadvertent touch event. Upon determining the user touch input is an inadvertent touch, the controller may perform a first set of avionic system actions and upon determining the user touch input is an intentional touch, the controller may perform a second set of avionic system actions.