Eye Movement Tracker Gaze Action Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current eye movement-based pointing devices face challenges in distinguishing between observational and intentional eye movements, leading to difficulties in mode switching and interpreting eye movements for operations, particularly due to the lack of buttons for mode indication and the complexity of analyzing eye tracking data.

Innovation Solution

The method involves analyzing eye movement information to determine gaze actions based on location, direction, length, and velocity, using time-based, location-based, and action-based techniques to switch between observational and operational modes, and specifying operations through gaze actions that include sequences of gaze movements across gaze-sensitive areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If eye movement tracking is used to control a pointing device, then the user can interact with the display using natural eye movements, but the system cannot reliably distinguish between observational and intentional eye movements

Engineering Contradiction:
Improvenatural interactionVSAvoidmode detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system dynamically adapts the interaction mode based on detected gaze patterns. When intentional gaze actions are detected (such as prolonged fixation or specific movement patterns), the system transitions from passive tracking to active operation mode, allowing the same eye tracker to serve both observational and operational functions without requiring separate hardware

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the interpretation parameters of eye movement data based on context. By analyzing duration, velocity, and pattern of gaze movements, the system distinguishes between observational viewing and intentional selection actions, enabling reliable mode detection without additional hardware inputs

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If additional input channels or buttons are added for mode switching, then mode detection accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvemode detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The eye tracker is designed to serve multiple functions: it simultaneously performs observational tracking and operational control. By analyzing the same gaze data stream with different interpretation algorithms, the system eliminates the need for separate buttons or input channels while maintaining both tracking and control capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the existing eye movement data stream to self-determine when operational mode should be activated. The gaze pattern analysis automatically identifies intentional actions without requiring external input signals, allowing the system to self-regulate mode switching based on user behavior patterns

Inventive Principle:
Principle #25Self-service

3Measurement precision

If complex eye movement analysis is performed to distinguish intentional actions, then operation specification accuracy improves, but data analysis complexity increases

Engineering Contradiction:
Improveaction recognition accuracyVSAvoiddata analysis complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies progressively more complex analysis only when needed. Basic gaze tracking is performed continuously, but detailed pattern recognition and action classification are activated only when fixation duration or movement patterns suggest potential intentional actions, reducing overall computational load while maintaining accuracy

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for natural and efficient interaction with displays by enabling accurate mode switching and operation specification using gaze actions, reducing the need for additional input channels and simplifying data analysis, thus enhancing user interaction in various contexts such as museums, aircraft, and surgical environments.

Implementation Method 1

The most commonly used approach in video-based eye tracking is to calculate the angle of the visual axis (and the location of the fixation point on the display surface) by tracking the relative position of the pupil and a speck of light reflected from the cornea, technically known as the 'glint'.

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

Infra-red illumination of the eye produces the 'bright pupil' effect 105 and makes the tracking easier.

Methodology Applied
Scientific EffectInfra-red illumination: Infrared Radiation

Data Source

PatentUS7561143B1Using gaze actions to interact with a display
Publication Date: 2009.07.14 SAMSUNG ELECTRONICS CO LTD
  • US7561143B1 patent drawing
  • US7561143B1 patent drawing
  • US7561143B1 patent drawing

AI summary

Techniques for using gaze actions to interact with interactive displays. A pointing device includes an eye movement tracker that tracks eye movements and an eye movement analyzer. The eye movement analyzer analyzes the eye movements for a sequence of gaze movements that indicate a gaze action which specifies an operation on the display. A gaze movement may have a location, a direction, a length, and a velocity. A processor receives an indication of the gaze action and performs the operation specified by the gaze action on the display. The interactive display may be digital or may involve real objects. Gaze actions may correspond to mouse events and may be used with standard graphical user interfaces.