Eye Tracking Selection via Moving Interactive Target

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Eye tracking systems face challenges in inferring a user's intent to select graphical user interface elements without additional input mechanisms, as dwell-based selection methods can feel slow and unnatural.

Innovation Solution

The use of periodically updated position signals interacting with interactive targets, allowing users to select user interface elements through natural eye motions that meet predetermined motion conditions, eliminating the need for dwell gestures and additional input mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If dwell-based selection methods are used, then user intent can be inferred without additional input mechanisms, but interaction speed becomes slow and unnatural

Engineering Contradiction:
Improvenaturalness of interactionVSAvoidinteraction speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent transforms the static dwell-based selection into a dynamic motion-based selection system. The interactive target moves along a predetermined path, and selection occurs when the position signal intersects with the moving target. This dynamic approach allows users to select elements through natural eye movements rather than requiring prolonged dwelling, thereby improving both interaction speed and naturalness.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary action by moving the interactive target along a predetermined path in advance. This allows the target to be positioned optimally for intersection with the user's gaze, enabling faster selection without requiring the user to dwell on multiple positions. The predetermined motion path is prepared beforehand to facilitate efficient interaction.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If additional input mechanisms are added to confirm selection intent, then selection accuracy improves, but device complexity increases

Engineering Contradiction:
Improveselection accuracyVSAvoidnumber of input mechanisms
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the user's natural eye movements themselves as the selection mechanism, rather than requiring separate confirmation inputs. The motion of the interactive target combined with the position signal intersection automatically indicates selection intent, making the eye movement self-sufficient for both navigation and selection confirmation. This eliminates the need for additional buttons, voice commands, or other input mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The interactive target serves as an intermediary element that mediates between the user's gaze and the selection action. By moving the target along a predetermined path and detecting intersections with the position signal, the system translates natural eye movements into precise selection events without requiring direct user confirmation. This intermediary mechanism maintains high selection accuracy while avoiding additional input devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If motion-based selection is implemented, then interaction speed improves, but false interactions may increase

Engineering Contradiction:
Improveinteraction speedVSAvoidfalse interaction rate
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system incorporates feedback by continuously monitoring the position signal and comparing it with the interactive target's position along the predetermined path. This real-time feedback mechanism allows the system to distinguish between intentional selections (where the gaze deliberately intersects the moving target) and accidental intersections, thereby reducing false interactions while maintaining fast selection speeds.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables quicker and more natural user interaction by allowing users to express intent through eye movements, reducing the likelihood of false interactions and providing a more intuitive experience.

Implementation Method 1

one or more image sensors configured to capture images of the user's eye. Images of the eye acquired while the light sources are emitting light may be used to detect the location of the user's pupil and of corneal (or other) reflections arising from the light sources

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP3014390B1Selecting user interface elements via position signal
Publication Date: 2019.07.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3014390B1 patent drawingFigure 1A~1B
  • EP3014390B1 patent drawingFigure 1C
  • EP3014390B1 patent drawingFigure 2

AI summary

Method of selecting user interface elements via a periodically updated position signal, the method comprising displaying on a graphical user interface a representation of a user interface element and a representation of an interactive target (106). The method further comprises receiving an input of coordinates of the periodically updated position signal, and determining a selection of the user interface element if a motion interaction of the periodically updated position signal with the interactive target meets a predetermined motion condition.