Eye Gaze Multi-Item Selection Using Animated Secondary Targets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Eye gaze tracking systems are prone to errors due to noisy and imprecise signals, leading to inaccurate item selection in user interfaces, which hinders their wide acceptance.

Innovation Solution

The system renders secondary selection targets within a threshold distance of a primary selection target, animating them to move outside their initial location, allowing the user's eye movement to create a vector that identifies the intended selection, thereby improving selection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If eye gaze tracking is used for item selection, then the system can replace traditional input devices, but the selection accuracy deteriorates due to noisy signals

Engineering Contradiction:
Improvereplacement of input devicesVSAvoiditem selection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The selection process is divided into two distinct phases: primary target selection through gaze dwell, and secondary target selection through gaze transition. This segmentation allows each phase to be optimized independently, with the first selecting from all targets and the second selecting from nearby targets only, thereby improving overall accuracy despite noisy signals

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by identifying and highlighting secondary selection targets near the primary target before the user actually intends to select them. This preliminary identification of potential targets allows the system to anticipate user intent and prepare for the next selection, reducing errors from noisy gaze signals

Inventive Principle:
Principle #10Preliminary action

2Extent of automation

If gaze dwell technique is used to trigger events, then the system can detect user intent, but false selections increase due to signal noise

Engineering Contradiction:
Improveautomatic event triggeringVSAvoidselection reliability
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The system implements feedback by continuously monitoring gaze position and providing visual feedback through highlighting potential secondary targets. This feedback loop allows the system to distinguish between intentional gaze (user wanting to select) and unintentional gaze (noise), thereby reducing false selections while maintaining automated triggering

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system introduces an intermediary mechanism - the secondary target highlighting system - that acts as a mediator between the raw gaze signal and the final selection action. This intermediary layer filters out false selections by requiring the gaze to actually transition to and dwell on the highlighted secondary target before triggering selection

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If secondary selection targets are rendered within threshold distance, then selection precision improves, but device complexity increases

Engineering Contradiction:
Improveselection precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies local quality by rendering secondary selection targets only in the local region near the primary target, rather than managing the entire interface. This localized approach improves precision for nearby selections while limiting complexity to only the necessary area, avoiding the need to manage all possible targets throughout the interface

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10254832B1Multi-item selection using eye gaze
Publication Date: 2019.04.09 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10254832B1 patent drawing
  • US10254832B1 patent drawing
  • US10254832B1 patent drawing

AI summary

Representative embodiments disclose mechanisms for selection of items using eye tracking. One or more primary selection targets are presented to the user. When the user selects a primary selection target, secondary selection targets are presented in close proximity to the primary selection target, either before or after selection of the primary selection target. The secondary selection targets are animated in a way that moves them away from the primary selection target. The user's eye naturally follows the secondary selection target of interest, if any, producing a vector having a magnitude and a direction. The magnitude and direction of the vector are used to identify which, if any, of the secondary selection targets are intended ty the user.