Eye-Tracking UI Selection Using Dual Targeting Criteria
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing eye tracking-based selection of user interface elements is prone to inadvertent or false positive selections, especially when multiple UI elements are proximate to each other, due to noise and inaccuracy in eye tracking.
Innovation Solution
Implementing multiple targeting criteria and adjusting selection regions based on eye tracking data, including enlarging or reducing selection regions, and applying scanning criteria to enhance accuracy and stability of UI element selection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If eye tracking is used to select UI elements, then selection speed is improved, but measurement precision deteriorates due to noise and inaccuracy in eye tracking
Solution Approach 1:
The system changes the temporal parameter by requiring the gaze to be sustained for a threshold duration before triggering selection. This transforms a potentially inaccurate instantaneous gaze measurement into a reliable selection signal by filtering out brief, unintentional glances through time-based parameter adjustment.
Solution Approach 2:
The patent introduces an intermediary validation mechanism between gaze detection and UI element selection. The system uses multiple UI elements with associated selection regions as intermediaries, where the eye tracking system first identifies a region of interest, then validates the selection through additional criteria before final selection occurs, reducing false positives from noisy gaze data.
2Area of stationary object
If multiple UI elements are displayed proximate to each other, then screen space utilization is improved, but reliability deteriorates due to increased likelihood of inadvertent selection
Solution Approach 1:
The system applies different selection region sizes to different UI elements based on their local context. When multiple UI elements are proximate to each other, the system adjusts the selection regions to ensure adequate separation, giving each element appropriate local properties that prevent inadvertent selection while maintaining efficient screen space utilization.
Solution Approach 2:
The system implements feedback by continuously monitoring gaze position and providing visual indication of the currently targeted UI element. This feedback loop allows users to verify their intended selection before final selection occurs, reducing inadvertent selections when multiple elements are displayed proximately by making the system's interpretation of user intent transparent and correctable.
3Ease of operation
If selection regions are enlarged to compensate for eye tracking inaccuracy, then ease of operation is improved, but manufacturing precision deteriorates as selection regions may overlap or extend beyond UI elements
Solution Approach 1:
The system dynamically adjusts selection region boundaries based on real-time gaze position and contextual factors. Rather than using fixed, overly large selection regions that would overlap with adjacent UI elements, the system adapts the selection region size and position to provide adequate margin for error while preventing overlap, balancing ease of operation with precise selection boundaries.
Solution Approach 2:
The system changes the spatial parameters of selection regions based on the specific UI layout and element proximity. When UI elements are close together, the system reduces selection region size or adjusts positioning to prevent overlap, whereas for isolated elements, larger selection regions are permitted. This parameter adaptation maintains ease of operation without compromising selection precision.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A method is performed at an electronic device with one or more processors, a non-transitory memory, an eye tracker, and a display. The eye tracker receives eye tracking data associated with one or more eyes of a user of the electronic device. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. While displaying the first UI element, the method includes determining, based on the eye tracking data, that a first targeting criterion is satisfied with respect to the first selection region, and determining, based on the eye tracking data, that a second targeting criterion is satisfied with respect to the second selection region. The method includes selecting the first UI element based at least in part on determining that the first targeting criterion is satisfied and the second targeting criterion is satisfied.