Gaze-Assisted Interaction Region for Cursor Precision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaze-assisted interaction methods face challenges in precision and accuracy due to eye jitter and are limited in real-world environments with complex GUIs and varying lighting conditions, especially when performing rapid and precise movements across large distances.
Innovation Solution
The system enhances user interaction by using eye gaze information to generate an interaction region on the screen, allowing for quick and precise cursor movements by leveraging gaze-assisted interaction, which reduces the need for repetitive motor movements and improves precision by magnifying on-screen content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If gaze tracking is used to control cursor movement, then interaction speed is improved, but precision deteriorates due to eye jitter
Solution Approach 1:
The interaction process is divided into two distinct phases: a selection phase where gaze quickly identifies a region of interest, and a confirmation phase where traditional pointing device input provides precise control. This segmentation allows the system to leverage the speed of gaze tracking for gross movements while using traditional devices for precise positioning, thereby resolving the contradiction between speed and precision.
Solution Approach 2:
The system introduces an intermediary confirmation mechanism that bridges gaze input and cursor control. Instead of directly mapping gaze position to cursor position, the system uses gaze to select a region and then requires traditional pointing device input within that region to confirm the final position. This intermediary step filters out gaze jitter while preserving the speed advantage of gaze-driven selection.
2Area of stationary object
If display screen size increases, then information capacity is improved, but interaction difficulty worsens due to larger cursor movement distances
Solution Approach 1:
The system dynamically adjusts the interaction mode based on the distance to the target. For distant targets on large screens, gaze-driven selection is activated to enable quick crossing of large screen distances. For nearby targets or during confirmation steps, traditional pointing device control is used. This dynamic switching optimizes ease of operation across the entire display area.
Solution Approach 2:
The system replaces mechanical cursor movement (controlled by hand movements of pointing devices) with gaze-driven cursor movement for gross displacements across large screens. This substitution eliminates the need for repetitive hand movements and makes the interaction more natural and less fatiguing, especially when dealing with large display screens.
3Quantity of substance
If text and icon sizes decrease, then information density is improved, but interaction precision worsens
Solution Approach 1:
The system performs preliminary gaze-based selection of a region containing the target element before requiring precise confirmation input. This preliminary action narrows down the search area and provides contextual information that aids in precise interaction with small elements. The gaze-selected region acts as a preview that helps users anticipate the target location, improving click accuracy for dense content.
Solution Approach 2:
The system provides visual feedback by highlighting or bounding the gaze-selected region, giving users immediate feedback about which area will be the target of the upcoming confirmation action. This feedback mechanism helps users precisely locate small text or icons within the selected region, improving interaction precision in high-density display scenarios.
Data Source
AI summary
Methods and systems for gaze assisted interaction with a pointing device on a display screen. In response to receiving an activation input, a user's point of gaze (POG) on a display is received and a gaze region of the display corresponding to the POG is extracted, enlarged and transposed on the display according to a first cursor location, generating an interaction region on the display. A user interaction with the pointing device at a second cursor location on the display associated with the interaction region is intercepted in a system hook, mapped to a location on the display corresponding to the gaze region and passed to an application. The disclosed method and system may enable improved GUI interaction with pointing devices on displays while overcoming challenges associated with the precision of eye-gaze assisted interaction, including the impact of eye jittering on gaze estimation.