Eye Tracker Contextual Action Input Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-computer interaction methods using eye tracking for graphical user interfaces are inefficient and stressful, as they require precise eye movements or blinking to select and activate objects, lacking intuitive and natural interaction.
Innovation Solution
A system that combines eye-based input with mechanical, IR-sensor, voice-activated, or proximity-based input to enable users to select and activate objects on a display by determining the user's gaze point and executing contextual actions based on predefined conditions, allowing for customizable interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If eye tracking is used to select and activate objects, then input bandwidth is increased and communication asymmetry is reduced, but user interaction becomes more stressful and less intuitive
Solution Approach 1:
The patent combines multiple input modalities (eye tracking, keyboard, mouse, touch, voice, gestures) into a unified interaction system. This merging allows users to leverage their most comfortable input method for each task while maintaining high input bandwidth through the eye tracking component, thereby increasing productivity without unnecessarily increasing stress.
Solution Approach 2:
The system implements a universal input framework where multiple input devices serve complementary functions. The eye tracking system provides gaze-based selection and activation, while other devices (keyboard, mouse, touch) provide complementary input capabilities. This multi-functionality ensures that no single input method must be used exclusively, maintaining ease of operation while maximizing input bandwidth.
2Measurement precision
If precise eye movements or blinking are required to select and activate objects, then object selection accuracy is improved, but user interaction becomes more difficult to control
Solution Approach 1:
The patent introduces an intermediary layer that translates precise gaze measurements into user-friendly selection actions. The system detects accurate gaze points but provides intuitive control mechanisms such as dwell-time-based selection, where the user simply needs to look at an object for a predetermined period to activate it, rather than requiring precise eye movements or controlled blinking.
Solution Approach 2:
The system enables self-service interaction where the user's natural gaze behavior automatically triggers selection actions. By using dwell-time detection and other passive methods, the system serves itself by automatically determining user intent based on where and how long the user looks, eliminating the need for the user to consciously control eye movements or blinking patterns.
3Ease of operation
If multiple input modalities are combined, then interaction intuitiveness is improved, but system complexity increases
Solution Approach 1:
The patent segments the input processing system into distinct functional modules, each handling a specific input modality (eye tracking module, keyboard module, mouse module, touch module, voice module, gesture module). This segmentation allows each module to operate independently with well-defined responsibilities, making the overall complex system more manageable and easier to implement while maintaining high intuitiveness through coordinated operation of these modular components.
Data Source
AI summary
The present invention relates to systems and methods for assisting a user when interacting with a graphical user interface by combining eye based input with input for e.g. selection and activation of objects and object parts and execution of contextual actions related to the objects and object parts. The present invention also relates to such systems and methods in which the user can configure and customize specific combinations of eye data input and input that should result in a specific contextual action.