Context-Aware On-Screen Keyboard for Faster Eye-Gaze Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice-controlled communication devices with on-screen keyboards suffer from slow input pace and high error rates due to gaze position inaccuracies in eye tracking, limiting user participation in conversations.
Innovation Solution
An optimized on-screen keyboard that displays context-aware word proposals within the focus area, allowing users to intuitively select and trigger additional elements without looking away, using eye control to enhance input speed and reduce errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If word proposals are displayed outside the focus area (e.g., above the keyboard), then users can access contextual suggestions, but users must shift their gaze to locate and select them, reducing input speed
Solution Approach 1:
The patent embeds word proposals within the existing keyboard button structure rather than placing them in a separate location. By integrating the suggestion layer into the same spatial dimension as the letter buttons, users can access contextual suggestions without shifting their gaze to a different area of the screen.
Solution Approach 2:
The patent combines the letter button and word proposal into a single interactive element. When a user focuses on a button, both the letter selection and the contextual word suggestion become available through the same gaze position, merging two functions into one spatial location.
2Stability of the object's composition
If the on-screen keyboard uses standard button sizes, then all buttons are uniformly visible, but users with motor skill limitations experience slow input pace and high error rates
Solution Approach 1:
The patent applies different visual properties to different parts of the keyboard interface. Buttons containing word proposals are highlighted with distinct styling (such as background color changes or borders) to differentiate them from regular letter buttons, providing local visual enhancement where contextual information is present.
3Measurement precision
If eye tracking detection accuracy is improved, then gaze position detection becomes more precise, but the system complexity and cost increase
Solution Approach 1:
The patent introduces an intermediate processing layer that translates imprecise gaze positions into definitive button selections. By using dwell time detection (how long the gaze remains on a button) as a mediator between the eye tracking camera and the keyboard selection, the system achieves accurate input without requiring perfectly precise gaze detection.
Data Source
AI summary
The present invention relates to a method for generating an optimized on-screen keyboard for a device (20), in particular device for a supported communication, wherein the device is formed to display an on-screen keyboard (1), which can be operated by a user by means of eye control, wherein the method has the following steps: (a) displaying an on-screen keyboard (1), which has a plurality of buttons, on the device (20); (b) receiving at least one user input with regard to the on-screen keyboard (1), in particular focusing on a button by means of eye control; (c) determining context information, at least based on the user input; (d) generating a modified on-screen keyboard based on the context information, wherein the modified on-screen keyboard includes at least one modified information and/or action element, which is arranged in a focus area of the user; and (e) displaying the modified on-screen keyboard on the device (1). What is further specified is a computer-readable storage medium, which includes instructions, which prompt at least one processor to implement the method as well as a corresponding device, in particular for a supported communication.