Dynamic On-Screen Keyboard for Eye Tracking Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Eye tracking systems for character input suffer from jitter and delays in character selection, particularly on small devices, leading to incorrect character choices and reduced typing speed due to sensitivity issues and lighting conditions.

Innovation Solution

A computer-based character input method using an on-screen keyboard interface where key segments are dynamically resized based on usage frequency, with frequently used characters placed closer to the center and rarely used characters removed or minimized, and a word database that updates usage frequencies and recommends words for faster typing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If eye tracking is used for character input, then hands-free operation is enabled for physically disabled persons, but jitter and delays occur leading to incorrect character selections

Engineering Contradiction:
Improvehands-free operationVSAvoidcharacter selection accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The keyboard layout is made dynamic by automatically rearranging key positions and sizes based on usage frequency analysis. Frequently used characters are placed closer to the center and given larger key areas, while less frequent characters are positioned peripherally with smaller keys. This dynamic adaptation reduces selection time and improves accuracy by anticipating user needs without requiring manual adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary analysis of usage frequency patterns and pre-arranges the keyboard layout before actual typing begins. By anticipating which characters will be needed based on statistical analysis of the input context, the system prepares the optimal key arrangement in advance, reducing the impact of eye tracking jitter and delays.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If fixed character amount and size are used on small devices, then device simplicity is maintained, but it becomes difficult to wait for pointer convergence on the same key

Engineering Contradiction:
Improvedevice simplicityVSAvoidtyping speed
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The system dynamically adjusts both the size and position of keyboard keys based on usage frequency. High-frequency characters receive larger key areas and central positions that allow for easier pointer convergence, while maintaining a compact overall layout suitable for small devices. This dynamic resizing enables faster typing without increasing device complexity.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If conventional keyboard layout is used, then all characters are equally accessible, but frequently used characters require more time to reach

Engineering Contradiction:
Improvecharacter accessibilityVSAvoidtyping speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

Different regions of the keyboard are assigned different properties based on usage frequency. The center region contains larger keys for frequently used characters, while peripheral regions contain smaller keys for less frequent characters. This local differentiation optimizes access time for common characters while maintaining comprehensive character coverage, directly improving typing speed without sacrificing versatility.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3430497B1Method and system for realizing character input by means of eye movement
Publication Date: 2022.11.16 ANADOLU UNIVSI
  • EP3430497B1 patent drawingFigure 1~2
  • EP3430497B1 patent drawingFigure 3a~3c

AI summary

The present invention is a computer-based character input method in order to provide the user to type by means of eye (6) movements, where, an on-screen keyboard interface (2), comprising the key segments (21) accommodating at least one typing character, is presented to a display unit (5), the typing character, provided in the key segment (21) corresponding to the point where the eye (6) gazes at the display unit (5), is selected and presented to the user in accordance with the data taken from an eye tracking device (1) which senses the eye (6) position of the user gazing at said display unit (5).