Gaze Tracking Text Input for Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional head-mounted devices lack efficient and discreet methods for user input, particularly for text entry, as traditional virtual keyboards are difficult to use without peripheral accessories.
Innovation Solution
The implementation of a gaze tracking system within head-mounted optical modules, which uses cameras and light sources to track the user's gaze and create a gaze swipe input curve for text input, optionally supplemented by hand movements for secondary inputs, allowing for text entry on virtual keyboards displayed to the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional virtual keyboards are used in head-mounted devices, then text input functionality is provided, but the user interface becomes complex and difficult to use without peripheral accessories
Solution Approach 1:
The patent replaces traditional mechanical or manual text input methods (physical keyboards, on-screen keyboards requiring finger movement) with a gaze-based input system. The eye tracking system detects user gaze direction and interprets it as text input commands, substituting the mechanical interaction paradigm with an optical sensing paradigm. This eliminates the need for complex virtual keyboard interfaces while providing intuitive text input capability.
Solution Approach 2:
The patent introduces an intermediary processing layer between the user's natural gaze behavior and the text input output. The eye tracking system captures raw gaze data, and an interpretation algorithm mediates this data to determine user intent for text input. This intermediary layer translates unconscious gaze movements into structured input commands without requiring the user to interact with complex keyboard interfaces.
2Ease of operation
If gaze tracking system is implemented in head-mounted devices, then discreet and intuitive text input is enabled, but device complexity and manufacturing difficulty increase
Solution Approach 1:
The patent integrates the eye tracking system into the existing head-mounted device platform, making the gaze tracking capability serve multiple functions: text input, scrolling, selection, and potentially other interactions. By making the optical tracking system multi-functional rather than dedicated solely to text input, the patent amortizes the manufacturing complexity across multiple use cases, improving the ease of manufacture while maintaining input intuitiveness.
Solution Approach 2:
The patent merges the gaze tracking functionality with the existing display and optical systems of the head-mounted device. Rather than adding completely separate components, the system combines eye tracking with the device's native optical path and display architecture. This consolidation reduces the number of discrete parts that need to be manufactured and assembled, thereby improving manufacturing ease while preserving the discreet and intuitive input capability.
3Measurement precision
If hand movements are used for secondary inputs, then text input accuracy is improved, but the number of input modalities increases
Solution Approach 1:
The patent implements a dynamic input system that adapts between different modalities based on context and user behavior. The system primarily operates in gaze-tracking mode for discreet input, but dynamically transitions to or incorporates hand movement recognition when additional precision is needed. This dynamic switching allows the system to maintain high input accuracy while avoiding the permanent complexity of maintaining multiple equally-weighted input modalities.
Solution Approach 2:
The patent uses hand movements not as a complete alternative input system, but as a partial supplement to gaze tracking. Hand gestures are invoked selectively for specific functions such as confirming selections, correcting errors, or providing disambiguation when gaze alone is insufficient. This partial use of hand modalities improves input accuracy without requiring the full complexity of a multi-modal input system to be always active.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables intuitive and discreet text input using gaze tracking and hand movements, enhancing user interaction with head-mounted devices without the need for external accessories, improving usability and convenience.
Implementation Method 1
The gaze tracking system in each optical module may be used to create glints on a user's eye, such as by using a light emitter
Implementation Method 2
The light sources may be, for example, near infrared light-emitting diodes
Data Source
AI summary
A head-mounted device may have a head-mounted support structure, a gaze tracker in the head-mounted support structure, and one or more displays in the head-mounted support structure. For example, two displays may display images to two eye boxes. The display may display a virtual keyboard and may display a text input in response to a gaze location that is determined by the gaze tracker. The gaze tracker may additionally determine a gaze swipe input, or a camera in the support structure may determine a hand swipe input, and the swipe input may be used with the gaze location to determine the text input. In particular, the swipe input may create a swipe input curve that is fit to the text input to determine the text input. A user's hand may be used as a secondary input to indicate the start or end of a text input.