3D Gaze Keyboard Entry With Intent Detection to Cut Input Errors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy wastage, particularly in battery-operated devices.
Innovation Solution
The system employs gaze-based text entry in a three-dimensional environment, utilizing eye-tracking components to detect user interactions with a keyboard, allowing for intuitive and efficient text input by detecting gaze movements and initiating character selection based on predefined criteria.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input devices (cameras, controllers, joysticks, touch-sensitive surfaces) are used to interact with virtual reality environments, then user interaction capability is provided, but the interaction becomes cumbersome, inefficient, and places significant cognitive burden on users
Solution Approach 1:
The patent replaces mechanical input devices (controllers, joysticks, touch surfaces) with a gaze-based input system that uses eye tracking technology. The eye tracking component detects user gaze direction and eye movements to control virtual reality interactions, eliminating the need for physical input devices and reducing cognitive burden on users.
Solution Approach 2:
The system utilizes the user's natural eye movements and gaze patterns as the input mechanism, allowing the user's own physiological responses to directly control the interface without requiring external devices or deliberate manual actions. The gaze-based system automatically detects selection intent through predefined criteria such as gaze duration and fixation patterns.
2Productivity
If multiple inputs are required to achieve desired outcomes in augmented reality environments, then interaction capability is provided, but the number of inputs increases cognitive burden and reduces efficiency
Solution Approach 1:
The system performs preliminary detection of user gaze direction and intent before requiring any commitment from the user. By continuously monitoring eye movements and predicting selection targets based on gaze patterns, the system prepares the interface in advance, allowing users to simply look at and hold their gaze on the desired target without requiring multiple sequential inputs or confirmations.
Solution Approach 2:
The system provides continuous visual feedback to the user by highlighting potential selection targets based on current gaze direction and providing confirmation when selection criteria are met. This feedback loop allows users to understand the system's interpretation of their intent and make rapid corrections if needed, significantly reducing the time required for accurate text entry.
3Measurement precision
If complex manipulation of virtual objects is required, then interaction precision is provided, but the manipulation becomes tedious and error-prone
Solution Approach 1:
The system dynamically adjusts selection criteria and detection thresholds based on the user's gaze behavior patterns. By continuously adapting to individual user characteristics and contextual factors, the system maintains high selection accuracy while requiring minimal user effort. The predefined criteria for gaze-based selection (such as dwell time and fixation stability) are optimized to balance precision with ease of operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces the number of necessary inputs, enhances user interface efficiency, minimizes errors, conserves power, and extends battery life by enabling quicker and more intuitive device operation.
Implementation Method 1
the computer system detects, via the one or more input devices, a movement of a gaze of the user from a position away from a first key of the keyboard to the first key
Data Source
AI summary
In some embodiments, while a keyboard is visible in a three-dimensional environment, the computer system detects a gaze of a user move from a position away from a first key of the keyboard to the first key. In some embodiments, in response to detecting the gaze of the user moving from the position away from the first key to the first key, in accordance with a determination the one or more criteria are satisfied, the computer system initiates a process to select a first character corresponding to the first key for entry. In some embodiments, in response to detecting the gaze of the user moving from the position away from the first key to the first key, in accordance with a determination that the one or more criteria are not satisfied, the computer system forgoes initiating the process.