TapGazer Finger Tapping and Gaze Selection for VR Text Entry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Efficient text entry in Virtual Reality (VR) environments is challenging due to the proximity and visibility issues of physical keyboards, requiring users to move their hands away from keys and often occlude the real world, and existing methods are either cumbersome or slow, failing to leverage users' familiarity with QWERTY keyboards.
Innovation Solution
A text entry method called TapGazer, which combines finger tapping and gaze-directed word selection, allowing users to type on any surface without aligning fingers with keys, using sensors to detect finger taps and gaze to resolve ambiguity, and leveraging a QWERTY layout for familiarity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a physical keyboard is used for text entry in VR, then typing accuracy is improved, but user mobility is reduced and hands must remain near the keyboard
Solution Approach 1:
The patent replaces the mechanical interaction with a physical keyboard by using sensor-based finger tapping detection. Sensors detect finger taps on any surface, eliminating the need for a physical keyboard while maintaining typing functionality. This substitution enables users to type accurately without being constrained by keyboard proximity, thereby improving user mobility while preserving typing precision.
2Ease of operation
If VR headset is worn for immersive experience, then virtual environment interaction is improved, but physical keyboard visibility is reduced
Solution Approach 1:
The patent replaces visual dependence on a physical keyboard with sensor-based finger tap detection. Since the system detects taps through sensors rather than visual feedback from a keyboard, users can wear VR headsets for immersive experience without losing access to typing functionality. The sensors continue to detect finger taps on any surface even when the physical keyboard is not visible, thus maintaining both virtual environment interaction quality and typing capability.
3Adaptability or versatility
If finger tapping on any surface is allowed, then user mobility and comfort are improved, but input ambiguity increases
Solution Approach 1:
The patent uses sensors to detect finger taps and provides feedback through displayed candidate words. When a user taps a finger, the system detects the tap, identifies the corresponding letter based on the tapped finger's position, and displays candidate words that match the input sequence. This feedback mechanism resolves input ambiguity by showing users which words match their taps, allowing them to select the correct word even when typing on any surface rather than a standardized keyboard layout.
4Ease of manufacture
If QWERTY layout is used for familiarity, then learnability is improved, but device complexity increases due to finger position tracking
Solution Approach 1:
The patent replaces complex finger position tracking systems with simpler sensor-based tap detection. Instead of tracking the precise position of each finger on a virtual or physical keyboard, the system uses sensors to detect which finger is tapped and maps it to the corresponding QWERTY key. This substitution maintains the familiar QWERTY layout for learnability while significantly reducing device complexity by eliminating the need for sophisticated position tracking infrastructure.
Data Source
AI summary
A text entry apparatus, storage medium and method where users type by tapping their fingers in place, called TapGazer, is presented. Users can tap anywhere as long as the identity of each tapping finger can be detected with sensors. The ambiguity between different possible input words is resolved by selecting target words with gaze. If gaze tracking is unavailable, ambiguity is resolved by selecting target words with additional taps.