Virtual Keyboard Repositioning for Trackpad Typing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In Virtual Reality (VR) systems, typing on a virtual keyboard using a trackpad-based controller is inefficient due to the limited range of motion of the user's thumb, requiring repeated scrolling to reach distant keys.
Innovation Solution
The virtual keyboard is dynamically repositioned as the user moves their thumb on the trackpad, allowing the keyboard to move in the opposite direction of the thumb movement, enabling easier access to all keys within the trackpad's range of motion, and mapping thumb positions to keyboard positions for intuitive typing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the virtual keyboard is displayed at a fixed position, then the keyboard layout is stable and predictable, but the user cannot reach distant keys within the limited thumb range of motion on the trackpad
Solution Approach 1:
The virtual keyboard dynamically repositions itself in response to thumb movement on the trackpad. When the user moves their thumb toward a target key, the keyboard automatically shifts position to bring that key within reachable range, transforming the static keyboard into an adaptive interface that conforms to the user's movement intentions.
Solution Approach 2:
The solution adds a temporal dimension to keyboard positioning. Instead of solving the reachability problem within a single static frame, the keyboard evolves over time by repositioning itself based on continuous thumb movement, effectively using time as an additional dimension to overcome spatial limitations.
2Ease of operation
If the keyboard is large enough to include all keys, then all characters can be accessed, but the user cannot reach distant keys with limited thumb motion on the small trackpad
Solution Approach 1:
The keyboard anticipates the user's intended movement by detecting thumb direction and proactively repositioning keys before the user would otherwise need to scroll repeatedly. This preliminary action of moving keys into reachability range eliminates the time-wasting back-and-forth scrolling that would occur with a static keyboard.
Solution Approach 2:
The system continuously monitors thumb position and movement direction on the trackpad, using this feedback to dynamically adjust keyboard positioning. This closed-loop feedback mechanism ensures the keyboard responds in real-time to user intentions, optimizing access efficiency throughout the typing process.
3Productivity
If repeated scrolling is used to reach distant keys, then all keys can be accessed, but typing efficiency decreases due to the need for repeated scrolling motions
Solution Approach 1:
Instead of moving the thumb across a fixed keyboard (traditional approach), the system inverts the interaction by moving the keyboard beneath the thumb. This inversion transforms the user's simple directional thumb movement into an efficient key-access mechanism, where the keyboard adapts to the user's natural motion rather than requiring the user to adapt to the keyboard's fixed layout.
Data Source
AI summary
In one embodiment, a method includes displaying a virtual keyboard at a first position within a virtual scene that is visible to a user through a display, detecting that the user touches a first point on a trackpad of a controller that is associated with the display, re-positioning, in response to the detection, the virtual keyboard from the first position to a second position, where the second position is determined based on the first point on the trackpad, and displaying, in response to the detection, a pointing indicator, where the pointing indicator is displayed on top of the virtual keyboard, and where the pointing indicator represents that an area of the virtual keyboard indicated by the pointing indicator is being pointed by the user.