XR Keyboard Perimeter Keys with Slicing Gesture Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data entry in extended reality (XR) experiences is cumbersome, often requiring users to remove their headsets for traditional keyboards or use error-prone projection keyboards, which are difficult to calibrate and noisy.
Innovation Solution
A slice keyboard system that detects slicing movements of a user's hands to select keys on a virtual keyboard displayed along the perimeter, using hand controllers or cameras to track hand gestures for seamless key selection without vocalization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional keyboards are used for data entry in XR experiences, then users can input data accurately, but users must remove their headsets which breaks the immersive experience
Solution Approach 1:
The patent replaces physical keyboard mechanisms with a virtual projection keyboard displayed through the XR headset. Users interact with the virtual keyboard using hand gestures detected by cameras or sensors, eliminating the need to remove the headset while maintaining data entry capability. The projection keyboard is rendered in the user's field of view, allowing interaction without breaking immersion.
2Ease of operation
If projection keyboards are used for data entry in XR experiences, then users can keep wearing headsets, but the system becomes noisy and difficult to calibrate
Solution Approach 1:
The system performs self-calibration by automatically detecting the user's hand position and the projection keyboard's position in the field of view. The calibration process occurs automatically without requiring manual adjustment or complex setup procedures. The system adapts to the user's environment and adjusts parameters autonomously, reducing both noise and complexity.
3Ease of operation
If projection keyboards are used for data entry in XR experiences, then users can keep wearing headsets, but the system generates noise during operation
Solution Approach 1:
The patent replaces mechanical keyboard components (projectors, physical keys, actuators) with a virtual display rendered on the headset's own display elements. Hand gesture recognition uses optical sensors or cameras rather than mechanical detection systems. This substitution eliminates the noise generated by mechanical projection and physical interaction mechanisms while maintaining the virtual keyboard functionality.
Data Source
AI summary
In an example implementation according to aspects of the present disclosure, a XR system comprises an HMD which includes an HMD display, a user input device, and a processor operatively coupled with a computer readable storage medium and instructions stored on the computer readable storage medium that, when executed by the processor, direct the processor to display, by the HMD display, an XR keyboard to a user of the HMD, wherein the XR keyboard comprises keys lined along the perimeter of the XR keyboard; display, by the HMD display, at least one projection line indicating a selection direction by the user; capture, by the user input device, a movement of the at least one projection line across a key on the perimeter of the XR keyboard displayed on the HMD display; and identify a key selected based on the captured movement across the key.