Adaptive Virtual Keyboard Sizing for Accurate Hand Gesture Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual input systems in VR, AR, and MR environments suffer from low gesture recognition accuracy due to fingers blocking each other when the distance between virtual input elements is fixed and not adjusted to the user's hand size, leading to inaccurate finger location recognition.
Innovation Solution
Adjust the distance between virtual input elements based on the user's hand size to reduce finger blocking, using a head-mounted device with a depth detector to dynamically adjust the virtual keyboard or input element dimensions, and provide feedback through vibration or sound for successful input recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the distance between virtual input elements is fixed, then the device structure is simple, but the gesture recognition accuracy is low due to finger blocking
Solution Approach 1:
The patent applies the dynamics principle by making the virtual keyboard size adjustable based on detected hand size. The system transitions from a fixed virtual keyboard to a dynamic one that adapts its dimensions in real-time according to the user's hand characteristics, thereby improving gesture recognition accuracy while maintaining operational simplicity through automatic adaptation.
Solution Approach 2:
The patent implements parameter changes by modifying the virtual keyboard's dimensional parameters based on hand size detection. The system detects hand size parameters and adjusts the virtual keyboard size accordingly, changing the spatial parameters of the input interface to optimize gesture recognition and reduce finger blocking issues.
2Productivity
If the virtual keyboard dimension is small, then the input efficiency is high, but the finger blocking probability increases
Solution Approach 1:
The system dynamically adjusts the virtual keyboard size based on real-time hand size detection. When the hand is detected to be small, the virtual keyboard is scaled down to maintain input efficiency; when the hand is large, the virtual keyboard is expanded to reduce finger blocking, thereby balancing productivity and recognition accuracy adaptively.
Solution Approach 2:
The system employs feedback by continuously detecting hand size and using this information to adjust the virtual keyboard dimensions. This closed-loop control ensures that the virtual keyboard size always matches the user's hand characteristics, optimizing both input efficiency and gesture recognition accuracy through real-time adaptation.
3Measurement precision
If the virtual keyboard dimension is large, then the finger blocking probability is reduced, but the input efficiency decreases
Solution Approach 1:
The virtual keyboard size is dynamically adjusted to match the user's hand size. For users with larger hands, the virtual keyboard is expanded to reduce finger blocking and improve recognition accuracy; for users with smaller hands, the keyboard is compacted to maintain input efficiency, achieving optimal performance for each individual user.
Solution Approach 2:
The system changes the virtual keyboard's dimensional parameters based on detected hand size parameters. By establishing a correspondence between hand size and keyboard size, the system optimizes the spatial parameters of the input interface to simultaneously improve gesture recognition accuracy and maintain input efficiency for different users.
Data Source
AI summary
This application disclose a method and an electronic device. One example method includes: When a hand is located in a detection range of a depth detector, and the hand approaches a physical surface or when the hand is placed on the physical surface, a head mounted display device displays a virtual hand and a virtual keyboard in virtual space. The head mounted display device displays typed information in an interface of the virtual space in response to a typing operation of the finger of the hand. A size of the hand is positively correlated with a dimension of the virtual keyboard. When the hand is of a first size, the dimension of the virtual keyboard is a first dimension. When the hand is of a second size, the dimension of the virtual keyboard is a second dimension, where the first size is greater than the second size.