Gesture-Controlled Virtual Keyboard Cursor for Precise Key Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing key function execution methods on electronic devices lack granularity and accuracy in key triggering, particularly in virtual keyboards, leading to inefficient and complex operational processes.
Innovation Solution
A method and system that utilizes a virtual keyboard divided into left and right hand regions, with a cursor positioned based on biometric features and hand gestures, allowing movement of the cursor by maintaining a target gesture, enabling precise key selection and execution without direct screen touch.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a virtual keyboard is displayed and user touch operation is detected on the screen, then key function execution is achieved, but key triggering granularity and accuracy are insufficient
Solution Approach 1:
The patent replaces the traditional mechanical touch screen interaction with gesture-based control. Instead of requiring users to physically touch the screen, the system uses gesture recognition (hand movements, finger positions) to control cursor movement and key selection. This substitution enables more precise key triggering through nuanced gesture inputs while maintaining ease of operation by eliminating the need for direct screen contact.
Solution Approach 2:
The patent introduces a new dimension of interaction by mapping three-dimensional hand gestures to two-dimensional keyboard operations. The gesture tracking sensor captures spatial information from multiple dimensions (hand position, orientation, finger configuration) and translates this into precise cursor control and key selection, thereby enhancing triggering accuracy beyond what traditional two-dimensional touch can achieve.
2Measurement precision
If traditional touch operation is used on virtual keyboard, then simple implementation is maintained, but key triggering granularity is insufficient
Solution Approach 1:
The patent introduces a gesture tracking sensor as an intermediary between the user and the virtual keyboard. This intermediary device captures detailed gesture information and translates it into cursor movement and key selection commands. By using this intermediary, the system achieves finer granularity in key triggering through precise gesture recognition while managing system complexity through modular architecture.
Solution Approach 2:
The patent segments the interaction process into distinct phases: gesture recognition, cursor movement control, and key selection. The virtual keyboard is also segmented into left and right hand regions, with each region further divided into multiple keys. This segmentation allows for more granular control and precise key triggering by mapping specific gestures to specific regions and keys, while maintaining manageable system complexity through structured organization.
3Productivity
If direct screen touch is required for key selection, then implementation simplicity is maintained, but operational efficiency is reduced
Solution Approach 1:
The patent substitutes direct mechanical touch with gesture-based control, allowing users to interact with the virtual keyboard through hand movements in the air. This substitution significantly improves input efficiency by enabling faster, more intuitive key selection without the need for precise finger taps, while maintaining operation convenience through natural gesture inputs that require no physical contact with the screen.
Solution Approach 2:
The patent introduces dynamic cursor movement that responds to continuous hand gestures. Instead of static touch points, the cursor dynamically follows the user's hand movement, allowing for smoother and more efficient selection. The system adapts to the user's gestural rhythm and speed, creating a dynamic interaction loop that enhances both productivity and operational convenience by eliminating the disconnect between input action and cursor response inherent in traditional touch interfaces.
Data Source
AI summary
A key function execution method includes: displaying a virtual keyboard; displaying, in response to detecting that a hand is in a target gesture, a cursor at a first position according to a biometric feature of the target gesture; displaying, in response to the hand making a movement while keeping the target gesture, that the cursor moves with the movement of the hand; and executing, in response to a change in a gesture of the hand, a function of a key corresponding to a second position of the virtual keyboard, the second position being a position where the cursor is located when the gesture of the hand changes.