Adaptive Language Model for Virtual Keyboard Input Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual keyboards lack kinesthetic feedback, leading to lower accuracy in input provision due to the inability to guide users effectively, resulting in potential errors in hand motions and hand poses.
Innovation Solution
Implementing an adaptive language model that determines a user's level of focus and type of content to modify detected inputs, predicting and correcting inputs based on hand motion and pose data, thereby improving input accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual keyboard is used instead of a physical keyboard, then portability and space consumption are improved, but input accuracy deteriorates due to lack of kinesthetic feedback
Solution Approach 1:
The system implements a language model that provides semantic feedback to correct input errors. The language model analyzes the sequence of detected hand motions and poses, identifies likely errors based on contextual understanding of language patterns, and suggests corrections to improve input accuracy while maintaining virtual keyboard portability
Solution Approach 2:
The language model acts as an intermediary between the user's hand motions and the final input output. It processes the raw detected hand motions and poses, applies linguistic rules and contextual understanding, and produces corrected input sequences, thereby compensating for the lack of kinesthetic feedback in the virtual keyboard interface
2Device complexity
If a virtual keyboard is used instead of a physical keyboard, then device complexity is reduced, but input accuracy deteriorates due to inability to guide users
Solution Approach 1:
The patent replaces the mechanical guidance system of a physical keyboard (tactile feedback from key presses) with a computational system. The language model uses algorithms to analyze hand motion sequences, detect errors, and provide corrections, substituting mechanical guidance with intelligent software-based guidance that maintains input accuracy while preserving virtual keyboard simplicity
3Ease of operation
If hand motion detection is used for virtual keyboard input, then portability is improved, but reliability deteriorates due to potential errors in hand motions and poses
Solution Approach 1:
The system performs preliminary analysis of hand motion sequences using the language model before finalizing the input. By anticipating potential errors based on linguistic patterns and contextual understanding, the system can pre-correct likely mistakes, thereby improving input reliability while maintaining the portability benefits of virtual keyboard operation
Data Source
AI summary
Disclosed herein are related to systems and methods for providing inputs through a virtual keyboard with an adaptive language model. In one approach, one or more processors determine whether a user intended to provide semantically meaningful characters or not, when providing a hand motion or a hand pose with respect to a virtual keyboard. The virtual keyboard may be located on a surface without physical keys. In one approach, the one or more processors determine an input to the virtual keyboard based on the hand motion or the hand pose. In one approach, the one or more processors determine weight of a language model according to the determined user intention. In one approach, the one or more processors modify the detected input according to the determined weight of the language model.