Adaptive Text Entry via Hand Posture and Motion Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Touch screen devices lack tactile feedback, making accurate input challenging, especially when users are in motion or using non-dominant hands, due to situational impairments and the complexity of hand postures.
Innovation Solution
The ContextType system infers hand postures using built-in sensors and vibration motors to adjust touch patterns and language models, while WalkType uses accelerometer data to improve text entry accuracy during walking by compensating for extraneous movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If touch screen devices are used without tactile feedback, then device simplicity and visual interface are improved, but input accuracy deteriorates
Solution Approach 1:
The patent introduces an intermediary system that uses accelerometer data to detect hand posture and movement, then uses this information to adjust keyboard layout and predict user intent. This intermediary layer bridges the gap between the simple touch screen interface and the need for accurate input by adding computational intelligence rather than physical complexity.
2Adaptability or versatility
If users operate devices in motion or with non-dominant hands, then device versatility and ease of operation are improved, but input accuracy deteriorates due to situational impairments
Solution Approach 1:
The patent implements dynamic adaptation of the keyboard interface based on real-time detection of hand posture and movement patterns. The system continuously adjusts key positions, sizes, and layouts according to the detected situation, making the interface adaptive rather than static. This allows the same simple interface to optimize for different usage scenarios without adding physical complexity.
3Ease of operation
If hand posture varies (one hand vs two hands, different fingers), then ease of operation is improved, but input accuracy deteriorates
Solution Approach 1:
The patent applies local quality by detecting specific hand posture characteristics (which hand, which fingers, grip type) and applying targeted adjustments to the keyboard layout relevant to that posture. Rather than a global change, the system locally optimizes key positions and sizes based on the detected finger and hand configuration, providing precision tailored to each usage scenario.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances text entry accuracy by adapting to user hand postures and movement, reducing errors caused by situational impairments and improving input precision with both thumbs, thumbs, and index fingers, and during walking.
Implementation Method 1
vibration motors to adjust touch patterns
Implementation Method 2
WalkType uses accelerometer data to improve text entry accuracy during walking by compensating for extraneous movement
Data Source
AI summary
A system for classifying a user touch event by a user interacting with a device as an intended key is provided. For different hand postures (e.g., holding device with right hand and entering text with right thumb), the system provides a touch pattern model indicating how the user interacts using that hand posture. The system receives an indication of a user touch event and identifies the hand posture of the user. The system then determines the intended key based on the user touch event and a touch pattern model for the identified hand posture. A system is also provided for determining the amount a presser a user is applying to the device based on dampening of vibrations as measured by an inertial sensor. A system is provided that uses motion of the device as measured by an inertial sensor to improve the accuracy of text entry.