AI Touch Input Recognition for Gestures, Handwriting, and Virtual Keys
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch screen input methods, such as virtual keyboards, lack the tactile feedback of physical keyboards, require fixed positions, and are slow due to limited multi-input capabilities, necessitating continuous sequential actions and lacking recognition of gestures and complex inputs like handwriting and mathematical expressions.
Innovation Solution
A recognition system that processes touch data using both operating system and AI to recognize multiple inputs, including gestures, handwriting symbols, and virtual keys, with AI module corrections for improved accuracy and speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual keyboard is used on the touch screen, then the input can be performed without physical contact, but the input speed is slow and the user experience is degraded due to lack of tactile feedback and fixed position
Solution Approach 1:
The system segments the input recognition process into multiple stages: initial touch detection, gesture pattern recognition, handwriting symbol identification, and virtual key recognition. This segmentation allows the system to handle different input types efficiently without requiring a single complex recognition mechanism, thereby improving input speed while managing complexity.
Solution Approach 2:
The recognition system is designed to handle multiple input types (gestures, handwriting symbols, virtual keys) through a single unified system. This multi-functionality eliminates the need for separate recognition mechanisms for each input type, improving overall input speed and user experience while maintaining manageable system complexity.
2Ease of operation
If the virtual keyboard position is fixed, then the layout is simple to implement, but the user convenience is reduced as the keyboard cannot be moved to optimal positions
Solution Approach 1:
The virtual keyboard positioning system transitions from a static fixed position to a dynamic adjustable position. The keyboard can be moved to different locations on the touch screen based on user preferences and operational context, improving user convenience while the system manages the complexity through automated positioning algorithms.
3Measurement precision
If the operating system directly processes touch inputs, then the processing is simple and fast, but the system cannot recognize complex inputs like multiple simultaneous gestures or handwriting symbols
Solution Approach 1:
An intermediary recognition layer is introduced between the touch screen and the operating system. This intermediary system analyzes complex touch patterns, gestures, and handwriting symbols before passing recognized inputs to the OS, thereby improving recognition accuracy for complex inputs while managing system complexity through modular architecture.
4Adaptability or versatility
If multiple input types are supported simultaneously, then the system versatility is improved, but the processing complexity increases and may slow down response time
Solution Approach 1:
The processing of multiple input types is segmented into specialized modules: gesture recognition module, handwriting symbol recognition module, and virtual key recognition module. Each module processes its specific input type independently, allowing the system to support multiple input types simultaneously while maintaining fast processing speeds through parallel operation.
Solution Approach 2:
The system implements partial processing for different input types based on their complexity and urgency. Simple virtual key inputs are processed immediately, while more complex gestures and handwriting symbols undergo more thorough analysis. This selective processing approach maintains versatility while optimizing response time for different input scenarios.
Data Source
AI summary
A recognition system for recognizing multiple inputs of gestures, handwriting symbols and virtual keys on a touch screen includes a touch IC serves to convert a plurality of touch signals of the touch screen to a touch data frame. A processor set is connected to the touch IC and serves to perform a touch data processing on the touch data frame. The touch data processing is performed by using a processing directly executed by an OS (Operating System) and a processing of AI (artificial intelligence) recognizing. An AI recognition module is connected to the processor set. The AI recognition module is used for recognizing multiple key inputs, operation gestures and handwriting symbols. The key inputs and handwriting symbols are corrected by a grammar correction and a symbol correction respectively. The touch screen serves to display a virtual keyboard.