Dual Gesture and Virtual Key Recognition on Touch Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch screen input methods, including virtual keyboards and gestures, are inefficient as they require constant user attention and do not support continuous or multiple input operations, leading to decreased speed and increased errors.
Innovation Solution
A recognition system that processes dual inputs of gestures and virtual keys on a touch screen using a combination of OS processing and AI recognition, where touch data is directly processed by the OS for simple inputs and by an AI module for complex inputs, improving accuracy and speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual keyboard is used on touch screen, then typing can be performed, but the user must keep eyes on the keyboard which decreases input speed and increases errors
Solution Approach 1:
The system uses AI recognition to automatically identify and interpret touch inputs without requiring user visual confirmation. The AI module autonomously processes touch data frames, recognizes gesture patterns, and determines input intent, allowing users to type without looking at the keyboard while maintaining high accuracy and speed.
2Adaptability or versatility
If traditional gesture recognition is used, then basic operations can be performed, but continuous and multiple input operations cannot be processed simultaneously
Solution Approach 1:
The system continuously processes touch data frames in real-time using AI recognition, enabling multiple input operations to be processed simultaneously and continuously. The AI module maintains constant analysis of touch patterns, allowing seamless handling of complex, multi-step gestures and continuous input sequences without interruption or degradation in performance.
3Measurement precision
If AI recognition module is added to process complex inputs, then recognition accuracy improves, but system complexity increases
Solution Approach 1:
The AI recognition module serves as an intermediary layer between the touch screen hardware and the operating system. It receives touch data frames from the touch IC, performs intelligent recognition and interpretation, then outputs standardized commands to the OS. This intermediary approach enables complex input processing while maintaining a clean separation of concerns and manageable system architecture.
Data Source
AI summary
A recognition system for recognizing dual inputs of gestures and virtual keys on a touch screen includes a touch IC connected to the touch screen for receiving a plurality of touch signals generated by the touch screen and converting the touch signals to a touch data frame. A processor set is connected to the touch IC. The processor set serves to perform a touch data processing on the touch data frame from the touch IC. The touch data processing is performed by using a processing directly executed by an OS (Operating System) and a processing of AI (artificial intelligence) recognizing. The processor set serves to perform a grammar correction on a recognition result of the AI recognizing. A result of the grammar correction is output to the OS for processing.