Touch Screen Finger Tracing Device Gesture Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current touch devices do not adequately leverage touch technology for detecting and tracking finger and other gestures, limiting their application in various fields such as computer-aided design, education, and electronic music instruments.
Innovation Solution
A portable electronic device with a touch display, processing system, and memory that senses contact, generates sounds, and tracks user input by displaying trace indicator line segments and determining the direction of user gestures, allowing for the detection and confirmation of correct tracing of symbols and gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If touch devices use basic contact sensing, then device complexity is low, but gesture detection precision and tracking accuracy are insufficient
Solution Approach 1:
The symbol is divided into multiple trace indicator line segments, each with direction indicators and termination indicators. The system segments the gesture recognition into discrete traceable paths, allowing precise measurement of user input while maintaining manageable system complexity through modular processing of each segment.
Solution Approach 2:
The system displays trace indicator line segments with direction indicators and termination indicators before user interaction. This preliminary visualization guides the user's tracing action and enables the system to pre-establish the expected gesture path, improving detection precision without requiring complex real-time analysis.
2Loss of information
If the system provides detailed trace feedback, then user interaction accuracy improves, but information processing load increases
Solution Approach 1:
The system provides visual feedback by highlighting the current trace indicator line segment and displaying direction indicators. This feedback mechanism guides users through the tracing process and confirms accurate gesture execution without requiring complex processing, as the feedback follows a predetermined sequence based on the segmented trace indicators.
Solution Approach 2:
The system processes trace indicators in a periodic sequence, moving from one line segment to the next in predetermined order. This structured periodic processing reduces information processing load by breaking down continuous gesture recognition into discrete, manageable steps with clear start and end points.
3Reliability
If the system uses multiple iterations of symbols with trace indicators, then gesture training effectiveness improves, but display complexity increases
Solution Approach 1:
The system dynamically updates the display to show different iterations of symbols with trace indicators. The first iteration displays without trace indicators, the second iteration displays with trace indicators including direction and termination indicators, and subsequent iterations adapt based on user performance. This dynamic adaptation improves gesture recognition reliability while managing interface complexity through progressive disclosure.
Solution Approach 2:
The system prepares multiple iterations of symbols with embedded trace indicators in advance. These pre-configured iterations include all necessary directional and termination information, allowing the system to switch between different training levels without generating complex interface elements during runtime, thus improving reliability without excessive complexity.
Data Source
AI summary
A portable electronic device includes a touch display configured to sense contact with a finger or stylus, a speaker, and a processing system that communicates with the touch display and the speaker. The device is configured to display a symbol using a set of trace indicator line segments comprising a trace direction indicator and a trace termination indicator and to highlight a region of a first of the trace indicator line segments. The device is configured to detect user touch input at multiple locations on the touch display and determine whether the first trace indicator line segment has been traced from the highlighted region to the termination indicator in a direction corresponding to the trace direction indicator, and in response, to draw and maintain a color line corresponding to the detected user touch input at the multiple locations.