Touch Screen Gesture Recognition for Non-Literate Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Young children who are pre-literate or learning to read and write face challenges interacting with text-based menus and symbols in conventional computer systems, as these systems do not provide adequate support for non-literate users, making it difficult for them to perform tasks like searching and data processing.
Innovation Solution
A computerized system with a touch screen that detects and distinguishes between different gestures, providing both visual and auditory feedback to enable non-literate users to interact with the system by associating touch screen locations with specific actions, allowing them to perform tasks through intuitive gestures and oral descriptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If text-based menus and symbols are used in conventional computer systems, then information density and precision are improved, but accessibility for non-literate users deteriorates
Solution Approach 1:
The patent introduces audio output as an intermediary between the visual interface and non-literate users. The system converts text-based menu information into spoken audio cues that guide users through operations, enabling accessibility without sacrificing information density in the visual display.
Solution Approach 2:
The system changes the parameter of information presentation by adding audio modality to the existing visual interface. This multi-sensory approach allows the same information to be conveyed through different channels, making it accessible to non-literate users while maintaining the efficiency of text-based displays.
2Loss of information
If conventional mouse-operated systems with tooltips are used, then user guidance is improved, but applicability to touch-screen systems deteriorates
Solution Approach 1:
The patent replaces the mechanical mouse-hover interaction with touch-screen compatible audio feedback. Instead of requiring mouse movement and hover states, the system uses touch gestures combined with audio cues to provide user guidance, making the interface adaptable to touch-screen devices.
Solution Approach 2:
The system implements dynamic audio feedback that responds to user touch gestures. Audio cues are triggered and modified based on the timing and sequence of touches, creating a dynamic guidance system that adapts to user interaction patterns rather than relying on static tooltip displays.
3Ease of operation
If touch-screen gestures are simplified for ease of use, then ease of operation is improved, but gesture distinction capability deteriorates
Solution Approach 1:
The system uses audio feedback to clarify the meaning of simple touch gestures. By providing immediate auditory confirmation and guidance when users perform gestures, the system maintains gesture simplicity while ensuring users understand the distinction between different gesture types and their intended functions.
Data Source
AI summary
Computerized system operative to perform selectable system-actions responsive to user input, the system being accessible to non-literate users via a touch screen defining touch screen locations respectively corresponding to the selectable system-actions, the touch screen being operative to detect and distinguish between first and second gestures, the system comprising a processor-controlled touch-triggered actor which, responsive to at least each first gesture applied by end-user to an individual location within the touch screen, from among plural touch screen locations, performs individual action/s which corresponds to the individual location; and a processor-controlled touch-triggered oral presenter which, responsive to at least each second gesture applied by end-user to an individual location within the touch screen, from among the plural touch screen locations, presents an oral characterization of individual action/s which corresponds to said individual location.