Multisensory Tutorial Device for Simultaneous Voice and Touch Input Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies do not simultaneously receive and analyze spoken and written inputs on mobile devices, providing feedback on pronunciation and writing accuracy, which is essential for teaching reading, writing, and spelling, especially for Dyslexics and English language learners.
Innovation Solution
A multisensory analytics module in portable electronic devices allows users to input phonemes and graphemes simultaneously through voice and touch, analyzing the accuracy and providing feedback for correction, using a tutorial module that offers auditory and visual guidance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If spoken and written input are received simultaneously with analysis providing feedback on pronunciation and writing accuracy, then learning effectiveness is improved, but device complexity increases
Solution Approach 1:
The patent combines speech recognition and handwriting recognition functionalities into a single integrated system. The mobile device simultaneously receives and processes both vocal inputs (phonemes, words, sentences) and written inputs (graphemes, words, sentences) through unified analytics that cross-validate pronunciation accuracy and writing accuracy together, rather than treating them as separate functions.
Solution Approach 2:
The mobile device is designed to perform multiple functions simultaneously: it acts as both a speech recognition device and a handwriting recognition device. The analytics module universally processes different input types (spoken phonemes, written graphemes, words, sentences) through a single system that provides comprehensive feedback on both pronunciation and writing accuracy.
2Loss of information
If simultaneous analysis of vocal and tactile input is performed, then learning feedback is improved, but processing time increases
Solution Approach 1:
The system performs continuous simultaneous analysis of both vocal and tactile inputs rather than processing them sequentially. The analytics module continuously cross-validates the spoken input against the written input in real-time, providing uninterrupted feedback on both pronunciation accuracy and writing accuracy without requiring separate processing stages.
Solution Approach 2:
The system performs preliminary cross-validation by comparing spoken phonemes against written graphemes during the input process itself. The analytics module pre-processes both input streams simultaneously to identify mismatches between pronunciation and spelling patterns before final feedback is generated, reducing overall processing time.
Data Source
AI summary
Disclosed is a computer-based multisensory tutorial that collects vocal data and tactile input data from a user related to a target presented by a GUI, the target comprising a phoneme, grapheme, letter, word; determines if the collected data exceeds or fails to meet a threshold value associated with the target; and provides a correction prompt visible or audible to a user if the input does not meet the threshold. A typical user of the tutorial may be a student (child or adult) in an educational setting, but use is not intended to be limited thereto. The multisensory tutorial may be configured for a plurality of languages. A multisensory tutorial configured device comprises one or more tutorial software modules, a GUI lesson screen, and a plurality of integrated lessons based on an Ortin-Gillingham plus program (for example one chosen between lessons 20 and 50), but is not limited thereto.