Mobile Speech Therapy Game with Offline Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for improved systems and methods for speech therapy, particularly for adults with developmental disabilities and speech impairments, as existing solutions often require a facilitator for evaluation and lack effective mobile speech recognition capabilities.
Innovation Solution
A mobile serious game called SpokeIt that utilizes an offline critical speech recognition system capable of providing real-time feedback, allowing users to practice speech articulation anywhere without the need for a facilitator. The system includes a machine learning module for enhanced error detection and customization options for acoustic models and dictionaries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If mobile speech therapy apps are used, then accessibility and convenience are improved, but they require a facilitator for evaluation which reduces independence
Solution Approach 1:
The system enables self-service by implementing automated speech evaluation using speech recognition technology. The mobile device automatically evaluates speech samples without requiring a facilitator, allowing users to independently track their progress and receive feedback, thus resolving the contradiction between accessibility and independence.
Solution Approach 2:
The patent replaces the mechanical system of human facilitator evaluation with an automated speech recognition system. This substitution eliminates the need for manual evaluation while maintaining assessment accuracy, enabling users to practice independently on mobile devices without facilitator involvement.
2Adaptability or versatility
If non-professional facilitators are trained to deliver speech therapy, then access to therapy is improved, but therapy effectiveness decreases due to lack of expertise
Solution Approach 1:
The system replaces the human facilitator's evaluation role with automated speech recognition technology. This substitution ensures consistent, accurate evaluation regardless of the facilitator's expertise level, maintaining therapy effectiveness while improving accessibility through mobile delivery.
Solution Approach 2:
The system implements automated feedback mechanisms that provide immediate, accurate evaluation of speech samples. This feedback loop ensures therapy effectiveness by providing consistent, expert-level evaluation without requiring trained facilitators, thus resolving the contradiction between accessibility and reliability.
3Ease of operation
If speech therapy is delivered outside the office, then accessibility is improved, but quality control becomes difficult
Solution Approach 1:
The patent replaces manual quality control mechanisms with automated speech recognition and evaluation systems. This substitution ensures precise, consistent measurement of speech progress regardless of location, maintaining quality control while enabling therapy delivery anywhere with a mobile device.
Data Source
AI summary
A computer-implemented method can include: an audio input device of a portable electronic device receiving verbal speech input from a user and converting the received verbal speech input into an audio input signal; an online processing module of the portable electronic device performing at least one speech recognition operation on the audio input signal; an offline processing module of the portable electronic device performing at least one speech recognition operation on the audio input signal; an interactive game module of the portable electronic device generating user feedback based on results from the at least one speech recognition operation performed by the online processing module and the at least one speech recognition operation by the offline processing module; and a user interface of the portable electronic device providing the user feedback to the user.