Pronunciation Correction With Personalized Audio and Visual Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearing aids and cochlear implants cannot fully restore auditory perception for hearing-impaired individuals, limiting the effectiveness of pronunciation correction systems, which require excessive effort for minimal improvement.
Innovation Solution
An integrated pronunciation correction system comprising an audiometry module, frequency enhancement module, and speech recognition module that generates personalized hearing impairment data, adjusts word audios, and provides visual feedback on pronunciation errors to enhance learning efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If hearing aids or cochlear implants are used to restore hearing, then auditory perception is improved, but pronunciation correction effectiveness remains limited due to inability to fully restore auditory perception
Solution Approach 1:
The patent introduces a speech recognition module as an intermediary that bridges the gap between auditory input and pronunciation feedback. This module processes auditory information and generates visual feedback representations, enabling hearing-impaired individuals to perceive pronunciation errors without relying solely on auditory perception. The visual feedback serves as a mediator that compensates for the limitations of auditory restoration.
Solution Approach 2:
The patent replaces the reliance on auditory feedback mechanisms with a visual feedback mechanism. Instead of depending on the user to hear and process pronunciation corrections acoustically, the system converts auditory information into visual representations that can be perceived and processed by hearing-impaired individuals, thereby substituting the mechanical auditory pathway with a visual processing pathway.
2Manufacturing precision
If speech therapy is provided to correct pronunciation, then pronunciation accuracy is improved, but cost and time requirements increase significantly
Solution Approach 1:
The patent enables self-service pronunciation correction by providing individuals with autonomous feedback mechanisms. The speech recognition module automatically analyzes pronunciation and generates visual feedback, eliminating the need for continuous therapist intervention. Users can independently practice and receive immediate feedback, transforming the therapy process from a resource-intensive professional service into an accessible self-guided learning system.
Solution Approach 2:
The patent implements a feedback loop where the speech recognition module continuously monitors pronunciation, compares it with target sounds, and provides visual feedback to the user. This immediate feedback mechanism accelerates learning by allowing users to correct errors in real-time without waiting for therapy sessions, thereby reducing the overall time and cost required for pronunciation correction.
3Ease of operation
If continuous speech visualization is used for pronunciation learning, then learning accessibility is improved, but auditory perception limitations prevent effective sound mimicry
Solution Approach 1:
The patent uses visual feedback as an intermediary that translates auditory pronunciation information into visual representations. This allows hearing-impaired individuals to access pronunciation learning materials effectively while the visual feedback serves as a mediator that compensates for their inability to process auditory information fully, enabling them to learn and replicate sounds despite auditory limitations.
Data Source
AI summary
The present invention is a pronunciation correction system for hearing-impaired individuals. It employs an audiometry module to generate hearing impairment data for the hearing-impaired individual. A frequency enhancement module then uses this data to establish a gain model, which is applied to adjust multiple word audios, enabling the hearing-impaired individual to clearly hear the adjusted audios. An assistive learning module plays the adjusted word audios and captures the utterances repeated by the hearing-impaired individual. A speech recognition module performs speech recognition on these utterances, comparing the recognition result with the text labels corresponding to the word audios. The comparison results are sent back to the assistive learning module, which displays visual feedback to display the results. This process assists the hearing-impaired individual in correcting the pronunciation effectively.