Electronic teaching method for deaf people to learn speaking

Abstract

The invention belongs to learning appliance technology field, and relates to an electronic teaching method for deaf people to learn speaking, including: audio-video data and time synchronization information thereof during the period of learners' pronunciation practicing, are obtained through a microphone and a camera; audio feature parameters are extracted; visual features related to shapes of mouth are extracted; the extracted audio feature parameters are compared with corresponding feature parameters pre-stored in a feature parameter template library of standard pronunciation, and are classified so as to determine whether the learners' pronunciation is correct; if the learners' pronunciation is greatly different from that in the feature parameter template library of standard pronunciation, the audio features and the visual features related to shapes of mouth of the learners are compared with that in the feature parameter template library of common wrong pronunciation so as to determine that the errors of the learners belong to which types of the common errors, the comparison between wrong pronunciation manners of the learners and standard pronunciation manners being indicated through images, animations and video content. The method provided in the invention can automatically analyze whether the learners' pronunciation is standard, and correct errors, thereby basically requiring no intervention of teaching staffs in a learning process.

Description

technical field [0001] The invention belongs to the technical field of learning appliances, and in particular relates to an electronic teaching method for deaf people to learn to speak. Background technique [0002] The patent CN2057550 "Frequency Variable Speech Training Hearing Aid for the Deaf" proposes a hearing aid suitable for the deaf to conduct speech auditory training. Filters and amplifiers are used to form hearing aids, so that the deaf can hear the voice clearly without feeling painful, so as to achieve the purpose of speech and hearing training for the deaf. [0003] Patent CN2279662 "a language training machine for deaf people suitable for outdoor activities" proposes a multifunctional language training machine for deaf people suitable for outdoor activities, which is characterized in that a wireless microphone is composed of a microphone and a wireless transmitter for Carried by the teacher, the wireless receiver, post-amplifier, seven-band equalizer, power a...

AI Technical Summary

Problems solved by technology

[0005] The principle of the above technologies is to use analog circuits to make deaf people perceive the vibration of sound, and their common shortcomings are as follows: 1. The teaching device itself does not use visual teaching methods such as pictures and videos, but requires on-site teaching by teaching staff. Demonstration, poor repeatability, and not easy to arouse learners' interest; 2. Learners cannot learn independently through the interactive method of "demonstration-speaker pronunciation-correcting pronunciation"; 3. The learning process is inseparable from teaching staff 4. In a one-to-many teaching environment, teaching staff cannot tutor multiple learners at the same time