Computer assisted training method for mouth shape recognition capability

A computer-aided and recognition technology, applied in computing, electrical operation teaching aids, special data processing applications, etc., can solve problems such as the training of students' lip recognition ability, and the large workload of teachers and parents.

Inactive Publication Date: 2008-08-13
黄中伟 +3
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the deaf-mute have to go through many observations to remember the correspondence between the mouth shape and the semantics, the traditional method brings a lot of workload to the teachers and parents, so that many teachers and parents give up because of lack of patience. Lip recognition training for students

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Computer assisted training method for mouth shape recognition capability
  • Computer assisted training method for mouth shape recognition capability
  • Computer assisted training method for mouth shape recognition capability

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] Embodiment 1: Chinese " sleep " two word optional method trainings, open computer, start the computer aided training software learning system of mouth pattern recognition ability, select Chinese, as figure 2 As shown, enter the main interface of the Chinese system, and the user clicks to select "Optional Method", such as image 3 As shown, enter the self-selection method selection interface, the user clicks to select "two characters", as shown Figure 4 As shown, enter the self-selection method mouth shape recognition training (two characters) selection interface, the user clicks to select "sleep", and then selects "click to watch the pronunciation mouth shape", and then the pronunciation mouth shape of the word sleep can be seen. Select "On", and you can hear the sound of the word "sleep" at the same time. Press the button "Click to watch the mouth shape of the pronunciation" to observe the mouth shape of the pronunciation repeatedly. After learning, click the exit bu...

Embodiment 2

[0029] Embodiment 2: the optional training method that English 3 words form sentence, open computer, start the computer aided training software learning system of mouth pattern recognition ability, select English, as Figure 5 As shown, enter the main interface of the English system, and the user clicks to select "Optional method", as shown in Figure 6 As shown, enter the Optional method selection interface, the user clicks to select "words", such as Figure 7 As shown, enter the Sentence training selection interface, the user clicks to select "3words", such as Figure 8 As shown, enter the Optional method (3words) selection interface, the user clicks to select "how are you", and then selects "Click to see lipshape" to see the pronunciation of how are you. If the accompanying sound is selected as "open" , you can hear the voice of "how are you" at the same time, press the "Click to see lipshape" button to repeatedly observe the mouth shape of the pronunciation, after learnin...

Embodiment 3

[0030] Embodiment 3, Chinese " watch TV " three word random method training, open computer, start the computer aided training software learning system of mouth pattern recognition ability, select Chinese, as figure 2 As shown, enter the main interface of the Chinese system, the user clicks to select "random method", as shown in Figure 9 As shown, enter the random method selection interface, the user clicks to select "three words", as shown Figure 10 As shown, enter the random method mouth shape recognition training (three characters) selection interface, after the user clicks to select "click to watch the pronunciation mouth shape", the pronunciation mouth shape of the word "watching TV" can be seen, and then according to the mouth shape video image Select the word corresponding to the mouth shape in the word column, and the computer interface will show the display for the user to choose whether it is correct or not. If the audio switch is selected as "on", the sound of "wa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a computer aided training method for mouth-shape recognition ability which solves the technique problem of increasing training efficiency, saving time of teacher and parents. The method includes steps as follows: the user can select self-selection method or random method, when self-selection method is selected, the user watches pronouncing mouth-shape video and simulates pronouncing mouth-shape action and pronunciation; when random method is selected, computer plays pronouncing mouth-shape video, and interface displays letter, the user judges and computer gives correct answer. By comparison with present technique, the method can make computer replacing teacher or parents for training mouth-shape recognition ability by using computer multimedia function, so the method can save time of teacher or parents and has active action for increasing viability of deaf and dumb people and other hearing impaired people. The method is especially suitable for training mouth-shape recognition ability of hearing impaired people, such as deaf and dumb people, half-deafness people.

Description

technical field [0001] The invention relates to a method for using a computer to train the mouth-shaped recognition ability, in particular to a method for using the computer to train the mouth-shaped recognition ability of the hearing and speech-impaired. Background technique [0002] When you can't hear or can't hear the voice of the speaker clearly, you can analyze and judge the meaning expressed by the speaker by observing the change of the speaker's mouth shape. This ability of analysis and judgment is the ability of mouth shape recognition. Lip recognition ability is a kind of ability acquired after training, which has its special role in the fields of forensics, intelligence, special education and so on. Especially for the deaf and other hearing-impaired people, having a strong mouth shape recognition ability can make up for the inconvenience caused by hearing impairment, and partially or fully understand the semantics of the speaker, thus laying the foundation for com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G09B21/06G09B5/04G06F17/00
Inventor 黄中伟周延蕾冯杉杉刘明辉
Owner 黄中伟
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap