Audio and video dual mode-based spoken language learning monitoring method

Abstract

The invention discloses an audio and video dual mode-based spoken language learning monitoring method, which comprises the following steps: (a) establishing a sound information base and an image characteristic information base of all standard pronouncing units; (b) acquiring sound and video information during spoken language learning of a user in real time, performing compression coding and then transmitting to a server end; (c) decoding the sound of the user by the server and then segmenting to obtain sound information matching degree of each pronouncing unit of the user; and (d) extracting the image action characteristic information corresponding to each pronouncing unit from the simultaneously acquired video information by the server and giving the matching degree of the image action characteristic information and the image characteristic informationof thestandard pronouncing unit. According to the audio and video dual mode-based spoken language learning monitoring method provided by the invention, the sound and the image characteristic information are segmented and compared respectively by simultaneously acquiring the sound and video information, so that the defects and the reasons of pronouncing can be quickly and accurately found, the dependence on teacher resources is reduced and the learning efficiency is greatly improved.

Description

technical field [0001] The invention relates to a user online learning monitoring method, in particular to a spoken language learning monitoring method based on audio and video dual modes. Background technique [0002] At present, under the general trend of globalization, oral education is becoming a huge industry in the world. As far as China is concerned, the upsurge of Chinese people learning foreign languages ​​and foreigners learning Chinese is getting higher and higher. On the one hand, foreign languages ​​(especially English) are an indispensable tool in business communication activities, thus promoting the enthusiasm of Chinese incumbents to learn foreign languages. According to incomplete statistics, about 1% of employees in big cities such as Beijing and Shanghai spend more than 10% of their income on foreign language learning. On the other hand, in the upsurge of learning English promoted by globalization, new upsurges have also been achieved, such as "China fev...

AI Technical Summary

Problems solved by technology

In language teaching, teachers, as an effective source of feedback, still have some unsolvable problems: language learning requires repeated training, and it is necessary to effectively use fragmented time to practice anytime and anywhere; however, due to the limited resources of teachers, it is impossible for all Students receive one-on-one instruction anytime

Online oral language learning platforms are more and more popular with ordinary users because of their free time and low cost. For oral language learning platforms, if the number of users does not increase, the number of teachers will inevitably lead to a shortage of individual user resources. In today's society, The cost of labor is getting higher and higher, how to effectively monitor the learning situation of users has become an important issue on the oral learning platform

Images