Interactive virtual teacher system having intelligent error correction function

Abstract

The invention discloses an interactive virtual teacher system having an intelligent error correction function, which is designed for solving the technical problem that the conventional man-machine interaction teaching is limited to speech synthesis information and spoken language evaluation and cannot satisfy the need for intelligent error collection interaction in learning and communication. Thesystem comprises an audio and video data acquisition module, an information identification module, an error correction evaluation module, a teaching policy module and other modules. An audio sensor and a video sensor acquire the face images and voice signals of learners; the information identifies fused mouth shapes, pronunciation and emotion of the learners; the error collection evaluation module automatically evaluates the pronunciation mouth shapes of the learners and detects the differences between pronunciation mouth shape data and standard data stored in a standard pronunciation mouth shape databases, automatically selects a proper time to show the reasons of incorrect pronunciation and correction means and provides a correct pronunciation mouth shape and animated demonstration; andthe teaching policy module makes a teach-student one-by-one interactive personalized teaching implementation solutions according to evaluation data and emotion states. In the invention, real-time communication and animated demonstration are realized by fusing voice and emotion multi-source information and by intelligent error correction and simulation by video interaction with a virtual teacher. Thus, the accuracy of pronunciation teaching is improved.

Description

Technical field: [0001] The invention relates to a virtual teacher system, in particular to an interactive virtual teacher system with an intelligent error correction function. It is suitable for intelligent visual interactive man-machine dialogue learning platform. Background technique: [0002] Speech error correction is an important link in language learning and communication, and it is also one of the difficulties that need to be solved in the teaching of man-machine dialogue. Ideally, the virtual teacher should be sufficiently intelligent, not only able to discover errors independently, but also to analyze the root of the errors, know how to correct and when to correct, and take into account the emotional factors of the learners, so as to stimulate the learners' enthusiasm. Learning interest and learning confidence, improve teaching efficiency. However, most of the software products currently on the market have a fixed time for error correction. Once a learner’s voice...

AI Technical Summary

Problems solved by technology

[0006] In order to solve the problem that the traditional man-machine dialogue teaching usually only uses pure speech recognition technology, the recognition rate is low, and the anti-noise ability is poor. For the technical problems that cannot meet the needs of learning and communication in the aspect of error correction interaction, an interactive virtual teacher system with intelligent error correction function is provided, which includes audio and video data acquisition module, information identification module, error correction evaluation module, and teaching strategy module and database

Images