Vocal organ visible speech synthesis system

Abstract

The invention provides a vocal organ visible speech synthesis system which comprises a voice frequency analysis module, a parameter mapping module, an animation drive module and a motion analysis module; wherein, the voice frequency analysis module is used for receiving the input speech signal of a speaker, judging a mute section according to energy information, coding non-mute section of speech and outputting a speech line spectrum pair parameter; the parameter mapping module is used for receiving the speech line spectrum pair parameter transmitted in real time from the voice frequency analysis module, converting the speech line spectrum pair parameter into a model motion parameter by using the trained Gaussian mixture model; the animation drive module is used for receiving the model motion parameter generated in real time by the parameter mapping module, driving the motion of key points of a virtual vocal organ model so as to drive the motion of the whole virtual vocal organ model. According to the vocal organ visible speech synthesis system, the motion of the model is driven by the corresponding motion parameter generated directly by a frequency domain parameter of the input speech, and therefore, the vocal organ visible speech synthesis system has the advantage of being free from limitations of an online database and a physiological model.

Description

technical field [0001] The invention relates to the technical field of simulated reality in the information technology industry, in particular to a visual speech synthesis system for articulation organs. Background technique [0002] Visual speech synthesis technology is an important part of human-computer interaction technology, and it is also a technology that people have been paying attention to. The visualization of pronunciation organs is an important part of visual speech synthesis technology. It can process and analyze a person's voice to generate Corresponding motion parameters of the human articulation organ during pronunciation, and drive the motion of the graphics model. Its research results are of great significance to the fields of human-computer speech interaction, speech teaching, and treatment of articulatory disorders. [0003] Among the existing voice-driven articulation organ movement technologies, one is based on a large number of voices and correspondin...

AI Technical Summary

Problems solved by technology

[0003] Among the existing voice-driven articulation organ movement technologies, one is based on a large number of voices and corresponding motion databases, according to the input voice, with the help of data retrieval and matching technology to find the most suitable motion to drive the computer model or mechanical model motion , the synthesis effect produced by this kind of method is realistic, but there are many organs involved in the pronunciation process, it is difficult to use a unified method to describe the mapping relationship between the movement of different organs and speech; the other is to establish a biophysical model of the pronunciation organ, and analyze the Physiological changes over time, driving model movement, such methods are usually computationally complex and do not have good real-time performance

Images