The invention discloses a voice
mouth shape synchronization system based on mixing of phonemes and facial postures, relates to the field of
computer animation and voice synthesis, realizes an efficient text-to-voice and
mouth shape synchronization technology, and comprises the following steps: firstly, converting a text into voice and generating phoneme information through a TTS (Text To Speech) service, and then, according to the time length of the voice, carrying out voice and
mouth shape synchronization; the time point of each phoneme
peak value is accurately calculated, a designer prepares the mouth shape posture corresponding to each phoneme in advance, the weight of the previous phoneme is gradually reduced between the two phonemes, the weight of the next phoneme is increased, each phoneme corresponds to a curve in the unreal engine posture assets, and the unreal engine posture assets are obtained. The curve value is modified by dynamically adjusting the phoneme weight, so that the final mouth shape
animation is generated, in addition, more vivid facial expressions are realized through the facial
animation blueprint and the mixed emotion value, the scheme is excellent in real-time performance and
network delay, only 20
animation sequence assets are needed, compared with a traditional scheme,
resource consumption is reduced, and the method is suitable for popularization and application. And the efficiency is improved.