An automatic generation system for character Chinese lip animation

Abstract

The invention discloses a system for automatically generating animations of characters' Chinese mouth shapes. The dialogue text filtering and coding module performs phrase segmentation, pinyin mouth shape coding, overall recognition and reading mark setting and coding filtering on the dialogue text, generates and outputs dialogue mouth shape codes, and dialogue overall Recognition and reading code identification and dialogue mouth shape filter coding sequence; dialogue speech segmentation module conducts speech sampling and speech energy statistics on dialogue audio, generates and outputs dialogue speech segmentation candidate result sequence; dialogue segmentation coding integration module connects dialogue text filter coding The module and the dialogue voice segmentation module integrate and correct the dialogue voice segmentation candidate result sequence, generate and output the dialogue segmentation code sequence; the character Chinese mouth animation generation module is connected with the dialogue segmentation coding integration module, The sequence generates and outputs the character's Chinese lip animation. In the processing process of the invention, the production of the Chinese mouth animation of the whole character can be automatically completed without loading the corresponding voice library.

Description

technical field [0001] The invention belongs to the field of computers and relates to natural language processing, speech segmentation, computer character mouth animation and other application technologies, and specifically aims at the production of 3D character Chinese mouth animation, and proposes an automatic generation system for character Chinese mouth animation. Background technique [0002] Making realistic and accurate 3D lip animation is a research hotspot in the field of computer vision and computer animation. In the production of 3D character animation, lip animation has always been a relatively time-consuming task in the production process, requiring animators to match the lip shape with the dialogue bit by bit. [0003] At present, foreign lip animation systems such as Poser lip Mimic, 3ds max lip plug-in Voice-O-Matic, etc., are mainly designed for English, and do not support Chinese or the support effect is relatively poor; while some domestic lip animation sy...

AI Technical Summary

Problems solved by technology

In the existing system, these two modules are only loosely coupled (speech segmentation is performed on the audio separately, and then the result of the segmentation is used to guide and set the key frame position of the animation mouth shape), and there are almost few differences between the two parts. Interaction, so it is difficult to automatically complete the adjustment of the pronunciation position and the arrangement of the animated mouth shape according to the character's dialogue voice intensity and length characteristics

Images