Automatic generating system for role Chinese mouth shape cartoon

Abstract

The invention discloses an automatic generating system for a role Chinese mouth shape cartoon, which comprises a dialogue text filtering and coding module, a dialogue phonetic segmentation module, a dialogue segmentation code integrating module and a role Chinese mouth shape cartoon generating module, wherein the dialogue text filtering and coding module performs phrase segmentation, pinyin mouth shape coding, integral recognition mark setting and coding and filtering on a dialogue text to generate and output a dialogue mouth shape code, an integral dialogue recognition coding mark and a dialogue mouth shape filtering and coding sequence; the dialogue phonetic segmentation module performs phonetic sampling and phonetic energy statistics on dialogue audio to generate and output dialogue phonetic segmentation candidate result sequences; the dialogue segmentation code integrating module is connected with the dialogue text filtering and coding module and the dialogue phonetic segmentation module and used for integrating and correcting the dialogue phonetic segmentation candidate result sequences to generate and output a dialogue segmentation code sequence; and the role Chinese mouth shape cartoon generating module is connected with the dialogue segmentation code integrating module and used for generating and outputting the role Chinese mouth shape cartoon according to the dialogue segmentation code sequence. The system can automatically finish the manufacture of the whole role Chinese mouth shape cartoon without loading a corresponding phonetic library during processing.

Description

technical field [0001] The invention belongs to the field of computers and relates to natural language processing, speech segmentation, computer character mouth animation and other application technologies, and specifically aims at the production of 3D character Chinese mouth animation, and proposes an automatic generation system for character Chinese mouth animation. Background technique [0002] Making realistic and accurate 3D lip animation is a research hotspot in the field of computer vision and computer animation. In the production of 3D character animation, lip animation has always been a relatively time-consuming task in the production process, requiring animators to match the lip shape with the dialogue bit by bit. [0003] At present, foreign lip animation systems such as Poser lip Mimic, 3ds max lip plug-in Voice-O-Matic, etc., are mainly designed for English, and do not support Chinese or the support effect is relatively poor; while some domestic lip animation sy...

AI Technical Summary

Problems solved by technology

In the existing system, these two modules are only loosely coupled (speech segmentation is performed on the audio separately, and then the result of the segmentation is used to guide and set the key frame position of the animation mouth shape), and there are almost few differences between the two parts. Interaction, so it is difficult to automatically complete the adjustment of the pronunciation position and the arrangement of the animated mouth shape according to the character's dialogue voice intensity and length characteristics

Images