Dual-viseme mouth shape synthesis method

Abstract

The embodiment of the invention discloses a dual-viseme mouth shape synthesis method. The method is used for solving the technical problem of lower fidelity of a pronunciation mouth shape of a reproduction part of an existing mouth shape synthesis technology. The method comprises the steps that viseme classification is performed on the pronunciation in standard Chinese, and the pronunciation is classified into 13 categories; corresponding mouth shape videos are recorded according to the viseme classification; a basic mouth shape viseme library is established according to an original mouth shape video; the basic mouth shape viseme library is subjected to dual-viseme treatment to obtain a basic mouth shape dual-viseme library; a speech recognition technology is used for recognizing newly input speech to obtain a text material, after the text material is subjected to initial consonant or simple or compound vowel recognition, the mouth shape viseme corresponding to each initial consonant or simple or compound vowel is searched for in the basic mouth shape dual-viseme library, and the mouth shape visemes are inserted into corresponding points in time to form a discrete mouth shape sequence, and the discrete mouth shape sequence is subjected to smoothing to obtain a continuous mouth shape sequence.

Description

technical field [0001] The invention relates to the field of character animation and the technical field of humanoid robots, in particular to a method for synthesizing mouth shapes with two views. Background technique [0002] Mouth movements are an important part of human facial movements. In daily life, mouth movements can not only convey information, but also express emotions. In the field of character animation, in order to make the character's image more realistic, it takes a lot of time to make the character's mouth movements, while the artificially synthesized pronunciation and mouth movements have low fidelity and a large workload, so the method of automatic mouth synthesis is adopted It can greatly reduce the workload of synthesizing mouth movements; with the development of service robots, in addition to the appearance of humanoid robots, the movements of robots need to be more human-like, so higher requirements are put forward for the facial movements of robots. R...

Images