Dual-viseme mouth shape synthesis method

A synthesis method and viseme technology, which is applied in the direction of TV, color TV, color TV parts, etc., can solve the problem of low fidelity of pronunciation and mouth shape, achieve realistic reproduction of mouth movement, and solve the problem of low fidelity Effect

Inactive Publication Date: 2019-05-31
GUANGDONG UNIV OF TECH
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention discloses a dual-view mouth-synthesis method, which is used to solve the tec

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dual-viseme mouth shape synthesis method
  • Dual-viseme mouth shape synthesis method
  • Dual-viseme mouth shape synthesis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The embodiment of the present invention discloses a dual-view mouth-synthesis method, which is used to solve the technical problem that the existing lip-synthesis technology has low fidelity in reproducing partial pronunciation mouth-synthesis.

[0035] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0036] see Figure 1 to Figure 4 , an embodiment of a dual-view mouth-synthesizing method provided in the embodiment of the present invention includes:

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a dual-viseme mouth shape synthesis method. The method is used for solving the technical problem of lower fidelity of a pronunciation mouth shape of a reproduction part of an existing mouth shape synthesis technology. The method comprises the steps that viseme classification is performed on the pronunciation in standard Chinese, and the pronunciation is classified into 13 categories; corresponding mouth shape videos are recorded according to the viseme classification; a basic mouth shape viseme library is established according to an original mouth shape video; the basic mouth shape viseme library is subjected to dual-viseme treatment to obtain a basic mouth shape dual-viseme library; a speech recognition technology is used for recognizing newly input speech to obtain a text material, after the text material is subjected to initial consonant or simple or compound vowel recognition, the mouth shape viseme corresponding to each initial consonant or simple or compound vowel is searched for in the basic mouth shape dual-viseme library, and the mouth shape visemes are inserted into corresponding points in time to form a discrete mouth shape sequence, and the discrete mouth shape sequence is subjected to smoothing to obtain a continuous mouth shape sequence.

Description

technical field [0001] The invention relates to the field of character animation and the technical field of humanoid robots, in particular to a method for synthesizing mouth shapes with two views. Background technique [0002] Mouth movements are an important part of human facial movements. In daily life, mouth movements can not only convey information, but also express emotions. In the field of character animation, in order to make the character's image more realistic, it takes a lot of time to make the character's mouth movements, while the artificially synthesized pronunciation and mouth movements have low fidelity and a large workload, so the method of automatic mouth synthesis is adopted It can greatly reduce the workload of synthesizing mouth movements; with the development of service robots, in addition to the appearance of humanoid robots, the movements of robots need to be more human-like, so higher requirements are put forward for the facial movements of robots. R...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/22G10L15/26H04N5/232H04N5/76G10L15/08G06F16/33G06K9/00
Inventor 陈华谋朱海飞李培宏许崇铭陈宏楷
Owner GUANGDONG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap