3D face animation synthesis method and system

An animation synthesis and 3D technology, applied in the field of artificial intelligence, can solve problems such as affecting the realism of animation, and achieve the effect of reducing the amount of calculation and improving the practicability.

Pending Publication Date: 2021-07-23
合肥综合性国家科学中心人工智能研究院
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, people are very sensitive to whether the sound and lip movements are consistent. Using single-modal information cannot achieve high-precision mapping of facial animation parameters, which affects the realism of animation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D face animation synthesis method and system
  • 3D face animation synthesis method and system
  • 3D face animation synthesis method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The specific implementation manners of the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation manners described here are only used to illustrate and explain the implementation manners of the present invention, and are not intended to limit the implementation manners of the present invention.

[0040] In the embodiments of the present invention, unless stated otherwise, the used orientation words such as "up, down, top, bottom" are usually for the directions shown in the drawings or for vertical, vertical or The term used to describe the mutual positional relationship of each component in terms of the direction of gravity.

[0041] In addition, if there are descriptions involving "first", "second" and so on in the embodiments of the present invention, the descriptions of "first", "second" and so on are only for descriptive purposes, and should not b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a 3D face animation synthesis method and system, and belongs to the technical field of artificial intelligence, and the method comprises the steps: collecting the audio features of the voice of a user and the rhythm features of a text; taking the audio features and the rhythm features as input of a pre-trained trajectory prediction network to obtain a vocal organ motion trajectory corresponding to the user; and driving the 3D head network model by using the vocal organ movement track of the user to achieve lip sound synchronous 3D face animation synthesis. According to the method and system, the motion trail of the vocal organ is used as the animation parameter of the 3D face model, the 3D face model is driven through the motion trail to achieve the face animation with synchronous lip sound, and the calculation amount is greatly reduced.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a 3D human face animation synthesis method and system. Background technique [0002] Compared with individual voices, lip-synced voice animations can enhance the intelligibility of voices in noisy situations, better attract users' attention, and thus better realize human-computer interaction. However, the key issue in synthesizing lip-synchronized speech animation is to realize the conversion from speech features to visual features (audio-to-visual conversion). For the traditional viseme method, it is necessary to create a corresponding viseme for each phoneme. When synthesizing animation, phonemes are directly mapped to visemes, and then continuous animation synthesis is realized through subjectively defined smoothing functions or co-pronunciation models. However, this method needs to establish a corresponding viseme for each phoneme, which results in a large a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40G06T13/20G06F3/01G10L15/16G10L15/26G06N3/04G06N3/08
CPCG06T13/40G06T13/205G06F3/011G10L15/26G10L15/16G06N3/08G06N3/045
Inventor 于灵云
Owner 合肥综合性国家科学中心人工智能研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap