Facial expression generation method and device, electronic device and storage medium

A facial expression and expression technology, which is used in image data processing, animation production, speech analysis, etc., can solve the problem that the facial expression and voice data of the 3D animation model do not match, the facial expression cannot be simulated, and the facial expression of the 3D animation model is incorrect, etc. question

Pending Publication Date: 2019-07-12
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present application provides a method, device, electronic equipment and storage medium for generating facial expressions, so as to solve the problem that facial expressions cannot be simulate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression generation method and device, electronic device and storage medium
  • Facial expression generation method and device, electronic device and storage medium
  • Facial expression generation method and device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0066] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of this application and the above drawings are used to distinguish similar objects and not necessarily Describe a particular order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a facial expression generation method and device, an electronic device and a storage medium. The method comprises: performing feature extraction on obtained voice information, obtaining a first voice feature vector, the first voice feature vector comprising a plurality of voice feature parameters, and each voice feature parameter indicating a Mel frequency cepstrum coefficient based on voice; inputting the first voice feature vector into a preset recognition model to obtain a first expression vector, wherein the first expression vector comprises a plurality of expressionparameters; and fitting the three-dimensional animation model according to the first expression vector to obtain a three-dimensional animation model with expressions. The Mel frequency cepstrum coefficient based on the voice can retain the content information, pitch, tone and other voice characteristics of the voice, and can better restore the expression action. Therefore, the facial expressionsof the three-dimensional animation model are more correct, the facial expressions can be better simulated, and the obtained expression actions conform to the voice information and the voice data.

Description

technical field [0001] The present application relates to the technical field of animation, in particular to a method, device, electronic equipment and storage medium for generating facial expressions. Background technique [0002] With the development of 3D animation technology, 3D animation has been loved by more and more users, and has begun to be widely developed and applied. The 3D animation model needs to realize various actions, and the face of the 3D animation model needs facial expression actions. Therefore, it is necessary to process the face of the 3D animation model to obtain facial expression movements. [0003] In the prior art, speech can be used to fit the face of the 3D animation model, and then a 3D animation model with expressions can be obtained. First, feature extraction is performed on the original speech data to obtain the phoneme formant features; then, the phoneme formant features are used to drive the face of the 3D animation model, and then the f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T13/40G10L15/02
CPCG06T13/40G10L15/02
Inventor 袁燚田冠中
Owner NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap