Facial expression migration method and device, electronic equipment and storage medium

A facial expression and facial expression recognition technology, applied in the field of devices, facial expression migration methods, electronic equipment and storage media, can solve the problems of virtual object expressions not being realistic enough, poor effect, deep neural network model is not accurate enough, etc.

Active Publication Date: 2021-03-23
CHINA UNITED NETWORK COMM GRP CO LTD +1
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the data used in the training of the deep neural network model is limited, resulting in the training of the deep neu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression migration method and device, electronic equipment and storage medium
  • Facial expression migration method and device, electronic equipment and storage medium
  • Facial expression migration method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the purpose, technical solutions and advantages of the examples of the present invention more clear, the technical solutions in the examples of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the examples of the present invention.

[0023] The facial expression transfer technology refers to detecting the facial expression by detecting the color image of the face, and performing expression transfer, driving the virtual character to make the same expression, or generating pictures or videos of other characters making the same expression, and broadcasting It has a wide range of applications in scenarios such as , games, virtual people, and remote conferences.

[0024] The facial expression transfer technology mainly includes two parts: face recognition and expression transfer. Traditional facial expression recognition mostly uses machine learning algorithms to recognize facial expression...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a facial expression migration method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a real facial image; inputting the real face image into a pre-trained face expression recognition network model, and outputting an action unit coefficient corresponding to a face expression in the real face image, wherein the face expressionrecognition network model is obtained through training of a virtual face data set and a real face data set, and the action unit coefficient is used for representing face data when a face is in different expressions; and driving the face of the virtual object to make a corresponding facial expression according to the action unit coefficient so as to realize facial expression migration, i.e., the facial expression recognition network model in the embodiment of the invention is obtained through joint training of the virtual facial data set and the real facial data set, so that the recognition rate is more accurate, the accuracy of facial expression recognition is improved, and the virtual object can make more realistic facial expressions.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a method, device, electronic equipment and storage medium for transferring human facial expressions. Background technique [0002] The facial expression transfer technology has a wide range of applications in live broadcast, games, virtual people, remote conferences and other scenarios. [0003] The existing facial expression migration technology first uses the trained deep neural network model to recognize the facial expression, and then drives the virtual object to make the same expression according to the recognized facial expression. [0004] However, the data used in the training of the deep neural network model is limited, resulting in the trained deep neural network model being inaccurate, and the expressions made by virtual objects are not realistic enough and the effect is poor. Contents of the invention [0005] In view of the above problems, the present invent...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06T3/00
CPCG06T3/0012G06V40/161G06V40/172G06V40/174Y02D10/00
Inventor 王响王恺廉士国
Owner CHINA UNITED NETWORK COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap