Facial expression synthesis method based on generative adversarial network

A facial expression, expression synthesis technology, applied in computer parts, instruments, character and pattern recognition and other directions, can solve the problem of image blur resolution, complex calculation, lack of details in the image and other problems

Inactive Publication Date: 2018-07-17
SHENZHEN WEITESHI TECH
View PDF3 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the variational autoencoders utilized by traditional methods can produce high-resolution realistic images, the calculati

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression synthesis method based on generative adversarial network
  • Facial expression synthesis method based on generative adversarial network
  • Facial expression synthesis method based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

[0051] figure 1 It is a system framework diagram of a method for synthesizing facial expressions based on generative confrontation network in the present invention. It mainly includes geometry-guided facial expression synthesis and facial geometry manipulation.

[0052] The loss of geometry-guided facial expression synthesis includes adversarial loss, pixel loss, cycle consistency loss and identity preservation loss, and the weighted sum of these four loss functions is the total loss function.

[0053] Adversarial loss and pixel loss, since the proposed face editing model generates results conditioned on the input face image and heatmap, a generative adversarial network (GAN) is appli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention puts forward a facial expression synthesis method based on a generative adversarial network. The method comprises the following main contents of a geometric guidance facial expression synthesis and facial geometric operation. The process of the geometric guidance facial expression synthesis and facial geometric operation comprises the following steps that: firstly, giving a heat picture with a target facial expression and a front face without expressions to correspondingly synthesize a new face image; then, carrying out weighted summation on all loss functions to obtain a total loss function; thirdly, adopting the geometric positions of one group of datum points to guide facial expression editing, and using an expression synthesis model to obtain a facial expression transferring result; and finally, linearly regulating a shape parameter value to carry out facial expression interpolation. By use of the method, the geometric guidance generative adversarial network can be used for generating vivid images of different expressions from single image, the synthesis image is subjected to fine granularity control, facial expression transfer and interpolation can be easily carried out, and facial expression transfer and cross expression identification can be realized.

Description

technical field [0001] The invention relates to the field of facial expression synthesis, in particular to a method for synthesizing facial expressions based on generative confrontation networks. Background technique [0002] Human face plays a very important function of information expression in human communication, it conveys human emotion and mental state. In recent years, the automatic processing of facial expressions by computer has become a hot research topic in the fields of computer vision, computer graphics, and pattern recognition. It has broad application prospects in video conferencing, film and television production, and intelligent human-computer interface. Facial expression processing includes facial expression recognition and facial expression synthesis. Among them, facial expression synthesis makes it easier for people to use equipment. For example, facial expression synthesis enables computers to generate delicate and realistic facial expression animations...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/00
CPCG06V40/171G06V10/7553G06V10/757
Inventor 夏春秋
Owner SHENZHEN WEITESHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products