Expression migration model training method, expression migration method and device

An expression transfer and training method technology, applied in character and pattern recognition, texture/color, instruments, etc., can solve the problems of high training difficulty, high model training cost, and large consumption of computing resources.

Pending Publication Date: 2020-09-11
TENCENT TECH (SHENZHEN) CO LTD
View PDF5 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, using 3D modeling to construct a face model requires complex calculations. Therefore, in the actual tra...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression migration model training method, expression migration method and device
  • Expression migration model training method, expression migration method and device
  • Expression migration model training method, expression migration method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0113] The embodiment of the present application provides a training method for an expression transfer model, a method and a device for expression transfer. On the one hand, it does not need to perform complex image processing on the face image, which reduces the training difficulty and training cost. On the other hand, it is beneficial to The expression transfer model outputs more realistic face images, thus enhancing the model performance of the expression transfer model.

[0114]The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein, for example, can be practiced in sequences other than those illustrated or described here...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a training method of an expression migration model applied to the field of artificial intelligence. The method comprises the steps of obtaining a source domain face image, a target domain face image and a face feature image; obtaining a synthetic face image through a to-be-trained expression migration model; obtaining a first discrimination result and a second discrimination result through the discrimination network model; obtaining a category feature vector through an image classification model; and updating model parameters of the to-be-trained expression migration model according to the category feature vector, the first discrimination result and the second discrimination result until a model convergence condition is met, thereby obtaining the expression migration model. The invention further discloses an expression migration method and device. According to the invention, complex image processing does not need to be carried out on the face image, the trainingdifficulty and the training cost are reduced, and the expression migration model can output a more real face image.

Description

technical field [0001] The present application relates to the field of artificial intelligence, in particular to a training method for an expression transfer model, a method and a device for expression transfer. Background technique [0002] In recent years, the processing and analysis of facial expressions has become a research hotspot in the field of computer vision and graphics, and facial expression transfer has also been widely used. Wherein, the facial expression transfer refers to mapping the captured real user's expression to another target image, so as to achieve the purpose of transferring the facial expression to the target image. [0003] In existing schemes, expression transfer can be performed in a 3-dimensional (3D) manner. First, a 3D model of the face head needs to be constructed based on the face image, and then the image is warped and transformed based on the corresponding 3D face model. Fusion and other processing, and finally achieve the purpose of faci...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/168G06V40/174G06F18/2411G06F18/253G06F18/214G06V40/169G06V40/176G06T11/001Y02T10/40G06V40/172G06V40/162G06T11/60
Inventor 严宇轩贲有成李强丁杨申瑞雪王超程培俞刚傅斌
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap