Unlock instant, AI-driven research and patent intelligence for your innovation.

Face picture driving method, related model training method and related device

A training method and face image technology, applied in the field of image processing, can solve problems such as poor image effect

Pending Publication Date: 2021-11-16
GUANGZHOU HUYA TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Face animation is produced by image deformation on the basis of real face pictures, so it has a high sense of reality. However, the image obtained by the existing face picture driving method is not good in unstructured areas.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face picture driving method, related model training method and related device
  • Face picture driving method, related model training method and related device
  • Face picture driving method, related model training method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The solutions of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

[0022] In the following description, for purposes of illustration rather than limitation, specific details, such as specific system architectures, interfaces, and techniques, are set forth in order to provide a thorough understanding of the present application.

[0023] The terms "system" and "network" are often used interchangeably herein. The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the character " / " in this article generally indicates that the contextual objects are an "or" relationship. In addition, "many" herein means two or more than two.

[0024] see figure 1 , figure 1 It ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a face picture driving method, a related model training method and a related device, wherein an image generation network model comprises an image segmentation network, a structured generation network and an unstructured generation network. The training method of the image generation network model comprises the following steps: acquiring a portrait image training set comprising a first portrait image and a second portrait image of the same target; obtaining a structured region image and a first unstructured region image corresponding to the first portrait image and the second portrait image through the image segmentation network; generating a prediction target image by using a structured generation network and an unstructured generation network based on the corresponding structured region image and the first unstructured region image of the first portrait image and the second portrait image; and adjusting network parameters in the image generation network model based on a loss function between the second portrait image and the predicted target image. According to the scheme, the driving effect of the face picture can be improved.

Description

technical field [0001] The present application relates to the technical field of image processing, and in particular to a driving method for face pictures, a training method for related models, and related devices. Background technique [0002] Face animation is widely used in many fields such as computer animation industry, game industry, teleconferencing, agent and avatar, etc. It is a hot research topic at home and abroad in recent years. Face animation based on a single image, transforming the geometric position of a given image can produce some interesting visual effects, which are often used to produce special effects in film and television entertainment and advertising design. [0003] Face animation is produced by image deformation on the basis of real face pictures, so it has a high sense of reality. However, the image obtained by the existing face picture driving method is not good in unstructured areas. . Contents of the invention [0004] The main technical p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/24
Inventor 韩欣彤林哲
Owner GUANGZHOU HUYA TECH CO LTD