Check patentability & draft patents in minutes with Patsnap Eureka AI!

Face attribute editing model training method and face attribute editing method

A technology of attribute editing and training methods, applied in the field of image processing, which can solve the problems of reducing the accuracy of face target attribute editing and updating not natural enough, and achieve the effect of improving editing accuracy and maintaining editing invariance

Pending Publication Date: 2022-01-21
BIGO TECH PTE LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, due to the global loss function, there will be a corresponding strong constraint relationship between the input image and the output image of the generative adversarial network, so that although the target attributes in the face image output by the trained generative adversarial network can be edited, they are not consistent with the input Compared with images, while editing the target attributes, it may lead to changes in the background area and non-target attribute areas, making the update of the background area and non-target attribute areas in the output image unnatural, which greatly reduces the editing accuracy of face target attributes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face attribute editing model training method and face attribute editing method
  • Face attribute editing model training method and face attribute editing method
  • Face attribute editing model training method and face attribute editing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Figure 1A It is a flow chart of a training method for a face attribute editing model provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of re-editing various attributes in any face image to change the face style. The training method of the human face attribute editing model provided in this embodiment can be executed by the training device of the human face attribute editing model provided in the embodiment of the present invention, which device can be realized by means of software and / or hardware, and integrated in the execution method of electronic equipment.

[0040] Specifically, refer to Figure 1A , the method may include the following steps:

[0041] S110. Construct an initial face attribute editing model according to the reconstruction parameters of the face training image, where a target adversarial loss function and a similarity loss function are preset in the face attribute editing model.

[0042]Specifically, when ...

Embodiment 2

[0061] Figure 2A It is a flowchart of a training method for a face attribute editing model provided in Embodiment 2 of the present invention, Figure 2B It is a schematic diagram of the principle of the training process of the face attribute editing model provided by Embodiment 2 of the present invention, Figure 2C It is a schematic structural diagram of the face attribute editing model provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the foregoing embodiments. Specifically, such as Figure 2B As shown, considering that the StyleGAN network has a powerful generation ability to generate real and natural images, and the StyleGAN network is a model that maps random noise to images, it cannot directly accept real images as input, so the face attributes in this embodiment The editing model can include three parts: image encoding network, migration decoding network and latent space of migration decoding network, so as to use StyleG...

Embodiment 3

[0078] Figure 3A It is a flow chart of a face attribute editing method provided by Embodiment 3 of the present invention. This embodiment is applicable to the case of re-editing various attributes in any face image to change the face style. The face attribute editing method provided in this embodiment can be executed by the face attribute editing device provided in the embodiment of the present invention, and the device can be realized by software and / or hardware, and integrated in the electronic device executing the method.

[0079] Specifically, refer to Figure 3A , the method may include the following steps:

[0080] S310, input the current face image to be edited into the face attribute editing model trained by the face attribute editing model training method provided in the above embodiment, and obtain the corresponding face editing image.

[0081] Optionally, a corresponding face attribute editing model is trained by using the face attribute editing model training me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a face attribute editing model training method and a face attribute editing method. The training method comprises the following steps: constructing an initial face attribute editing model according to reconstruction parameters of a face training image, wherein a target adversarial loss function and a similarity loss function are preset in the face attribute editing model; and inputting the face training image into the face attribute editing model, and training the face attribute editing model by using the target adversarial loss function and the similarity loss function to obtain a trained face attribute editing model. According to the technical scheme of the invention, common constraint between the target attribute and the non-target attribute is realized when the face attribute editing model edits the target attribute in the face image, the editing invariance of the non-target attribute is maintained while the target attribute is edited, the editing accuracy of the face attribute editing model for the target attribute is improved, and the real naturalness of the current face image after the target attribute is edited is ensured.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of image processing, and in particular to a training of a human face attribute editing model and a method for editing human face attributes. Background technique [0002] Face attribute editing is an important technology in the field of computer vision. It is widely used in content production, film production and entertainment videos, such as changing bald head, changing hairstyle, changing child, changing star face, etc. Face attribute editing is to give an input image containing a face and the target attribute to be edited, and then transform the input image into a target domain face image with the target attribute, and ensure that other original attribute features in the face image remain unchanged . [0003] At present, a Generative Adversarial Networks (GAN) is usually pre-trained to achieve target attribute editing of face images. At this time, facing the difference between ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06V10/74G06V10/774G06V10/82G06K9/62G06N3/08
CPCG06N3/084G06F18/22G06F18/214
Inventor 黄嘉彬李玉乐项伟
Owner BIGO TECH PTE LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More