Unlock instant, AI-driven research and patent intelligence for your innovation.

A Robust Reference Image-Based Makeup Transfer Method

A technology for referencing pictures and makeup, applied in the field of computer vision, which can solve the problems of limited migration methods, migration, and poor performance.

Active Publication Date: 2022-05-20
BEIHANG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, the makeup transfer method based on the reference picture is relatively limited, and it is difficult to transfer part of the makeup of the reference picture during application, and provide functions such as partial makeup and mixed makeup.
It does not perform well when the head posture and expression of the picture to be made up and the reference picture differ greatly, and it is not robust enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Robust Reference Image-Based Makeup Transfer Method
  • A Robust Reference Image-Based Makeup Transfer Method
  • A Robust Reference Image-Based Makeup Transfer Method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0042] The embodiment of the present invention discloses a robust makeup transfer method based on reference pictures. By using the makeup extraction network as input, the makeup matrix is ​​extracted from the reference picture with makeup, and the makeup transformation module with attention mechanism is used to transform the makeup The matrix is ​​deformed into an adapted makeup matrix adapted to the picture to be changed. Finally, a makeup remover-remakeup ne...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a robust makeup transfer method based on reference pictures. By using a makeup extraction network, a reference picture with makeup is used as input to extract a makeup matrix, and a makeup deformation module with an attention mechanism is used to deform the makeup matrix. Become the post-adaptation makeup matrix adapted to the picture to be changed. Finally, a make-up removal-re-change network is used to take the picture to be changed as input, encode the picture into the latent space, and then use the adapted makeup matrix to zoom and translate the visual feature map of the picture to be changed, and then change the makeup The visual feature map is sampled to get the final makeup change picture.

Description

technical field [0001] The present invention relates to the field of computer vision, and more specifically, uses a generative confrontation network to generate images. Background technique [0002] The makeup transfer based on the reference picture means that given the picture to be made up and the reference picture, the algorithm needs to transfer the makeup on the reference picture to the picture to be made up. Through this method, users can see the effect of their own makeup without spending time and money buying cosmetics and make-up, which can be widely used in the Internet industry. [0003] However, in the existing technology, the makeup transfer method based on the reference picture is relatively limited, and it is difficult to transfer part of the makeup of the reference picture during application, and provide functions such as partial makeup and mixed makeup. It does not perform well when the head poses and expressions of the picture to be made up and the referen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T11/40G06K9/00G06K9/62
CPCG06T11/40G06V40/168G06V10/56G06V10/758G06F18/22
Inventor 姜文韬刘偲高晨
Owner BEIHANG UNIV