Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An interactive face cartoon method based on generative adversarial networks

An interactive human and face cartoon technology, applied in biological neural network models, neural learning methods, character and pattern recognition, etc., can solve problems such as insufficient details, and achieve the effect of eliminating differences

Active Publication Date: 2019-02-22
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF7 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Based on this principle, the generative confrontation network is widely used in image generation and style transfer. Compared with the general generation model, the network can generate clearer images, but the details are still insufficient, and it relies on a large number of training samples with similar styles.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An interactive face cartoon method based on generative adversarial networks
  • An interactive face cartoon method based on generative adversarial networks
  • An interactive face cartoon method based on generative adversarial networks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0063] Step S1: Build a training set.

[0064] Step S101: cutting the original data into a uniform size of 256*256;

[0065] Step S102: Perform interactive segmentation processing, mark the hair area with a blue thick line, mark the background area with a green thick line, and use red dots to represent the left eye, right eye, and lips;

[0066] Step S103: Crop the eyebrow image and the lip image according to the coordinates of the red dots (square clipping), and record the upper left coordinate position and the size of the clipped image. And the size is normalized to 64*64 to form a training database;

[0067] Step S104: Obtain the face contour according to the face segmentation image, and fill in the skin color, as a cartoon face image;

[0068] Step S105: filling the background of the segmented hair image with white to form a hair training set;

[0069] Step S2: Train the generative confrontation network to obtain three generative models.

[0070] Use the above three da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an interactive face cartoon method based on generative adversarial networks. The image to be processed is firstly subjected to interactive segmentation processing to obtain eyebrow-eye, mouth-nose, hair and face images, and then eyebrow-eye, mouth-nose and hair images are respectively input into three trained eye, mouth-nose and hair generation models to output corresponding cartoon five-feature images. Based on the cartoon processing of face image, the cartoon face can be obtained directly. Then the facial features are synthesized on the cartoon face and superimposed on the hair effect to get the final cartoon image. The invention utilizes the advantages of interactive and generating antagonistic network, obtains the five features of human hair, face shape and facethrough interactive segmentation, eliminates the difference between training samples due to different backgrounds, converts the style of each part through generating antagonistic network, and retainsas much information of eye corner, mouth corner and other detail parts as possible.

Description

technical field [0001] The invention belongs to the technical field of image processing and computer vision, and relates to an interactive face cartoon method based on a generative confrontation network. Background technique [0002] In recent years, with the rapid development of mobile networks and mobile phones, especially the vigorous development of mobile Internet, digital entertainment has become larger and larger in the industry with its special advantages, and the technology of face cartoon drawing has emerged as the times require. This technology is mainly Using image processing and computer programs to automatically generate cartooning results can greatly reduce the workload of painters and improve the efficiency of cartooning. [0003] At present, the face cartoonization methods mainly include interactive methods and unsupervised learning methods. The interactive-based method uses human-computer interaction to extract the contour lines of the face, and then artifi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06V40/172G06V40/171G06V10/44G06N3/045G06F18/24
Inventor 李宏亮梁小娟邓志康颜海强尹康袁欢
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products