Target domain oriented unsupervised image conversion method based on generative adversarial network

An image conversion, target domain technology, applied in the field of unsupervised image conversion, can solve problems such as unsupervised and GAN training difficulties

Active Publication Date: 2019-10-15
DALIAN UNIV OF TECH
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0015] Aiming at the problems that the traditional method requires paired data and GAN itself is difficult to train, the present invention proposes a GAN-based target domain-oriented unsupervised image conversion method to realize unsupervised image conversion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target domain oriented unsupervised image conversion method based on generative adversarial network
  • Target domain oriented unsupervised image conversion method based on generative adversarial network
  • Target domain oriented unsupervised image conversion method based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The present invention provides a target domain-oriented unsupervised image conversion method based on generative adversarial networks. The specific embodiments discussed are merely illustrative of implementations of the invention, and do not limit the scope of the invention. Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, specifically including the following steps:

[0039] 1. Image preprocessing. Take the face attribute conversion experiment as an example. From the real source domain data distribution p data Sampling in (x) obtains the real source domain image x, a photo of a black-haired female with a pixel size of 178*178, and distributes p from the real target domain data data (y) is sampled to obtain the real target domain image y, a photo of a blonde woman with a pixel size of 178*178. Use Python's image processing module to uniformly process the real source domain image x and the real targe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a target domain oriented unsupervised image conversion method based on a generative adversarial network, and belongs to the field of computer vision. The target domain orientedunsupervised image conversion method is used for realizing an unsupervised cross-domain image-to-image conversion task, and belongs to the field of computer vision. According to the target domain oriented unsupervised image conversion method, a self-encoding reconstruction network is designed, and hierarchical representation of a source domain image is extracted by minimizing reconstruction loss of the source domain image; meanwhile, through a weight sharing strategy, the weights of network layers for encoding and decoding high-level semantic information in two groups of generative adversarialnetworks in the network model are shared, so that the output image can keep the basic structure and characteristics of the input image; and then, the two discriminators are respectively used for discriminating whether the input image is a real image or a generated image in respective fields. According to the target domain oriented unsupervised image conversion method, unsupervised cross-domain image conversion can be effectively carried out, and a high-quality image is generated. Experiments prove that the method provided by the invention obtains a good result on standard data sets such as CelebA and the like.

Description

technical field [0001] The invention belongs to the field of computer vision and relates to an unsupervised image conversion method based on a generation confrontation network. Background technique [0002] With the popularization of mobile devices and the rapid growth of Internet bandwidth, graphic image data has shown an explosive growth, and they carry a large amount of information to be mined. In recent years, research in the field of computer vision has developed rapidly, especially with the development of generative adversarial networks, the problem of image translation has also attracted extensive attention. [0003] Image transformation refers to converting an image from one representational scene to another while keeping the content of the image unchanged. Many problems in the fields of computer vision, computer graphics and image processing can actually be understood as image conversion problems. For example, image coloring can be regarded as converting grayscale ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/00G06T3/40
CPCG06T3/4046G06T3/4053G06T3/04
Inventor 葛宏伟姚瑶周东清张强郭枫
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products