Segmentation loss-based generative adversarial network method

A network and generator technology, applied in the field of deep learning neural network, can solve the problems of poor discriminator feature and robust discriminator feature, and achieve the effect of feature robustness, stable training process, and improvement of mode collapse phenomenon.

Active Publication Date: 2018-10-16
XUZHOU UNIV OF TECH
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problems existing in the above-mentioned prior art, the present invention provides a method of generative adversarial network based on segmentation loss, which can avoid the phenomenon of training instability and mode collapse of conventional generative adversarial network under a single form of loss, thereby solving the problem of discrimination The problem of poor features extracted by the generator; this method can realize that the generator uses different forms of loss functions in different training periods, and makes the network training more stable by making the generator introduce feature-level losses between real samples and generated samples. The features extracted by the machine are more robust

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Segmentation loss-based generative adversarial network method
  • Segmentation loss-based generative adversarial network method
  • Segmentation loss-based generative adversarial network method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Machine learning algorithms can be divided into supervised learning with labels and unsupervised learning without labels. Due to the high cost of obtaining labeled data for supervised learning and the lack of performance of unsupervised learning algorithms, semi-supervised learning (SSL) has become an important research direction for researchers. SSL can learn robust features by using a large number of unlabeled samples and a small number of labeled samples, and has a good performance in image classification. Lee et al. proposed an efficient method of pseudo-labeling unlabeled data to help model training. Rasmus et al. proposed a ladder network based on an autoencoder. The encoder is used for supervised learning, and each layer of the decoder corresponds to the encoder one-to-one to form a ladder for unsupervised learning training.

[0036] In recent years, Deep generative models (DGMs) and Generative Adversarial Networks (GAN) have performed well in semi-supervised le...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a segmentation loss-based generative adversarial network method. The method comprises the following steps of 1, performing parameter initialization: setting a batch size m to be 100 and a hyper-parameter k to be 1, performing the parameter initialization by using an Xavier method, determining a maximum iterative frequency and a loss switching iterative frequency parameter T, and setting an iterative frequency epoch to be 0; 2, training discriminator parameters: setting i to be 1, wherein i is a cyclic variable; and 3, training generator parameters: in epoch=epoch+1, judging whether the epoch is greater than the maximum iterative frequency or not, if the epoch is smaller than the maximum iterative frequency, repeating the steps 2 and 3, and if the epoch is greater than the maximum iterative frequency, ending the training process. According to the method, a generator can adopt loss functions in different forms in different training stages, so that the deficiency of a GAN theory under a single loss form is made up for to a certain extent, and the network training is more stable; and by introducing feature-level loss between a real sample and a generated sample,features extracted by a discriminator are robuster.

Description

technical field [0001] The invention belongs to the technical field of deep learning neural network, in particular to a generation confrontation network method based on segmentation loss. Background technique [0002] Generative Adversarial Network (GAN for short) is an unsupervised deep learning framework proposed by Goodfellow in 2014. Drawing on the idea of ​​"game theory", two players are constructed: generator (generator) and discriminator (discriminator) , the former generates images through uniform noise or Gaussian random noise with input parameters of (0, 1), and the latter discriminates the input images to determine whether the input is an image from a data set or an image generated by a generator. The discriminator feeds back the result of the judgment to the generator, so that it can be optimized toward the distribution of real data. [0003] In recent years, generative adversarial networks have been widely used in image generation and semi-supervised learning. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06K9/00
CPCG06V40/50G06N3/045
Inventor 姜代红刘其开黄轲
Owner XUZHOU UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products