A method for improving a generative adversarial network by using adaptive control learning

An adaptive control and network technology, applied in neural learning methods, biological neural network models, etc., can solve problems that hinder effective learning of generators, unbalanced capabilities of generator and discriminator models, and unbalanced capabilities of generator and discriminator models Growth and other issues, to achieve the effect of improving training stability, expanding the available range, and improving stability

Pending Publication Date: 2019-06-18
TIANJIN POLYTECHNIC UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Two major issues complicate the problem are: 1) the imbalance in the capabilities of the generator and discriminator models during training, which prevents the generator from effectively learning the real data distribution; 2) the lack of computable, interpretable convergence criteria

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for improving a generative adversarial network by using adaptive control learning
  • A method for improving a generative adversarial network by using adaptive control learning
  • A method for improving a generative adversarial network by using adaptive control learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0072] 1), against the generative network

[0073] GANs estimate generative models through an adversarial process, where a generator G plays a game against a discriminator D. The input to D comes from two data distributions: real data and synthetic data, the latter being generated by G. D is trained to maximize its ability to fully classify samples as real or synthetic, while G is trained to minimize D's ability to discern synthetic data. In the original framework, the training objective is defined as a maximin problem:

[0074]

[0075] where G is the mapping of the input noise variable Pz(z) to the generated data distribution P g and D is a function that maps the data space to scalar values, where each value represents the probability that a particular sample comes from the actual data distribution. Functions G and D constitute the GAN network, which is usually a neural network model and is trained simultaneously on its objective function. Loss function L for G and D ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of an adversarial network, and discloses a method for improving a GAN (Generative Adversarial Network) by using adaptive control learning, which is suitable for an adaptive hyper-parameter learning process of the GAN to improve the training stability of different data sets so as to ensure the quality of generated data (such as images and characters). The method is realized by guiding a training process of a data set with relatively complex categories and modes through a learning curve of training elements obtained under the data set with relativelysimple categories and modes; The present invention also analyzes an adaptive generative adversarial network (Ak-GAN) model having a multi-layer perceptron (MLP) and a deep convolutional neural network(DCGAN) architecture. According to the method, the stability of general GAN training can be improved indeed, and the method can be well popularized to various improved models and data sets; For future work, plan analysis better generates a sample metric, which may encourage convergence of the GAN; The effect of the proposed adaptive control mechanism in GAN multi-modal learning is hoped to be analyzed.

Description

technical field [0001] The invention belongs to the technical field of confrontation networks, and in particular relates to a method for improving generation confrontation networks with adaptive control learning. Background technique [0002] Generative Adversarial Networks (GANs) can efficiently synthesize samples for various applications, such as image generation, industrial design, speech synthesis, and natural language processing. The goal of GAN is to alternately train the generator model G and the discriminator model D. G and D of GAN usually choose to use multi-layer perceptron (MLP) or convolutional neural network (CNN). The generator accepts a set of noise priors to simulate the real data distribution, and the simulated distribution is called the generated data distribution, while the discriminator is trained to extract the discriminative features of the real data. More specifically, the discriminator judges the probability that a piece of data is from the real da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08
Inventor 金日泽马晓寒白准永孙庆雅郑泰善
Owner TIANJIN POLYTECHNIC UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products