A method for generating a new sample base on a generative adversarial network and an adaptive proportion

An adaptive, new sample technology, applied in the field of deep neural network, can solve the problem of model convergence decline, affecting the performance of gradient update algorithm, etc.

Active Publication Date: 2019-01-08
HANGZHOU DIANZI UNIV
View PDF3 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The optimization problem of a simple neural network is a convex optimization problem. "Convex optimization" refers to a special kind of optimization. Specifically, it refers to a type of optimization problem in which the objective function for finding the minimum value is a convex function. It uses some commonly used algorithms such as Gradient Descend (GD), Stochastic Gradient Descend (SGD), etc. can quickly converge to the minimum value; while the optimization problem of DNN is a non-convex optimization problem, there are a large number of saddle points in the network, adding noise disturbance to the model parameters or according to the Hessian matrix The method of finding the escape direction of the saddle point can improve the performance of the model, but changing the model parameters directly affects the performance of the gradient update algorithm, which may lead to a decline in model convergence, and requires strict theoretical proof of the convergence of the changed optimization algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for generating a new sample base on a generative adversarial network and an adaptive proportion
  • A method for generating a new sample base on a generative adversarial network and an adaptive proportion
  • A method for generating a new sample base on a generative adversarial network and an adaptive proportion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The technical solution of the present invention will be further described and illustrated through specific embodiments below, so that the technical solution will be clearer and clearer.

[0075] The present invention decouples the noise from the gradient update algorithm, and proposes a method for generating new samples based on the generative confrontation network and adaptive ratio, directly adding the noise generated by the generative confrontation network and the distribution of the original sample to the input sample (original sample) , to get a new sample, the new sample adjusts the proportion of the noise and the original sample according to the adaptive ratio, when the DNN loss function is steep, increase the original sample ratio, reduce the noise ratio, and avoid the DNN from crossing the minimum value; when the DNN loss function is flat, reduce Smaller original sample ratio and larger noise ratio are beneficial to speed up the convergence speed of DNN. The in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for generating a new sample based on a generative adversarial network and an adaptive proportion. The method comprises the following steps: S1, adding noise generatedby the generative adversarial network to the input sample directly and close to the distribution of the input sample; S2, constructing an adaptive proportion according to that variance of the sample,fusing the input sample and the noise generated by the generative adversarial network to generate a new sample, and adjusting the proportion of the noise and the input sample accord to the adaptive proportion of the new sample; S3 supplementing the original sample information for the new sample through the pixel addition operation, and generating a final sample which is beneficial to improving theDNN detection rate. The method improves the accuracy of DNN, and the cost is relatively small, and the complexity is lower.

Description

technical field [0001] The invention belongs to the technical field of deep neural networks, and in particular relates to a method for generating new samples based on generative confrontation networks and adaptive ratios. Background technique [0002] Computer vision mainly uses machines to try to establish an artificial intelligence system that can obtain "information" from images or multi-dimensional data. Specifically, it refers to using cameras and computers instead of human eyes to identify, track and measure targets, and Further graphics processing is done to make the computer processing become an image more suitable for human observation or sent to the instrument for detection. The deep neural network (DNN) is the basis of computer vision applications. In recent years, with the continuous improvement of computer hardware capabilities, the development of DNN technology has also advanced by leaps and bounds, especially in the field of computer vision such as image class...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08
CPCG06N3/082
Inventor 郭春生夏尚琴都文龙应娜
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products