A data reduction method based on a stack noise reduction self-coding neural network

A neural network and self-encoding technology, applied in the field of data reduction based on stack noise reduction and self-encoding neural network, can solve the problems of data redundancy, waste of storage space, reduce data-based modeling, etc., to reduce complexity, The effect of improving the classification effect and reducing the operation cost

Inactive Publication Date: 2019-04-09
INFORMATION & COMMNUNICATION BRANCH STATE GRID JIANGXI ELECTRIC POWER CO +1
View PDF8 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, with the rapid development of data acquisition and storage technology, the problem of data redundancy is becoming more and more serious. It not only wastes storage space greatly, but also significantly reduces the cost of data-based modeling.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data reduction method based on a stack noise reduction self-coding neural network
  • A data reduction method based on a stack noise reduction self-coding neural network
  • A data reduction method based on a stack noise reduction self-coding neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0024] A data reduction method based on a stacked denoising autoencoder neural network. On the basis of retaining the characteristics of AE, the denoising autoencoder (Denoising Autoencoder, DAE) enables AE to learn from the input containing noise. Some noise is added to the input data to improve the robustness of the system. The schematic diagram of DAE is as follows figure 1 Shown by q D , the original data X is scrambled into, and this noisy data is used a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data reduction method based on a stack type noise reduction self-coding neural network, which is characterized in that a reduction model of the stack type noise reduction self-coding neural network is constructed by the following steps of: 1, taking the output of the previous DAE as the input of the next DAE so as to achieve the purpose of layer-by-layer coding; Step 2, representing an original input sample by using a formula shown in the specification, and representing the coding condition of the DAE of the i layer d by the formula shown in the specification,and obtaining the coding condition of the DAE of each layer; And carrying out greedy training and fine tuning layer by layer, and in the fine tuning process, adjusting a cross entropy function of an initial parameter through a BP algorithm to ensure the minimization of a reconstruction error. Improved method-stack type noise reduction self-coding neural network algorithm adopting noise reduction self-coding network The is used for carrying out dimensionality reduction on a sample feature set, so that the complexity of various models is reduced, the classification effect of a classifier in machine learning application is improved, the operation cost of various learning algorithms is reduced, and the feasibility and high efficiency of reduction of the method are verified.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data reduction method based on a stacked noise reduction autoencoder neural network. Background technique [0002] Autoencoder (Autoencoder, AE) was proposed by Hinton in 2006, and its structure is divided into input layer, output layer, and hidden layer. The number of neurons in the input layer and the output layer is the same, and the number of neurons in the hidden layer is small. The input layer and the hidden layer constitute the encoding network part, and AE compresses data in the encoding network part. [0003] At present, with the rapid development of data acquisition and storage technology, the problem of data redundancy is becoming more and more serious. It not only wastes storage space greatly, but also significantly reduces data-based modeling. [0004] In view of the characteristics of high dimensionality, high redundancy and strong correlation between ind...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08G06N20/00
CPCG06N3/08G06N3/045
Inventor 肖子洋邱日轩付晨李路明褚红亮
Owner INFORMATION & COMMNUNICATION BRANCH STATE GRID JIANGXI ELECTRIC POWER CO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products