Data classification method and system, equipment and information data processing terminal

A data classification and data technology, applied in the fields of systems, equipment and information data processing terminals, and data classification methods, can solve the problems of fluctuations in learning performance, large amount of calculation, large training errors of neural networks, etc., and achieve good recognition performance, good generalization The effect of optimization performance and high classification accuracy

Pending Publication Date: 2021-11-09
XIDIAN UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0033] (1) The existing feedforward neural network training algorithm has limitations, such as slow convergence speed, easy to fall into local optimum, and strong dependence on initial weights, etc.
[0034] (2) There is a large training error in the existing neural network, and the neural network structure is relatively complex
[0035] (3) The randomness of ELM easily leads to fluctuations in its learning performance, which further leads to unstable classification performance of SLFN, and only calculates network parameters with a fixed structure
[0036] (4) Due to the inappropriate learning step size, the existing learning method based on gradient descent tends to converge to a local optimal solution, and needs to solve the gradient information and iterative calculation, resulting in a large amount of calculation
[0037] The difficulty of solving the above problems and defects is: it is necessary to design an algorithm to optimize the network, so that the performance of the network is good enough, and at the same time the obtained network is compact, and it is necessary to overcome the shortcomings of easy to fall into local optimum, reduce the amount of calculation, and improve the calculation efficiency. speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data classification method and system, equipment and information data processing terminal
  • Data classification method and system, equipment and information data processing terminal
  • Data classification method and system, equipment and information data processing terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0150] Simultaneously optimizing network structure and connection parameters in SLFN is a challenging task. Extreme learning machine is a popular learning method in recent years. It usually makes SLFN have good generalization performance with extremely fast learning speed. The present invention proposes a collaborative genetic algorithm based on an extreme learning machine, called CGA-ELM, which can simultaneously adjust the structure and parameters of a single hidden layer feedforward neural network to achieve a compact network with good generalization performance. In CGA-ELM, a hybrid coding scheme is designed to optimize the network structure and input parameters (i.e., input weights between input neurons and hidden layer neurons and the bias of hidden layer neurons), while output parameters ( That is, the output weight between the hidden layer neuron and the output neuron) is determined by the ELM. The combination of training error and network complexity is used as a fitn...

Embodiment 2

[0168] 1. If image 3 As shown, it is a schematic diagram of a single hidden layer feedforward neural network. What the present invention establishes is an N-K-L type network, which only contains an input layer, a hidden layer and an output layer, wherein the input layer contains N neurons, Corresponding to N attributes of the sample data, the output layer contains L neurons, corresponding to L classification labels, and the hidden layer contains K neurons, and the initial setting is K=2×N+1.

[0169] Figure 4 It is an algorithm flowchart of the present invention, and the concrete steps are as follows:

[0170] 1. Randomly initialize the population P G The Pop chromosomes, each chromosome includes a binary vector and a real vector, and set G=0;

[0171] 2. Evaluate the initial population P G The fitness function value of the chromosome in

[0172] 3. When G≤MaxG, repeat steps 4-15;

[0173] 4. For Repeat steps 5-7;

[0174] 5. Use roulette to select from population P ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of machine learning and intelligent computing, and discloses a data classification method and system, equipment and an information data processing terminal. The data classification method comprises: dividing each data set into a training set and a test set; initializing the structure and partial network parameters of a single hidden layer feedforward neural network (SLFN), including the state of hidden layer neurons, an input weight and hidden layer bias, and calculating an optimal output weight; evaluating fitness function values of the generated chromosomes; optimizing a network structure and connection parameters at the same time through a collaborative genetic algorithm (CGA-ELM) based on an extreme learning machine, and obtaining an optimal solution to serve as a final single-hidden-layer feedforward neural network; and testing network performance by using the test set, and outputting average classification accuracy. The generalization ability of the CGA-ELM provided by the invention is obviously superior to that of CGA and ELM. Compared with other advanced algorithms, the CGA-ELM can achieve higher recognition capability on the premise of keeping convergence speed, and has higher competitive capacity and better generalization performance.

Description

technical field [0001] The invention belongs to the technical field of machine learning and intelligent computing, and in particular relates to a data classification method, system, equipment and information data processing terminal. Background technique [0002] At present, the artificial neural network (ANN) is a nonlinear adaptive information processing system composed of a large number of processing units. It is proposed on the basis of modern neuroscience research results, trying to process information by simulating the way the brain's neural network processes memory information. Feedforward neural network (FNN) is the earliest simple neural network invented in the field of artificial intelligence. In FNN, information is unidirectionally propagated from the input layer to the output layer through the hidden layer, which has attracted extensive attention due to its simple structure and good performance. The approximation theorem of ANN shows that a trained multi-layer ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06N3/12
CPCG06N3/126G06N3/084G06N3/048G06N3/045G06N3/044G06F18/241
Inventor 李宏高卫峰白利霞李和成谢晋
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products