Method for improving BP (back propagation) neutral network and based on genetic algorithm

A technology of BP neural network and genetic algorithm, which is applied in the field of improving BP neural network based on genetic algorithm, can solve the problems of difficult determination of the number of hidden layers and the number of hidden layer units, insufficient perfection, and great influence of network training, and achieve the standardization of implementation steps , easy to realize, simple thinking effect

Inactive Publication Date: 2014-08-06
SOUTH CHINA UNIV OF TECH
View PDF0 Cites 68 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] BP neural network is the most widely used algorithm in artificial neural network. Many effective learning algorithms have been proposed, but there are still some defects: ①The learning convergence speed is too slow; ②The gradient descent method used by BP neural network corrects weights and thresholds, There is a local minimum problem, which cannot guarantee convergence to the global minimum point; ③The number of hidden layers and the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for improving BP (back propagation) neutral network and based on genetic algorithm
  • Method for improving BP (back propagation) neutral network and based on genetic algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be further described in detail below in conjunction with the embodiments and the accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0035] Such as figure 2 , a method for improving a BP neural network based on a genetic algorithm, comprising steps in the following order:

[0036] S1. Coding the BP network: determine the structure of the neural network, including the number of hidden layers and the number of units in each layer; use real number coding, encode the weights and thresholds of each layer as genes, and after coding, each neural network corresponds to a chromosome;

[0037] S2. Use the genetic algorithm to select and optimize the network, specifically including the following steps:

[0038] (1) Initialize the population: determine the population size N, and randomly generate N chromosomes;

[0039] (2) Determine the fitness function: the fitness function is used to judge the adaptability...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for improving a BP (back propagation) neutral network and based on a genetic algorithm. The method includes coding the BP network to determine structure of the neutral network, wherein the structure includes the number of hidden layers and the number of units of each layer; adopting real-number coding to code by taking weight and threshold as genes, wherein each neutral network corresponds to a chromosome after coding; using the genetic algorithm to perform selection optimization on the network, wherein selection optimization includes the steps of selection, crossing and variation; training the BP network to acquire a final result; decoding an optimal individual selected by the genetic algorithm to generate a new neutral network, and training the new network by applying a BP training algorithm to acquire a final result. The method combines the genetic algorithm with the BP network, thereby being capable of fully utilizing advantages of the both, the problem that initial weight and threshold of the BP network are difficult to determine can be solved, searching range can be narrowed, training speed of the BP network can be increased, and the problem of local minimum can be improved.

Description

technical field [0001] The invention relates to an artificial neural network, in particular to a method for improving a BP neural network based on a genetic algorithm. Background technique [0002] The artificial neural network is developed from the biological neural network, which is the simplification, abstraction and simulation of the human brain or some basic characteristics. Its purpose is to simulate some mechanisms and mechanisms of the brain to achieve some specific functions. [0003] Among them, BP neural network, as the most widely used neural network model, has many practical applications in handwriting recognition, speech recognition, face recognition and biomedical signal processing. [0004] BP neural network, also known as error reverse broadcast network, is a multi-layer forward network, generally including an input layer, an output layer and one or more hidden layers, such as figure 1 shown. The BP neural network is a learning network with a tutor, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/02G06N3/12
Inventor 肖南峰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products