Adaptive dynamic cooperative particle swarm optimization method for feed-forward network

A technology of particle swarm optimization and feed-forward network, which is applied to biological neural network models, instruments, character and pattern recognition, etc., can solve the problems of insufficient network generalization ability and falling into local extremum, so as to enhance local search ability and strengthen The effect of development, improvement of network learning ability and recognition ability

Inactive Publication Date: 2014-01-22
WINGTECH COMM
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The algorithm adopts this kind of objective function, which is easy to fall into

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adaptive dynamic cooperative particle swarm optimization method for feed-forward network
  • Adaptive dynamic cooperative particle swarm optimization method for feed-forward network
  • Adaptive dynamic cooperative particle swarm optimization method for feed-forward network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] In order to improve the network learning ability and recognition ability, the present invention designs an objective function that can realize the unity of network learning and recognition from the network structure, objective function and network optimization algorithm, and uses it as a "baton" to adopt a The improved particle swarm optimization algorithm realizes simultaneous optimization of network structure and weights, enabling the network to quickly summarize the internal laws of all samples from the learning samples, thereby improving the network's learning ability and recognition ability.

[0035] 1 Particle swarm optimization of feedforward network

[0036] 1.1 Basic PSO algorithm

[0037] Particle swarm algorithm is the particle to its own experience P i and group experience P g Continuous learning to achieve optimization in the solution space. Suppose the position of the i-th particle in the particle swarm in the d-dimensional space is x i =(x i1 , x i2 ,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an adaptive dynamic cooperative particle swarm optimization method for a feed-forward network. The method comprises the following steps of (1) initializing particles, and initializing sub-populations; (2) recording extreme values (pi) of particle individuals, an extreme value (pn) of each sub-population and a global extreme value (pg); (3) sorting the sub-populations according to the goodness of the extreme value (pn) of each sub-population, and determining the number of cooperative particles of the sub-populations; (4) enabling the particles in the sub-populations to learn from the extreme values (pi) of the particles and the extreme values (pn) of the sub-populations; (5) randomly selecting the cooperative particles from other sub-populations, enabling the cooperative particles to learn from the extreme values (pi) of the cooperative particles and the extreme values (pn) of the sub-populations, and updating the extreme values of the cooperative particles and social extreme values of the sub-populations to which the cooperative particles belong at any time according to the goodness of the particles; (6) updating particle information in sequence according to the steps (4 and 5), and randomly selecting at most two particles from a worse sub-population to enable the particles to become members of a better sub-population; (7) meeting all stopping conditions, stopping calculation, and otherwise, carrying out the step (2) for next iteration. By virtue of the method, the learning capacity and identification capacity of a network can be improved.

Description

technical field [0001] The present invention belongs to the field of pattern classification. This paper designs a dynamic adaptive cooperative particle swarm algorithm to optimize the feed-forward network, which has a wide range of applications in the fields of face recognition, smiley face recognition, and gender recognition. Background technique [0002] With its self-learning, self-organization, fault-tolerant characteristics and the ability to simulate nonlinear relationships, neural networks are particularly suitable for solving pattern classification problems. Hornik demonstrated that a three-layer feed-forward neural network can model complex nonlinear relationships with arbitrary precision [Ref. 1]. The realization of the above-mentioned performance of the neural network depends on the sufficient training of the neural network structure and weights under the guidance of a good objective function, so as to realize the law of the entire population in a limited learnin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/02G06K9/66G06K9/62
Inventor 李保印
Owner WINGTECH COMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products