Second-order hybrid construction method and system of complex-valued forward neural network

A technology of neural network and construction method, which is applied in the field of second-order hybrid construction method and system of complex-valued forward neural network, can solve the problems of slow convergence speed and falling into local minimum value, etc., so as to reduce the number of parameters and speed up the convergence. Speed, the effect of improving generalization performance

Pending Publication Date: 2020-11-17
SUZHOU UNIV
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the first-order complex-valued optimization algorithm has disadvantages such as slow convergence speed and easy to fall into local minimum.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Second-order hybrid construction method and system of complex-valued forward neural network
  • Second-order hybrid construction method and system of complex-valued forward neural network
  • Second-order hybrid construction method and system of complex-valued forward neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Such as figure 1 As shown, this embodiment provides a second-order hybrid construction method of a complex-valued feedforward neural network, including the following steps: Step S1: initialize the structure and parameters of the complex-valued neural network according to a given task; Step S2: use The complex-valued second-order hybrid optimization algorithm adjusts the parameters in the complex-valued neural network, and judges whether the construction termination condition is satisfied. If not, proceed to step S3, and if satisfied, proceed to step S4; step S3: verify the complex-valued neural network The generalization performance of the network, saving the number of current hidden layer neurons and all parameter values ​​of the complex-valued neural network, judging whether the addition criteria of the hidden layer neurons are met, and if so, using the complex-valued incremental construction mechanism , add a hidden layer neuron to the current model, calculate the ne...

Embodiment 2

[0098] Based on the same inventive concept, this embodiment provides a second-order hybrid construction system of a complex-valued feedforward neural network, and its problem-solving principle is similar to the second-order hybrid construction method of the complex-valued feedforward neural network. No longer.

[0099] This embodiment provides a second-order hybrid construction system of a complex-valued forward neural network, including:

[0100] The initialization module is used to initialize the structure and parameters of the complex-valued neural network according to a given task;

[0101] The training module is used to adjust the parameters in the complex-valued neural network by using the complex-valued second-order hybrid optimization algorithm to judge whether the construction termination condition is satisfied, if not satisfied, enter the verification update module, and if satisfied, then enter the fine-tuning module;

[0102] The verification update module is used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a second-order hybrid construction method and system for a complex-valued forward neural network. The second-order hybrid construction method comprises the following steps: initializing the structure and parameters of the complex-valued neural network according to a given task; adjusting parameters in the complex-valued neural network by using a complex-valued second-orderhybrid optimization algorithm, and judging whether a construction termination condition is met or not; verifying the generalization performance of the complex-valued neural network, storing the number of current hidden layer neurons and all parameter values of the complex-valued neural network, judging whether the adding standard of the hidden layer neurons is met or not, if yes, adding one hidden layer neuron to the current model by utilizing a complex-valued increment construction mechanism, and otherwise, adding one hidden layer neuron to the current model by utilizing a complex-valued increment construction mechanism; calculating a new hidden layer output matrix and an error function on the basis of current training, and returning to the previous step; if not, directly returning to the previous step; and further finely adjusting the parameters by using the complex-valued second-order hybrid optimization algorithm to obtain an optimal complex-valued neural network model. Accordingto the invention, the complex-valued neural network model with a reasonable structure can be constructed automatically.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence and pattern recognition, in particular to a second-order hybrid construction method and system of a complex-valued feedforward neural network. Background technique [0002] Artificial neural network has powerful self-learning, self-organization, self-adaptation and nonlinear function approximation capabilities, and can learn rules and knowledge from seemingly disordered massive data. In recent years, the research of real-valued neural network has achieved very fruitful results. However, in some engineering fields, it is often necessary to analyze and process complex signals. With its powerful computing power and good generalization performance, complex-valued neural network has received more and more attention, and has been widely used in various industrial fields, such as radar signal processing, medical image processing, channel State prediction, pattern recognition, etc. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/08G06N3/045
Inventor 黄鹤张书芳
Owner SUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products