Feedback type pulse neural network model training method for image data classification

A pulse neural network and image data technology, applied in biological neural network models, neural learning methods, neural architectures, etc., can solve problems such as a large number of time steps, and achieve small parameters, less time steps, and fewer neurons Effect

Pending Publication Date: 2021-09-28
PEKING UNIV
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, they simply assume that the activation function of neurons is linear, and th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Feedback type pulse neural network model training method for image data classification
  • Feedback type pulse neural network model training method for image data classification
  • Feedback type pulse neural network model training method for image data classification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0119] Below in conjunction with accompanying drawing, further describe the present invention through embodiment, but do not limit the scope of the present invention in any way.

[0120] The invention provides a feedback-type impulse neural network model training method for image data classification, by constructing a feedback-type impulse neural network, deriving the equilibrium state of the network, and using the implicit differential of the equilibrium state fixed point equation to carry out the model Training, the trained model can be used for visual tasks such as classification and recognition of computer image data and neuromorphic image visual data with high performance and energy efficiency. Include the following steps:

[0121] Step 1: the image data is divided into training samples and test samples, all data sets in this embodiment are MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100 and N-MNIST data sets, wherein MNIST and Fashion-MNIST data sets are It consists of 70,000...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a feedback type pulse neural network model training method for image data classification. The method comprises the following steps: constructing a feedback type pulse neural network model, and training the model through implicit differential in an equilibrium state, the model comprising two spiking neuron models based on an integration activation model IF and a leakage integration activation model LIF, and a feedback type spiking neural network model of a single-hidden-layer neural network structure and a feedback type spiking neural network model of a multi-hidden-layer neural network structure; using re-parameterization method to restrain the spectral norm of the feedback connection weight, and using an improved method to carry out batch normalization. According to the invention, the common problem of difficulty in training of a spiking neural network model can be avoided, the method is used for high-performance and efficient classification processing of computer image data and neuromorphic image visual data in an energy-saving manner, and higher classification accuracy can be obtained with fewer neurons, smaller parameters and shorter time steps.

Description

technical field [0001] The invention belongs to the technical fields of pattern recognition, machine learning, artificial intelligence, image processing and neuromorphic computing, and relates to a computer image data classification method and a neuromorphic image visual data classification method, in particular to an image and neuromorphic data classification method Feedback spiking neural network model training method. Background technique [0002] In recent years, spiking neural network (SNN) models have received increasing attention due to their computationally energy-efficient properties in the task of image data classification. Inspired by the real neurons in the human brain, the neurons of the biologically feasible SNN model transmit information by sending out pulse signals, thereby supporting event-based computing, which can pass fewer energy consumption to achieve. The SNN model can process computer image data, and can also efficiently process neuromorphic image v...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06N3/04G06K9/62
CPCG06N3/084G06N3/049G06N3/045G06F18/24Y02D10/00
Inventor 林宙辰肖命清孟庆晏张宗鹏王奕森
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap