Training device for memristor-based neural network and training method thereof

A technology of neural network and training method, which is applied in the direction of neural learning method, biological neural network model, neural architecture, etc., and can solve problems such as restricting development

Active Publication Date: 2018-05-08
TSINGHUA UNIV
View PDF5 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the continuous strengthening of neural network capabilities, the demand for computing resources is also increasin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training device for memristor-based neural network and training method thereof
  • Training device for memristor-based neural network and training method thereof
  • Training device for memristor-based neural network and training method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present disclosure. Apparently, the described embodiments are some of the embodiments of the present disclosure, not all of them. Based on the described embodiments of the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative effort fall within the protection scope of the present disclosure.

[0032] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those skilled in the art to which the present disclosure belongs. "First", "second" and similar words used in the present disclosure do not indicate any order, quantity or importan...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a training device for a memristor-based neural network and a training method thereof. The neural network comprises N neuron layers which are connected one by one. The trainingmethod comprises the following steps of: inputting input data into a first neuron layer of the neural network so as to output an output result of the neural network at the Nth neuron layer, and calculating an output error of the Nth neuron layer; and counter-propagating the output error of the Nth neuron layer in a layer-by-layer manner so as to correct weight parameters between the neuron layers;and in the layer-by-layer counter-propagation process, three-valuing an output error of the mth neuron layer, and reversely inputting a voltage signal corresponding to an output result of the three-valuing operation to the mth neuron layer so as to correct a weight parameter of the mth neuron layer, wherein N is an integer greater than or equal to 3, and m is an integer greater than 1 and smallerthan N. According to the training method, the calculation ability of the memristor-based neural network is improved.

Description

technical field [0001] Embodiments of the present disclosure relate to a memristor-based neural network training device and a training method thereof. Background technique [0002] With the rapid development of the field of artificial intelligence, neural networks have achieved remarkable results in many fields such as speech and image recognition. However, with the continuous strengthening of neural network capabilities, the demand for computing resources is also increasing, and the memory wall problem in the traditional Von Neumann architecture has become a bottleneck restricting its development. In this context, the brain-inspired computing architecture based on memristor arrays is considered to be one of the most promising technologies for next-generation computing chips due to its advantages of integrated storage and computing, low energy consumption, large-scale integration and parallel operation. Contents of the invention [0003] At least one embodiment of the pre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06N3/04G11C13/00
CPCG06N3/084G11C13/0002G06N3/045
Inventor 张清天吴华强姚鹏章文强高滨钱鹤
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products