A convolution neural network-on-chip learning system based on nonvolatile memory

A technology of convolutional neural network and non-volatile memory, which is applied in the field of artificial neural network, can solve the problems that cannot be solved flexibly in real time, the separation of calculation and storage is time-consuming and low-speed, and the cost of large hardware, etc., to achieve the realization of information storage and calculation Integration, realization of real-time and low energy consumption simulation, and the effect of reducing energy consumption during operation

Active Publication Date: 2019-03-12
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the defects of the prior art, the purpose of the present invention is to solve the von Neumann bottleneck encountered by the existing computer to realize the convolutional neural network. The separation of calculation and storage is quite time-consuming and low-speed, and will lead to huge hardware costs. At the same time The off-chip learning realized by computer can only realize the specific functions of the pre-training, and cannot solve the technical problems flexibly in real time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A convolution neural network-on-chip learning system based on nonvolatile memory
  • A convolution neural network-on-chip learning system based on nonvolatile memory
  • A convolution neural network-on-chip learning system based on nonvolatile memory

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0041] The on-chip learning of convolutional neural network can not only overcome the influence of device variability, but also more in line with biological learning characteristics, and can also modify the weight according to the tasks to be performed, which has good flexibility. Therefore, it is necessary to realize the hardwareization of convolutional neural networks, the integration of stora...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a convolution neural network on-chip learning system based on non-volatile memory, comprising an input module, a convolution neural network module, an output module and a weight update module. The on-chip learning of the convolution neural network module utilizes the characteristic that the conductance of the memristor changes with the applied pulse to realize the synapticfunction, and the convolution kernel value or the synaptic weight value is stored in the memristor unit. The input module converts the input signal into the voltage signal required by the convolutional neural network module. The convolutional neural network module transforms the input voltage signal layer by layer and transmits the result to the output module to get the output of the network. Theweight updating module adjusts the conductance value of the memristor in the convolutional neural network module according to the result of the output module, and updates the convolution core value orsynaptic weight value of the network. The invention aims at realizing the on-chip learning of the convolution neural network, realizing the on-line processing of the data, and realizing the requirements of high speed, low power consumption and low hardware cost based on the high parallelism of the network.

Description

technical field [0001] The present invention relates to the technical field of artificial neural network, and more specifically, relates to a convolutional neural network on-chip learning system based on a non-volatile memory. Background technique [0002] The artificial neural network is a structure similar to the synaptic connection of the brain. It is an algorithmic mathematical model that imitates the behavioral characteristics of the animal neural network and performs information processing on a distributed parallel information processing model. Among many machine learning algorithms, neural networks have wide applicability and strong robustness. This kind of network depends on the complexity of the system, and achieves the purpose of processing information by adjusting the interconnection relationship between a large number of internal nodes. [0003] As one of the most important algorithms of deep learning, convolutional neural network has great advantages in large-s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/063
CPCG06N3/063G06N3/084G06N3/049G06N3/065G06N3/048G06N3/045G06F17/153G06N3/04G06N3/08
Inventor 缪向水潘文谦李祎
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products