Implementation methods of neural network accelerator and neural network model

Abstract

The invention relates to a neural network data processing method, and particularly relates to implementation methods of a neural network accelerator and a neural network model. The implementation method of a neural network accelerator is characterized in that the neural network accelerator comprises a nonvolatile memory, and the nonvolatile memory comprises a data storage array prepared in a back-end manufacturing process; and in a front-end manufacturing process for preparing the data storage array, a neural network accelerator circuit is prepared on a silicon substrate under the data storage array. According to the implementation method of a neural network model, the neural network model comprises an input signal, a connection weight signal, a bias, an activation function, an operation function and an output signal, wherein the activation function and the operation function are implemented through the neural network accelerator circuit, and the input signal, the connection weight, the bias and the output signal are stored in the data storage array. As the neural network accelerator circuit is implemented directly under the data storage array, the data storage bandwidth is not restricted, and data is still not lost after power failure.

Description

technical field [0001] The invention relates to a data processing method of a neural network, in particular to a method for realizing a neural network accelerator. [0002] The invention relates to a method for realizing a model, in particular to a method for realizing a neural network model. Background technique [0003] Artificial Neural Network (ANN) is a research hotspot in the field of artificial intelligence since the 1980s. It abstracts the human brain neuron network from the perspective of information processing, establishes a simple model, and forms different networks according to different connection methods. In engineering and academia, it is often referred to simply as neural network or neural network. A neural network is an operational model consisting of a large number of nodes (or neurons) connected to each other, such as figure 1 Shown is a schematic diagram of a neuron, each node represents a specific output function, called the activation function; every...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the problem that the neural network accelerator is implemented by software but has poor flexibility, and the data storage bandwidth is limited by hardware implementation, and data is easily lost after power failure, the present invention provides a method for implementing a neural network accelerator and a neural network model

Images