Configurable convolutional neural network processor circuit

A convolutional neural network and processor circuit technology, applied in biological neural network models, neural architectures, neural learning methods, etc., can solve problems such as being unable to meet portable devices, unable to keep up with the rapid development of artificial intelligence algorithms, and high power consumption

Active Publication Date: 2020-08-07
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF10 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the way the CPU implements the deep convolutional neural network cannot make good use of the parallelism characteristics of the convolutional neural network algorithm, so it cannot meet the low latency and low power consumption requirements required by most applications.
Although the convolutional neural network on the GPU can make good use of the parallelism of the convolutional neural network algorithm to achieve good performance, its high power consumption cannot meet the requirements of portable devices
Traditional ASIC (Application Specific Integrated Circuit, ASIC) special artificial intelligence calculation acceleration circuit, for a specific algorithm, realizes calculation through a dedicated circuit structure, but its configurability is poor, and it cannot keep up with the rapid development of artificial intelligence algorithms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Configurable convolutional neural network processor circuit
  • Configurable convolutional neural network processor circuit
  • Configurable convolutional neural network processor circuit

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] This embodiment proposes a configurable convolutional neural network processor circuit, such as figure 1 As shown, it includes a FIR filter module, a window processing module and a neural network operation module, wherein the neural network operation module includes a convolutional layer, a pooling layer, a configurable activation function layer and a fully connected layer, and the configurable Configure the activation function layer to configure the sigmoid function or tanh function, and also configure the error;

[0045] The sigmoid function or tanh function fitting formula configured by the configurable activation function layer is specifically obtained in the following manner:

[0046] pair input To divide different intervals, the error is required to be less than , the sigmoid function or tanh function is , the activation function is ;

[0047] First of all for , the fitting process of sigmoid function or tanh function is as follows:

[0048] when whe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a configurable convolutional neural network processor circuit, which comprises an FIR filtering module, a windowing processing module and a neural network operation module, wherein the neural network operation module comprises a convolution layer, a pooling layer, a configurable activation function layer and a full connection layer; and the configurable activation function layer comprises an absolute value setting module, an interval judgment module, a first multiplexer, a configuration module, an address generation module, an RAM, an interval expansion module and a second multiplexer. The configurable activation function layer is configured with a sigmoid function or a tanh function and errors, so that the universality and the flexibility of the processor are greatly improved; by combining hierarchical quantization and saturation truncation, the quantization standard of each layer of neural network is configurable, and the overflow risk is reduced; and an FIR filtering function is realized by multiplexing a multiply-accumulate-add operation unit of a full connection layer, and data is transmitted by adopting a two-stage data transmission mode, so that the power consumption is further reduced.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence, and in particular relates to a configurable convolutional neural network processor circuit. Background technique [0002] Artificial Intelligence (AI) is a strategic industry leading the future, and AI chips, as a key technical link in the entire field of artificial intelligence, are the foundation of my country's artificial intelligence industry and an important hurdle to achieve breakthroughs in artificial intelligence. As an important way to develop artificial intelligence, deep learning differs from traditional computing models in that it does not require large-scale logic programming, but requires massive parallel computing. New computing models and the strong demand for new computing in the era of artificial intelligence are giving birth to new Dedicated computing chips. The maturity of deep learning algorithms, the improvement of computing power and big data jointly promot...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/063G06N3/04G06N3/08
CPCG06N3/063G06N3/08G06N3/048G06N3/045
Inventor 周军周勇刘嘉豪刘青松
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products