Dynamic multi-channel neural network SOC (system on a chip) and channel resource distribution method thereof

Abstract

The invention provides a dynamic multi-channel neural network SOC (system on a chip) and a channel resource distribution method thereof. A dynamic distribution channel resource circuit is arranged additionally. The circuit comprises source counting units, a DDR (double data rate) visit grouping unit, a group configuration and storage unit, a DDR visit channel matrix unit, a terminal counting unitand a plurality of DDR channels. During working of the dynamic distribution channel resource circuit, each source counting unit counts data flow of each neural network layer and sends the data flow tothe DDR visit grouping unit. The DDR visit grouping unit judges input data size of each neural network layer and data sizes of the DDR channels, and adjusts connection relations among the DDR channels according to the data sizes to form new DDR channel using and grouping relations. The DDR visit channel matrix unit groups and connects data source channels and the DDR channels, so that dynamic channel resource distribution is realized, and the bandwidth problem of an artificial intelligent chip is solved effectively.

Description

technical field [0001] The invention relates to an artificial intelligence device, in particular to a neural network SOC chip and a channel resource allocation method thereof. Background technique [0002] With the rapid development of artificial intelligence technology, people have higher and higher performance requirements for artificial intelligence equipment. However, a major obstacle to the rapid development of deep learning neural network equipment is that the structure and operation of neural networks require a large amount of data movement. For example, data reading of neurons, weights, thresholds, and convolution kernels, intermediate calculation results of each layer of neural networks, error calculation and write-back during feedback training, and the final result caused the storage structure of the existing SOC chip to be overwhelmed. Memory bandwidth can easily become a performance bottleneck for deep learning neural networks. [0003] Therefore, the present i...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a dynamic multi-channel neural network SOC chip and its channel resource allocation method, through multiple groups of independent DDR channels, dynamically allocate channel resources, so that the bandwidth problem of the artificial intelligence chip is effectively solved solve

Images