Device used for executing forward operations of neural network of fully-connected layers and methods

A fully-connected layer, artificial neural network technology is applied in the field of devices that perform forward operations of fully-connected layer artificial neural networks, and can solve problems such as off-chip bandwidth performance bottlenecks and no multi-layer artificial neural network operations.

Active Publication Date: 2017-11-03
CAMBRICON TECH CO LTD
View PDF10 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the GPU is a device specially used to perform graphics and image calculations and scientific calculations, without special support for multi-layer artificial neural network operations, it still requires a lot of front-end decoding work to perform multi-layer artificial neural network oper

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Device used for executing forward operations of neural network of fully-connected layers and methods
  • Device used for executing forward operations of neural network of fully-connected layers and methods
  • Device used for executing forward operations of neural network of fully-connected layers and methods

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Other aspects, advantages and salient features of the present invention will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of the present invention when taken in conjunction with the accompanying drawings.

[0026] In the present invention, the terms "include" and "comprising" and their derivatives mean to include but not limit; the term "or" is inclusive, meaning and / or.

[0027] In this specification, the various embodiments described below to describe the principles of the present invention are illustrative only and should not be construed as limiting the scope of the invention in any way. The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the present invention as defined by the claims and their equivalents. The following description includes numerous specific details to aid in understanding, but these sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a device used for executing forward operations of fully-connected layers of an artificial neural network. The device includes an instruction storage unit, a controller unit, a data access unit, an interconnection module, a main operation module and a plurality of slave operation modules. One or more layers of forward operations of the fully-connected layers of the artificial neural network can be realized by using the device. For each layer, weighted summation is firstly carried out on an input neuron vector to calculate an intermediate result vector of the current layer, then bias is added to the intermediate result vector and activation are carried out to obtain an output neuron vector, and the output neuron vector is used as an input neuron vector of a next layer.

Description

technical field [0001] The present invention generally relates to artificial neural networks, and in particular to a device and method for performing forward operation of fully connected layer artificial neural networks. Background technique [0002] Multi-layer artificial neural networks are widely used in the fields of pattern recognition, image processing, function approximation, and optimization calculations. In recent years, multi-layer artificial networks have been favored by academic circles and researchers due to their high recognition accuracy and good parallelism. industry is getting more and more attention. The artificial neural network involves a variety of algorithms, among which the fully connected layer, as an important algorithm in the artificial neural network, is widely used in various artificial neural network models. [0003] One known method to support forward operation of the fully connected layers of a multi-layer artificial neural network is to use a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/30G06F9/38G06N3/063
CPCG06N3/063G06N3/08G06N3/045G06F13/28G06N3/084G06N5/01G06N3/048G06N3/02G06F9/3885G06F9/3001G06F9/30036G06F12/0875G06F2212/452G06N3/04
Inventor 刘少礼兰慧盈郭崎陈云霁陈天石
Owner CAMBRICON TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap