Neural network training device and related products

A neural network training and neural network technology, applied in biological neural network models, neural learning methods, physical implementation, etc., can solve the problems of slow training speed and time-consuming, and achieve the goal of improving training speed and accuracy and saving training time Effect

Active Publication Date: 2019-07-09
CAMBRICON TECH CO LTD
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The operation of the existing neural network is based on the CPU (Central Processing Unit, central processing unit) or GPU (English: Graphics Processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network training device and related products
  • Neural network training device and related products
  • Neural network training device and related products

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] In order to enable those skilled in the art to better understand the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only It is a part of the embodiments of the present disclosure, but not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure.

[0034] In the device provided in the first aspect, the neural network chip includes a main processing circuit and a plurality of basic processing circuits; at least one of the main processing circuit or a plurality of basic processing circuits includes: a data type operation circuit; the data A type operation circuit for performing conversion between the first t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present disclosure provides a neural network training device and a related product, the training device comprises X neural network chips, the X neural network chips being connected to each other,the value range of X being an integer greater than or equal to 2; wherein Y neural network chips in the X neural network chips are used for receiving neural network training data and executing training operation to obtain Y weight gradients, and Y is smaller than or equal to X; wherein Z neural network chips in the X neural network chips are used for receiving the weight gradients sent by the Y neural network chips and integrating the Y weight gradients into the trained final weight gradient according to a pre-strategy, and Z is smaller than or equal to X. The technical scheme provided by theinvention has the advantages of high training speed and short time consumption.

Description

technical field [0001] The present disclosure relates to the field of neural networks, in particular to a neural network training device and related products. Background technique [0002] Artificial Neural Network (ANN) is a research hotspot in the field of artificial intelligence since the 1980s. It abstracts the human brain neuron network from the perspective of information processing, establishes a simple model, and forms different networks according to different connection methods. In engineering and academia, it is often referred to directly as a neural network or a neural network. A neural network is an operational model consisting of a large number of nodes (or neurons) connected to each other. [0003] The calculation of the existing neural network is based on CPU (Central Processing Unit, central processing unit) or GPU (English: Graphics Processing Unit, graphics processing unit) to realize the calculation of neural network, and the training speed of a single tr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06N3/063
CPCG06N3/063G06N3/08
Inventor 不公告发明人
Owner CAMBRICON TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products