A computing cluster and a computing cluster configuration method

A computing cluster and computing module technology, applied in the computer field, can solve problems such as insufficient memory and computing resources

Active Publication Date: 2019-05-10
上海燧原智能科技有限公司 +1
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the memory and computing resources that a single computer can provide are far from enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A computing cluster and a computing cluster configuration method
  • A computing cluster and a computing cluster configuration method
  • A computing cluster and a computing cluster configuration method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The embodiment of the present invention discloses a computing cluster to provide a solution for training a deep neural network.

[0038] The topological structure of the above computing cluster corresponds to the topological structure of the deep neural network to be trained, so as to form different topological structures according to the application requirements of deep learning.

[0039] figure 1 The topological correspondence between computing clusters and deep neural networks is shown.

[0040] The number of single-layer networks A contained in the deep neural network to be trained is N (N is a natural number). Wherein, each single-layer network A includes multiple functional nodes a.

[0041] The computing cluster includes: a sub-computing cluster C corresponding one-to-one to the above-mentioned N-layer single-layer network.

[0042] For the convenience of naming, any single-layer network A can be expressed as the i-th layer network (A i ), i is less than or e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a computing cluster for training a deep neural network and a computing cluster configuration method. Wherein the number of the single-layer networks contained in the deep neuralnetwork to be trained is N, and N is a natural number; wherein each single-layer network comprises a plurality of function nodes; wherein any one single-layer network is represented as the ith layerof network; I is less than or equal to N; wherein the computing cluster comprises sub-computing clusters in one-to-one correspondence with the N layers of single-layer networks; wherein the sub-computing cluster corresponding to the i layer of single-layer network is the i sub-computing cluster; wherein the computing nodes in the i sub-computing cluster are in one-to-one correspondence with the functional nodes in the i layer of single-layer network; the computing node comprises at least one basic computing module; wherein each basic computing module comprises m acceleration cards which are in point-to-point full interconnection, and each acceleration card comprises n artificial intelligence chips which are in point-to-point full interconnection; M is a naturalnumber not less than 2; wherein n is a natural number; and any basic computing module and the adjacent basic computing module are interconnected through chip-level point-to-point connection.

Description

technical field [0001] The invention relates to the field of computers, in particular to a computing cluster and a configuration method for the computing cluster. Background technique [0002] Deep neural networks are a popular topic in the field of machine learning in recent years and have achieved advanced results on many tasks. [0003] Deep neural networks need to be trained before they can be put to use. Training a neural network model requires a lot of memory and computing resources. Therefore, the memory and computing resources that a single computer can provide are far from enough. Contents of the invention [0004] In view of this, the present invention provides a computing cluster and a computing cluster configuration method for training a deep neural network. [0005] In order to achieve the above-mentioned purpose of the invention, the present invention provides the following technical solutions: [0006] A computing cluster for training deep neural network...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F15/177G06N3/04G06N3/08H04L29/08
Inventor 江斌刘彦李翔胡维
Owner 上海燧原智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap