Supercharge Your Innovation With Domain-Expert AI Agents!

Embedding rings on a toroid computer network

A computerized, embedded technology used in the field of data exchange that resolves issues such as overlapping forward and backward link activities

Pending Publication Date: 2022-02-01
GRAPHCORE LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if the partial vector is large due to pipelining, the resulting leading data item will be returned to the start node before it finishes sending its partial data item, so all activity on the forward and backward links may there will be a lot of overlap

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Embedding rings on a toroid computer network
  • Embedding rings on a toroid computer network
  • Embedding rings on a toroid computer network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] Aspects of the invention were developed in the context of multi-tile processors designed as accelerators for machine learning workloads. The accelerator includes a plurality of interconnected processing nodes. Each processing node can be a single multi-tile chip, a package of multiple chips, or a rack of multiple packages. The goal of this paper is to design machines that are very efficient at deterministic (repeatable) computation. The processing nodes are interconnected in a manner that enables efficient implementation of aggregates (particularly but not limited to broadcast and all-reduce).

[0080] One particular application is updating the model while training a neural network using distributed processing. In this context, distributed processing utilizes multiple processing nodes that are in different physical entities, such as chips or packages or racks. That is, processing data transfer between nodes requires exchanging messages over physical links.

[0081] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A computer comprising a plurality of interconnected processing nodes arranged in a toroid configuration in which multiple layers of interconnected nodes are arranged along an axis; each layer comprising a plurality of processing nodes connected in a ring in a non axial plane by at least an intralayer respective set of links between each pair of neighbouring processing nodes, the links in each set adapted to operate simultaneously; wherein each of the processing nodes in each layer is connected to a respective corresponding node in each adjacent layer by an interlayer link to form respective rings along the axis; the computer programmed to provide a plurality of embedded one-dimensional logical paths and to transmit data around each of the embedded one-dimensional paths in such a manner that the plurality of embedded one- dimensional logical paths operate simultaneously, each logical path using all processing nodes of the computer in a sequence.

Description

technical field [0001] The present disclosure relates to data exchange between processing nodes connected in computers, particularly but not limited to optimizing data exchange in machine learning / artificial intelligence applications. Background technique [0002] Collectives are routines commonly used in computers when working with data. They are routines that enable data to be shared and processed across multiple different processes, which can run on the same processing node or on different processing nodes. For example, if a process reads data from a data store, it can use a "broadcast" process to share that data with other processes. Another example is when the result of a particular function is needed on multiple processes. A "reduction" is the result of requiring a computational function to be applied to data values ​​from each of multiple processes. Gather and Scatter collections process more than one data item. Certain collections are becoming more and more impor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F13/38G06N20/00
CPCG06F15/173G06F15/80G06F15/17381G06F15/17318G06F15/17387G06F15/17375G06F13/4068
Inventor S.诺尔斯
Owner GRAPHCORE LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com