Check patentability & draft patents in minutes with Patsnap Eureka AI!

Network topology device and method based on central communication mode

A technology of network topology and communication mode, which is applied in the field of network topology devices based on the center communication mode, and can solve problems such as not being able to meet the communication requirements of the PS architecture, bandwidth performance bottlenecks, etc.

Pending Publication Date: 2021-01-12
HUAWEI TECH CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the PS architecture, the parameter server is used as a data aggregation node to process data from all workers, and its bandwidth can easily become a performance bottleneck. However, in most existing topologies, all server nodes are the same, which cannot satisfy the PS architecture. communication needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network topology device and method based on central communication mode
  • Network topology device and method based on central communication mode
  • Network topology device and method based on central communication mode

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Embodiments of the present application are described below with reference to the drawings in the embodiments of the present application.

[0026] First, several concepts that may be involved in this application are described:

[0027] (1) circuit switch, packet switch

[0028] The circuit switch directly builds a path between the input and output ports according to the communication requirements. Generally, there is no cache and no processing of data packets, which can realize flexible changes in topology. The packet switch stores and forwards data packets, and can buffer data packets.

[0029] (2) Bipartite graph / bipartite graph

[0030] Bipartite graph / bipartite graph is a special model in graph theory. Let G=(V,E) be an undirected graph, if the vertex V can be divided into two mutually disjoint subsets (A,B), and each edge (i, j) in the graph is associated with two Vertices i and j belong to these two different vertex sets respectively, then the graph G is said t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a network topology device and method based on a central communication mode. The network topology device comprises H modules, each module comprises P first-class nodes, R firstswitches, one second switch, M second-class nodes and a module control plane, and each first-class node is connected with the R first switches through R network cards; the M second type nodes are connected to the R first switches through the second switches; and the module control plane is used for controlling the topological structure of the network topology device according to the training taskinformation of the M second-class nodes. According to the invention, a flexible cluster topology structure which is based on circuit switching and meets the communication requirement of a parameter server architecture is constructed, and the large bandwidth requirement of the first type of nodes is met as much as possible.

Description

technical field [0001] The present application relates to the field of artificial intelligence (AI), in particular to a network topology device and method based on a central communication mode. Background technique [0002] With the advent of the era of big data, distributed machine learning came into being. Among them, data parallelism is a widely used distributed machine learning method. Its basic idea is to divide the data set into multiple data blocks, and each data block uses different computing nodes (workers) for parallel training. Synchronization of model parameters before starting the next iteration. Some training tasks require up to hundreds of thousands of iterations to achieve the desired convergence accuracy. [0003] The use of acceleration hardware such as graphics processing unit (GPU) and tensor processing unit (TPU) has greatly increased the number of samples processed per unit time in the distributed machine learning training process, but the number of sa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/24G06N20/00
CPCH04L41/12G06N20/00
Inventor 陈永献刘和洋郑合文韩磊
Owner HUAWEI TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com