Data transmission method and device for computing cluster and storage medium

A data transmission method and computing cluster technology, applied in computing, transmission systems, memory systems, etc., can solve problems such as poor performance, inability to solve heterogeneous hardware communication problems, poor flexibility of cross-node data access, etc., to improve data transmission efficiency Effect

Active Publication Date: 2022-03-08
VIRTAI TECH BEIJING CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in related technologies, the direct memory data copy method requires the CPU to intervene in the processing of the network software stack, which brings additional performance overhead and poor performance; RDMA techn

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method and device for computing cluster and storage medium
  • Data transmission method and device for computing cluster and storage medium
  • Data transmission method and device for computing cluster and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0056] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0057] figure 1 It is a data transmission method for a computing cluster shown according to an exemplary embodiment, and is applied to a computing cluster including multiple nodes. The computing cluster can be used as a server, and the method includes:

[0058] S101. Perform unified addressing on the storage spaces of the storage media of the multiple nodes to obtain addressing information, where each address in the addressing information is mapped to a storage medium of any one of the multiple nodes A physical address of storage space.

[0059] In some possible implementation manners, in step S101, the storage space includes internal memory and / or video me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data transmission method and device for a computing cluster and a storage medium, and the method comprises the steps: carrying out the unified addressing of the storage space of the storage medium of a plurality of nodes, and obtaining the addressing information; constructing a cache space in the storage space of each node of the plurality of nodes; responding to a data access request initiated by an application program in any target node in the plurality of nodes, and determining demand data; determining a first node where the demand data is located and a target physical address according to the demand data; when the first node is not the target node, querying whether the demand data is hit in a local cache space of the target node according to the target physical address; and under the condition that the local cache space does not hit the demand data, transmitting the demand data in the first node to the local cache space of the target node, so that the application program obtains the demand data from the local cache space of the target node.

Description

technical field [0001] The present disclosure relates to the field of information transmission, and in particular, to a data transmission method, device and storage medium for computing clusters. Background technique [0002] At present, with the rapid development of computing hardware and high-speed networks, the construction of multi-node heterogeneous computing clusters has received extensive research and attention. However, despite the rapid development of network hardware and communication protocols, there is still a gap in bandwidth and delay between network transmission and local PCI bus transmission; how to improve cross-node data transmission capabilities and improve the overall computing performance of the cluster is the current cluster An important direction for performance optimization. [0003] In cross-node clusters, current network transmissions use a variety of methods to achieve and improve data transmission performance. However, in related technologies, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F12/0802G06F12/0862H04L67/568
CPCG06F12/0802G06F12/0862
Inventor 黄增士王鲲陈飞邹懋杨智佳
Owner VIRTAI TECH BEIJING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap