A data transmission method and device for a distributed storage system

A technology of data transmission method and data transmission device, which is applied in the direction of transmission system, digital transmission system, data exchange network, etc., and can solve problems such as inability to fully utilize high-efficiency network resources

Active Publication Date: 2020-07-07
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the rapid development of Internet technology, in the IB network (Infiniband, high-speed Internet) commonly used in distributed storage systems and 40G Ethernet, since nodes between existing distributed storage systems often use a single connection mechanism, data The transmission occupies less network bandwidth under the single connection mechanism and cannot fully utilize efficient network resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data transmission method and device for a distributed storage system
  • A data transmission method and device for a distributed storage system
  • A data transmission method and device for a distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0040] The terms "first", "second", "third" and "fourth" in the specification and claims of this application and the above drawings are used to distinguish different objects, rather than to describe a specific order . Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device compris...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data transmission method and a device of a distributed storage system. The number of connections amonde nodes is calculated according to the bandwidth upper limit of network equipment in advance. The connections of the above number are established among the nodes of the distributed storage system. Meanwhile, a sending queue of a data request and a response queue of the data request are established for each connection. According to the ID values of files / objects in the data request of a sending end, each file / object is placed in the sending queues of different connections in a polling mode, so that the concurrent sending of files / objects is carried out. Meanwhile, the corresponding information of the connections of the files / objects is recorded. When a receiving end processes the data request according to the service logic, the responding information of each file or object in the data request is placed in corresponding response queues according to the corresponding information. Meanwhile, a feedback is concurrently sent to the sending end. Therefore, high-speed network bandwidth resources are fully and effectively utilized, and the service throughput is improved. The request processing time delay is reduced, and the overall performance of the distributed storage system is improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of distributed storage, and in particular, to a data transmission method and device for a distributed storage system. Background technique [0002] With the rapid development of Internet technology, in the IB network (Infiniband, high-speed Internet) commonly used in distributed storage systems and 40G Ethernet, since nodes between existing distributed storage systems often use a single connection mechanism, data The transmission occupies less network bandwidth under the single connection mechanism and cannot fully utilize efficient network resources. [0003] However, more and more high-performance scenarios need to improve system performance under high-speed networks, and the data transmission of the storage system becomes the bottleneck. [0004] In view of this, how to make full use of high-speed network resources to improve system performance is an urgent problem to be solved by t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L12/803H04L12/863H04L12/24
CPCH04L41/0668H04L47/125H04L47/6225H04L67/1097
Inventor 孟祥瑞
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap