OSD data distribution method and device of a distributed file system

Abstract

The invention discloses a method and a device for distributing OSD (object-based storage devices) data of distributed file systems and a computer readable storage medium. The method includes reading the first OSD data by the aid of a Socket communication layer, then transmitting the first OSD data to first virtual layer queues corresponding to the first OSD data and reading the second OSD data after the first OSD data are successfully transmitted; reading the first OSD data from the first virtual layer queues by the aid of first virtual layer threads and transmitting the first OSD data to first OSD. The first virtual layer queues are virtual layer queues corresponding to the first virtual layer threads where the first OSD corresponding to the first OSD data are located. The method, the device and the computer readable storage medium have the advantages that the processing speeds of the Socket communication layer can be increased owing to concurrent processing modes for virtual layers, accordingly, the concurrent processing capacity of the virtual layers can be improved, message processing bottleneck can be eliminated, and the processing capacity of the distributed file systems can be enhanced.

Description

technical field [0001] The invention relates to the field of distributed file systems, in particular to an OSD data distribution method, device and computer-readable storage medium of a distributed file system. Background technique [0002] With the development of science and technology in modern society, the application of distributed file system has been paid more and more attention by people. [0003] In the prior art, the OSD (Object-based Storage Device, Object Storage Device) in the distributed file system operates in a single process mode, and all OSDs on a node share a TCP (Transmission Control Protocol, Transmission Control Protocol) link, and its processing flow like figure 1 As shown, the Socket communication layer needs to return to read the next OSD data from the NIC (Network Interface Card, network card) after distributing one SOD data in the virtual layer. In this mode, although the number of links is reduced, a single link needs to be used to receive and se...

AI Technical Summary

Problems solved by technology

In this mode, although the number of links is reduced, a single link needs to be used to receive and send all OSD data. The virtual layer receives OSD data and distributes data, which is prone to performance bottlenecks, which makes OSD data read blocking and affects system performance.

Images