Unlock instant, AI-driven research and patent intelligence for your innovation.

Ceph storage osd read equalization method and ceph storage osd read equalization system

A balancing method and storage module technology, applied in instruments, electrical digital data processing, input/output to record carriers, etc., can solve the problems of slowing down client response and increasing the load of primary copy, so as to improve reading efficiency and reduce Response time, the effect of reducing resource reading pressure

Active Publication Date: 2021-02-09
GUANGDONG EFLYCLOUD COMPUTING CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since data reading and writing all fall on the master copy, when disk io operations are frequent, disk io is a relatively time-consuming operation, which will inevitably increase the load on the master copy and slow down the response of the client. This is the existing technology. The problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ceph storage osd read equalization method and ceph storage osd read equalization system
  • Ceph storage osd read equalization method and ceph storage osd read equalization system
  • Ceph storage osd read equalization method and ceph storage osd read equalization system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] In the prior art, such as figure 1 As shown, it can be seen that for each storage unit, the read and write requests are processed by the master copy osd0, and the slave copy osd1 and slave copy osd2 only process the write request synchronization; if the read requests are frequent during this period, the master copy will be greatly increased. The load increases the response time of the request, and the request cannot be dequeued quickly, causing the queue request to reach the threshold and reject the request, which affects the user experience.

[0034] According to the shortcoming of prior art, the present invention improves, as figure 2 As shown, the present invention puts the request of reading and writing into the read-write request queue. When a read data request is found, the object objectA to be read is analyzed, and then the entire read-write request queue is checked to see if there is any writing to the object objectA. Request, if not, the request to read objec...

Embodiment 2

[0051] This embodiment provides a ceph storage osd read balance system on the basis of implementation 1, which can implement the ceph storage osd read balance method.

[0052] Such as Figure 4 As shown, a ceph storage osd read balancing system includes a client, a ceph storage module, and several storage units, and the storage unit includes a read-write request queue module, a master copy storage module, a first slave copy storage module, and a second slave Copy storage module; for example, the storage unit includes storage unit A, storage unit B, storage unit C...storage unit N;

[0053] The client is used to send the data written by the user to the ceph storage module;

[0054] The ceph storage module is used to divide the data written by the user into several data blocks, and send each data block to the read and write request queue module of the corresponding storage unit;

[0055] The read-write request queue module is used to write data blocks into the primary copy sto...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a ceph storage osd read equalization method and a ceph storage osd read equalization system. The method comprises the following steps of: equally dividing data into a pluralityof data blocks and sending the data blocks to a read-write request queue module; writing the data blocks into a master copy storage module, and synchronously writing the data blocks into a first slave copy storage module and a second slave copy storage module by the master copy storage module; when data needs to be read, judging whether writing operation needs to be carried out on the object datablock or not when the object data block is read; and if a read-write request queue module contains the write operation of the corresponding data block, completing the read operation by the master copy storage module, otherwise, distributing the read operation of the data block to the first slave copy storage module or the second slave copy storage module to read the object data block, and sendingthe read object data block to a ceph storage module. According to the method, the read requests are uniformly distributed to all the slave copies for processing through an algorithm, so that the pressure of the master copy is reduced, and the response time of data reading is shortened.

Description

technical field [0001] The invention relates to the technical field of ceph storage, in particular to a ceph storage osd read balancing method and system thereof. Background technique [0002] Ceph is an open source distributed storage system that provides block services, file system services, and object storage services, and is widely used in the market. [0003] The data of the ceph distributed storage system is stored by different disks distributed in different hosts, and each disk is processed by a daemon process named osd to process data read and write requests. Ceph uses object to represent a piece of data, and object belongs to a pg. By default, pg uses 3 copies to achieve data reliability. 3 copies correspond to 3 osds, that is, 1 object has copies on 3 osds, and 3 osds are divided into 1 master replica and 2 slave replicas. [0004] In order to ensure data consistency, ceph assumes that data reads and writes are initiated by the master copy by default, and the sla...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/064G06F3/0659G06F3/067
Inventor 吴日明闵宇史伟
Owner GUANGDONG EFLYCLOUD COMPUTING CO LTD