Unlock instant, AI-driven research and patent intelligence for your innovation.

A ceph storage osd read equalization method and system thereof

A technology for storage modules and read requests, which is applied to instruments, input/output to record carriers, and calculations. It can solve problems such as slowing down client responses and increasing the load on the master copy, so as to improve reading efficiency, reduce response time, and The effect of reducing resource reading pressure

Active Publication Date: 2021-05-18
GUANGDONG EFLYCLOUD COMPUTING CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since data reading and writing all fall on the master copy, when disk io operations are frequent, disk io is a relatively time-consuming operation, which will inevitably increase the load on the master copy and slow down the response of the client. This is the existing technology. The problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A ceph storage osd read equalization method and system thereof
  • A ceph storage osd read equalization method and system thereof
  • A ceph storage osd read equalization method and system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] In the existing technology, such as figure 1 As shown, it can be seen that for each storage unit, the read and write requests are processed by the master copy osd0, and the slave copy osd1 and slave copy osd2 only process the write request synchronization; if the read requests are frequent during this period, the master copy will be greatly increased. The load increases the response time of the request, and the request cannot be dequeued quickly, causing the queue request to reach the threshold and reject the request, which affects the user experience.

[0034] According to the shortcoming of prior art, the present invention improves, as figure 2 As shown, the present invention puts the request of reading and writing into the read-write request queue. When a read data request is found, the object objectA to be read is analyzed, and then the entire read-write request queue is checked to see if there is any writing to the object objectA. Request, if not, the request to ...

Embodiment 2

[0051] This embodiment provides a ceph storage osd read balance system on the basis of implementation 1, which can implement the ceph storage osd read balance method.

[0052] Such as Figure 4 As shown, a ceph storage osd read balancing system includes a client, a ceph storage module, and several storage units, and the storage unit includes a read-write request queue module, a master copy storage module, a first slave copy storage module, and a second slave Copy storage module; for example, the storage unit includes storage unit A, storage unit B, storage unit C...storage unit N;

[0053] The client is used to send the data written by the user to the ceph storage module;

[0054] The ceph storage module is used to divide the data written by the user into several data blocks, and send each data block to the read and write request queue module of the corresponding storage unit;

[0055] The read-write request queue module is used to write data blocks into the primary copy sto...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a ceph storage osd read equalization method and a system thereof. The method steps include: dividing data into several data blocks and sending them to a read-write request queue module; writing the data blocks into a master copy storage module, and the master copy storage module will The data block is synchronously written into the first slave copy storage module and the second slave copy storage module; when data needs to be read, it is judged whether it is also necessary to write to the target data block when reading the target data block; The request queue module contains the write operation of the corresponding data block, and the read operation is completed by the master copy module, otherwise the data block read operation is distributed to the first slave copy storage module or the second slave copy storage module to read the object data block, And send the read object data block to the ceph storage module. The invention uses an algorithm to evenly distribute read requests to all slave copies for processing, thereby reducing the pressure on the master copy and reducing the response time for data reading.

Description

technical field [0001] The invention relates to the technical field of ceph storage, in particular to a ceph storage osd read balancing method and system thereof. Background technique [0002] Ceph is an open source distributed storage system that provides block services, file system services, and object storage services, and is widely used in the market. [0003] The data of the ceph distributed storage system is stored by different disks distributed in different hosts, and each disk is processed by a daemon process named osd to process data read and write requests. Ceph uses object to represent a piece of data, and object belongs to a pg. By default, pg uses 3 copies to achieve data reliability. 3 copies correspond to 3 osds, that is, 1 object has copies on 3 osds, and 3 osds are divided into 1 master replica and 2 slave replicas. [0004] In order to ensure data consistency, ceph assumes that data reads and writes are initiated by the master copy by default, and the sla...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/064G06F3/0659G06F3/067
Inventor 吴日明闵宇史伟
Owner GUANGDONG EFLYCLOUD COMPUTING CO LTD