Unlock instant, AI-driven research and patent intelligence for your innovation.

Read-write control method and system for distributed storage system

A distributed storage, read and write control technology, applied in the input/output process of data processing, instruments, input/output to record carrier, etc., can solve the problems of write amplification, read amplification, and reduce the service life of SSD, so as to reduce the The effect of small read amplification, reduced write amplification, and reduced occupied space

Active Publication Date: 2021-08-13
济南浪潮数据技术有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a distributed storage read and write control method and system, aiming at solving The problem of amplification and write amplification seriously reduces the service life of SSD

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Read-write control method and system for distributed storage system
  • Read-write control method and system for distributed storage system
  • Read-write control method and system for distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0060] The main technical problems of the embodiments of the present invention are as follows:

[0061] In the data reading and writing method of the existing distributed storage system, all metadata is written into the database of the distributed storage system in the form of kv (key-value, key-value pair), which will cause problems of read amplification and write amplification. Because when performing a read request on RockDB (an embeddable, persistent key-value storage database), it is necessary to perform a binary query on the disk space layer by layer, and multiple IO operations will be performed; in addition, Bluestore actually writes The incoming data will also be larger than the write request.

[0062] To solve the above problems, see figure 1 , figure 1 A frame diagram of a read-write control system of a d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a read-write control method and system of a distributed storage system, and the read-write control method of the distributed storage system comprises the steps: writing an SST file into a spare layer of a disk according to a layer writing sequence of the disk, the SST file comprising a key value; when the spare layer of the disk is full, combining and compressing the SST files with the same key value according to the corresponding relation between the key value and the disk storage space and a preset compression strategy; writing the merged and compressed SST file into the next spare layer of the disk according to the layer writing sequence; and when the SST file needs to be read, reading the SST file in the disk according to the corresponding relation between the key value and the disk storage space. According to the technical scheme, the problems of read amplification and write amplification caused by an existing disk read-write mode in the prior art and serious reduction of the service life of the SSD can be solved.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a method and system for reading and writing control of a distributed storage system. Background technique [0002] The underlying architecture of existing distributed storage systems mostly uses the new object storage engine Bluestore for storage management. Bulestore will write all metadata to RocksDB in the distributed storage system in the form of kv (key-value, key-value pair). [0003] RocksDB is a C++ database that stores kv data and supports atomic reads and writes. It has high flexibility in configuration, and RocksDB can run in various production environments. RocksDB is based on the LSM-Tree data structure, which can convert discrete random write requests into batch sequential write requests, thereby improving write performance. However, RocksDB also introduces problems such as read amplification and write amplification. Read amplification is because Rock...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/067G06F3/0608G06F3/062
Inventor 彭超峰侯斌
Owner 济南浪潮数据技术有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com