Unlock instant, AI-driven research and patent intelligence for your innovation.

Data storage method and system based on improved LSM tree structure

An LSM tree and data storage technology, applied in structured data retrieval, database indexing, database updating, etc., can solve problems such as high tail delay, achieve the effects of reducing tail delay, improving hit rate, and improving read performance

Active Publication Date: 2021-11-26
SUN YAT SEN UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In practical applications, some keys are frequently updated or frequently read, which may result in a large number of invalid key-value pairs in the system, and if the frequently read key-value pairs are not in the cache, it will cost Multiple disk I / Os to read, resulting in high tail latency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and system based on improved LSM tree structure
  • Data storage method and system based on improved LSM tree structure
  • Data storage method and system based on improved LSM tree structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. For the step numbers in the following embodiments, it is only set for the convenience of illustration and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art sexual adjustment.

[0047] refer to figure 1 , the present invention provides a kind of data storage method based on improving LSM tree structure, and this method comprises the following steps:

[0048] In response to the user's operation of creating a database, the system creates an update table and sets a threshold according to the capacity specified by the user, and creates a hot data record table at the same time;

[0049] In response to the user inserting a key-value pair into the database, the system records the key-value pair in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data storage method and system based on an improved LSM tree structure, and the method comprises the steps: responding to the operation of creating a database by a user, and creating an update table and setting a threshold value by the system according to the capacity specified by the user; in response to the fact that the user inserts the key-value pairs into the database, recording the key-value pairs by the system into the Memtable, recording the keys into the update table, and if it is judged that the update table does not reach the preset threshold value, ending the insertion process; and when it is judged that the update expression reaches a preset threshold value, selecting the SStable meeting a preset condition to trigger a special compression operation. The system comprises a pre-creation module and a storage module. By using the method and the system, the read request tail delay of the LSM-Tree data storage system is reduced. The data storage method and system based on the improved LSM tree structure can be widely applied to the field of data storage.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a data storage method and system based on an improved LSM tree structure. Background technique [0002] LSM-Tree (Log-Structured-Merge Tree) is a log-structured merge tree, which is a hierarchical, ordered, disk-oriented data storage structure. In the traditional LSM-Tree-based data storage system, all key updates are completed by inserting a new key-value pair, and the old key-value pair remains in the system, becoming an invalid key-value pair, and does not identify frequent access The function of key-value pairs (that is, hot data). In practical applications, some keys are frequently updated or frequently read, which may result in a large number of invalid key-value pairs in the system, and if the frequently read key-value pairs are not in the cache, it will cost Multiple disk I / Os to read, resulting in high tail latency. Contents of the invention [0003] In order to solve th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/23G06F16/2455
CPCG06F16/2246G06F16/2282G06F16/2455G06F16/23
Inventor 林清音陈志广卢宇彤
Owner SUN YAT SEN UNIV