Data storage method, device and storage engine based on lsm Tree structure

A data storage and data storage technology, applied in the computer field, can solve problems such as reducing data processing efficiency and increasing data processing volume.

Active Publication Date: 2021-02-23
BEIJING QIHOO TECH CO LTD
View PDF16 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Of course, the storage file of the LSM Tree structure not only contains 3 storage levels, but there may be more levels. In this way, the data in each level needs to be replaced, which will inevitably greatly increase the data storage for larger data. The amount of processing, reducing the efficiency of data processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, device and storage engine based on lsm Tree structure
  • Data storage method, device and storage engine based on lsm Tree structure
  • Data storage method, device and storage engine based on lsm Tree structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0044] In order to solve the above technical problems, an embodiment of the present invention provides a data storage method based on an LSM Tree structure. figure 1 A schematic flowchart of a data storage method based on an LSM Tree structure according to an embodiment of the present invention is shown. see figure 1 , the method at least includes step S102 to step S106.

[0045] Step S102, process the received data to be stored,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data storage method, device and storage engine based on the LSM Tree structure, wherein the method includes processing the data to be stored in the computer memory, parsing out the key of the data to be stored and the value corresponding to the key . Store the value of the data to be stored, and obtain the storage address of the value of the data to be stored. Assign the obtained storage address to the key of the data to be stored, and write the assigned key into the LSM Tree structure. Therefore, by separately storing the key of the data to be stored and its corresponding value value, the LSM Tree structure does not directly store the value value of the data, but stores the key and the corresponding value value storage address for subsequent data processing. Merging can not only effectively reduce a large number of value processing processes, but also reduce disk IO.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data storage method, device and storage engine based on an LSM Tree structure. Background technique [0002] The traditional LSM Tree (Log Structure Merge Tree, log structure merge tree) can store data through leveldb (a very efficient kv database implemented by Google), rocksdb (embedded Key-value storage system), etc., and its advantage is through Convert random disk writes into sequential writes to achieve optimal write performance and build indexes quickly. Although the LSM Tree sequentially writes to the disk to effectively improve the write performance of the disk, such an operation is likely to cause a waste of space and bring additional disk space overhead. [0003] A common problem with using the LSM Tree structure is that it is easy to amplify the written data. The default amplification factor in Leveldb and Rocksdb is 10, and the write amplification factor is Leve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/185G06F16/13
CPCG06F16/13G06F16/185
Inventor 陈宗志
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap