Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for merging and sorting lsm data

A sorting method and data technology, applied in the computer field, can solve the problems of low utilization rate of storage space and inability to delete old versions in time, and achieve the effect of avoiding storage for a long time and improving utilization rate

Active Publication Date: 2018-09-28
HUAWEI TECH CO LTD +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, with the method in the prior art, the old version cannot be deleted in time for the same key value in the storage device, resulting in a low utilization rate of the storage space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for merging and sorting lsm data
  • Method and device for merging and sorting lsm data
  • Method and device for merging and sorting lsm data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] LSM usually has 7 levels, such as figure 1 as shown, figure 1 It is a schematic diagram of the LSM storage structure of the present invention, and each level is marked as Li from top to bottom, wherein, 0≤i≤6, the storage space size of each level from level 0 to level 6 shows an increasing trend, that is, The storage space of level 0 is the smallest, and the storage space of level 6 is the largest; usually, level 0 is set in memory, which is also the f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention provide an LSM (Log Structured Merge) data compact method and device. A compact operation is carried out on a pair of SSTables (Sorted String Table) with highest similarity of key words in adjacent stages through utilizing similarity of the SSTables between the adjacent stages; the most same key values exist in the pair of SSTables with the highest similarity of the key values, namely the most old versions of the key values exist, so that the SSTables carrying out the compact operation are determined according to the similarity of the key values, the key values of the old versions can be deleted in an earliest and most manner, and the key values of the old version can be prevented from storing in a storage device for a long time to occupy the storage space, and thus the utilization rate of the storage space is improved.

Description

technical field [0001] Embodiments of the present invention relate to computer technology, and in particular to a log structured merge (Log Structured Merge, hereinafter referred to as: LSM) data merging and sorting method and device. Background technique [0002] LSM is a data structure with ordered non-local updates. It is often used in the data structure of big data merge and sort. It is mainly used in frequently updated data indexes. Frequent data updates mean that there are a large number of key values ​​(key / value) in the storage device. Two or more versions exist. [0003] Usually, LSM has 7 levels (level). In the prior art, when the data size of a certain level exceeds a preset threshold, the sorted string table (Sorted String Table) in a certain key range (key Range) in the level is sorted. , hereinafter referred to as: SSTable) performs a merge sort (compact) operation with SSTables in the same key range in the next level, thereby realizing compression and sorting...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 岳银亮张子刚潘锋烽刘扬宽
Owner HUAWEI TECH CO LTD