Storage method for data in Key-Value system and related device

A key-value pair, data technology, applied in the computer field, can solve problems such as reducing the efficiency of Value data storage operations

Active Publication Date: 2014-11-12
HUAWEI TECH CO LTD +1
View PDF2 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing key-value pair storage system, the index data structure of the LSM-Tree described above is usually used, but in the existing LSM-Tree, a C i The tree (i is any value less than k) will bring the overhead of input and output (I/O, Input/Output) ports when updating the Value data. When the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Storage method for data in Key-Value system and related device
  • Storage method for data in Key-Value system and related device
  • Storage method for data in Key-Value system and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] Embodiments of the present invention provide a data storage method and a related device in a key-value pair system, which are used to store Value data with relatively small I / O port overhead and improve the efficiency of storage operations on Value data.

[0074] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0075] The terms "first", "second" and the like in the description and claims of the present invention and the above draw...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention discloses a storage method for data in a Key-Value system and a related device. By means of the method and the device, the storage operation efficiency of Value data can be improved. The method comprises steps as follows: whether the data volume of Value data in the Key-Value exceeds the threshold value of data is judged; if the data volume of Value data doesn't exceed the threshold value of data, the Value data is sliced, and M slice contents are obtained; slice information is generated for N slices according to the M slice contents and comprises the number of Value data slices, offset addresses of slice contents in the N slice contents, serial numbers ID of the slice contents in the N slice contents and (M-N) slice contents; and Key data and slice information are stored in an LSM-Tree (the log-structured merge-tree), the N slice contents are stored in a Key-Value database, and the Key data correspond to the slice contents.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data storage method and a related device in a key-value pair system. Background technique [0002] LSM-Tree (The Log-Structured Merge-Tree, a log-structured merge tree) is an index mechanism introduced for frequently updating Value (such as frequent insertion or deletion) in a key-value pair (K-V, Key-Value) storage system , can be applied to scenarios where the frequency of querying Value is much lower than the frequency of updating Value, such as history tables and log files. [0003] The implementation method of LSM-Tree is: save the update of the Value data in the memory, and write these updates to the disk in batches when the Value stored in the memory reaches the specified threshold. Such as Figure 1-a and Figure 1-b As shown, specifically, the LSM-Tree passes through two layers of ordered datasets (C 0 tree and C 1 tree) or a multi-level ordered dataset (C 0 tre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2219G06F16/2246
Inventor 潘锋烽张子刚熊劲岳银亮
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap