Key-value separated storage method and system

A technology that separates storage and nodes. It is applied in special data processing applications, structured data retrieval, database indexing, etc. It can solve problems affecting IO performance, improve read and write performance, reduce disk I/O consumption, and reduce IO throughput. volume effect

Pending Publication Date: 2022-03-04
上海沄熹科技有限公司
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] In the process of data migration, it is often necessary to compare key values, so the encoded and stored data needs to be pars

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Key-value separated storage method and system
  • Key-value separated storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0034] The Key-value separation storage method uses the ART prefix tree as the basic data structure of the data index, allocates space for the key value and value value in the node Node of each data for storage, and stores the corresponding SequenceNumber and ValueType realizes the separation of Key-value. At the same time, no encoding is performed in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention particularly relates to a Key-value separated storage method and a Key-value separated storage system. According to the Key-value separation storage method and system, an ART prefix tree is used as a basic data structure of a data index, spaces are distributed for a key value and a value value in a node Node of each piece of data for storage, corresponding Sequence Number and Value Type are stored in the node Node, separation of Key-value is achieved, coding is not carried out any more in the data storage process, the key, the Sequence Number, the Value Type and the value are directly stored and read, and the data storage efficiency is improved. And therefore, the IO throughput is reduced, the CPU cache hit rate is increased, and the read-write performance of the database is improved. According to the Key-value separated storage method and system, corresponding information does not need to be decoded during data read-write operation, and the information can be obtained by directly using the node Node, so that the I/O consumption of a disk is reduced, the IO throughput is reduced, the CPU cache hit rate is increased, and the read-write performance of a database is improved.

Description

technical field [0001] The invention relates to the technical field of data storage management, in particular to a Key-value separate storage method and system. Background technique [0002] In the current network environment, information flows rapidly, which involves the input and output of a large number of documents, pictures, voice, video, etc., and the majority of user groups have put forward higher requirements for the performance of information writing and query. [0003] The RocksDB database is an LSM-tree architecture engine developed based on LevelDB that provides Key-value (key-value) storage and read and write functions. It has the following characteristics: [0004] 1) High efficiency [0005] RocksDB uses a log-structured database engine, written entirely in C++ for maximum performance. Keys and values ​​are just streams of bytes of arbitrary size. [0006] 2) Optimized for fast storage [0007] RocksDB is optimized for fast, low-latency storage such as fla...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22
CPCG06F16/2246G06F16/2282
Inventor 李刘鹏
Owner 上海沄熹科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap