Design method of separate-storage type key-value storage system

A storage system and design method technology, applied in the direction of program control devices, etc., can solve problems such as affecting read performance and large read disk overhead, and achieve the effect of simple code modification, convenient transplantation, and improved read performance

Inactive Publication Date: 2014-02-05
BEIHANG UNIV
View PDF2 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the reading order of the record is close to the writing order, it wi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Design method of separate-storage type key-value storage system
  • Design method of separate-storage type key-value storage system
  • Design method of separate-storage type key-value storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The technical solution of the present invention will be described in detail below with reference to the drawings and embodiments.

[0021] For the convenience of description, the A system is used to represent key-value storage systems such as Leveldb, Hbase, and Cassandra. In the present invention, the key and value are stored separately, and the value is stored in a separate file. The original A system stores the offset and length information of the key value and value, so that the value maintains the writing order. In this way, when the read sequence is consistent with the write sequence, the read speed is greatly improved. The premise of the present invention is that the length of value is more than 200B.

[0022] combine figure 2 , introducing the key-value storage system design method of the present invention from bottom to top.

[0023] The first step is to implement the file writing and reading functions of value.

[0024] Step 1.1, implement value writing. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a design method of a separate-storage type key-value storage system and relates to the technical field of storage system and program design. The method comprises constructing writing and reading functions of value in files and storing the value in a separate file according to a writing sequence; combining the offset of the value in the file and the length of the value into a 64-bit information field and base64-encoding the information field; writing key and the base64-encoded information field as a key-value pair in to an existing key-value storage system; reading the value in a memory mapping mode. The design method of the separate-storage type key-value storage system improves the prior art a little and can greatly improve the reading performance of the key-value storage system when a reading sequence is close to the writing sequence.

Description

technical field [0001] The invention relates to the technical field of storage system and program design, in particular to a design method of a key (key)-value (value) storage system. Background technique [0002] The underlying structure of key-value storage systems such as Leveldb, Hbase, and Cassandra is based on bigtable, and its storage structure is similar to figure 1 shown. These storage systems will store the key and value as a whole, that is, a record (record) into the system. During the writing process, the records will be sorted in the key value order, which disrupts the writing order of the records and presents a random distribution phenomenon on the disk. When the read order of records is close to the write order, it will bring a lot of read disk overhead, thus affecting the read performance. Contents of the invention [0003] In order to improve the reading performance of the current key-value storage system in some cases, the present invention provides a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/44
Inventor 王雷赵玉龙王宇
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap