Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

SCM-based key-value log-type local storage method

A local storage and log technology, which is applied in multi-channel program devices, input/output to record carriers, resource allocation, etc., can solve problems such as write amplification, and achieve the effects of prolonging service life, improving read and write performance, and improving utilization

Active Publication Date: 2020-11-06
SHANGHAI JIAOTONG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

LSM-tree implements data merging operations through layering. This layering operation introduces the problem of write amplification, that is, when merging a table, multiple tables need to be read at the same time.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SCM-based key-value log-type local storage method
  • SCM-based key-value log-type local storage method
  • SCM-based key-value log-type local storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0027] The Key-Value log type local storage method based on SCM provided by the present invention comprises the following steps:

[0028] SCM memory division steps: the SCM memory is divided into fixed-size pages as the basic unit, and the pages are labeled 1, 2, 3.... Such as Figure 4As shown, the SCM memory is divided and partitioned according to function, that is, it is divided into five different logical partitions: super block area, checkpoint area, page management area, static hash table area, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an SCM (Storage Class Memory)-based Key-Value log-type local-storage method. The storage method comprises the following steps: an SCM dividing step, wherein partition dividing is carried out on an SCM according to functions, that is, the SCM is divided into five different logic partitions of a superblock area, a checkpoint area, a page management area, a static-hash-table area and a data storage area; a multilayer memory management step, wherein three layers of memory management modules are built, the memory is managed at different layers, and dynamic allocation and reclaimation of pages are realized; and a high-concurrency hash-table building step, wherein a static hash table is used to index key-value objects, and a dynamically allocated array is used to store hash-conflicting elements. According to the method realized in the invention, storage space is reasonably scheduled and allocated according to hardware characteristics of a heterogeneous memory medium, autilization rate of the storage medium is increased, service life of hardware is prolonged, and concurrency and data throughput of a hybrid key-value storage system are improved.

Description

technical field [0001] The invention relates to the field of local data storage management systems, in particular to an SCM-based Key-Value (key-value) log-type local storage method. Background technique [0002] The rise of new storage technologies and the emergence of different SCM (Storage Class Memory, storage class memory) devices have aroused people's attention and research on hybrid memory system architecture and management methods. SCM devices have the characteristics of non-volatility, fast reading and slow writing, low static power consumption and high dynamic power consumption, which are different from traditional memory. Many experts and scholars at home and abroad have also proposed various memory organization methods and optimization methods based on SCM devices. However, many organizational methods and optimization methods have their own limitations and scope of application. [0003] With the development of technologies such as cloud computing and the Intern...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F9/50
Inventor 黄林鹏朱燕民沈艳艳王振杰
Owner SHANGHAI JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com