Supercharge Your Innovation With Domain-Expert AI Agents!

Key value pair storage system based on persistent memory and data concurrent insertion method

A storage system, key-value pair technology, applied in database indexing, database updating, climate sustainability, etc., to reduce conflict waiting overhead and improve performance

Active Publication Date: 2021-04-06
ZHEJIANG UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the performance problem caused by using the lock mechanism in the multi-threaded mode of the storage system, the present invention proposes a key-value pair storage system based on persistent memory and a data concurrent insertion method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Key value pair storage system based on persistent memory and data concurrent insertion method
  • Key value pair storage system based on persistent memory and data concurrent insertion method
  • Key value pair storage system based on persistent memory and data concurrent insertion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0023] figure 1 (a) represents the node structure of a conventional key-value pair storage system. As shown in the figure, a node consists of two parts, one part is a bitmap, and the other part is a key value pair array. The bitmap can identify whether the key-value pair at the corresponding position of the key-value pair array is valid; where 1 means that the key-value pair at the corresponding position is valid. figure 2 (a) is the operation process of the corresponding conventional lock mechanism. As shown in the figure, the operation process of the conventional lock mechanism is to lock, find the first bit position of 0 in the bitmap, and write the corresponding key-value pair and persist it. Update the bitmap and persist it, release the lock. The order of the two steps of writing key-value pairs and updating bitmap cannot be modified. I...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a key value pair storage system based on a persistent memory, each node in the system comprises a key value pair array and two bitmaps with the same initialization value, the bitmaps are respectively expressed as commitBM and shadowBM, and the shadowBM is used for inserting a thread to obtain a writing vacancy of the key value pair array; and the commitBM is used for updating the written key value pairs and keeping consistency. The invention also provides a corresponding data concurrent insertion method, which can solve the performance problem caused by using a lock mechanism by the key value under the multi-thread mode of the storage system. According to the scheme, the critical data is modified by adopting a lock-free technology CAS (compare and swap), and effective key value pairs are identified by using bitmaps, so that concurrent insertion operation under the lock-free condition is achieved, conflict waiting expenditure among threads is reduced, and the performance of the whole key value pair storage system is improved.

Description

technical field [0001] The invention relates to the technical field of computer science databases, in particular to a method for concurrently inserting data into a persistent memory-based key-value pair storage system. Background technique [0002] The emerging persistent memory (PM: persistent memory) has the characteristics of low latency, high capacity, and data will not be lost when power is turned off, which greatly improves the performance of the key-value pair storage system. In order to meet the ever-increasing business requirements, storage systems often need to expand from single-threaded mode to multi-threaded mode to support multiple client requests at the same time. For multiple insertion threads at the same time, the existing solution is to use the lock mechanism to achieve concurrency control. However, the lock mechanism manages critical resources by locking and unlocking. After a thread obtains the permission of a critical resource, other threads can only bl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/22
CPCG06F16/2308G06F16/2365G06F16/2237Y02D10/00
Inventor 何水兵李振鑫
Owner ZHEJIANG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com