A distributed persistent memory storage system and method

A storage system, persistent technology, applied in instrumentation, input/output to record carrier, computing, etc., can solve problems such as system bottlenecks

Active Publication Date: 2021-02-05
NANJING YUNCHUANG LARGE DATA TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problems to be solved by the present invention are as follows: first, the traditional cloud storage system usually adopts a table lookup method when locating the data storage location, which is likely to cause a system bottleneck; second, in order to support transactions, the traditional cloud storage system interface The log mechanism is introduced, that is, all write operations need to be written to the log first (in the log file system XFS mode), and then written to the local file system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed persistent memory storage system and method
  • A distributed persistent memory storage system and method
  • A distributed persistent memory storage system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention is described in further detail now in conjunction with accompanying drawing.

[0030] Aiming at the shortcomings of traditional cloud storage systems such as data write amplification, long IO paths, and insufficient support for high-performance hardware, the following proposals are proposed: figure 1 The shown distributed persistent memory storage system is composed of key / value database, operation abstraction interface, file system and the bottom block device. The key / value database stores write-ahead logs, data object metadata, addressable data information, and allocator metadata (the allocator is responsible for deciding where the real data should be stored). The operation abstract interface realizes the encapsulation of the underlying system for the key / value database. In order to connect to the operation abstract interface, a small file system is realized, and the allocation and management of metadata, file space and disk space are solved. D...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A distributed persistent memory storage system and method, based on persistent memory design, adopting a distributed storage method in which data is dispersedly stored on different nodes, and performing I / O operations on bare devices by directly managing bare disks. The relevant metadata is stored in the key / value database in the form of key / value, and the user's related operations on the key / value database are abstracted into corresponding interfaces, directly connected to a small file system, and all metadata are loaded. In the memory, the data and log files of the file system are saved to the raw device through the block device, so that the file system and the system can share the raw device, and can also specify different devices. The invention combines the distributed storage mode, abandons the local file system, further reduces the overhead of the file system, and fully utilizes the performance advantage of persistent memory.

Description

technical field [0001] The invention belongs to the field of cloud storage of distributed big data, and in particular relates to a distributed persistent memory storage system and method. Background technique [0002] In today's society, information data is growing explosively, and the explosive data growth has led to multiple problems such as slow data processing, and storage systems based on traditional storage technology have gradually been unable to meet the requirements of computer systems for performance and functionality. consumption needs. However, as the price of memory is getting lower and lower, the capacity of memory is getting larger and the reading and writing speed of memory is more than an order of magnitude higher than that of disk, it is necessary to develop a distributed persistent memory storage system to solve massive data processing and storage. Feasibility is provided. [0003] In traditional cloud storage systems, centralized storage nodes are usual...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0629G06F3/067
Inventor 刘鹏张真王昌淦章亮王义飞王小聪
Owner NANJING YUNCHUANG LARGE DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap