Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed storage system and method for persistent memory

A storage system, persistent technology, applied in instruments, electrical digital data processing, input/output to record carriers, etc., can solve problems such as system bottlenecks, and achieve the effect of improving overall performance efficiency

Active Publication Date: 2018-04-27
NANJING YUNCHUANG LARGE DATA TECH CO LTD
View PDF6 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problems to be solved by the present invention are as follows: first, the traditional cloud storage system usually adopts a table lookup method when locating the data storage location, which is likely to cause a system bottleneck; second, in order to support transactions, the traditional cloud storage system interface The log mechanism is introduced, that is, all write operations need to be written to the log first (in the log file system XFS mode), and then written to the local file system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system and method for persistent memory
  • Distributed storage system and method for persistent memory
  • Distributed storage system and method for persistent memory

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention is described in further detail now in conjunction with accompanying drawing.

[0030] Aiming at the shortcomings of traditional cloud storage systems such as data write amplification, long IO paths, and insufficient support for high-performance hardware, the following proposals are proposed: figure 1 The shown distributed persistent memory storage system is composed of key / value database, operation abstraction interface, file system and the bottom block device. The key / value database stores write-ahead logs, data object metadata, addressable data information, and allocator metadata (the allocator is responsible for deciding where the real data should be stored). The operation abstract interface realizes the encapsulation of the underlying system for the key / value database. In order to connect to the operation abstract interface, a small file system is realized, and the allocation and management of metadata, file space and disk space are solved. D...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed storage system and method for a persistent memory. Based on the design of the persistent memory, the distributed storage method that data is stored at different nodes in a scattered mode is adopted, I / O operation is conducted on a raw device in the mode of directly managing a raw disk, associated metadata is stored in a key / value database in a key / value form, the associated operation of a user on the key / value database is abstracted into a corresponding interface to be directly docked with a small file system, all the metadata is uploaded into the memory, and data and log files of a file system are stored on the raw device through a block device so that the file system and this system can share the raw device, and different devices can also be assignedto the file system and this system respectively. According to the distributed storage system and method, a distributed storage mode is combined, a local file system is abandoned, the file system overhead is further reduced, and the performance advantages of the persistent memory are fully developed.

Description

technical field [0001] The invention belongs to the field of cloud storage of distributed big data, and in particular relates to a distributed persistent memory storage system and method. Background technique [0002] In today's society, information data is growing explosively, and the explosive data growth has led to multiple problems such as slow data processing, and storage systems based on traditional storage technology have gradually been unable to meet the requirements of computer systems for performance and functionality. consumption needs. However, as the price of memory is getting lower and lower, the capacity of memory is getting larger and the reading and writing speed of memory is more than an order of magnitude higher than that of disk, it is necessary to develop a distributed persistent memory storage system to solve massive data processing and storage. Feasibility is provided. [0003] In traditional cloud storage systems, centralized storage nodes are usual...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0629G06F3/067
Inventor 刘鹏张真王昌淦章亮王义飞王小聪
Owner NANJING YUNCHUANG LARGE DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com