Remote non-volatile memory access and management method oriented to key value storage

Abstract

The invention relates to a remote non-volatile memory access and management method oriented to key value storage. The method comprises the steps that a non-volatile memory caching zone is set in a key value storage system and is registered in a network card capable of supporting a remote and direct memory accessing technology; the non-volatile memory caching zone is divided into two parts, namely sparse zones and compact zones, memory blocks in the sparse zones are mainly used for receiving data of a remote client-side, different memory blocks are allocated each time for remote data writing, the memory blocks in each sparse zone only belong to one key value pair, the memory blocks in the compact zone are main caching zones of the key value pair, and each memory block includes multiple key value pairs serving the reading requirement of the client-side; the client-side compresses the key value pairs in the multiple allocated memory blocks of the sparse zone to the memory blocks of one or more compact zones through a compressor at certain time intervals; when the number of usable memory blocks of the compact zones is insufficient, the data is replaced to a data storage zone. The fixed-point writing abrasion problem of a remote non-volatile memory can be solved, and the remote reading-writing performance can be improved.

Description

technical field [0001] The invention relates to a remote non-volatile memory access and management method, in particular to a key-value storage-oriented remote non-volatile memory access and management method. Background technique [0002] In the big data environment, it is necessary to face the storage requirements of massive data. On the one hand, higher requirements are put forward for the scalability of the application system, while the NoSQL system based on the key-value storage architecture uses independent key-value pairs as the basic unit for data storage, which reduces the correlation between data and has a good Scalability; on the other hand, computer storage systems based on traditional memory and external memory architectures are faced with the challenge of massive data processing performance; new storage devices, such as PCM (phase-change random access memory), 3D Xpoint, non-volatile memory with external memory characteristics such as performance, high integra...

AI Technical Summary

Problems solved by technology

[0003] However, while NVM has the advantages of internal memory and external storage, NVM also has problems such as read-write imbalance and write wear. Because RDMA technology can make remote non-volatile memory directly accessible to clients, and RDMA The mapping between the accessed virtual address and physical address is fixed, which accelerates NVM write loss. Therefore, how to design the access method and management mechanism of NVM has become a new challenge

Images