Method and device for compressing redundant information in fault-tolerant NVM persistence process

Abstract

The invention discloses a method and a device for compressing redundant information in a fault-tolerant NVM persistence process. The implementing steps of the invention include allocating a write set,an address queue and a plurality of value queues, and allocating a persistence log storage area in the NVM. Writing all persistent write operation information to the write collection during the transaction; Scaning the write set, adding the corresponding value queue according to the new and old comparison of the values, and adding the address queue according to the value queue in order; compressing The address information in the address queue so that the same part of a group of adjacent addresses is eliminated, and writing the compressed address information into the address record. Wirtting The lower X bits of the N-bit values of all elements in the individual value queues to the value record, thereby eliminating redundant information of the values. The invention can reduce the size of the persistent data, thereby reducing the persistent overhead of the transaction, achieving the purpose of improving the persistent transaction performance and prolonging the service life of the NVM.

Description

technical field [0001] The present invention relates to the field of computer persistent memory, in particular to a method and device for compressing redundant information in a fault-tolerant NVM persistent process, which is used to compress redundant information in persistent storage to improve the write performance and lifespan of persistent memory . Background technique [0002] In recent years, with the rapid development of the computer field, the processing capacity of the central processing unit CPU has been greatly improved, while the performance improvement of the storage system is relatively small. There is a huge performance gap between the traditional main memory-auxiliary memory structure. It has become the performance bottleneck of the computer system. [0003] On the one hand, in the traditional main memory-auxiliary memory system, the main memory (usually DRAM, Dynamic Random Access Memory, dynamic random access memory) usually has the characteristics of smal...

AI Technical Summary

Problems solved by technology

from figure 2 As can be seen in the above, no matter what kind of log mechanism, there is a certain overhead in persistence: two write operations (write to the log and write to the persistent heap) must be performed, and each write operation requires data update ( Flush) and operation synchronization (fence) are two time-consuming operations to ensure that the write persistence is completed, and the NVM write operation itself has a long delay

On the other hand, such log persistence only simply writes the address and value information into NVM, and does not deal with the redundancy of information locality during program execution.

Images