A log management method for a distributed persistent memory transaction system

Abstract

The present invention relates to the technical field of persistent memory storage, in particular to a log management method of a distributed persistent memory transaction system, including a master replica node, a slave replica node and a coordinator thread, and the master replica node and the slave replica node are the Each coordinator thread allocates an independent persistent log area; the primary replica node and the secondary replica node provide the coordinator thread with a write log interface; the primary replica node and the secondary replica node invoke CPU persistent instructions, and update the log area elements atomically Data; the primary replica node executes the contents of the persistent log area and recycles garbage log items; the slave replica node replays the contents of the persistent log area of ​​different coordinator threads in parallel through an independent background thread group, and recycles garbage log items. The log management method of the distributed persistent memory transaction system can simultaneously provide efficient log writing performance, multi-core scalability, and post-crash recovery capabilities.

Description

technical field [0001] The invention relates to the technical field of persistent memory storage, in particular to a log management method of a distributed persistent memory transaction system. Background technique [0002] Persistent Memory (PM) is a new type of storage device that supports byte-level reading and writing directly using the CPU's load (load) and store (store) instructions. Common persistent memory devices include Resistive RAM (RRAM), Phase Change Memory (PCM), Spin-Torque Transfer RAM (STT-RAM), and the like. Intel also released the first-generation Intel Optane DC Persistent Memory in 2019. Persistent memory has extremely high read and write bandwidth and extremely low read and write latency, which brings opportunities for building new types of storage systems. But at the same time, persistent memory has problems such as asymmetric read and write performance and low lifespan. Persistent memory changes the boundary between volatile and non-volatile in tr...

AI Technical Summary

Problems solved by technology

First, the characteristics of the existing new hardware are not fully utilized: the persistence overhead of persistent memory is high, and CPU persistence instructions need to be called frequently; when using RDMA, it brings multiple unnecessary data copy overhead

Second, the multi-core scalability is poor, which is reflected in two aspects: first, multiple coordinator threads need to coordinate when writing logs to the master replica node and the slave replica node, and the requests are serialized; secondly, when the log content is executed from the replica node , due to the correct sequence of log playback, it is difficult to execute in parallel

Images