Method for disaster recovery and playback of computing node data, terminal equipment and storage medium

Abstract

The invention discloses a method for disaster recovery and playback of computing node data. The method comprises the following processes: a process of setting a disk directory, a process of setting backup frequency of check point files, a process of enabling data to enter computing nodes, a process of processing the data by the computing nodes, and a process of data playback when the computing nodes are abnormal. A terminal device for disaster recovery and playback of computing node data comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, and the processor implements the method for disaster recovery and playback of the computing node data when executing the computer program. A computer readable storage medium stores a computerprogram, and when the computer program is executed by a processor, the steps of the method for disaster recovery and playback of computing node data are achieved. Not only is the high-performance datadisaster recovery problem of the computing node realized, but also the aging problem of data recovery and playback is solved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for computing node data disaster recovery playback, a terminal device and a storage medium. Background technique [0002] With the advent of the era of massive data, data computing power and data disaster recovery have become indispensable indicators in software system architecture. As for the computing power of data, the horizontal expansion of computing nodes can be realized by means of distributed load balancing at the system architecture level, so as to achieve unlimited improvement of computing power. However, how to ensure data disaster recovery and playback on each computing node has also become the focus of the industry. [0003] Most of the data disaster recovery on traditional computing nodes is to use WAL (write-ahead-log) for the data cached in the queue, that is, to record a log into a disk file before inserting the data into the queue. Persist to ...

AI Technical Summary

Problems solved by technology

Although this method ensures the high availability of computing node data, when writing records to disk files, because they are written to a disk file uniformly, there will inevitably be I / O performance problems of concurrent writing. In addition, when In an abnormal situation, when it is necessary to restore the data of the computing node, it is necessary to perform "full playback", that is, to load all the records in the entire disk file one by one. When the computing node runs for a long time and the calculated data is large , the history records of the entire disk file are very large, and most of the records may be useless outdated records. Performing "full playback" not only does a lot of useless work, but also the efficiency of playback is extremely low

Although all data can be recovered, the recovery time is often not satisfactory

Images