System and method for cluster fault toleration

Abstract

The invention discloses a system for cluster fault tolerance and a method thereof. The system comprises a checkpoint server which is connected with a plurality of nodes through networks and used for collecting information, which is applied in parallel, of all of processes, sending monitoring request to the nodes and responding to the checkpoint operation request from the nodes as well as saving checkpoint files on a checkpoint file server; on the completion of cutting operation of the checkpoints, the checkpoints are recovered; the checkpoint file server is connected with a plurality of nodes through networks, used for storing checkpoint files, and provides support for accessing checkpoint files during process recovery; a fault monitoring module is arranged on the nodes, and used for monitoring the running status of the operation systems of the local nodes and the specified running status of the specified process in the monitor request, and the specified status of the specified hardware components in the monitoring request according to the monitoring request, as well as sending checkpoint operation request to the checkpoint server when faults are monitored.

Description

technical field [0001] The invention relates to cluster fault tolerance, in particular to a method and system for cluster fault tolerance based on process checkpoint cut and recovery. Background technique [0002] The cluster is the mainstream structure of the current high-performance computer, and its nodes and interconnection network usually use off-the-shelf commercial components rather than custom-made. The openness and scalability of this hardware platform make the cluster have excellent advantages compared to traditional mainframes, massively parallel processing systems (Massively Parallel Processors, MPPs) and symmetric multiprocessing systems (Symmetric MultiProcessors, SMPs). cost performance. With the continuous expansion of the scale and complexity of the cluster system, its reliability shows a downward trend. The problem of fault tolerance in cluster systems has attracted extensive attention from academia and industry. Exploring cluster fault-tolerant mechanis...

AI Technical Summary

Problems solved by technology

Both of these existing technologies need to run in the node where the target process is located, and their shortcoming is that the checkpoint operation cannot run when the target node fails

Therefore, the existing cooperative parallel application checkpoint technology has the following disadvantages: first, it is necessary to periodically perform checkpoint operations on all processes in a parallel application, resulting in a large time overhead; second, the checkpoint image file occupies a huge amount of storage resources , in order to meet the storage requirements of checkpoints, the number of components in the cluster system will increase, resulting in an increase in system cost, but a decrease in the overall reliability of the system

Images