Concurrent job backup method for mass data backup

Abstract

The invention discloses a concurrent job backup method for mass data backup. The method comprises the following steps of: 1) selecting multiple backup nodes to for a backup cluster, wherein the backupnodes have uniform configuration; 2) selecting a backup node to serve as a backup management server by a terminal, and starting a backup strategy of an object needing backup; 3) selecting a backup node to serve as a job scheduler by the backup management server, obtaining a directory structure corresponding to the object needing backup layer by layer, and generating a scanning job when a directory is obtained; 4) submitting a job path corresponding to each scanning job to the job scheduler by the backup management server, and sending the job paths to the backup nodes by the job scheduler so as to scan target directories in the scanning jobs; 5) selecting a file needing backup by the backup management server and generating a plurality of file sub-tables, generating a copy job according toeach sub-table, and sending the copy jobs to the jog scheduler; and 6) sending different copy jobs to different backup nodes by the job scheduler so as to copy the file needing backup to a corresponding position.

Description

technical field [0001] The invention relates to a data backup method, in particular to a parallel job backup method for mass data backup. Background technique [0002] Data is crucial to an enterprise, department, unit or individual. Due to various reasons, such as equipment failure, hacker virus, human misoperation, etc., once data information is lost or destroyed, it will cause inestimable losses, which makes data backup very important. Data backup is a data security strategy, making a copy of key data so that when a failure occurs, the data can be restored through the backup software to avoid losses caused by data loss. [0003] With the continuous development of information technology, emerging things such as cloud computing, Internet of Things, and social networks have caused the type and scale of data in human society to explode on a global scale. As of 2012, the amount of data has jumped from TB (1TB=1024GB) level to PB (1PB=1024TB), EB (1EB=1024PB) and even ZB (1ZB...

AI Technical Summary

Problems solved by technology

However, for massive data containing tens of millions or even billions of files, it takes days or even weeks, and the backup task cannot be completed within an acceptable time frame

[0007] 2. There is a possibility of a single point of failure in the backup system

Once a server fails, the backup and recovery services defined on that server cannot continue

[0008] 3. The backup software adopts a custom storage format for safety reasons. The backup files depend on the backup software. When the software fails, the backup files cannot be used, resulting in the result that having backup is equal to no backup

Images