A distributed storage system and method for storing backup data

Abstract

The invention provides a distributed storage system and a method for storing backup data, which uses a distributed storage system mode instead of an index mode to manage the backup data. A distributedstorage method includes a method for storage of backup data, a method of data recovery and a method of backing up data garbage collection. The data storage method can greatly utilize the advantages of high IOPS of disk device and high concurrency of cluster, the system design has redundancy, the system will not easily collapse, and saves a lot of environment of optimizing the backup server's owndata, which is convenient for system administrator to carry on system management and saves the authorization cost of the database. And different from the traditional backup system index management, itdoes not need to simulate the tape to manage the file system space, so that the data can be recovered in time when it is invalid, which improves the utilization of storage spa ce.

Description

technical field [0001] The invention relates to the technical field of data backup, in particular to the related technologies of distributed storage and file systems, in particular to a distributed storage system and method for storing backup data. Background technique [0002] With the development of new technologies such as cloud computing and big data, the amount of data generated by business systems is increasing exponentially, so the requirements for IPO and ITO of backup systems are getting higher and higher. At the same time, the development speed of disk technology far exceeds that of tape media, and more and more devices use disk devices instead of tape devices as the preferred backup medium. [0003] However, the current backup system's support for disk devices has the following problems: mainstream backup software all use tapes to manage disks, and disk space will only be recovered after all data stored on the disks expire, which greatly wastes disk space. . For...

AI Technical Summary

Problems solved by technology

[0003] However, the current backup system has the following problems in supporting disk devices: mainstream backup software uses tapes to manage disks, and the disk space will be recovered only after all the data stored on the disk expires, which greatly wastes disk space

For file system backup, if the file index is used for management, a large number of files will make it difficult to manage the index of the backup software. After a large number of files are backed up for a long time, the index space of the backup system will skyrocket, accompanied by significant performance degradation

When restoring the incremental backup of massive files, it is necessary to restore the incremental one at a time, which will consume a lot of time. Restoring the files in the browsing cycle requires cumbersome index queries. If the file index is used, the efficiency of the index is very low, and the index structure is very bloated

If a small open source database is used to store indexes, the st

Images