Data de-duplication method of backup server

Abstract

The invention provides a data de-duplication method of a backup server. The data de-duplication method specifically comprises the following steps that a logical volume of a hard disk module of the backup server is divided to form a partition which is used for temporally storing data needing to be backed up on the server, and the partition has the data buffering function; block segmentation is carried out the buffered data in the partition, and the hash value of the buffered data is worked out with one block as a calculation unit and stored in a database; the hash values are compared, in other words, the hash value of the new data backed up each time is compared with the existing hash value in the database, if the hash value of the new data is the same as the existing hash value in the database, the new data and the data in the database are repeating data, or otherwise, the new data and the data in the database are not repeating data, and the hash value of the data block is added into a hash library. Compared with the prior art, the data de-duplication method of the backup server has the advantages that the repeating data can be effectively deleted, the storage space is greatly saved, the storage space is saved to a certain degree, and the operating cost of enterprises is reduced.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a data deduplication method of a backup server which can effectively improve the operating speed and quality of the system. Background technique [0002] The core concept of data deduplication technology is: check and compare existing data when storing data, if they are the same, then filter out the backup of this part of data, and then refer to the existing data through pointers. Data deduplication is currently a popular research topic in the storage field, because it can bring many obvious benefits to the entire storage system and even the entire enterprise. Obviously, data deduplication can fundamentally reduce the space occupied by storage and the number of disk drives of users, and reduce the overhead of manpower, energy, and power resources, thereby greatly saving storage costs. In addition, data deduplication can reduce the amount of data transmitted in the network, the...

AI Technical Summary

Problems solved by technology

[0004] Sometimes in order to be able to delete duplicate data, the enterprise needs to assign a special person to be responsible for the deletion work. The deletion process is cumbersome and error-prone, which may easily lead to the loss of backup data. Therefore, how to ensure that the backup server is automatically completed without data loss? Data deduplication has become a development trend in the future, especially for small enterprises, saving storage space can greatly reduce the operating costs of enterprises. Based on this, we now provide a method that can effectively deduplicate data on the backup server method

Images