Data de-duplication operation system

Abstract

The invention discloses a data de-duplication operation system which is applied to a file backup program operated by a client. The data de-duplication operation system comprises a file screening module of the client, a redirection read-write module, an indexed file read-write module and an attribute control module, wherein the file screening module of the client is used for setting corresponding screen strategies for a file to be backed up; the redirection read-write module is used for receiving an access request sent by the file backup program, and sending the data information of the access request; the indexed file read-write module is used for generating an indexed file for a duplication file, wherein the indexed file internally comprises at least one group of feature codes and storage information; when the file to be backed up is the duplication file, the attribute control module is used for modifying the size of the file to be backed up into the size of the indexed file, at the same time, modifying the size of the file to be backed up in the access request, and then sending the access request to a storage system. For the system disclosed by the invention, when the client receives the file to be backed up, and the file to be backed up and the storage file of the client have duplication, the storage location of the file to be backed up is reset directionally.

Description

technical field [0001] The invention relates to a data backup system, in particular to an operating system for deduplication data. Background technique [0002] Data deduplication is a data reduction technique, usually used in disk-based backup systems, with the main purpose of reducing the storage capacity used in the storage system. It works by looking for duplicate variable-sized chunks of data at different locations in different files over a certain period of time. Duplicated data blocks are replaced with indicators. Because the storage system is always filled with a large amount of redundant data. In order to solve this problem and save more space, the "duplication deletion" technology has naturally become the focus of attention. Using "deduplication" technology can reduce the stored data to 1 / 20 of the original, so as to allow more backup space, not only can save the backup data on the storage system for a longer time, but also save offline storage time A lot of ba...

AI Technical Summary

Problems solved by technology

[0003] However, in general file storage programs, not all related applications support deduplication

If the existing file storage program is redeveloped, it is not only a major burden for software developers

Images