Method and device for managing data on basis of duplicated data deletion technologies

Abstract

The invention discloses a method and a device for managing data on the basis of duplicated data deletion technologies. The method includes computing fingerprint values of the target data by the aid of HASH algorithms; determining storage locations for the target data by means of CRUSH mapping; utilizing the target data as to-be-stored data and judging whether data are available at the storage locations for the to-be-stored data or not; adding one to reference counts of the to-be-stored data if the data are available at the storage locations; storing the to-be-stored data if the data are not available at the storage locations, setting the reference counts of the to-be-stored data as one and storing metadata information of the to-be-stored data. The storage locations correspond to the fingerprint values of the target data. The method and the device for managing the data on the basis of the duplicated data deletion technologies in an embodiment of the invention have the technical advantages that the data can be prevented from being repeatedly stored in data storage procedures, and accordingly the work efficiency can be improved; the data can be managed on the basis of the duplicated data technologies, the cost can be saved, and the service lives of storage systems can be prolonged.

Description

technical field [0001] The present invention relates to the technical field of cloud computing data centers, and more specifically, to a data management method and device based on deduplication technology. Background technique [0002] With the rapid development of computer technology and the Internet industry, data information is increasing day by day. In order to save storage space and realize resource sharing, a distributed storage system emerges as the times require. The distributed storage system disperses and stores data on multiple independent devices, adopts a scalable system structure, uses multiple storage servers to share storage load, and uses location servers to locate and store information, which can improve system reliability, availability and management efficiency , and is easy to expand. [0003] However, since many terminals can access the storage server, there must be a large amount of duplicate data, which occupies storage space. At this time, the data d...

AI Technical Summary

Problems solved by technology

[0003] However, since many terminals can access the storage server, there must be a large amount of duplicate data, which takes up storage space. At this time, the deduplication technology that optimizes storage capacity solves this problem

Images