Method and device for optimizing data placement to reduce data fragments

Abstract

The invention relates to a method and a device for optimizing data placement to reduce data fragments. The method comprises the following steps of: carrying out data partitioning on each file to be backed up, and determining a data block fingerprint of each data block to be backed up; organizing a plurality of continuous data blocks to be backed up into a data segment to be backed up; searching whether the data block same as that backed up by the backed-up data segment in the system as to each data block to be backed up in the data segment to be backed up, if not, judging the data block to be a non-repeated data block, entering a data reading and writing step, if so, judging the data block to be a repeated data block, and entering the next step; calculating the data redundancy locality of the data segment to be backed up and the backed-up data segment, and quantifying the data redundancy locality, if the value of the data redundancy locality is smaller than a preset threshold, entering the data reading and writing step, or else, entering the next step; and deleting the repeated data block shared by the data segment to be backed up and the backed-up data segment from the data segment to be backed up. According to the method disclosed by the invention, non-sequenced placement of the data and the data fragment are reduced; deterioration of the data fragment is slowed down under the premise of sacrificing a little of data compression ratio; and the reading and writing performance of the system is improved.

Description

technical field [0001] The invention belongs to the technical field of computer information storage, and in particular relates to a method and a device for reducing data fragmentation by optimizing data placement. Background technique [0002] Data deduplication is an advanced data lossless compression technology, which is mainly used to save the storage space required in the information storage backup system. The basic principle it implements is to cut each file into multiple consecutive data blocks in turn, and delete duplicate data blocks within a single file or between multiple files to reduce data storage space. Most of the existing information storage and backup systems use this technology to optimize storage space and save data storage and management costs. [0003] In an information storage and backup system that uses deduplication technology (referred to as a deduplication system for short), there are mainly two types of data blocks. One is new data blocks that ne...

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to reduce the non-sequential placement of data and data fragmentation, alleviate the deterioration of data fragmentation on the premise of sacrificing little data compression rate, and improve the read and write performance of the system

Images