Method and device for resolution of data block

Abstract

The invention discloses a data block split method, which comprises the following steps that: the file type of a file to be split is examined; the split rule which is corresponded to the examined file type is indexed in the corresponding relation of the pre-stored file type and the split rule; the file to be split is split into data blocks according to the indexed split rule. Correspondingly, the invention also discloses a data block split device. The invention increases the repetitive rate of the data blocks which are split out aiming at the different files, so as to further filtrate the data blocks which have the repeated contents, thereby greatly reducing the storage space occupied by the stored files, and decreasing the transmission quantity of the data and saving the network bandwidth resources when the files are transmitted.

Description

technical field [0001] The present invention relates to the technical field of data storage, and more specifically, to a data block splitting method and a device thereof. Background technique [0002] In the field of data storage technology, if the storage file is divided into smaller data blocks, and the data block with the same content is only stored once, the storage space occupied by the storage file can be greatly reduced, and it can also be reduced when transferring the file. The transmission volume of small data saves network bandwidth resources. [0003] Currently, files are generally split into data blocks in a fixed-length manner, that is, the split data blocks are equal in length and size. For example, a collection-type file, whose content is AABBCC, contains three sub-files, whose contents are AA, BB, and CC; another collection-type file, whose content is AXYBBCC, also contains three sub-files, The contents of the sub-files are AXY, BB, and CC; if the contents ...

AI Technical Summary

Problems solved by technology

[0005] It can be seen that the above two files are split according to the fixed length method, and the repetition rate of the data block is 0, which means that the data block repetition rate of different files split according to the current fixed length method is relatively low. It is impossible to filter out some data blocks with repeated content, so when the file is divided into data blocks for storage, the saving of storage space and network transmission resources will not be very effective.

Images