Data compression method and terminal

Abstract

The embodiment of the invention discloses a data compression method and a terminal. The method comprises the steps that a first eigenvalue of a data block to be compressed is calculated by the terminal according to a first calculation strategy; the terminal judges whether or not a first reference value exists in a first search library; if yes, the terminal compresses the data block to be compressed by means of a similar compression technique with the data block corresponding to the first reference value used as a reference data block; if not, the terminal calculates a second eigenvalue of thedata block to be compressed according to a second calculation strategy; the terminal judges whether or not a second reference value exists in a second search library, wherein the second reference value is an eigenvalue identical with the second eigenvalue; if yes, the terminal compresses the data block to be compressed by means of the similar compression technique with the data block correspondingto the second reference value used as the reference data block. By means of the data compression method and the terminal, the compression ratio can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data compression method and a terminal. Background technique [0002] Data storage is an integral part of a computer system, and disks, tapes, flash memory, non-volatile memory, cloud storage, etc. can all be used to store data. Huge amounts of data are generated every day all over the world. If these data are stored unprocessed, they will take up a large storage space and the cost will be high. In order to effectively save these data, data reduction techniques are usually used to reduce these data Commonly used data reduction techniques include data deduplication, general lossless compression, and similar compression. [0003] Taking the backup scenario as an example, there is usually a large amount of identical data between two consecutive backup files. The deduplication technology can be used to effectively reduce the actual number of backup files saved, that is, the latt...

AI Technical Summary

Problems solved by technology

[0004] First select similar data for the data to be compressed, then use Delta compression technology to compress the data to be compressed with reference to the similar data, the higher the similarity, the better the compression effect; the defect of the prior art is that the data to be compressed consists of many If the reference data block is selected for these data blocks through a higher similarity standard, some data blocks may not be able to find the reference data block, resulting in the data block not being able to find the reference data block. Based on Delta compression technology compression, if the reference data block is selected for these data through a lower similarity standard, then the reference data block screened for some data blocks has a lower similarity angle with the data block, resulting in the compression effect of the data block not good

Images