A data compression method and terminal

Abstract

The embodiment of the present invention discloses a data compression method and a terminal, the method comprising: the terminal calculates the first characteristic value of the data block to be compressed through the first calculation strategy; the terminal judges whether the first reference value exists in the first search library ; If the first reference value exists, the terminal uses a similar compression technique to use the data block corresponding to the first reference value as a reference data block to compress the data block to be compressed; if the first reference value does not exist value, then the terminal calculates the second eigenvalue of the data block to be compressed through the second calculation strategy; the terminal judges whether there is a second reference value in the second search library, and the second reference value is the same as the An eigenvalue with the same second eigenvalue; if the second reference value exists, the terminal compresses the data block to be compressed using a data block corresponding to the second reference value as a reference data block through a similar compression technique. According to the present invention, the compression rate can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data compression method and a terminal. Background technique [0002] Data storage is an integral part of a computer system, and disks, tapes, flash memory, non-volatile memory, cloud storage, etc. can all be used to store data. Huge amounts of data are generated every day all over the world. If these data are stored unprocessed, they will take up a large storage space and the cost will be high. In order to effectively save these data, data reduction techniques are usually used to reduce these data Commonly used data reduction techniques include data deduplication, general lossless compression, and similar compression. [0003] Taking the backup scenario as an example, there is usually a large amount of identical data between two consecutive backup files. The deduplication technology can be used to effectively reduce the actual number of backup files saved, that is, the latt...

AI Technical Summary

Problems solved by technology

[0004] First select similar data for the data to be compressed, then use Delta compression technology to compress the data to be compressed with reference to the similar data, the higher the similarity, the better the compression effect; the defect of the prior art is that the data to be compressed consists of many If the reference data block is selected for these data blocks through a higher similarity standard, some data blocks may not be able to find the reference data block, resulting in the data block not being able to find the reference data block. Based on Delta compression technology compression, if the reference data block is selected for these data through a lower similarity standard, then the reference data block screened for some data blocks has a lower similarity angle with the data block, resulting in the compression effect of the data block not good

Images