Cloud storage file archiving and compressing method

Abstract

The invention discloses a cloud storage file archiving and compressing method. The method comprises the steps of setting the threshold value S of the size of an archived file and the threshold value H of the hotness of the archived file; distributing the starting point of archiving and the final point of archiving according to an archiving service request, and acquiring accounts in the distributing zone between the starting point of archiving and the final point of archiving; extracting files with access frequency lower than the threshold value H of the hotness of the archived file and size smaller than or equal to the threshold value S of the size of the archived file under each account during the time of cloud storage external service idling; checking the completeness of the extracted files, and judging whether the extracted files are consistent with the original file; re-extracting the files if not, and rechecking the completeness of the files till the file identical with the original file is obtained; archiving, compressing and storing the file identical with the original file according to file characteristics. According to the method, archiving and compressing are conducted according to the access hotness of cloud storage files, and restraining of the increase speed of the number of cloud storage files and improvement of storage benefits are realized.

Description

technical field [0001] The invention relates to a technology for archiving and compressing massive files on a cloud storage platform, in particular to a method for archiving and compressing files in cloud storage. Background technique [0002] Cloud storage is a new concept extended and derived from the concept of cloud computing. Cloud Computing is the development of Distributed Computing, Parallel Computing and Grid Computing. It is to automatically split a huge computing processing program into countless smaller subroutines through the network. Then it is handed over to a huge system composed of multiple servers, and after calculation and analysis, the processing results are sent back to the user. Through cloud computing technology, network service providers can process tens of millions or even billions of information in a few seconds to achieve network services as powerful as supercomputers. Cloud storage is a service, similar to cloud computing. Through functions such...

AI Technical Summary

Problems solved by technology

At present, the solutions of many cloud storage service providers do not have the processing steps of archiving and compressing files, and Facebook's Haystack cloud storage solution only archives files, but does not perform compression processing, which slows down the processing time of files. The growth rate of the number, but the storage capacity of cloud storage is not saved, and the file migration when a single file is too large fails takes a long time and affects the cluster performance

[0004] However, the existing cloud storage platform uses a single file with multiple backups for storage in the background storage, and evenly places the backups on different disks. However, with the exponential growth of the number of files, the read and write performance of the disk will decrease. As a result, the quality of service is affected, and the storage space is also fixed, occupying the capacity of the file size multiplied by the number of backups, so this method cannot optimize the storage efficiency of cloud storage

Images