File storing system based on dynamic transcript strategy and storage method of file storing system

Abstract

The invention discloses a file storing system based on a dynamic transcript strategy. The file storing system comprises a file popular degree calculating module, a plurality of storage modules, a master control module and an encoding and decoding module. The file popular degree calculating module is used for calculating the popular degree of files stored within the periodic time and the average popular degree of all the files stored within the periodic time. The storage modules are used for storing and having access to data. The file popular degree calculating module and the storage modules are respectively connected with the master control module, and the master control module is used for dynamically adjusting the number of transcripts of the storage files according to the popular degree of the storage files. The encoding and decoding module is connected with the master control module and used for carrying out erasure code encoding on the storage files conforming to the encoding conditions according to the number of the transcripts of the storage files. The invention further discloses a file storing method. According to the file storing system and the file storing method, the number of the complete transcripts of the high-popular-degree files is increased, the access speed and load balancing of the high-speed files are improved, the number of the complete transcripts of the low-popular-degree files is reduced, and due to the fact that storing is carried out after the RS erasure code encoding, the storing tolerance capability and reliability are improved.

Description

technical field [0001] The present invention relates to the technical field of file storage systems, in particular to a file storage system and storage method that dynamically adjusts the number of file copies in a file server and performs erasure code encoding and decoding on files according to the different situations in which files are accessed . Background technique [0002] With the advent of the era of big data, the storage and application of massive heterogeneous data has brought us huge challenges. Cloud storage is to build a large number of storage devices into a storage resource pool through technologies such as distributed file system, grid computing and cluster management, and jointly provide data storage and management services to the outside world. Because of its high stability and high efficiency, cloud storage is being used by more and more enterprises. [0003] At present, most file storage systems adopt a static full copy redundancy mechanism to ensure hi...

AI Technical Summary

Problems solved by technology

However, the static full copy strategy is to copy multiple copies of each file and store them on different data nodes, which causes the storage cost to increase linearly with the increase in the number of copies, resulting in low storage efficiency and poor load balancing capabilities. Disadvantages, but also increase the management overhead of the copy, affecting the scalability of the system

Images