Distributed adaptive coding and storing method

Abstract

The invention discloses a distributed self-adaptive coding and storage method, which comprises the following steps: detecting the number of storage nodes in a distributed system(S11); self-adaptively adjusting codes according to the number of the storage nodes in the system, and self-adaptively coding files required to be stored(S12); equally dividing the coded files according to the number of the nodes(S13); encapsulating the equally divided files into file blocks in a unified file encapsulation format(S14); storing the encapsulated file blocks to each node in the system(S15); when a certain node sending a file required request, detecting on-line storage nodes and judging whether the nodes are integrated; if the nodes are not integrated, acquiring the lost information blocks using the decoding of file blocks in the on-line storage nodes and recombining the decoded lost information blocks with the existing information blocks in sequence to obtain the original file. Compared with the prior art, since a coding method is used to implement the storage of the files, the invention enables to implement the storage effect of large number of disaster tolerance nodes with lower redundancy.

Description

technical field [0001] The invention relates to an encoding storage method in the field of information security storage, in particular to a distributed self-adaptive encoding storage method. Background technique [0002] In the data-centric information age, especially in recent years, data has shown explosive growth. How to securely and effectively obtain data security and availability with low storage space is a major problem in the storage field. Safely and reliably storing data with low redundancy is one of the challenging issues in the storage field in the new century, and how to improve the sustainable disaster recovery capability of storage systems has also become the focus of industry research. At present, in order to improve the reliability or performance of the system, the replication scheme is mainly adopted, but effectively realizing the consistency of shared data in a large-scale distributed system is the main problem faced by the replication technology. At the ...

AI Technical Summary

Problems solved by technology

At present, in order to improve the reliability or performance of the system, the replication scheme is mainly adopted, but effectively realizing the consistency of shared data in a large-scale distributed system is the main problem faced by the replication technology

At the same time, in order to improve the reliability of the system, multiple copies of files greatly increase the redundancy of data. For the storage of large amounts of data, the cost of data storage is greatly increased. At the same time, special storage devices are expensive and not easy to expand

Images