Network distributed storage and reading method for file

A distributed file and distributed storage technology, applied in the direction of electrical components, transmission systems, etc., can solve problems that restrict the efficiency of large-scale network distributed file storage services, resource waste, waste, etc., to improve disaster recovery capabilities and improve confidentiality The effect of low performance and computational time cost

CN103023968AActive Publication Date: 2013-04-03CAS OF CHENGDU INFORMATION TECH CO LTD
3 Cites 16 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2013-04-03

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a network distributed storage and reading method for a file. The method comprises the following steps of: determining the storage disaster recovery parameter index (n, k, t and sigma) of a storage system (N1, N2,..., Nn); constructing a file subblock matrix Gn*k and a file aggregation matrix Hn*(n-k); equally dividing the file into k data blocks after the file is transformed into a binary format; carrying out information coding on the k data blocks of the file according to the file subblock matrix Gn*k, thereby obtaining n coded data blocks; and storing the n coded data blocks into n different storage nodes of the storage system. Compared with the prior art, the method has the advantages that the complete information of the file can be read and recovered through randomly selecting any n-t storage nodes from the n storage nodes of the storage system, namely, the condition that any t storage nodes of the system are simultaneously broken down can be tolerated, so that the disaster recovery capability of distributed data storage can be remarkably improved, and the dependence on data redundancy and equipment redundancy of the storage system is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of coding organization and storage of electronic information files, and in particular relates to data disaster recovery and file reading technology for distributed storage of electronic information files on a network. Background technique

[0002] With the rapid development of the network, it has become a trend for users to store or host data files on the network. However, the network covers a wide range, and some unpredictable accidental changes in any place may cause permanent loss or damage of some important data stored on the network, such as human operation errors, equipment component failures, earthquakes, floods, fires, typhoons , and even electronic warfare, which may cause immeasurable losses. The act of preventing such network data damage is called network data disaster recovery; in addition, due to the wide-area and unbalanced distribution of file data resources on the network, the existing netwo...

Examples

Embodiment 1

[0052] In this embodiment, it is assumed that the size of the user file to be stored is 400M, and the file is stored and read according to the system storage disaster recovery parameter index [n=7, k=4, t=2, δ=1]: the storage system The number of storage nodes n=7, the disaster tolerance index of the storage system t=2, when the number of damaged storage nodes ≤ 2, the stored files can be fully restored.

[0053] The specific steps of file storage are as follows:

[0054] Step 1: Construct the file block matrix G 7×4 and the document aggregation matrix H 7×3 :

[0055] G 7 × 4 = 1 0 0 0 0 1 0 ...