Building method of large-scale and high-reliable filing storage system

A technology for archiving storage and construction methods, applied in transmission systems, special data processing applications, instruments, etc., can solve problems such as insufficient, unable to reduce fault recovery time, long recovery time, etc., and achieve easy expansion, high cost performance, and reliability high effect

Inactive Publication Date: 2010-04-07
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When peer-to-peer storage is used, the failure rate is reduced, but the fault recovery time cannot be reduced, because files can only be restored serially, and the recovery time may be longer; when random storage is used, the fault recovery time ca...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Building method of large-scale and high-reliable filing storage system
  • Building method of large-scale and high-reliable filing storage system
  • Building method of large-scale and high-reliable filing storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] figure 1 Is the general flowchart of the present invention.

[0054] 1. Use the distributed storage and parallel recovery method of multiple copies of files to store and restore large-scale archived files.

[0055] 2. Design a continuous-time Markov model to describe the failure recovery process of large-scale archival storage systems.

[0056] 3. Obtain storage system optimization parameters according to the Markov model.

[0057] 4. Construct a large-scale archival storage system based on storage system optimization parameters.

[0058] figure 2 It is a schematic diagram of the first step of the present invention that includes three copies of files distributed randomly across multiple nodes. figure 2 There are N (N=9) nodes in total, forming a storage cluster. n (n=9) files (blocks numbered 0-8, each file has K=3 copies) are randomly and evenly distributed among N nodes, and the nodes are independent of each other. This storage mode has at least the following ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a building method of a large-scale and high-reliable filing storage system. The technical problem to be solved is to provide a large-scale filing storage system and improve the reliability of the filing storage system on the basis of filing data. The technical scheme is as follows: adopting the multi-copy distributed storage and parallel recovery methods of files to store and recover the large-scale filing storage system, designing a continuous-time Markov model to describe the fault recovery process of the large-scale file storage system so as to obtain optimized parameters of the large-scale filing storage system according to the Markov model, and finally building the storage system according to the obtained optimized parameters. The model of the invention is simple, lowers the difficulty of building the high-reliable filing storage system and improves the reliability of the filing storage system, and the built storage system has extensible structure and high cost performance.

Description

technical field [0001] The invention relates to a method for constructing a storage system in the field of computer application technology, in particular to a method for constructing a large-scale and highly reliable archiving data storage system based on a computer cluster system. Background technique [0002] Large-scale archival data storage applications involve many fields such as network security management, network search, communication, finance, and scientific experiments. For example, in network security applications, real-time storage, query and analysis of network communication packet header information is a common network security management method. Generation, the generation speed is fast (the number of messages generated by an ordinary Gbit network connection can reach 100,000 per second, and its data speed can reach tens of MB per second), so the formed system has a large scale. Similar applications include: in the network search engine, it is necessary to pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L29/08
Inventor 杜凯王怀民杨树强
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products