Distributed erasure code storage system data restoration method based on simulated annealing

A technology of distributed storage and data restoration, applied in the field of distributed erasure code storage systems, can solve the problem of inability to effectively reduce the amount of data transmitted by the data restoration network, and achieve faster data restoration speed, shorter execution time, and lower network bandwidth. occupied effect

Active Publication Date: 2019-09-06
XI AN JIAOTONG UNIV
View PDF3 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these optimization methods cannot effectively reduce the amount of network transmission data during data repair

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed erasure code storage system data restoration method based on simulated annealing
  • Distributed erasure code storage system data restoration method based on simulated annealing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The present invention is further described below in conjunction with accompanying drawing:

[0049] A data restoration method for distributed erasure code storage systems based on simulated annealing is mainly aimed at the data reading and transmission process during erasure code data restoration in distributed storage systems, and improves the process so that it can read less Data, transmit less data and use less data to complete the decoding operation, reduce the network overhead of data repair, and use the heterogeneous characteristics of the network bandwidth of the system to speed up the speed of data repair.

[0050] attached Figure 1 It is a schematic diagram of erasure code data recovery process in a distributed storage system. The distributed storage system includes two types of nodes: the monitoring node is responsible for monitoring the heartbeat information of each storage node, and judges whether the storage node is faulty; the storage node is responsible ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed erasure code storage system data restoration method based on simulated annealing. The method comprises the following steps: constructing a distributed storage system; the monitoring node judging that the storage node has a fault; the monitoring node selecting a storage node as a repair node to repair the data and store the lost data; the repair node obtainingthe network transmission speed; the repair node obtaining the erasure code generation matrix, the failure node number and the current node number and obtaining a repair scheme through a search algorithm; the repair node constructing a data reading request according to the repair scheme and sending the data reading request to each storage node; each complete storage node reading corresponding element data and returns the element data to the repair node; the restoration node executing decoding operation to reconstruct the lost data; and the restoration node feeding back the metadata informationto the monitoring node and storing the data locally. The bandwidth occupation of data restoration of the CRS erasure codes is effectively reduced, the adverse influence of data restoration on the system is reduced, and the data restoration speed is increased.

Description

technical field [0001] The invention belongs to the field of distributed erasure code storage systems, and in particular relates to a method for restoring data in a distributed erasure code storage system based on simulated annealing. Background technique [0002] Distributed storage system has attracted widespread attention due to its good scalability and low cost. This system is composed of cheap storage servers interconnected through the network, and some data redundancy technologies are adopted to ensure data reliability. The traditional data redundancy technology in a distributed storage system is a copy strategy, but the copy strategy brings about a large storage overhead. For example, for a three-copy strategy, it will bring three times the storage overhead. The erasure code strategy is a relatively new type of data redundancy technology, which divides the original data into k blocks, and encodes these data blocks to obtain m check blocks, and finally places the data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H03M13/15G06F11/10
CPCG06F11/1076H03M13/154
Inventor 张兴军刘云飞董小社梁宁静刘威武旭瑞赵英交
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap