A Simple Regenerative Code Restoration Method Using Network Topology Information

A technology of network topology information and simple regeneration code, applied in the field of distributed storage and network coding, can solve problems such as neglect, and achieve the effect of reducing repair delay, improving network bandwidth utilization, and reducing node repair delay

Inactive Publication Date: 2018-11-30
NANJING UNIV +3
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This node repair process ignores the topology information and link bandwidth information of the network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Simple Regenerative Code Restoration Method Using Network Topology Information
  • A Simple Regenerative Code Restoration Method Using Network Topology Information
  • A Simple Regenerative Code Restoration Method Using Network Topology Information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention will be further described below in conjunction with the accompanying drawings.

[0057] The invention is based on a distributed storage system using simple regeneration codes as a storage redundancy strategy, and uses network topology information and bandwidth information to optimize the node repair process.

[0058] Such as figure 1 The concrete steps of described data restoration are:

[0059] Step 1: According to the distributed storage system where the failed node is located and the simple regeneration code configuration of the application, obtain the simple regeneration code encoding parameters (n, k, f) used by the system, and the storage node composed of the node to be repaired and the repairing participating node A set and a set of links between each node in the storage node set;

[0060] Step 2: Build a repair network G(N,E), where N is a node set composed of nodes to be repaired and participating nodes, satisfying |N|=2f+1, f+1 node set...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a simple regenerating code reparation method by using network topology information. The method comprises following specific steps of 1, obtaining simple regenerating code parameters (n, k, f) used by a system, a storage node set composed of to-be-repaired nodes and reparation participating nodes, and a set of links among the nodes in the storage node set, according to the distributed storage system in which ineffective nodes are located, and simple regenerating code configuration of an application; 2, establishing a reparation network G (N, E); 3, establishing f+1 parallel reparation trees Fi (1 <=i <=f+1) specific to all of f+1 lost data blocks, by using a parallel reparation tree establishing algorithm, according to the reparation network established in the step 2; and 4, carrying out data block reparation on the reparation trees Fi (1 <=i <=f+1) obtained in the step 3. According to the method, the simple regenerating code reparation process is optimized by using network link bandwidth information and coding / decoding capabilities of intermediate nodes of transmission paths; tree-shaped reparation paths specific to lost data blocks are established; high bandwidth links can be used reasonably in the data block reparation process; and the reparation time delay is reduced.

Description

technical field [0001] The invention relates to the fields of distributed storage and network coding, in particular to a simple regeneration code repair method using network topology information. Background technique [0002] With the rise of big data technology, large-scale data storage, as one of the key technologies of big data technology, has received more and more attention. Distributed storage systems are mostly deployed on cheap commercial machines, and node failures in the system are normal. [0003] In order to ensure the reliability of data in the system, it is necessary to introduce a storage redundancy strategy for the distributed storage system. Typical storage redundancy strategies are multi-copy strategy and Reed-Solomon coding. Network coding technology was proposed in 2000. Its core idea is that each node in the network not only has a routing function, but also performs linear or non-linear coding processing on the data received by the node and then forwar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/14
CPCG06F11/1402G06F11/1464H04L67/1097
Inventor 童鑫叶保留陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products