Unlock instant, AI-driven research and patent intelligence for your innovation.

A node repair method and system for reducing storage overhead and improving repair efficiency

A technology for node repair and storage overhead, which is applied in the transmission system, error detection coding and coding using multiple parity bits, and can solve problems such as fragile disks, aggravating the burden of network bandwidth, and occupying I/O port resources. , to achieve low complexity, high repair efficiency, and low storage overhead

Active Publication Date: 2021-02-19
SHENZHEN UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In the actual operation process, this decoding method not only increases the burden of network bandwidth, easily damages the disk, but also occupies too much system I / O port resources during the repair process.
leading to poor scaling performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A node repair method and system for reducing storage overhead and improving repair efficiency
  • A node repair method and system for reducing storage overhead and improving repair efficiency
  • A node repair method and system for reducing storage overhead and improving repair efficiency

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] like figure 1 As shown, the node repair method for reducing storage overhead and improving repair efficiency provided by the present invention is described in detail as follows:

[0044] Step S1, group system nodes for (n, k) codes on the piggyback coding framework and define system vectors and coding matrices, use zigzag decoding (zigzag decoding) on ​​the piggyback coding framework, thereby reducing decoding complexity and Improving the repair efficiency of faulty nodes is an improvement to the node repair scheme proposed by K.V.Rashmi et al.; the proposed (n, k) code has the property of CP-BZD. The property of CP-BZD means that (n, k) code can be zigzag decoded in the binary domain, and it can tolerate failures of up to n-k nodes at the same time. We divide the original information s into k packets of length L bits, denoted as s 1 ,...,s k . the s i The jth bit of is denoted as s i，j , and s i，j ∈ {0, 1}, where S i，j Also known as an information bit. Accordi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention is applicable to the improvement field of distributed storage technology, and provides a node repair method that reduces storage overhead and improves repair efficiency. The node repair method includes the following steps: on the piggyback coding framework, the (n, k) code is converted to System nodes are grouped and system vectors and encoding matrices are defined; S2. Substitute the defined encoding matrix into the encoding structure to obtain the corresponding encoding method; S3. Repair damaged nodes in the distributed storage system through zigzag decoding according to the encoding method. According to its special encoding method, the designed code not only satisfies the property of MDS, but also has relatively small storage overhead. In the actual operation process, through zigzag decoding, the complexity of decoding can be effectively reduced, and at the same time, the efficiency of node repair is improved.

Description

technical field [0001] The invention belongs to the field of improving distributed storage technology, and in particular relates to a node repair method and system for reducing storage overhead and improving repair efficiency. Background technique [0002] In a large-scale distributed storage system, we can store and analyze large-scale data. However, during daily operations, nodes in the system may experience various failures, such as data loss due to disk damage or disconnection. Therefore, it is particularly important to ensure the reliability and availability of nodes in the system. [0003] 1. In traditional distributed storage systems, data storage often adopts a duplication strategy. That is, by replicating multiple copies of data and storing them on nodes in the system. When there is data damage and data recovery is required, it is only necessary to find the data stored in the corresponding node to recover. [0004] 2. In recent years, relevant scholars have propo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H03M13/11H04L29/08
CPCH03M13/1148H04L67/1097
Inventor 代明军王霞王晖
Owner SHENZHEN UNIV