Erasure code repairing method based on assembly line

A repair method and pipeline technology, applied in the field of erasure code repair based on pipeline, can solve the problems of simultaneous disk access performance and bottleneck, and achieve the effect of improving repair performance and reducing the conflict of network traffic.

Pending Publication Date: 2022-08-05
中电云数智科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If there is no constraint on the reconstruction request, a disk will be accessed simultaneously, resulting in a performance bottleneck

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Erasure code repairing method based on assembly line
  • Erasure code repairing method based on assembly line
  • Erasure code repairing method based on assembly line

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0039] It should be noted that the following embodiments and the features in the embodiments can be combined with each other without conflict; and, based on the embodiments in the present disclosure, those of ordinary skill in the art can obtain the results obtained without creative work. All other embodiments fall within the protection scope of the present disclosure.

[0040] It is noted that various aspects of embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and / or function described herein is illustrative only. Based on this disclosure, those skilled in the art should appreciate that an aspect described herein may be implemented independently of any other aspects and that two or more of these ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of computer software data storage, and provides a streamline-based erasure code repair method, which comprises the following steps of: obtaining data repair requests, and sorting the obtained data repair requests; carrying out pipeline serial distribution on data block nodes in the obtained data recovery request; sequentially arranging the data block nodes which are distributed in a pipeline serial manner, and reconstructing a data recovery request; and executing the reconstructed data recovery request. According to the pipeline-based erasure code repairing method disclosed by the embodiment of the invention, the data traffic is balanced to all the nodes, so that network bottlenecks are prevented from being formed on some nodes; triggering of the serial assembly line is combined with sequential arrangement of the data nodes, so that the conflict between disk read-write and network flow at the same moment is minimum, and the EC repair performance of the system can be improved to the maximum extent.

Description

technical field [0001] The invention relates to the field of computer software data storage, in particular to an erasure code repair method based on a pipeline. Background technique [0002] Erasure code is a mainstream technology in data redundancy protection. In the storage technology represented by ceph, erasure code is used for data protection. Data reconstruction is divided into three stages. The first stage uses a pseudo-random algorithm to select reconstruction nodes. In the second stage, the repair task is sent to the newly added node, and in the third stage, the data on the other related nodes is pulled from the reconstruction node for data calculation and reconstruction. The speed of data reconstruction is an important indicator of the storage system. The faster the reconstruction speed, the better the stability of the storage system. [0003] In practical applications, the nodes that make up an erasure code in redistributed storage may be distributed in different...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/07
CPCG06F11/0793G06F11/0727
Inventor 陈玉强周士钦胡波
Owner 中电云数智科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products