Unlock instant, AI-driven research and patent intelligence for your innovation.

Data reconstruction method and device

A technology of data reconstruction and data slicing, which is applied in the direction of redundant code error detection, input/output to record carrier, generation of response error, etc. Communication pressure and other issues

Pending Publication Date: 2022-07-01
ALIBABA (CHINA) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In other words, the target node cannot be randomly selected in the entire server cluster, but can only be selected within a small range, that is, the selection range of the target node is relatively limited
[0005] Since reconstructing the data itself requires a large amount of bandwidth, when the number of fault domains in the server cluster is small, the above-mentioned limitation of the target node will make the communication pressure of the target node greater

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reconstruction method and device
  • Data reconstruction method and device
  • Data reconstruction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numerals in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments are not intended to represent all implementations consistent with one or more embodiments of this specification. Rather, they are merely examples of apparatus and methods consistent with some aspects of one or more embodiments of this specification, as recited in the appended claims.

[0056] It should be noted that: in other embodiments, the steps of the corresponding methods are not necessarily performed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than described in this specification. In addition, a single step described in this specificat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data reconstruction method and device which are applied to a distributed storage system, and the distributed storage system comprises a metadata node and a plurality of data nodes. The metadata node selects a storage node according to a fault domain of an erasure code EC check group corresponding to a storage target data piece; the target data piece is a data piece to be reconstructed, and the storage node does not belong to other fault domains storing the EC verification group except the fault domain storing the target data piece; the metadata node selects a reconstruction node from the plurality of data nodes; the reconstruction node obtains other data pieces and verification pieces of an EC verification group corresponding to the target data piece, and reconstructs the target data piece according to the obtained other data pieces and verification pieces; and the reconstruction node sends the reconstructed target data piece to the storage node, and the storage node stores the reconstructed target data piece.

Description

technical field [0001] One or more embodiments of this specification relate to the field of computer applications, and in particular, to a data reconstruction method and apparatus. Background technique [0002] In a distributed storage system, in order to ensure the reliability of data, erasure coding (EC) check group is used to store data, that is, a piece of data is divided into multiple pieces of data, and multiple pieces are generated based on multiple pieces of data. Check slices (multiple data slices corresponding to a piece of data and multiple check slices together form an EC check group), and store the multiple pieces of data slices and multiple pieces of check slices in different node devices, such as one device A data slice or a check slice is stored in it. In this way, even if any node device fails, only one piece of data will be lost, and when any one piece of data is lost, the lost piece of data can be reconstructed through other pieces of data and check piece...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/10
CPCG06F3/0614G06F3/0644G06F3/067G06F11/1044
Inventor 王竹凡庄灿伟邱晗董元元
Owner ALIBABA (CHINA) CO LTD