Data storage method, recovery method, related device and system

A data storage device and data storage technology, which are applied in multi-programming devices, electrical digital data processing, input/output process of data processing, etc., can solve problems such as poor storage consistency of distributed storage systems and inconsistent storage of EC strips.

Active Publication Date: 2017-11-21
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, it takes a certain amount of time to write the EC block to the storage node
If among the m+k storage nodes used to store a certain EC stripe, a storage node fails when writing the EC block, some storage nodes will have the EC block of the EC stripe, while the other part will If the storage node does not have the EC block of the EC stripe, the storage of the EC stripe is inconsistent, and the storage consistency of the distributed storage system is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, recovery method, related device and system
  • Data storage method, recovery method, related device and system
  • Data storage method, recovery method, related device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0127] An embodiment of the present invention provides a data storage method for improving the consistency of a distributed storage system. Embodiments of the present invention also provide a synchronization method, a related device, and a system, which will be described respectively below.

[0128] A distributed storage system includes multiple storage nodes. The upper-layer data sending device divides the data to be stored into multiple data blocks, and then sends them to multiple storage nodes of the distributed storage system for storage. Distributed storage of data can reduce the risk of data loss and improve the reliability of the distributed storage system. Wherein, the data sending device may be a client, a server or other devices.

[0129] The principle of EC technology is to divide the data to be stored into m data blocks, and use the redundant algorithm to check and encode the m data blocks to generate k check blocks. The m data blocks and the k check blocks An E...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data storage method for improving the storage consistency of a distributed storage system. The method in the embodiment of the present invention includes: the main storage node performs EC coding on the data segment to be stored to obtain the target EC strip; and determines the m+k target EC blocks used to store the target EC strip in the storage node group. k target storage nodes; send a preparation message to the target storage node; receive the response message sent by the target storage node; after receiving the response messages from all target storage nodes, send an execution message to the target storage node, indicating that the target storage node is ready to write The target EC block in the log. The embodiment of the present invention also provides a data recovery method and a related device.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a data storage method, a recovery method, a related device and a system. Background technique [0002] More and more distributed storage systems at the present stage use Erasure Code (EC, Erasure Code) technology to store data. The principle of erasure code technology is to divide the data into m data blocks, and use the redundant algorithm to perform check coding on the m data blocks to generate k check blocks. The m data blocks and the k check blocks are called for an EC strip. Wherein, a data block or a check block is also called an EC block, and each EC stripe can tolerate the loss of k EC blocks. [0003] In order to ensure the reliability of storage, the distributed storage system will deliver m+k EC blocks of each EC stripe to m+k storage nodes for storage. In this way, even if a node fails, the EC block stored in the failed node can be recovered according to the data stored...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/10
CPCG06F3/0617G06F3/0619G06F3/0631G06F3/064G06F3/067G06F9/466G06F9/5011G06F11/1076G06F11/10G06F11/00
Inventor 王道辉张烽樊伟张志乐曾永强
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap