Data storage method, data recovery method, and relevant device and system

A data storage and data block technology, applied in multi-programming devices, electrical digital data processing, input/output process of data processing, etc., can solve the problems of inconsistent storage of EC strips, poor storage consistency of distributed storage systems, etc.

Active Publication Date: 2015-11-25
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF9 Cites 63 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, it takes a certain amount of time to write the ECblock to the storage node
If among the m+k storage nodes used to store a certain EC stripe, a storage node fails when writing the ECblock, some storage nodes will have the ECblock of the EC stripe, while the other part of the storage nodes will If there is no ECblock of the EC stripe, the storage of the EC stripe is inconsistent, and the storage consistency of the distributed storage system is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, data recovery method, and relevant device and system
  • Data storage method, data recovery method, and relevant device and system
  • Data storage method, data recovery method, and relevant device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0127] The embodiment of the present invention provides a data storage method for improving the consistency of a distributed storage system. The embodiments of the present invention also provide a synchronization method, related devices, and systems, which will be described separately below.

[0128] The distributed storage system includes multiple storage nodes. The upper data distribution device divides the data to be stored into multiple data blocks, and then distributes them to multiple storage nodes of the distributed storage system for storage. Distributed storage of data can reduce the risk of data loss and improve the reliability of distributed storage systems. Among them, the data distribution device may be a client, a server, or other equipment.

[0129] The principle of EC technology is to divide the data to be stored into m data blocks, and use a redundancy algorithm to check and encode the m data blocks to generate k check blocks, the m data blocks and k check blocks...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method for improving the storage consistency of a distributed memory system in an embodiment. The method comprises: a major storage node performs EC coding on a data fragment to be stored to obtain a target EC stripe; (m+k) target storage nodes for storing (m+k) target EC blocks of the target EC stripe are determined in a storage node group; a preparation message is sent to the target storage nodes; a response sent by each target storage node is received; and after the response messages of all the target storage nodes are received, an execution message is sent to the target storage nodes to instruct the target storage nodes to write in the target EC blocs in a preparation log. The embodiment of the invention further provides a data recovery method and a relevant device.

Description

Technical field [0001] The present invention relates to the field of data storage, in particular to data storage methods, recovery methods, related devices and systems. Background technique [0002] At this stage, distributed storage systems are increasingly using erasure code (EC, Erasure Code) technology to store data. The principle of erasure coding technology is to divide data into m data blocks, and use redundancy algorithm to check and encode m data blocks to generate k check blocks. The m data blocks and k check blocks are called It is an EC strip. Among them, the data block or check block is also called ECblock, and each EC strip can tolerate the loss of k ECblocks. [0003] In order to ensure the reliability of storage, the distributed storage system will give m+k ECblocks of each EC strip to m+k storage nodes for storage. In this way, even if a node fails, the ECblock stored in the failed node can be recovered based on the data stored in other nodes. It is understanda...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/10
CPCG06F3/0617G06F3/0619G06F3/0631G06F3/064G06F3/067G06F9/466G06F9/5011G06F11/1076G06F11/10G06F11/00
Inventor 王道辉张烽樊伟张志乐曾永强
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap