Data distribution method, data storage method, and relevant device and system

A technology of data storage device and data distribution device, which is applied in the direction of electric digital data processing, input/output process of data processing, generation of response errors, etc., and can solve time-consuming, large read and write delays, frequent lock grabbing of data distribution devices And lock switching and other issues

Active Publication Date: 2015-09-23
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF10 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, if the distributed lock method is used to solve the conflict problem of multiple data distribution devices, when the upper-layer application distributes IO in different data distribution devices, it will lead to frequent lock gr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distribution method, data storage method, and relevant device and system
  • Data distribution method, data storage method, and relevant device and system
  • Data distribution method, data storage method, and relevant device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0161] An embodiment of the present invention provides a data distribution method for improving the performance of a distributed storage system. Embodiments of the present invention also provide related data storage methods, related devices, and systems, which will be described respectively below.

[0162] A distributed storage system includes multiple storage nodes. The data distribution device at the upper layer divides the data to be stored into multiple data blocks, and then distributes them to multiple storage nodes of the distributed storage system for storage. Distributed storage of data can reduce the risk of data loss and improve the reliability of the distributed storage system. Wherein, the data distribution device may be a client, a server or other devices.

[0163] The principle of EC technology is to divide the data to be stored into m data blocks, and use the redundant algorithm to check and encode the m data blocks to generate k check blocks. The m data block...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data distribution method, which is used for improving the performance of a distribution storage system. The embodiment of the invention comprises the following steps: a data distribution device receives a storage instruction of a user; to-be-stored data which is indicated to be stored by the storage instruction is divided into P data segments; a storage node group corresponding to each data segment is determined; and finally, each data segment is distributed to the main node of the corresponding storage node group. The embodiment of the invention also provides a relevant data storage method and a relevant device and system.

Description

technical field [0001] The present invention relates to the field of data storage, in particular to a data distribution method, a data storage method, a related device and a system. Background technique [0002] More and more distributed storage systems at the present stage use Erasure Code (EC, Erasure Code) technology to store data. The principle of erasure code technology is to divide the data into m data blocks, and use the redundancy algorithm to check and encode the m data blocks to generate k check blocks, which are composed of m data blocks and k check blocks An EC strip. Each EC stripe can tolerate the loss of k data blocks or parity blocks. [0003] In the erasure code technology, the data distribution device performs EC coding on the data, generates m data blocks and k check blocks, and then distributes them to m+k storage nodes. If multiple data distribution devices read and write data of the same EC stripe at the same time, a distributed lock needs to be used...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10
CPCG06F3/0604G06F3/0611G06F3/0619G06F3/0631G06F3/064G06F3/0644G06F3/067G06F11/1004Y02D10/00
Inventor 王道辉张烽樊伟张志乐曾永强
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap