Data placing method aiming at erasure codes

An erasure code and data technology, applied in the field of data placement oriented to erasure codes, can solve problems such as difficulty in effectively meeting performance requirements, achieve both data reliability and data repair efficiency, avoid the impact of data reliability, and improve fault tolerance. effect of ability

Active Publication Date: 2014-09-10
NAT UNIV OF DEFENSE TECH
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the random placement method can balance data reliability and data access efficiency to a certain extent, it is difficult to effectively meet the performance requirements of large-scale distributed storage systems for data access efficiency and data reliability, and cannot provide effective support for improving data repair efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data placing method aiming at erasure codes
  • Data placing method aiming at erasure codes
  • Data placing method aiming at erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] figure 1 It is a physical structure diagram of the distributed storage system constructed in the first step of the present invention. The nodes of the distributed storage system are composed of control nodes and storage nodes. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. The control node and the storage node are connected through an interconnection network.

[0065] figure 2 It is a software deployment diagram of the distributed storage system of the present invention. An operating system, TCP / IP network software, and a data writing management program are installed on the control node. Wherein the operating system and the TCP / IP network software are general software, which are obtained from publicly issued software packages; the data writing management program is the special software of the present invention. An operating system, TCP / IP network software, and a data writing program are installed ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data placing method aiming at erasure codes and aims to increase the fault-tolerant capacity of a large-scale distributed storage system. According to technical scheme, the method includes: the distributed storage system formed by a control node and M frames (N storage nodes are mounted on each frame) is built, a data writing managing program is installed on the control node, and a data writing program is installed on each storage node; the control node execute the data writing managing program, receives a data object writing request submitted by a user, performs partitioning and encoding calculation to data objects to obtain original data blocks and redundant data block, and transmits a data block writing request to each storage node; the data writing programs of storage nodes receive the data writing requests from the control node, and write the original data blocks or the redundant data blocks into a local disk. The method has the advantages that data access efficiency, data reliability and data recovery efficiency of the distributed storage system are effectively considered, and the fault-tolerant capacity of the large-scale distributed storage system is increased to the maximum extent.

Description

technical field [0001] The invention relates to a data fault-tolerant technology of a distributed storage system, in particular to a data placement method oriented to an erasure code. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data, and data fault tolerance is crucial to improving system availability and reliability. Currently, data fault-tolerant technologies mainly include fault-tolerant technologies based on replication and fault-tolerant technologies based on erasure codes. [0003] The fault-tolerant technology based on replication is simple and intuitive, easy to implement and deploy, and needs to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure code divides the data object into multiple data blocks, and encodes the original data block by using the erasure code algorithm to obtain redun...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F11/07
Inventor 王意洁许方亮裴晓强符永铨孙伟东程力李小勇马行空王媛赵越林轩熊泽宇
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap