Local data updating method based on erasure code cluster storage system

A cluster storage and data update technology, applied in the direction of response error generation, redundant code error detection, input/output to record carrier, etc., can solve time-consuming optimization that affects system response time and bandwidth loss, and no data update , Affecting data node updates and other issues, to achieve the effect of improving read and write speed and update efficiency, reducing load, and avoiding bottlenecks

Inactive Publication Date: 2012-09-19
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the existing erasure code cluster storage system has the following problems: the strategy for data update is only managed by a simple update manager, and the consumed network bandwidth and time-consuming data update are not sufficiently optimized; in addition , due to the encoding characteristics of erasure codes, when there is data update, in addition to affecting the up

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Local data updating method based on erasure code cluster storage system
  • Local data updating method based on erasure code cluster storage system
  • Local data updating method based on erasure code cluster storage system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] In order to make the objectives, technical solutions and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0025] Such as figure 2 with image 3 As shown, the localized data update method of the erasure code cluster storage of the present invention includes the following steps:

[0026] (1) Receive data D sent by the user 0 Update request, and according to the update request, the data D 0 Update to D 0 ’; It needs to be understood that the present invention uses only data node D for the purpose of clear examples 0 The data update method is described, but the present invention is by no means limited to this;

[0027] (2) The updated data D 0 ’Send to the data node to be updated;

[0028] (3) The data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a local data updating method based on an erasure code cluster storage system, which comprises the following steps: receiving a data D0 updating request sent by a user; updating a data D0 into a data D0'; sending the data D0' to a data node to be updated; reading the data D0' from a local disc to a memory by the data node to be updated; calculating a provisional data block set needed by m redundant nodes in the memory of the data node to be updated; writing the data D0' into the local disc by the data node to be updated; sending m provisional data blocks onto the m redundant nodes by the data node to be updated through the network at the same time; reading an original redundant data Pj by the j redundant node from the local disc, and calculating to obtain a new check data Pj'; and writing the check data block Pj' obtained through calculating into the local disc by the redundant node. Due to the adoption of the local data updating method based on the erasure code cluster storage system, the consumption of the bandwidth can be reduced effectively, the load pressure of the update server can be decreased, and the data updating performance can be improved.

Description

technical field [0001] The invention belongs to the field of data storage, and more specifically relates to a partial data update method based on an erasure code cluster storage system. Background technique [0002] In recent years, multicast transmission has become an important component of the Internet. When large-scale software is transmitted to many users through the Internet, multicast or broadcast transmission is required. These transports must be completely reliable, while having low network overhead and supporting random access by a large number of various users. To achieve this goal, a coding method is needed, that is, to encode the transmitted k-bit original data into n (n>k)-bit data and send it out. If the receiver receives enough data, it will use appropriate The decoding method can restore the source data of k bits, and this code is called a forward error correction code, or an erasure correction code. [0003] It is precisely because of the high fault tol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F11/08
Inventor 黄建忠曹强谢长生张峰豪刘政泽
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products