A reconstruction optimization method based on erasure code cache

An optimization method and erasure code technology, applied in the direction of memory system, response error generation, redundant code error detection, etc., can solve the problems of increased response time, reduced system reliability, and increased reconstruction time, etc., to achieve The effect of ensuring mutual independence, improving data reliability, and shortening response time

Active Publication Date: 2016-08-31
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The write invalidation process in traditional erasure code storage clusters has the following problems: First, the process of writing invalid data nodes and the process of reconstructing invalid data are carried out at the same time, and the two processes compete with each other for resources such as network bandwidth, disk, and memory, and the reconstruction time As a result, the reliability of the system is reduced; in addition, the client's write request involves three operations: recovery of invalid data, writing of new data, and updating of verification data, so the response time of the client's write request will also increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A reconstruction optimization method based on erasure code cache
  • A reconstruction optimization method based on erasure code cache
  • A reconstruction optimization method based on erasure code cache

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0032] Below at first explain and illustrate with regard to the technical terms of the present invention:

[0033] Pre-allocated buffer: pre-apply for a fixed-size continuous memory in the node's memory to temporarily store data. In the present invention, we use the pre-allocated memory of the surviving node to buffer the request record written by the client to the failed node. While improving...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a reconfiguration optimization method based on erasure code caching. The reconfiguration optimization method based on erasure code caching comprises a failure data caching process and a cached data migration process; the failure data caching process comprises the steps of receiving a client request record from a write miss data node of a client, writing the client request record in a data area in an erasure code cache region which is composed of pre-allocated memories of survived nodes in a cluster, updating a check area in the erasure code cache region according to the original data in the data area in the erasure code cache region and the new written client request record, and returning the completion result of the write miss data node to the client; the cached data migration process comprises the steps of reading one client request record in the erasure code cache region, reading data from a position of which a data offset address is offset in a substitute node corresponding to a failure node, and writing new data corresponding to the client request record in a position of which a write data offset address is offset in the substitute node. The reconfiguration optimization method based on erasure code caching is capable of improving the reconstruction performance of the failure data nodes and also capable of reducing the response time of the client to write miss.

Description

technical field [0001] The invention belongs to the field of computer storage, and more specifically relates to a reconstruction optimization method based on an erasure code cache. Background technique [0002] The erasure code cluster storage connects multiple storage nodes according to the erasure code method to form a storage system with certain fault tolerance. The multiple storage nodes constituting the erasure code cluster storage can be logically regarded as a large storage pool, and each node works at the same time to improve I / O parallelism. Due to the use of erasure coding algorithm, in the case of a certain number of storage nodes failure, the data on the failure nodes can be decoded to achieve the purpose of fault tolerance. Generally, data recovery operations and client I / O interact with each other. On the one hand, during the recovery process of lost data, the read and write performance of the cluster storage will decrease; on the other hand, compared with th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F11/10G06F12/0808
Inventor 黄建忠曹强谢长生王艳群梁先海
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products