Data redundancy processing method, device and distributed storage system

A data redundancy and processing method technology, applied in the storage field, can solve problems such as low flexibility, increased storage node load, and low storage space utilization, and achieve the effect of meeting reliability requirements and high flexibility

Active Publication Date: 2011-12-14
CHENGDU HUAWEI TECH
View PDF4 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the above-mentioned existing multi-copy mechanism simply writes the same data to multiple storage nodes. If it is necessary to ensure that the data is still available after N storage nodes are damaged, at least N+1 copies of the data need to be repeatedly written, and the...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data redundancy processing method, device and distributed storage system
  • Data redundancy processing method, device and distributed storage system
  • Data redundancy processing method, device and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0029] Before specifically describing the technical solution of this embodiment, firstly, an array of independent redundant object sets (Redundant Array of Independent objectSet, hereinafter referred to as: RAIS), an object set (combination of objects, hereinafter referred to as: ObjectSet) and the relationship between objects (which may be physic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method and device for processing data redundancy and distributed storage system are provided. The method comprises: generating M pieces of slice data and N pieces of redundancy slice data of data to be written by using a redundancy algorithm (403), wherein when at most N pieces of data among said M pieces of slice data and N pieces of redundancy slice data are arbitrarily damaged, the damaged data can be recovered by using the undamaged data, with M being a natural number which is more than 1, and N being a natural number which is not less than 1; and respectively storing said M pieces of slice data and N pieces of redundancy slice data into objects located in at least two storage nodes (404), wherein each storage node contains at least one object set, and each object set contains s at least one object. The method can improve utilization rates of storage spaces and storage loads are reduced, moreover, different redundancy algorithms can be supported, thus different requirements for reliability of customers can be met and the flexibility is relatively higher.

Description

technical field [0001] Embodiments of the present invention relate to storage technologies, and in particular, to a data redundancy processing method, device, and distributed storage system. Background technique [0002] A distributed storage system includes multiple storage nodes interconnected through a network, and data can be distributed and stored on different storage nodes to achieve large-capacity, high-reliability, and easy-to-expand storage applications. [0003] Existing distributed storage systems can use object-based storage. For this storage method, the prior art adopts a multi-copy mechanism among storage nodes to ensure the reliability of data storage. Specifically, the multi-copy mechanism is to use one or several storage nodes in the distributed storage system as backup nodes of the main storage node. When writing data, it is necessary to write multiple copies of the same data on these storage nodes, so as to realize redundant backup of data. When a storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/14G06F3/06
CPCG06F3/06G06F11/1076G06F11/14
Inventor 曹宇
Owner CHENGDU HUAWEI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap