Distributed storage system and distributed storage method based on erasure coding mechanism

A distributed storage and erasure coding technology, applied in the storage field, can solve problems such as weak data consistency and increased complexity, and achieve the effect of ensuring reliability and saving storage space

Active Publication Date: 2014-03-12
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As the number of cloud storage users continues to increase, it is estimated that by the end of 2014, user data will exceed 200PB. If the three-copy mechanism continues to be used, the cos

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system and distributed storage method based on erasure coding mechanism
  • Distributed storage system and distributed storage method based on erasure coding mechanism
  • Distributed storage system and distributed storage method based on erasure coding mechanism

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like parts throughout. The embodiments will be described below in order to explain the present invention by referring to the figures.

[0029] figure 1 A block diagram of a distributed storage system based on an erasure coding mechanism according to an exemplary embodiment of the present invention is shown. refer to figure 1 , the distributed storage system according to an exemplary embodiment of the present invention includes: a management layer system 10 and a storage bottom layer system 20, wherein the management layer system 10 includes a plurality of node devices for performing erasure coding on the written data, and The erasure-coded data is provided to the storage underlying system 20; the storage underlying system 20 includes a plurality of storage servers for distributing the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed storage system and a distributed storage method based on an erasure coding mechanism. The distributed storage system comprises a management layer system and a storage bottom layer system, wherein the management layer system comprises a plurality of node devices and is used for performing erasure coding on written data and providing data subjected to erasure coding for the storage bottom layer system; the storage bottom layer system comprises a plurality of storage servers and is used for storing the data subjected to erasure coding in a distributed manner; the index information of the data in the storage bottom layer system is stored in N node devices in the plurality of node devices in a copy form respectively, and N is an integer more than 1. According to the mode, the distributed storage space can be reduced and the reliability is ensured.

Description

technical field [0001] The present application relates to storage technologies, and more specifically, to a storage system and storage method for distributedly storing data based on an erasure coding mechanism. Background technique [0002] With the development of Internet technology, achieving reliable mass data storage has become a huge challenge. At present, the back-end storage systems in the Internet mostly use a three-copy mechanism (for example, a key-value pair (key-value) distributed storage system), so that data is stored in three different locations to improve the reliability of data storage. For example, data and metadata for rights management, namespaces, and file objects can all be stored in the cloud storage system, wherein the data or metadata for each cloud storage is stored on three different storage servers. [0003] However, the distributed storage system based on the three-copy mechanism has the following disadvantages: [0004] 1. The storage cost is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 黄浩
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap