Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed storage system and distributed storage method based on erasure coding mechanism

A distributed storage and erasure coding technology, applied in the storage field, can solve problems such as weak data consistency and increased complexity, and achieve the effect of ensuring reliability and saving storage space

Active Publication Date: 2014-03-12
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As the number of cloud storage users continues to increase, it is estimated that by the end of 2014, user data will exceed 200PB. If the three-copy mechanism continues to be used, the cost of redundant data will reach an intolerable level
[0005] 2. Data consistency is weak
This will increase the complexity for users when using applications based on the above storage methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system and distributed storage method based on erasure coding mechanism
  • Distributed storage system and distributed storage method based on erasure coding mechanism
  • Distributed storage system and distributed storage method based on erasure coding mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like numerals refer to like parts throughout. The embodiments are described below in order to explain the present invention by referring to the figures.

[0029] figure 1 A block diagram showing a distributed storage system based on an erasure coding mechanism according to an exemplary embodiment of the present invention. refer to figure 1 , the distributed storage system according to an exemplary embodiment of the present invention includes: a management layer system 10 and a storage bottom layer system 20, wherein the management layer system 10 includes a plurality of node devices for performing erasure coding on written data, and The erasure coded data is provided to a storage underlay system 20; the storage underlay system 20 includes a plurality of storage servers for distributing the storage erasure coded data. He...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed storage system and a distributed storage method based on an erasure coding mechanism. The distributed storage system comprises a management layer system and a storage bottom layer system, wherein the management layer system comprises a plurality of node devices and is used for performing erasure coding on written data and providing data subjected to erasure coding for the storage bottom layer system; the storage bottom layer system comprises a plurality of storage servers and is used for storing the data subjected to erasure coding in a distributed manner; the index information of the data in the storage bottom layer system is stored in N node devices in the plurality of node devices in a copy form respectively, and N is an integer more than 1. According to the mode, the distributed storage space can be reduced and the reliability is ensured.

Description

technical field [0001] The present application relates to storage technologies, and more specifically, to a storage system and storage method for distributedly storing data based on an erasure coding mechanism. Background technique [0002] With the development of Internet technology, achieving reliable mass data storage has become a huge challenge. At present, the back-end storage systems in the Internet mostly use a three-copy mechanism (for example, a key-value pair (key-value) distributed storage system), so that data is stored in three different locations to improve the reliability of data storage. For example, data and metadata for rights management, namespaces, and file objects can all be stored in the cloud storage system, wherein the data or metadata for each cloud storage is stored on three different storage servers. [0003] However, the distributed storage system based on the three-copy mechanism has the following disadvantages: [0004] 1. The storage cost is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
Inventor 黄浩
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com