Cloud storage system and implement method based on erasure code technological improvement

A cloud storage system and technology improvement technology, applied in the field of distributed file system, can solve the problems of unfavorable green resource scheduling, green data center development, storage space waste, etc., and achieve the effects of high stability, cost reduction, and high reliability

Active Publication Date: 2014-07-23
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF3 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the data backup method used in this invention is still a traditional copy strategy. This strategy will cause a lot of waste of storage space durin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cloud storage system and implement method based on erasure code technological improvement
  • Cloud storage system and implement method based on erasure code technological improvement
  • Cloud storage system and implement method based on erasure code technological improvement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The invention improves the file backup strategy in the cloud storage system, further reduces the space occupation cost caused by redundant backup, and ensures the reliability, availability and fault tolerance of the system at the same time. The file uploading and data block recovery process of the present invention will be further described below in conjunction with the accompanying drawings and specific implementation methods.

[0044] Such as figure 2 As shown, the nodes and functions included in the improved cloud storage system architecture based on erasure code technology:

[0045] Metadata management node 2. The metadata management node 2 is the manager of the original data in the cloud storage system. It is responsible for managing the namespace of the file system, maintaining the file tree of the file system and metadata of all files and directories. At the same time, the metadata management node 2 also saves the mapping relationship between each file and eac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cloud storage system and implement method based on erasure code technological improvement and relates to a distributed file system. The method includes the steps of building a metadata management node, a data storage node, a recovery management node, a work management node and a client node, storing and reading data through the metadata management node, the data storage node and the client node according to the erasure code technology, and recovering lost or damaged data blocks after the erasure code technology is adopted through the recovery management node and the work management node. The recovery process of erasure codes is separated from a file management node of the cloud storage system, burdens of the metadata management node in the recovery process are relieved, and the stability, high reliability and high availability of the system in the recovery process are ensured.

Description

technical field [0001] The invention belongs to the distributed file system, especially to ensure the high reliability, high availability and high fault tolerance of the distributed file system. Background technique [0002] In recent years, with the explosive growth of data, a large number of data-intensive applications such as high-performance computing, medical imaging, oil and gas exploration, digital media and social networking have led to a blowout of data. According to research, the digital universe will be in 2020. Reached 35.2ZB, a 44-fold increase from 0.8ZB in 2009, and how to ensure the system's high reliability, high stability and high availability of stored data with the lowest possible space overhead. [0003] In the traditional cloud storage system, adopting the replication strategy to improve the reliability of the distributed file system can guarantee the reliability of the system to a certain extent, but with the explosive growth of data, adopting a single...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 刘晓东孙毓忠
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap