Data-center-oriented generalized network coding fault-tolerant storage platform and working method for same

A network coding and data-oriented technology, which is applied to the data center-oriented generalized network coding fault-tolerant storage platform and the work field, can solve the problems of excessive storage overhead, data transmission bandwidth consumption, increase of failure repair storage space, etc., and achieve reduction The effect of storage redundancy, meeting reliability requirements, and meeting scalability

Inactive Publication Date: 2014-01-29
南京大学镇江高新技术研究院 +2
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, as the storage efficiency of large-capacity data and private data becomes higher and higher, the data fault-tolerant storage mechanism based on multiple copies used in the existing d

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data-center-oriented generalized network coding fault-tolerant storage platform and working method for same
  • Data-center-oriented generalized network coding fault-tolerant storage platform and working method for same
  • Data-center-oriented generalized network coding fault-tolerant storage platform and working method for same

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The invention provides a data center-oriented universal network coding fault-tolerant storage platform and a realization method thereof. A detailed description will be given below in conjunction with the accompanying drawings.

[0046] The system architecture diagram is as follows figure 1shown. In this storage platform, the name node acts as the core server, and there is only one in the whole system. The name node acts as the master node in the system, manages the mapping between data blocks in the file system and data nodes and the configuration information of the entire cluster, etc. In addition, the name node is also responsible for the namespace operation of the file system, such as opening and closing of the file system and renaming directories or files. As a slave node, there are several data nodes in the whole system, and the data in the system will be stored in the data nodes. Under the scheduling of the name node, the data node can create, delete, and trans...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data-center-oriented generalized network coding fault-tolerant storage platform and an implementation method for the same. A system mainly comprises a name node, a plurality of data nodes and a coding agent node which form the data-center-oriented distributed storage platform, and the data nodes are used for storage. The implementation method mainly includes designing a uniform processing frame on the basis of network coding; performing data coding and distributed storage processes; integrating different coding schemes; performing recovering processing. The data-center-oriented generalized network coding fault-tolerant storage platform and the implementation method have the advantages that the storage platform is data-center-oriented, the uniform processing frame on the basis of network coding is provided, and stored files are coded, so that the purpose of reducing storage redundancy of the system and a transmission bandwidth can be achieved under the condition of identical reliability of the system; the system provides integration of the different coding schemes and accordingly is extensible.

Description

[0001] technical field [0002] Based on an open-source distributed storage platform, the invention studies the problems of redundant overhead and extra transmission bandwidth brought about by multi-copy-based data fault-tolerant technology. On this basis, by introducing the mainstream data fault-tolerant coding technology in information theory, the system architecture is extended, and a generalized data center-oriented network coding fault-tolerant storage platform and its working method are designed and implemented. Background technique [0003] With the rapid development of Internet technology and the rapid expansion of massive data, the storage and management of massive data has become a hot spot in the industry, and it is also an important supporting technology for "big data processing". Distributed storage systems are widely used because they support large-capacity storage, provide good scalability, and can quickly adapt to system changes in terms of capacity, performa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F11/10
CPCG06F16/13H04L67/1097
Inventor 薛艳陈正亮叶保留吴小志李东辉
Owner 南京大学镇江高新技术研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap