Distributed file system facing to cloud storage

A distributed file and cloud storage technology, applied in the computer field, can solve the problems of not realizing the simultaneous transfer of computing and storage, loss of computing resources and service capabilities, and failure to meet the requirements of consistency, so as to ensure scalability and reliability. , Overcome the single point failure problem and improve the effect of parallel processing performance

Inactive Publication Date: 2012-04-18
XIDIAN UNIV
View PDF0 Cites 49 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] 1) A single master control node makes the load of the system uneven
[0011] 2) Although the monitoring process guarantees the transfer of computing to storage, it does not realize the simultaneous transfer of computing and storage in task processing, otherwise it may cause task restart, and for giant tasks, the loss of computing resources and service capabilities is huge
[0016] 1) The d

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system facing to cloud storage
  • Distributed file system facing to cloud storage
  • Distributed file system facing to cloud storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] refer to figure 1 , the cloud storage-oriented file system of the present invention includes a block data service layer, a metadata service layer and a client application layer sequentially from the inside to the outside.

[0037] The block data service layer is composed of a large number of data block servers and the failure of the servers is handled as normal. These servers are composed of cheap computers. Each data block server runs a Linux file system and manages a large number of data block. Among them, the data block server has the following functions:

[0038] 1) Manage data block information, that is, use an efficient data structure to organize tens of thousands of data blocks existing on the block data server, and centrally manage these data block information.

[0039] 2) Reading and writing of data blocks, that is, the client frequently reads and writes data blocks, and the block data server reads and writes data blocks in a streaming manner, and at the same...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed file system facing to cloud storage, mainly aiming at solving the problem that the existing cloud storage system is low in performance and reliability, high in load and invalid in a single point. The system comprises a block data service layer, a metadata service layer and an application client layer, wherein the metadata service layer replaces single metadata server in a global file system (GFS) by a plurality of agent servers, and forms into peer-to-peer type service network by adopting peer-to-peer P2P network configuration; the interaction among three layers of the system comprises the following steps: the application client layer requests to write to the metadata service layer, and the metadata service layer returns block data server information; and the client layer writes the file into the block data service layer and performs the redundancy backups according to a returned result, and the metadata service layer generates metadata according to a backups result and updates local metadata and a vector clock. Therefore, the performance and the business support capacity of the existing cloud storage system can be enhanced, and the system can be used for designing and optimizing the high-performance and high-reliability cloud storage system.

Description

technical field [0001] The invention belongs to the field of computer technology, in particular to a cloud storage-oriented distributed file system, which can effectively enhance the reliability and performance of the cloud storage-oriented distributed file system, and can be used for the design and optimization of high-performance and high-reliability cloud storage systems. Background technique [0002] Cloud storage is the foundation and support of cloud computing systems, and also the core system for providing cloud computing IaaS services. It is a complex distributed file system. Existing distributed file systems have many mature and simple architecture solutions, but they cannot meet the requirements of cloud storage and cloud computing systems. The main reason is that the distributed file system for cloud storage should be built on the basis of ultra-large scale, and has the ability to store massive files, read and write efficiency with high concurrency and low latenc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 樊凯李晖赵黎斌陈曦王康
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products