Distributed file system facing to cloud storage

Abstract

The invention provides a distributed file system facing to cloud storage, mainly aiming at solving the problem that the existing cloud storage system is low in performance and reliability, high in load and invalid in a single point. The system comprises a block data service layer, a metadata service layer and an application client layer, wherein the metadata service layer replaces single metadata server in a global file system (GFS) by a plurality of agent servers, and forms into peer-to-peer type service network by adopting peer-to-peer P2P network configuration; the interaction among three layers of the system comprises the following steps: the application client layer requests to write to the metadata service layer, and the metadata service layer returns block data server information; and the client layer writes the file into the block data service layer and performs the redundancy backups according to a returned result, and the metadata service layer generates metadata according to a backups result and updates local metadata and a vector clock. Therefore, the performance and the business support capacity of the existing cloud storage system can be enhanced, and the system can be used for designing and optimizing the high-performance and high-reliability cloud storage system.

Description

technical field [0001] The invention belongs to the field of computer technology, in particular to a cloud storage-oriented distributed file system, which can effectively enhance the reliability and performance of the cloud storage-oriented distributed file system, and can be used for the design and optimization of high-performance and high-reliability cloud storage systems. Background technique [0002] Cloud storage is the foundation and support of cloud computing systems, and also the core system for providing cloud computing IaaS services. It is a complex distributed file system. Existing distributed file systems have many mature and simple architecture solutions, but they cannot meet the requirements of cloud storage and cloud computing systems. The main reason is that the distributed file system for cloud storage should be built on the basis of ultra-large scale, and has the ability to store massive files, read and write efficiency with high concurrency and low latenc...

AI Technical Summary

Problems solved by technology

[0010] 1) A single master control node makes the load of the system uneven

[0011] 2) Although the monitoring process guarantees the transfer of computing to storage, it does not realize the simultaneous transfer of computing and storage in task processing, otherwise it may cause task restart, and for giant tasks, the loss of computing resources and service capabilities is huge

[0016] 1) The design of Dynamo's final consistency and synchronization is valuable for node failures, but it is impossible to estimate how much data is not synchronized

[0017] 2) Many consistency problems of Dynamo are caused by the decentralized design

In some specific environmental applications, the above system can show better availability and reliability, but the consistency is not up to the requirements

Images