Distributed file system metadata copy synchronization method for wide area network

Abstract

The invention provides a distributed file system metadata copy synchronization method for a wide area network. In the embodiment of the invention, a metadata synchronization service of a copy space can be constructed, a request of a client is obtained, consensus groups of different levels are selected according to a file access state tree maintained by a consensus protocol running on a wide area network to submit the request, and conflict avoidance is carried out; compared with a consensus protocol without hierarchical difference running on a wide area network, the method has the advantages that the number of proposal schemes on the wide area network can be reduced, and then the IOPS of metadata operation is improved.

Description

technical field [0001] The invention discloses a method for synchronizing metadata copies of a distributed file system facing a wide area network, relates to challenges faced by wide-area high-performance computing, and belongs to the technical field of computers. Background technique [0002] Cross-domain virtual data space is an important research topic born in the wide-area high-performance computing environment in order to exert the aggregation effect of dispersed resources and effectively support large-scale computing applications. In the current wide-area high-performance computing environment, the geographical location of each supercomputing center is scattered, and the network topology is complex, which leads to long delay and interference of remote access in the cross-domain virtual data space. In order to improve access performance, increase data security, and support the scheduling of stored data, research on cross-domain copy technology has become an urgent need ...

AI Technical Summary

Problems solved by technology

[0004] First of all, the consistency problem has always been the biggest challenge of the distributed storage replica mechanism. Bengfort pointed out in the research that the distributed storage system in a single data center can achieve the balance between consistency and performance by relaxing strong consistency. However, for wide-area distributed As far as the storage system is concerned, the huge data synchronization delay and too small bandwidth will amplify the consistency problem between multi-center replicas

[0008] The second type of method, that is, the metadata consistency method based on the consensus protocol, is often applied in multi-center storage systems, because the quality of cross-center network communication and the quality of intra-center network communication are too large, resulting in the single-point commit method for different The client node has a huge performance gap, and due to the barrel effect, it eventually introduces a huge delay for application execution in a multi-center environment

However, the defect of the consensus protocol is the long waiting period for proposal negotiation, which will bring a large drop in performance in the cross-center storage environment of the wide area network

Images