Distributed file system-based data synchronization method and apparatus

Abstract

The invention provides a distributed file system-based data synchronization method and apparatus. The data synchronization method comprises the steps of detecting whether file metadata is changed or not; when it is detected that the file metadata is changed, obtaining changed target file metadata; judging whether the file size of the target file metadata is greater than a preset threshold or not; when it is judged that the file size is greater than the preset threshold, storing the target file metadata in a caching queue; and executing preset synchronization operation on the target file metadata in the caching queue to synchronize the target file metadata into other file systems of a distributed file system. Through the technical scheme, efficient, secure and stable data synchronization among the file systems in the distributed file system can be realized, so that the interconnection of the distributed file system is realized.

Description

technical field [0001] The invention relates to the technical field of data synchronization, in particular, to a data synchronization method based on a distributed file system and a data synchronization device based on a distributed file system. Background technique [0002] In Internet applications, in order to improve the speed of users browsing the system, it is necessary to deploy applications in many places, but files are only stored in each computer room and cannot be shared, which brings great inconvenience to users, such as: [0003] (1) After a user uploads a file in a computer room in a certain place, it can only be used in the local DNS (Domain Name System, Domain Name System), and users in other regions cannot share this file. If you want to use it, you need to rewrite the synchronization program, which is time-consuming and labor-intensive; [0004] (2) If something catastrophic occurs in the data center, such as an earthquake, the files will also become unrecov...

AI Technical Summary

Problems solved by technology

[0002] In Internet applications, in order to improve the speed of users browsing the system, applications need to be deployed in multiple places, but the files are only stored in each computer room and cannot be shared, which brings great inconvenience to users, such as:

[0003] (1) After a user uploads a file in a local computer room, it can only be used in the local DNS (Domain Name System, domain name system). Users in other regions cannot share this file. If they want to use it, they need to rewrite the synchronization program, which is time-consuming and laborious;

[0004] (2) If a catastrophic event occurs in the data center, such as an event such as an earthquake, the file will also become unrecoverable

[0005] (3) If a distributed file system cluster is deployed across the Internet, the file system will be very unstable due to limited resources such as the network, which will easily lead to file loss or inability to access normally

[0006] The above problems have not been well resolved and have been bothering us.

Images