Inter-node data synchronization method, data synchronization device and data synchronization equipment

Abstract

The invention discloses an inter-node data synchronization method. The data synchronization method is realized based on a monitoring node and comprises the steps of firstly, real-time incremental synchronous deployment is carried out on each node, therefore, real-time increment synchronization among the nodes is realized; minimization of occupied bandwidth in a data synchronization process is realized; meanwhile, the transmission process of the incremental data between the nodes is monitored, when incremental data transmission fails, incremental data transmission failure information is recorded, on this basis, the incremental data transmission failure information is conveniently supervised manually or by a machine, subsequent processing is conducted on the incremental data transmission failure information, and therefore the accuracy of data synchronization between the nodes is guaranteed. Therefore, the inter-node data synchronization method provided by the invention not only ensures the accuracy of inter-node data synchronization, but also reduces the required network bandwidth. The invention further discloses an inter-node data synchronization device, data synchronization equipment and a computer readable storage medium, which have the above beneficial effects.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a data synchronization method between nodes, a data synchronization device, a data synchronization device and a computer-readable storage medium. Background technique [0002] With the rapid development of the Internet, the emergence of massive data and changes in data structures have brought huge challenges to all walks of life in terms of data processing. Data synchronization is an extremely common and important data processing job, which involves the migration process of data from one location to another. The data migration process of the data synchronization task is performed manually at the beginning, which is not only labor-intensive, but also has limited application areas. Then there is a method of using automated tools to import a large amount of data, such as using scheduled tasks to call the FTP protocol to upload specific folders in batches, but as the am...

AI Technical Summary

Problems solved by technology

However, the problem with this data synchronization method is that when the transmission fails, there will be data differences between the data source and the data destination.

[0004] It can be seen that the existing technology cannot guarantee the accuracy of real-time incremental transmission on the issue of data synchronization. It is also necessary to introduce full-volume transmission that occupies a large bandwidth to ensure the accuracy of data synchronization. As the amount of data increases, there will still be problems The network bandwidth produces a large pressure, resulting in a waste of network bandwidth

Images