A data synchronization method across data centers

Abstract

The present invention provides a cross-data-center data synchronization method. An implementation process of the method comprises: implementing writing-in of data and recording of a log; performing synchronous scheduling and pushing; playing back the log to implement the data synchronization; and performing cross-data-center data access to implement a synchronous operation of asynchronous data. Compared with the prior art, the cross-data-center data synchronization method can implement a cross-data-center synchronous operation of asynchronous data, and can improve security of the data; the method can effectively use IO resources in data centers and network resources among the data centers, and the method has high practicality and is easy to popularize.

Description

technical field [0001] The invention relates to the technical field of computer data storage, in particular to a data synchronization method across data centers. Background technique [0002] With the advent of the Internet era: social networks, microblogs, location services and other interactive websites for ordinary Internet users are booming, such as Google, Facebook, Twitter and domestic Renren, Weibo, etc., to hundreds of millions It provides interactive services based on the Internet and wireless networks to users of the project. Internet users all over the world carry out a variety of interactions every day and produce all kinds of data at any time. The amount of these data is several times the amount of data in the stand-alone era. [0003] In order to store these data, Internet companies have built huge data centers all over the world, and the number of hosts in a single data center ranges from hundreds to tens of thousands. Information from Google shows that Goog...

AI Technical Summary

Problems solved by technology

[0004] At present, the research on massive data storage is still in its infancy, and there are still many aspects worthy of research and improvement for data synchronization methods between data centers. Taking Hbase as an example, the replication of Hbase depends on the architecture of Master / Slave , the feature of simple data replication between two data centers was added in version 0.90.0. There is no implementation of priority queues for replication tasks, and there is no unified scheduling for data center loads.

On the other hand, the traditional cross-data center data synchronization algorithm usually uses the transmission and coverage of the entire block of data as the main method, which will occupy a large amount of network resources and IO resources

Images