Multi-IDC distributed system data synchronization method based on SQL command level

Abstract

The invention discloses a multi-IDC (Internet Data Center) distributed system data synchronization method based on an SQL (Structured Query Language) command level. The multi-IDC distributed system data synchronization method comprises the following steps: configuring database tables and addition, deletion and modification operation types which need to be synchronized; generating an addition, deletion and modification SQL command of the synchronization table through a database trigger; packaging the SQL command into a synchronization task and transmitting the synchronization task to each target IDC; the target IDC receives the synchronization task and executes the received synchronization task in a corresponding database according to a time sequence generated by the task; according to the synchronization task state, trying to repeatedly execute the failed synchronization task according to a time sequence; and regularly performing consistency monitoring on the synchronous data tables of the IDCs. According to the invention, the addition, deletion and modification operations of the data table can be synchronized in a system of a plurality of IDC machine rooms under the condition of not changing the logic of a service layer, so that the final consistency of the data table level is realized; and a data synchronization solution is provided for the multi-IDC distributed system.

Description

technical field [0001] The invention relates to the technical field of distributed system data synchronization, in particular to a method for data synchronization of multiple IDC distributed systems based on SQL command level. Background technique [0002] With the development of distributed systems, especially the development of distributed database technology, the deployment of three centers in two places has become a common phenomenon, and many large factories have even entered the multi-active era of five centers in three places. However, many small and medium-sized Internet companies are hesitant when facing the deployment of multiple IDCs in information systems, mainly due to the high technical threshold and large investment. The most critical technology here is the data synchronization of multiple IDC rooms, because the upper-layer application can be deployed in a distributed manner after it is stateless, but the underlying database cannot. For example, stateful stor...

AI Technical Summary

Problems solved by technology

Traditional distributed database data synchronization solutions are usually deployed in a master-slave structure, and data is synchronized from the master node to the slave node, which is one-way; it is difficult to directly apply to multi-IDC deployment in different places; and the slave node is in a cold standby state, which is a kind of huge waste

Emerging distributed database data synchronization solutions such as NewSQL and PGXC can realize cross-regional multi-IDC distributed deployment, but the software volume is large, the technical threshold is high, and the investment in migration and operation and maintenance is large.

Images