Data synchronization method, apparatus and system

Abstract

Embodiments of the invention provide a data synchronization method, apparatus and system. The method comprises the steps of obtaining a corresponding event notification generated by each data providerduring data change in real time; adding the obtained event notification to an event task table; and starting an event consumption process to read the event notification in the event task table, and sending the read event notification to a data demander, thereby enabling the data demander to obtain changed data from the data provider according to the event notification. Through the scheme providedby the data synchronization method, apparatus and system, the resource pressure of the data provider and the data demander is reduced while real-time data synchronization is realized.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of data synchronization, and in particular, to a data synchronization method, device, and system. Background technique [0002] Currently, data synchronization within or between enterprises mostly adopts two methods. [0003] The first way is through data import and export, that is, the data provider exports data according to the required format, and transmits it to the data demander through communication tools, and the data demander processes the data according to its own needs and then imports it into its own storage. [0004] The second way is to call through the HTTP (Hyper Text Transfer Protocol) interface. The data provider calls the HTTP interface of the data demander to push the data, or the data demander calls the HTTP interface of the data provider to pull the data. fetch data. [0005] However, the real-time performance of the data import and export method is too low to mee...

AI Technical Summary

Problems solved by technology

[0005] However, the real-time performance of the data import and export method is too low, and it is difficult to meet the real-time data synchronization requirements of existing Internet companies. For example, an application needs to display the logistics information of different related logistics companies in real time, resulting in poor user experience.

[0006] For a data synchronization method based on interface calls, that is, the way the data provider pushes data to the data demander, when the amount of data is large and the interface push fails, the data provider not only needs to consume resources to push the data, but also needs to spend Resources to consider unexpected situations and handling of unexpected situations, such as whether the data requester successfully receives the data to complete data synchronization, whether the data requester needs to resend after receiving failure, when to resend, etc., resulting in heavy resource pressure on the data provider

[0007] For another data synchronization method based on interface calls, that is, the data demander calls the interface of the data provider to pull data in real time. The data demander does not know when data changes occur on the data provider. Pulling data by the data provider will not only cause waste of resources on the data demand side, but also cause heavy resource pressure on the data provider

Images