Method and device of synchronizing incremental data in distributed non-relational database

Abstract

The object of the application is to provide a method and a device used for synchronizing incremental data in a distributed non-relational database. Specifically, a to-be-incrementally-synchronized corresponding data table in the distributed non-relational database is determined according to user configuration information, and the user configuration information includes a target time range of the to-be-synchronized incremental date in the data table; and one or more slices corresponding to the data table in the distributed non-relational database are synchronously processed according to the target time range and location point information of the slices. Compared with the prior art, the method and the device determine the to-be-incrementally synchronized corresponding data table in the distributed non-relational database according to the configuration information of the target time range specified by a user, then synchronously process, according to the target time range and the location point information of the slices, the slices corresponding to the data table, can thus close or periodically start a synchronization program after synchronization, avoid always starting the program, and save resources.

Description

technical field [0001] The present application relates to the computer field, and in particular to a technique for synchronizing incremental data in a distributed non-relational database. Background technique [0002] With the development of the Internet, the volume of online business has surged. In the process of processing business through applications or platform systems, a large amount of online data analysis is involved, and the latest data needs to be obtained from the database. However, regular synchronous acquisition of full data will waste a lot of time and resources. , so the existing technology will obtain the log records corresponding to the operations in each data fragment independently read and written in the distributed non-relational database every time data synchronization is performed, such as obtaining the commit log in the fragment, Synchronize the newly generated incremental data in the source system to the target system. [0003] However, in the existi...

AI Technical Summary

Problems solved by technology

[0004] One purpose of this application is to provide a method and device for synchronizing incremental data in a distributed non-relational database, which is used to solve the problem that when synchronizing incremental data in a distributed non-relational database, the program needs to be resident and does not support The problem of exporting incremental data by time range

[0005] In order to achieve the above purpose, according to one aspect of the present application, the present application provides a method for synchronizing incremental data in a distributed non-relational database, which solves the need for synchronizing incremental data in a distributed non-relational database. The problem that the program runs permanently and does not support the export of incremental data based on the time range, the method includes:

Images