Method and device for synchronizing incremental data in a distributed non-relational database

Abstract

The purpose of this application is to provide a method and device for synchronizing incremental data in a distributed non-relational database. Specifically, determine the corresponding data table to be incrementally synchronized in the distributed non-relational database according to the user configuration information, wherein the user configuration information includes the target time range of the incremental data to be synchronized in the data table; according to the Synchronize one or more fragments corresponding to the data table in the distributed non-relational database according to the target time range and location information of the fragments. Compared with the existing technology, this application determines the corresponding data table to be incrementally synchronized in the distributed non-relational database according to the configuration information of the target time range specified by the user, and then performs synchronous processing according to the target time range and the location information of the fragment The fragmentation corresponding to the data table, so that the synchronization program can be closed or periodically started after synchronization, so as to avoid the program being opened all the time and save resources.

Description

technical field [0001] The present application relates to the computer field, and in particular to a technique for synchronizing incremental data in a distributed non-relational database. Background technique [0002] With the development of the Internet, the volume of online business has surged. In the process of processing business through applications or platform systems, a large amount of online data analysis is involved, and the latest data needs to be obtained from the database. However, regular synchronous acquisition of full data will waste a lot of time and resources. , so the existing technology will obtain the log records corresponding to the operations in each data fragment independently read and written in the distributed non-relational database every time data synchronization is performed, such as obtaining the commit log in the fragment, Synchronize the newly generated incremental data in the source system to the target system. [0003] However, in the existi...

AI Technical Summary

Problems solved by technology

[0004] One purpose of this application is to provide a method and device for synchronizing incremental data in a distributed non-relational database, which is used to solve the problem that when synchronizing incremental data in a distributed non-relational database, the program needs to be resident and does not support The problem of exporting incremental data by time range

[0005] In order to achieve the above purpose, according to one aspect of the present application, the present application provides a method for synchronizing incremental data in a distributed non-relational database, which solves the need for synchronizing incremental data in a distributed non-relational database. The problem that the program runs permanently and does not support the export of incremental data based on the time range, the method includes:

Images