Data increment synchronization method based on multi-table associated query

A technology of incremental synchronization and associated query, which is applied in the field of data processing, can solve problems such as system performance impact, data synchronization time-consuming, query performance loss, etc., and achieve the effect of high efficiency and reduced data synchronization pressure

Pending Publication Date: 2022-02-11
上证所信息网络有限公司
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But the patent is for single-table incremental synchronization, and the single-table incremental synchronization scenario is relatively simple
[0004] The data associated with multiple tables contains query logic in the middle. In order to maintain the data integrity after the associated query, the results of the query are often fully synchronized or a materialized view is built. This method can be simple when the amount of data is not large. It works effectively, but for the associated query of relational tables with a large amount of data, data synchronization is time-consuming, and a large number of archived logs are generated, which is likely to have a great impact on system performance
The method of ordinary view is finally converted into base table query, which has a certain loss on query performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data increment synchronization method based on multi-table associated query

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described below in conjunction with accompanying drawing, and the structure and principle of the present invention are very clear to those skilled in the art. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0022] The present invention is a method for data incremental synchronization based on multi-table association query, specifically as follows:

[0023] A. Select the unique key of the base table (it can be a primary key field or a unique index field), and one or more tables at the source of data synchronization are called base tables, and the destination table of data synchronization is called a destination table, as follows same.

[0024] B. Define the target table. In addition to the fields required for normal synchronization, the target table additionally includes the unique keys of all base tables. At the same time, a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of data processing, in particular to a data increment synchronization method based on multi-table associated query. The method comprises the following steps: selecting a unique key of a base table, naming one or more tables of a data synchronization source as the base table, wherein a target table of data synchronization is called as a target table; defining a target table, and additionally incorporating unique keys of all the base tables in the target table except that fields required by normal synchronization are established; establishing a data synchronization module, and when the data of the base table changes, automatically storing the data before and after the change of the base table; updating and storing the data into a target table in an asynchronous mode according to the association logic between the base tables. According to the multi-table associated query data increment synchronization method, the problem of multi-table associated incremental data synchronization is solved, a multi-table associated incremental data cross-database synchronization scheme is also provided, the efficiency is higher, a large number of archiving logs do not exist, and the data synchronization pressure on a disk and city-wide disaster recovery is also obviously reduced.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for synchronizing incremental data based on multi-table association query. Background technique [0002] Existing data synchronization methods include trigger-based incremental synchronization and timestamp-based incremental synchronization, but the current technologies are all single-table synchronization without processing logic. [0003] There is an existing Chinese patent: a database management method and device, publication number: CN101382949A, which judges whether there is duplicate data in multiple database tables through a unique index or a primary key. However, the patent is for single-table incremental synchronization, and the single-table incremental synchronization scenario is relatively simple. [0004] Since the data associated with multiple tables contains query logic in the middle, in order to maintain the data integrity after the associated que...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27G06F16/23G06F16/22
CPCG06F16/275G06F16/23G06F16/2282
Inventor李炜赵冬昊王海菲赵金江徐颗科
Owner上证所信息网络有限公司