Unlock instant, AI-driven research and patent intelligence for your innovation.

A processing method for trigger incremental synchronization exception caused by source-side concurrency

A technology of incremental synchronization and processing method, applied in the database field, can solve problems such as affecting execution efficiency

Active Publication Date: 2022-03-25
WUHAN DAMENG DATABASE
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method affects execution efficiency due to the existence of additional database data UPDATE operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A processing method for trigger incremental synchronization exception caused by source-side concurrency
  • A processing method for trigger incremental synchronization exception caused by source-side concurrency
  • A processing method for trigger incremental synchronization exception caused by source-side concurrency

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0086] Embodiment 1 of the present invention provides a processing method for trigger incremental synchronization abnormality caused by concurrency at the source end. The method proposed in the embodiment of the present invention is mostly used in the field of database synchronization backup, that is, the insertion, update, Data operations such as deletion need to be synchronized to the incremental destination side. like image 3 shown, including:

[0087] In step 201, incremental data that has not yet been synchronized is acquired, and a first-stage synchronization of the corresponding incremental data on the incremental destination side is performed.

[0088] The acquisition action described here is usually passive in the specific implementation process, that is, from the perspective of the incremental destination side, the incremental data synchronized by the incremental source side is mainly pushed by the incremental source . Of course, in the specific implementation pr...

Embodiment 2

[0112] The embodiment of the present invention also provides a processing system for trigger incremental synchronization abnormality caused by source-side concurrency, such as Figure 7 As shown, the system includes an incremental source 11 and an incremental target 12, and data intercommunication can be completed between the incremental source 11 and the incremental target 12. The method also includes:

[0113] The incremental source 11 reads data from the CDC table;

[0114] The incremental source 11 sends the read incremental data to the incremental destination 12;

[0115] Incremental purpose 12 performs corresponding DML operations in the target table according to the incremental data, so that the data in the incremental purpose 12 table is consistent with the data in the incremental source 11 table;

[0116] Increment purpose 12 sends the CDC_ID value array of this batch of incremental data to incremental data cleaning module 121;

[0117] Incremental data cleaning mod...

Embodiment 3

[0126] The embodiment of the present invention uses a relatively complete process to show the implementation position of Embodiment 1 of the present invention under the whole architecture environment. Moreover, in the embodiment of the present invention, specific table data will also be introduced to carry out the specific realization of related data synchronization combined with the regional technical features proposed in the embodiment of the present invention.

[0127] In step 501, the delta source reads data from the CDC table (only once per synchronization process).

[0128] In step 502, the incremental source sends the read incremental data to the incremental destination.

[0129] In step 503, the incremental target performs a corresponding DML operation in the target table according to the incremental data, so that the data in the target table is consistent with the data in the source table.

[0130] In step 504, the incremental object sends the array of CDC_ID values ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of databases, and provides a processing method, system and device for trigger incremental synchronization abnormality caused by source concurrency. The method includes acquiring the incremental data that has not yet been synchronized, and performing the first-stage synchronization of the corresponding incremental data on the incremental destination side; according to the CDC_ID value of the incremental data that has completed the first-stage synchronization of the incremental destination data, the continuous The CDC_ID values ​​of one or more incremental data are recorded in the form of intervals to obtain intervals; when cleaning incremental data, it is determined according to the interval value that the incremental data located in the interval value has completed the first stage Incremental data for sync operations and deletes it. After the incremental target table completes the synchronization operation, the invention can ensure the high-efficiency execution of the incremental synchronization process without relying on the continuous increment feature of the CDC_ID column value in the incremental target table and not marking the data in the incremental target table according to the interval after the incremental target table completes the synchronization operation, and No data loss will result.

Description

【Technical field】 [0001] The present invention relates to the technical field of databases, in particular to a processing method, system and device for trigger incremental synchronization abnormality caused by source concurrency. 【Background technique】 [0002] Incremental synchronization technology is to record the data insertion, modification and deletion instructions that occurred on the source table in the incremental destination table in the form of incremental data, and then package the incremental data by parsing the data in the incremental destination table The corresponding DML operation is performed, and the same DML operation is performed on the destination table, so as to realize the synchronization of the data in the destination table and the data in the source table. [0003] After the source table data is fully extracted to the target table during the first synchronization, the changed data generated by the DML operation on the source table can be synchronized...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/2365G06F16/23G06F16/27
Inventor 梅纲胡高坤
Owner WUHAN DAMENG DATABASE