Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Incremental data synchronization method, device and equipment and readable storage medium

An incremental data and database technology, applied in the field of data synchronization, can solve problems such as inability to delete synchronously, identify table structure changes, and inability to handle data updates and insertions

Pending Publication Date: 2022-06-28
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] As a closed-source database, SQL Server generally uses the following three methods for incremental data synchronization: 1) Based on the auto-increment field, this method relies on the auto-increment field in the database table. By setting the value of the increment point, from Incremental records larger than the incremental point are filtered out in the table. This method must rely on the auto-increment field. Not all tables have auto-increment fields, and this method cannot synchronize the delete operation, and cannot handle increments smaller than the setting 2) Based on CDC (Change Data Capture, change data capture), that is, using the CDC mechanism of SQL Server itself to capture activities such as insertion, update and deletion of database tables, incremental data will be recorded In the change capture table, incremental data can be obtained by querying the change capture table. However, this method cannot identify the table structure change and cannot synchronize the table structure change; 3) Based on fn_dblog, query fn_dblog to obtain the incremental data of the database Incremental information, and incremental data is obtained through incremental information, but this method cannot perform incremental data synchronization when the log is truncated, that is, once the database log is truncated, incremental data cannot be obtained through fn_dblog

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental data synchronization method, device and equipment and readable storage medium
  • Incremental data synchronization method, device and equipment and readable storage medium
  • Incremental data synchronization method, device and equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The core of the present application is to provide an incremental data synchronization method, apparatus, device and readable storage medium, which are used to efficiently and reliably perform incremental data synchronization of databases.

[0043] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0044] see figure 1 , which shows a flowchart of an incremental data synchronization method provided by an embodiment of the present application. An incremental data synchronization method prov...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an incremental data synchronization method, device and equipment and a readable storage medium. The method comprises the steps that a source database is controlled to start a CDC, and capture operation in the CDC is forbidden; obtaining table structure information corresponding to the current scanning from the source database, comparing the table structure information of the current scanning with the corresponding table structure information of the last scanning to obtain table structure change information, and sending the table structure change information to the target database; and scanning logs of the source database by using fndblog to obtain a log corresponding to current scanning, analyzing the log corresponding to current scanning to obtain incremental data, and sending the incremental data to the target database. According to the technical scheme disclosed by the invention, the CDC and the fndblog are combined to synchronize the incremental data, so that the log is prevented from being cut off, the table structure change information can be identified, and the incremental data synchronization can be effectively and reliably carried out without depending on the self-increasing field.

Description

technical field [0001] The present application relates to the technical field of data synchronization, and more particularly, to an incremental data synchronization method, apparatus, device, and readable storage medium. Background technique [0002] When database data changes, the changes are synchronized to another database, which belongs to incremental data synchronization. SQL Server is a relational database system launched by Microsoft, which has the characteristics of scalability and high performance. [0003] As a closed-source database, SQL Server generally adopts the following three methods for incremental data synchronization: 1) Based on auto-increment fields, this method depends on the auto-increment fields existing in the database table. The incremental records larger than the increment point are filtered out from the table. This method must rely on the auto-increment field. Not all tables have auto-increment fields, and this method cannot synchronize delete op...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/2365G06F16/27
Inventor 邓光超高传集江燕孙思清方建勋肖雪
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products