Real-time synchronization method and system based on data

A technology for data synchronization and real-time synchronization, which is applied in database update, structured data retrieval, special data processing applications, etc. It can solve problems such as not supporting Update/Delete synchronization semantics, not supporting automatic synchronization of Schema changes, etc., to achieve real-time synchronization efficiency, improve real-time efficiency, and highly available effects

Pending Publication Date: 2020-06-12
山东汇贸电子口岸有限公司
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] Aiming at the problems of the prior art, the present invention provides a data-based real-time synchronization method and system, which solves the problems of not supporting Update/De

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time synchronization method and system based on data

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0032] The present invention will be further described below with reference to the accompanying drawings and specific embodiments, so that those skilled in the art can better understand and implement the present invention, but the examples cited are not intended to limit the present invention.

[0033] The present invention provides a real-time synchronization system based on data, which includes a control module, a change capture module, a message queue module, a data synchronization module and a Schema management module,

[0034] The control module defines and starts the synchronization task,

[0035] The change capture module captures the changed data of the source database and encodes the data as a synchronization message according to the synchronization message Schema template, and sends the synchronization message to the message queue module,

[0036] The data synchronization module pulls unconsumed synchronization messages in the message queue module, parses and verifies the syn...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time synchronization method and system based on data, and relates to the technical field of data synchronization. The system comprises a control module, a change capturemodule, a message queue module, a data synchronization module and a Schema management module, the control module defines and starts a synchronization task; the change capture module captures changeddata of the source database and encodes the data into a synchronous message according to a synchronous message Schema template; and sending the synchronization message to a message queue module, pulling the unconsumed synchronization message in the message queue module by the data synchronization module, analyzing and verifying the synchronization message according to source table Schema information in the Schema management module, assembling the synchronization message into a target database command, and sending the target database command to execute.

Description

technical field [0001] The invention discloses a data-based real-time synchronization method and system, and relates to the technical field of data synchronization. Background technique [0002] Real-time data synchronization is to establish a real-time coordination process between data sources and destinations. There are two common real-time data synchronization technologies, namely log-based data synchronization and data-based data synchronization. [0003] Log-based synchronization: After the source database performs DML operations, the detailed information of each operation command is recorded in the log file. The synchronization component actively pulls the incremental logs of the source database according to the locally maintained offset, and then parses out the command information of the logs one by one, and assembles them into DML operations of the target data. Finally, the DML operations are sent to the target database for execution to complete the synchronization ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/2365G06F16/27
Inventor 樊文昌何文钦刘浩喆江磊
Owner 山东汇贸电子口岸有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap