Method for synchronizing data between heterogeneous databases based on CMSP message middleware

A technology for message middleware and data synchronization, applied in database management systems, database distribution/replication, structured data retrieval, etc., can solve problems such as the inability to achieve synchronous exchange of heterogeneous data, and enhance overall flexibility and scalability. , the effect of simplifying complexity and saving transmission overhead

Active Publication Date: 2019-10-25
INSPUR SOFTWARE CO LTD
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This technical solution can support Sqlserver, Oracle and Mysql, adopting the native trigger mechanism of relational database does not ne

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for synchronizing data between heterogeneous databases based on CMSP message middleware
  • Method for synchronizing data between heterogeneous databases based on CMSP message middleware
  • Method for synchronizing data between heterogeneous databases based on CMSP message middleware

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0050] The method for synchronizing data between heterogeneous databases based on the CMSP message middleware of the present invention, the method is to split the extraction service of the specific database platform, define a unified message transmission protocol, transmit through the CMSP message middleware, and store in the service Through the database type mapping model, the terminal finally realizes the synchronization and migration of data between heterogeneous databases; as attached figure 1 As shown, the specific steps are as follows:

[0051] S1. Realize the different source database extraction server as a separate microservice program;

[0052] S2. The extraction server serializes specific database events through a unified coded message format;

[0053] S3. Distribute through the CMSP message bus to ensure the correctness and sequence of data distribution;

[0054] S4. The storage server acts as the receiver of the message and the consumer matches the data mapping m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for synchronizing data between heterogeneous databases based on CMSP message middleware. The method belongs to the field of data synchronization between databases. Thetechnical problem to be solved is how to carry out safe and reliable synchronous exchange on heterogeneous data. The technical scheme is as follows: the method comprises the following steps: splitting an extraction service of a specific database platform, defining a unified message transmission protocol, transmitting through CMSP message middleware, and finally realizing synchronization and migration work of data among heterogeneous databases through a database type mapping model by a warehousing server; the method comprises the following steps of S1, realizing each heterogeneous database extraction server as an independent micro-service program; S2, serializing specific database events by the extraction server through a unified coded message format; S3, distribution is performed througha CMSP message bus; S4, matching the data mapping model between the warehousing server as a message receiver and a consumer by analyzing the message format; and S5, migrating the database operation from the source database to the target database.

Description

technical field [0001] The invention relates to data synchronization technology between databases, in particular to a method for data synchronization between heterogeneous databases based on CMSP message middleware. Background technique [0002] With the rapid development of the information age and the rise of big data and artificial intelligence, data, as a resource, is increasingly valued by some enterprises and units, and the economic and social value of data output is becoming more and more obvious. In today's society, enterprise data is becoming more and more large and complex, showing the characteristics of huge data volume, various data types (structured data and unstructured data), and single data storage, which will inevitably bring unsafe and unreliable hidden dangers to data. Therefore, data synchronization and backup are becoming more and more important. A problem is often encountered in the production environment. Different data warehousing platforms are suitab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/25
CPCG06F16/27G06F16/25
Inventor 张明邓光超李朝铭
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap