Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data synchronization system and method, equipment and medium

A data synchronization and database technology, applied in the direction of database management systems, relational databases, database models, etc., can solve problems such as data exchange problems in business systems, and achieve the effects of meeting data exchange requirements, improving efficiency, and efficient data synchronization

Pending Publication Date: 2021-12-14
GUANGDONG POWER GRID CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This requires that the source and target databases must be MySQL databases to use the master-slave configuration scheme, which brings difficulties to the data exchange between business systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization system and method, equipment and medium
  • Data synchronization system and method, equipment and medium
  • Data synchronization system and method, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0029] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0030] At present, most data synchronization products require that the source and target databases must be MySQL databases to use the master-slave configuration scheme, which brings difficulties to data exchange between business systems. In order to improve the above problems, the embodiments of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data synchronization system and method, equipment and a medium. The system comprises a MySQL, a log analysis module, a message receiving module and an ETL loading module. The MySQL records a logic log file updated by source end databases in real time by utilizing binlog, wherein the logic log file is composed of a series of transaction Events; the log analysis module analyzes the logic log file based on preset analysis rules to obtain a transaction processing data stream; the message receiving module writes transaction processing data streams from the different source end databases into a cache file according to a specified cache path; and the ETL loading module reads the transaction processing data streams from the cache file, performs ETL processing on the transaction processing data streams to obtain an SQL statement in a general format, and loads the SQL statement into a target end database. According to the invention, different-library backup can be efficiently realized, and complex data exchange requirements of a service system can be well met.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, and in particular to a data synchronization system, method, device and medium. Background technique [0002] The vast majority of data synchronization products are mainly developed by large database manufacturers for their own database products, and may not be applicable to other database management systems. Taking MySQL database data synchronization as an example, MySQL's master-slave replication cluster relies on the master server to write updates to binary log files, maintain an index of the files to track log rotation, and send these logs to the slave servers for updates from the servers. This requires that the source and target databases must be MySQL databases to use the master-slave configuration scheme, which brings difficulties to data exchange between business systems. Contents of the invention [0003] In order to solve the above technical problems or at least partl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/28G06F16/242
CPCG06F16/254G06F16/284G06F16/2433
Inventor 冯歆尧彭泽武谢瀚阳梁盈威
Owner GUANGDONG POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products