Heterogeneous database synchronization system and synchronization method based on domestic environment

A synchronization system and database technology, applied in the database field, can solve the problems of low reliability of data synchronization and inability to capture database logs in real time, and achieve the effect of low resource occupation rate and high capture efficiency

Pending Publication Date: 2020-04-17
上海浪擎信息科技有限公司
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem solved by the present invention is to provide a heterogeneous database synchronization system and synchronization method based on the domestic environment, to solve the problem in the above background technology that the reliability of data synchronization between heterogeneous databases is low. Capable of capturing database logs in real time, converting non-domestic database sql statements into sql statements required by the target end according to user-configured filter mapping and other functions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous database synchronization system and synchronization method based on domestic environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0018] Such as figure 1 A heterogeneous database synchronization system based on a domestic environment is shown, including: an initialization module that provides software startup parameters, including synchronization data directory, data size of sent and received files, and data file limit size; a port monitoring module that provides process information Module management, including task start, pause, stop, etc.; task management module, capture of specified database type and version, including full and incremental capture, database specified table, table name, field capture and filtering, etc.; collection and extraction module, Collect and extract the original data and logs; the file writing module writes the collected data into the transmission channel directory; the channel transmission module completes the data transmission process in the secure channel; the data receiving module receives the data transmitted by the secure channel; The data verification module verifies the...

Embodiment 2

[0025] Such as figure 1 A heterogeneous database synchronization system based on a domestic environment is shown, including: an initialization module that provides software startup parameters, including synchronization data directory, data size of sent and received files, and data file limit size; a port monitoring module that provides process information Module management, including task start, pause, stop, etc.; task management module, capture of specified database type and version, including full and incremental capture, database specified table, table name, field capture and filtering, etc.; collection and extraction module, Collect and extract the original data and logs; the file writing module writes the collected data into the transmission channel directory; the channel transmission module completes the data transmission process in the secure channel; the data receiving module receives the data transmitted by the secure channel; The data verification module verifies the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a heterogeneous database synchronization system based on a domestic environment. The system comprises an initialization module, a port monitoring module, a task management module, an acquisition and extraction module, a file writing module and the like. Personalized setting is performed through reading and writing. The method comprises setting of a read-write mode, a frequency, a rate and the like. Data reading objects can be selected in batches, the system is automatically matched with a table structure of a heterogeneous data source, tables needing to be synchronized at a production end are selected through a task management module and a collection and extraction module, transmission configuration is completed, the tables at the production end are synchronously mapped to a target end through a file writing module and a channel transmission module, and configuration of the target end is completed. According to the method, mainstream databases at home and abroadare supported, meanwhile, data exchange under isolation of internal and external networks of a user is met, the functions of capturing database logs in real time, filtering mapping configured by the user and the like are achieved, and non-domestic database sql statements are converted into finally generated sql statements needed by a target end.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a heterogeneous database synchronization system and synchronization method based on a domestic environment. Background technique [0002] The current Internet is developing rapidly, the number of users is increasing, and the pressure of large-scale network applications is increasing. The processing capacity of a single machine is limited, and there will always be a maximum value, which is inevitable in a distributed environment. [0003] Since the system is constantly expanding and built in different periods, heterogeneous databases are likely to appear. It is impossible for heterogeneous databases to share data, otherwise "information islands" will appear. Therefore, how to flexibly, effectively and economically deal with the information sharing and data synchronization of these heterogeneous databases has become a research direction that has attracted much attention. [0004...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/21
CPCG06F16/21G06F16/27
Inventor 李庆银
Owner 上海浪擎信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products