Remote data increment synchronization method and device based on data package

A technology for incremental synchronization and remote data, applied in the database field, it can solve problems such as narrow application scope, inability to guarantee the quality of data delivery, and inability to deal with complex situations, and achieve the effect of ensuring stability

Active Publication Date: 2013-04-24
广东邮电职业技术学院
View PDF2 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The method of web service can realize the real-time synchronous transmission of data, but only a small amount of data can be transmitted, which is suitable for scenarios where the data changes sporadically, and the quality of data delivery cannot be guaranteed; JMS message middleware is generally suitable for transmitting a small amount of data, but it can guarantee the data It can also achieve the goal in a bad network environment; FTP can transfer large-scale data volume, and can support breakpoint resume
These three methods have their own advan

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote data increment synchronization method and device based on data package
  • Remote data increment synchronization method and device based on data package
  • Remote data increment synchronization method and device based on data package

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0034] The technical solutions of the present invention will be described in detail below with reference to the drawings and specific embodiments, so as to understand the essence of the present invention more clearly and intuitively.

[0035] figure 1 It is a flowchart of an incremental data collection method based on log capture in an embodiment of the present invention; figure 2 Yes figure 1 The flow chart of obtaining the DML of the source database in the illustrated embodiment.

[0036] Reference figure 1 with figure 2 As shown, the embodiment of the present invention first provides a remote data incremental synchronization method based on data packets, which includes the following steps:

[0037] S1: Get the DML of the source database;

[0038] S2: Export DML as a data package;

[0039] S3: remotely synchronize the data packet to the target database;

[0040] S4: Parse the data packet into SQL statements and change data;

[0041] S5: Update the SQL statement and change data to the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a remote data increment synchronization method and a device based on a data package. The method comprises a first step of obtaining data manipulation languages (DML) of a database, a second step of leading out the DML into the data package, a third step of sending the data package to a target database in a remote synchronization mode, a fourth step of analyzing the data package into structural query languages (SQL) and changing data, and a fifth step of updating the SQL and the changing data to the target database. According to the remote data increment synchronization method and the device based on the data package, increment records, deleted records and changed records in the database can be extracted in fixed time to form the data package including the increment records. According to network situations and data synchronization demands, the data package is transmitted to a target database system in a java message service (JMS) or a file transfer protocol (FTP) manner by utilizing message-oriented middleware or an FTP client side/ server terminal product and being supported by a certain allocation management, and therefore consistency of data of a remote terminal and a near-terminal databases is kept.

Description

Technical field [0001] The present invention relates to the technical field of databases, in particular to a method and device for remote data incremental synchronization based on data packets. Background technique [0002] Remote data synchronization means that two database systems across network segments maintain data consistency. The source system is generally a business system database deployed at the front end, and the target system is generally an OLAP data mart or data warehouse system used to support decision analysis. The connection between the front-end business system database and the back-end data center needs to penetrate the firewall. The existing remote data synchronization system has the following problems: [0003] 1. The remote data transmission method is fixed and single, unable to cope with various complicated situations. [0004] Remote data transmission can use various methods such as Web services, JMS message middleware, and FTP. Web services can realize re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 戴浩
Owner 广东邮电职业技术学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap