Log based structured data synchronization method

A structured data and log technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as inconsistent query results, synchronization exceptions, abnormal records that cannot be synchronized, etc., to maintain data consistency and avoid synchronization abnormal effect

Active Publication Date: 2013-12-18
上海新炬网络技术有限公司
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The defect is that the entire line where the exception record is located cannot be synchronized, which will lead to inconsistent query results at the source and target ends, seriously affecting usability
Such a defect is very harmful to enterprises using GoldenGate. If the data is lost due to abnormal data synchronization and data loss, how much loss will it bring to these enterprises?

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log based structured data synchronization method
  • Log based structured data synchronization method
  • Log based structured data synchronization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0059] figure 2 It is a schematic flow chart of log-based structured data synchronization in the present invention.

[0060] See figure 2 , taking the abnormal data of OracleGoldenGate as an example below, the present invention uses multiple technical features such as filtering, conversion, one-to-many synchronization, and compatible database triggers of Oracle GoldenGate itself to change the abnormal date format into varchar2 format storage, and Convert to raw format through a custom function, and then realize the conversion to date type through Oracle’s built-in function, successfully bypassing the verification mechanism, and finally locate the relevant row through the pre-recorded primary key information, realize data change, and maintain data consistency , including the following steps:

[0061] Step S101: Create an intermediate table for stori...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log based structured data synchronization method. The log based structured data synchronization method includes the steps of a), establishing a middle table for storing major keys and doubt fields of a doubt table; b), modifying database synchronization settings and adding the doubt table to a synchronization strategy of the middle table; c), modifying a database synchronization setting strategy and adding filter conditions and store procedures during doubt table synchronization of the doubt table; d), establishing a trigger on the doubt table and setting trigger date for clearing of the middle table and entering of illegal data format data. By the log based structured data synchronization method, data synchronization can be realized by avoiding the verification mechanism of a database, data consistency of corresponding records between a source library and an object library can be kept, and synchronous exception caused by data type report errors can be avoided.

Description

technical field [0001] The invention relates to a data synchronization method, in particular to a log-based structured data synchronization method. Background technique [0002] Oracle GoldenGate software is a log (log)-based structured data replication software. It obtains data addition, deletion, and change by parsing the source database online log or archive log, and then applies these changes to the target database to realize the source database. Synchronize and active-active with the target database. Oracle GoldenGate software can realize sub-second real-time replication of large amounts of data between heterogeneous IT infrastructures (including almost all common operating system platforms and database platforms). [0003] Oracle GoldenGate is a software-based data replication method. It parses data changes from the database log, converts data changes into its own format, and transmits them directly through the TCP / IP network without relying on the database's own tran...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 程永新黎君原
Owner 上海新炬网络技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap