A data synchronization method, device and server

A data synchronization and data technology, applied in the field of data processing, can solve problems such as inability to read and use directly, complex installation operations, etc., and achieve the effects of avoiding data duplication, simple processing, and high real-time requirements

Active Publication Date: 2021-10-29
NEW H3C BIG DATA TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the redo log data stored in the redo log is encrypted and cannot be read and used directly.
[0003] The existing common database data change capture technologies (Change Data Capture, CDC) include OGG, DataX, etc., and these technical products are basically charged or require complex installation operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data synchronization method, device and server
  • A data synchronization method, device and server
  • A data synchronization method, device and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

[0038] In order to better understand the present invention, the technical terms involved in the present invention are introduced:

[0039] (1) Logminer: The database log parsing component of the Oracle database;

[0040] (2) CDC: Change Data Capture, data change capture;

[0041] (3) Synchronization relationship: a data synchronization rela...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data synchronization method, device and server. The data synchronization method includes: obtaining a synchronization relationship, the synchronization relationship includes data source information and corresponding data destination information, and the data source information includes source database information and source database information in the source database. Data table information; data purpose information includes the target database information and the target data table information in the target database; based on the synchronization relationship, the change data of the source database table is extracted through the database change extraction task; the database change extraction task uses the database change capture tool to obtain the source The changed data in the database table; based on the synchronization relationship, the acquired changed data is synchronized to the target data table through the database change consumption task. By implementing the invention, there is no need to rely on traditional OGG, DataX and other technologies, the processing process is simple, real-time data synchronization of the database can be realized, and the high real-time requirement of database backup data can be met.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data synchronization method, device and server. Background technique [0002] All operation records of the database are included in the redo log (redo log). If the database is down and data is lost, data redo and recovery can be performed by parsing the redo log. However, the redo log data saved by the Redo log is encrypted and saved, and cannot be directly read and used. [0003] Existing relatively common database data change capture technologies (Change Data Capature, CDC) include OGG, DataX, etc. These technology products are basically charged or require complex installation operations. In some scenarios where the real-time requirements of database backup data are relatively high, a technology that can realize real-time database data synchronization is required to meet the requirements in this scenario. SUMMARY OF THE INVENTION [0004] In view of this, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/23G06F16/25G06F16/27
CPCG06F16/2358G06F16/258G06F16/27
Inventor 李洪雷
Owner NEW H3C BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap