Data synchronization method and device, and server

A data synchronization and data technology, applied in the field of data processing, can solve the problems of complex installation operations, inability to directly read and use, etc., to achieve the effect of simple processing process, real-time data synchronization, and avoid data duplication

Active Publication Date: 2019-10-08
NEW H3C BIG DATA TECH CO LTD
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the redo log data stored in the redo log is encrypted and cannot be read and used directly.
[0003] The existing common database data change capture technologies (Change Data Capture, CDC) include OGG, DataX, etc., and these technical products are basically charged or require complex installation operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device, and server
  • Data synchronization method and device, and server
  • Data synchronization method and device, and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

[0038] In order to better understand the present invention, the technical terms involved in the present invention are introduced:

[0039] (1) Logminer: the database log parsing component of the Oracle database;

[0040] (2) CDC: Change Data Capture, data change capture;

[0041] (3) Synchronization relationship: the data synchronization relationship from a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data synchronization method and device, and a server. The data synchronization method comprises the steps: obtaining a synchronization relationship which comprises data source information and corresponding data destination information, wherein the data source information comprises source database information and source data table information in a source database; and thedata destination information comprises destination database information and destination data table information in a destination database; based on the synchronization relationship, extracting change data of a source database table through a database change extraction task; using a database change capture tool to obtain change data in a source database table by the database change extraction task;and based on the synchronization relationship, changing the consumption task through the database to synchronize the obtained change data to the target data table. By implementing the data synchronization method, dependence on traditional OGG, DataX and other technologies is not needed, and the processing process is simple, and real-time data synchronization of the database can be realized, and the high real-time requirement of database backup data is met.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data synchronization method, device and server. Background technique [0002] All operation records of the database are included in the redo log (redo log). If the database is down and data is lost, the redo log can be parsed for data redo and recovery. However, the redo log data stored in the redo log is encrypted and cannot be read and used directly. [0003] The existing common database data change capture technologies (Change Data Capture, CDC) include OGG, DataX, etc., and these technical products are basically charged or require complicated installation operations. In some scenarios where the real-time requirements of database backup data are relatively high, a technology that can realize real-time data synchronization of the database is needed to meet the requirements in this scenario. Contents of the invention [0004] In view of this, the embodiment...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/25G06F16/27
CPCG06F16/2358G06F16/258G06F16/27
Inventor 李洪雷
Owner NEW H3C BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap