System and method for capture of change data from distributed data sources, for use with heterogeneous targets

A distributed data and data capture technology, applied in database update, special data processing application, structured data retrieval, etc., can solve the problem that the database or data replication system cannot fully expand the data, etc.

Pending Publication Date: 2019-09-17
ORACLE INT CORP
View PDF10 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] However, environments that support very large data sets, such as big data environments, present challenges related to availability, scala

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for capture of change data from distributed data sources, for use with heterogeneous targets
  • System and method for capture of change data from distributed data sources, for use with heterogeneous targets
  • System and method for capture of change data from distributed data sources, for use with heterogeneous targets

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] As mentioned above, organizations may sometimes need to move data between different database environments, for example, to create backups of data, or to enable data sharing between different database applications. Data replication systems help address this need, for example by detecting and replicating changes to data in database tables as a result of row operations, instead of copying entire tables and the data within them. This method can be used to synchronize the data in the target database with the data in the source database. However, environments that support very large data sets, such as big data environments, pose challenges related to availability, scalability, and fault tolerance.

[0028] For example, a data replication system that operates to read a commit log or transaction log to extract changes in a data source faces the following challenges: the source system may have more than one copy of data on various nodes; the source system is partition tolerant ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

In accordance with an embodiment, described herein is a system and method for capture of change data from a distributed data source system, for example a distributed database or a distributed data stream, and preparation of a canonical format output, for use with one or more heterogeneous targets, for example a database or message queue. The change data capture system can include support for features such as distributed source topology-awareness, initial load, deduplication, and recovery. A technical purpose of the systems and methods described herein includes determination and communication of changes performed to data at a distributed data source that includes a large amount of data across a plurality of nodes, to one or more target computer systems.

Description

[0001] Copyright Notice [0002] Portions of the disclosure of this patent document contain material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office's patent files or records, but otherwise reserves all copyrights in all instances. [0003] Priority Claims and Cross-References to Related Applications: [0004] This application claims priority to U.S. Provisional Patent Application No. 62 / 566,113, filed September 29, 2017, and entitled "SYSTEM AND METHOD FOR CAPTUREOF CHANGE DATA FROM NOSQL DATABASES OR DISTRIBUTED DATA STREAMS, FOR USE WITHHETEROGENEOUS TARGETS" and related to U.S. Patent Application No. 13 / 077,760, filed March 31, 2011, entitled "MYSQL DATABASE-HETEROGENEOUS LOG BASED REPLICATION," which subsequently issued as U.S. Patent 8,510,270, which claims the July 2010 Priority to U.S. Provisional Patent ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/27G06F16/2358G06F16/2365
Inventor S·瓦苏德万L·哈严托S·R·科尔宾
Owner ORACLE INT CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap