Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data exchange adapter, data synchronization system and method between heterogeneous systems

A data system and data exchange technology, applied in program synchronization, electrical digital data processing, special data processing applications, etc., can solve the problems of linear increase in demand for export tools, inability to effectively meet, and very large differences in efficiency.

Active Publication Date: 2018-10-19
ULTRAPOWER SOFTWARE
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] With the increase of business systems, the introduction and application of different types of libraries will lead to a linear increase in the demand for these data import and export tools.
In this way, we need to develop and maintain a series of tools to achieve data synchronization between different databases or file systems, resulting in a network structure for data synchronization between different systems, as follows figure 1 As shown, it greatly increases the difficulty of system maintenance and management
[0004] In addition, some of these tools exchange data in the form of files (File), and some transfer data in the form of pipelines (Pipe), all of which bring additional overhead to data synchronization to varying degrees, resulting in very large differences in efficiency
At the same time, many tools cannot effectively meet the common requirements in data warehouse system ETL (Extraction, Transformation&Loading, data extraction, transformation and loading) tasks, such as time format conversion, special character conversion, encoding conversion, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exchange adapter, data synchronization system and method between heterogeneous systems
  • Data exchange adapter, data synchronization system and method between heterogeneous systems
  • Data exchange adapter, data synchronization system and method between heterogeneous systems

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0058] See figure 2 , The embodiment of the present invention provides a data exchange adapter (DXA, Data eXchangeAdapter), which specifically includes:

[0059] The task scheduling manager 201 is used to configure and schedule data synchronization tasks between data systems.

[0060] The data input plug-in manager 202 includes a plurality of data input plug-ins corresponding to various data systems, and is used to obtain the source data input task configured by the task scheduling manager 201, and call the source data input task corresponding to the source data input task. The matched data input plug-in obtains the source data resource from the source data system and loads it into the data cache manager 203.

[0061] The data cache manager 203 i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data exchange adapter and a system and a method for synchronizing data among heterogeneous systems, and relates to the technical field of mass data processing. With a star-like mode design principle, a set of data exchange adapter device located between different types of databases or file systems is established, then the mass data are synchronized effectively among different heterogeneous systems, and the original net-shaped data synchronization mode formed by maintaining and managing a series of complicated data import and export tools is replaced. In addition, the embodiment of the invention provides a set of unified open framework to support secondary development, a DataIn plug-in and a DataOut plug-in provided by the scheme can be used or required DataIn plug-in and DataOut plug-in are self-defined, so that the task of synchronizing any mass data among the different types of databases or file systems is rapidly executed.

Description

Technical field [0001] The invention relates to the technical field of massive data processing, in particular to a data exchange adapter and a data synchronization system and method between heterogeneous systems. Background technique [0002] In large-scale business production system application scenarios, there are often many different types of databases or file systems, such as Oracle, MySQL, SQL Server, Sybase, DB2, Informix, PostgreSQL, MongoDB, Redis, HDFS (Hadoop Distributed File System, Hadoop distributed file system) and other databases or FS (File System, file system), etc., and it is often necessary to import or export massive amounts of data between them. At present, there are many mature data import and export tools for different types of databases or file systems, such as MySQLDumper, OracleSQLLoader, etc., but these tools generally only provide data export or import, and only support one or a few specific types of databases or file systems. [0003] With the subseque...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06F9/52G06F11/34
Inventor 孟艳青
Owner ULTRAPOWER SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com