ETL data synchronization method and device, electronic equipment and storage medium

A technology for synchronizing data and synchronizing data, which is applied in structured data retrieval, database management systems, special data processing applications, etc., and can solve problems such as cumbersome operations

Active Publication Date: 2021-01-29
HANGZHOU DT DREAM TECH
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In this related technology, technicians need to configure ETL tasks in the ETL servers on both sides of the gatekeeper to realize the mutual conversion between the data to be synchronized and the transmission file, and the operation is very cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • ETL data synchronization method and device, electronic equipment and storage medium
  • ETL data synchronization method and device, electronic equipment and storage medium
  • ETL data synchronization method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0036] The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an ETL data synchronization method and device, electronic equipment and a storage medium. The method is applied to a downstream ETL server and can comprise the following steps that a configuration file which is sent by an upstream ETL server and forwarded through a gateway is obtained, and the configuration file is obtained by converting an ETL task through the upstream ETLserver according to a preset conversion rule; a transmission file forwarded by the gateway and sent by the upstream ETL server is acquired, wherein the transmission file is obtained by performing format conversion on to-be-synchronized data by the upstream ETL server according to the ETL task; and the configuration file is analyzed into an ETL task through the preset conversion rule, and the transmission file is restored into the to-be-synchronized data by the ETL task obtained through analysis. According to the technical scheme, a downstream ETL server can automatically generate the ETL taskbased on the received configuration file, and the problem that in the prior art, ETL tasks need to be configured on the ETL servers on the two sides of the gatekeeper respectively, and consequently operation is tedious is solved.

Description

technical field [0001] The present application relates to the field of data storage, in particular to an ETL data synchronization method and device, electronic equipment, and a storage medium. Background technique [0002] In the field of data storage, in order to meet the access requirements of users in different networks to the same service data, it is necessary to perform data synchronization between data storage spaces of different networks (also known as data synchronization between isolated networks). [0003] In related technologies, in order to ensure data security, offline transmission is usually used to realize data synchronization between isolated networks. For example, it can be implemented through a gatekeeper and ETL servers deployed on both sides of it. In this implementation, since the data to be synchronized cannot be directly transmitted in the gatekeeper, the upstream ETL server needs to convert it into a file that can be transmitted in the gatekeeper; co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F16/25G06F16/27
CPCH04L67/06H04L67/30H04L67/1095G06F16/254G06F16/258G06F16/275H04L67/565
Inventor 褚占峰郑高江峰陈世兴
Owner HANGZHOU DT DREAM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap