Data exchange control method and device

A data exchange and control method technology, applied in the field of data processing, can solve problems such as waste of resources, low exchange efficiency, poor performance and resource utilization, and achieve the effect of improving exchange efficiency, reducing exchange time, and reducing the number of restarts

Pending Publication Date: 2021-02-09
HANGZHOU DT DREAM TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] When the following two scenarios exist (1. The network environment where the data exchange system and the destination database are located is poor or the network is abnormal, such as network jitter or packet loss, the data exchange system submits data to the destination database, and the destination database loads data successfully, but the destination database returns 2. When the performance of the destination database itself is poor or the resource utilization rate is very high, if the data is not successfully written for a long time), it will cause the data exchange system to wait for a long time, waste resources, and finally submit the data It will fail, and the data needs to be submitted again, resulting in low exchange efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exchange control method and device
  • Data exchange control method and device
  • Data exchange control method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the embodiments of the invention as recited in the appended claims.

[0027] Terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments of the present invention, and are not intended to limit the embodiments of the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data exchange control method and device. According to the embodiment of the invention, after the first information is received, the received data volume corresponding to the current data exchange operation of the working node is obtained from a destination database, and the data submission of the current data exchange operation is controlled according tothe received data volume and the submitted data volume corresponding to the current data exchange operation, therefore, the restart frequency of a data submission task is reduced, the exchange time ofthe whole data exchange is reduced, and the exchange efficiency of a data exchange system is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data exchange control method and device. Background technique [0002] The ETL (Extract-Transform-Load, Extract-Transform-Load) system, also known as the data exchange system, is used to extract, transform, and load data from the source to the destination. In order to improve the ability of ETL exchange and support more data source access, ETL tools will be deployed in the form of clusters, and the control node will manage multiple work nodes in a unified manner, and assign data exchange jobs to one or more work nodes for data processing. exchange. [0003] According to the data exchange job issued by the control node and its parameter settings, the working node extracts data from the source database, and submits the data to the destination database after its own processing. [0004] When the following two scenarios exist (1. The network environment where the data exc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25
CPCG06F16/254
Inventor 陈振洲
Owner HANGZHOU DT DREAM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap