Unlock instant, AI-driven research and patent intelligence for your innovation.

Data exchange method and device and related equipment

A technology of data exchange and target data, applied in the field of data processing, can solve the problems of increasing time-consuming and resource consumption, increasing the amount of exchanged data, etc., and achieve the effect of saving resources, reducing time-consuming, and reducing the amount of exchanged data

Pending Publication Date: 2019-10-01
HANGZHOU DT DREAM TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method will lead to an increase in the overall amount of exchanged data, increasing time-consuming and resource consumption

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exchange method and device and related equipment
  • Data exchange method and device and related equipment
  • Data exchange method and device and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the embodiments of the invention as recited in the appended claims.

[0040] Terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments of the present invention, and are not intended to limit the embodiments of the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data exchange method and device and related equipment. The method comprises the following steps: a working node completing the data exchange operation through multiple times of batch exchange; performing data exchange according to the number of the batch exchange rows corresponding to the batch each time, updating and recording the number of the next batch exchange rows according to the number of the batch exchange rows and the exchange time after each batch exchange is completed, and recording the number of the exchanged rows after the batch exchange; wherein the number of exchanged rows before the first batch exchange is 0, and the number of the batch exchange rows before the first batch exchange is a preset value; when the working node meets the continuous transmission condition, obtaining the number of exchanged rows and the number of batch exchange rows when an interrupted data exchange operation is interrupted, determining a target datarow of current data exchange according to the number of exchanged rows and the number of batch exchange rows, and carrying out data exchange on the target data row, thereby realizing breakpoint continuous transmission, reducing the total exchange data volume, reducing time consumption and saving resources.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data exchange method, device and related equipment. Background technique [0002] ETL (Extract-Transform-Load, Extraction-Interactive Transformation-Loading) is used to describe the process of extracting, transforming, and loading data from the source to the destination. In order to improve the ability of ETL exchange and support more data source access, ETL tools will be deployed in a cluster mode, and the control node will manage multiple work nodes in a unified manner, and assign exchange jobs to one or more work nodes for data processing. exchange. [0003] The control node usually selects one or more working nodes to extract and exchange the full amount of data from the source database. In the event of a network failure or abnormality of the working node during the full data exchange, the exchange job will be interrupted. [0004] In the related art, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/27
CPCG06F16/254G06F16/27Y02D10/00
Inventor 林鹏程
Owner HANGZHOU DT DREAM TECH