Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and apparatus for transferring data in batches across databases

A database and data technology, applied in the field of data transmission, can solve the problems of no effective solution, lack of methods for fast batch transfer of data across databases, etc., and achieve the effect of reducing transmission time and improving transmission efficiency

Inactive Publication Date: 2019-01-29
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] There is no effective solution to the problem of the lack of fast batch transfer data across databases in the existing technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and apparatus for transferring data in batches across databases
  • A method and apparatus for transferring data in batches across databases

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0030] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0031] Based on the above purpose, the first aspect of the embodiments of the present invention proposes an embodiment of a method capable of performing cross-database batch transfer for different data or different types of data. figure 1 What is sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for transferring data in batch across databases. The method comprises the following steps: segmenting data to be transported in a first database, sequentially generating a plurality of data slices; after each data slice is generated, the data slice is exported to memory immediately. When the number of data slices present in the memory reaches a specified number, the data slices are simultaneously imported into the second database in parallel. The technical proposal of the invention can conduct cross-database batch transmission according to different data or different types of data, thereby improving data batch transmission efficiency and reducing transmission time.

Description

technical field [0001] The present invention relates to the field of data transmission, and more specifically, relates to a method and device for transferring data in batches across databases. Background technique [0002] The most commonly used big data search engine in the prior art is ElasticSearch (ES), and the data loaded into ES can be quickly searched and queried. One of the sources of ES data is from a relational database (such as K-DB database). In the prior art, there is a lack of solutions for quickly batch-loading data from K-DB to ES. The existing technology is to query the data from the K-DB database and generate a data file (the so-called file landing), and then import the landed data file into ES. Since the import is a full import, the import efficiency is low when the amount of data is large . [0003] There is no effective solution to the problem of the lack of methods for fast batch transfer of data across databases in the prior art. Contents of the i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/28
Inventor 魏本帅杜彦魁
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD