A data extraction method and device

A data extraction and data technology, applied in the field of data processing, can solve problems such as low accuracy, data extraction errors, and error-prone, and achieve the effect of improving extraction efficiency, reducing the impact of errors, and realizing data synchronization

Active Publication Date: 2021-11-12
BANK OF CHINA
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The entire processing flow of the existing data extraction scheme needs to be controlled and executed by the operator, which will make the data extraction efficiency low due to manual intervention
Moreover, the export and import process of a large number of data tables is prone to errors. Once there is a problem with the exported DPM file, if hundreds or even thousands of tables are exported at one time, all tables will not be able to be exported and imported successfully, making the efficiency low And the accuracy is low; due to the different structure of each data table, the use of data extraction statements in the existing scheme cannot realize the extraction of a part of the data that meets the requirements in all tables, and the impact of data extraction errors will occur

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data extraction method and device
  • A data extraction method and device
  • A data extraction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0048] The terms "first" and "second" in the specification and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or apparatus comprising a series of steps or units is not defined by listed steps or u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data extraction method and device. The method includes: analyzing the acquired data extraction task of the source system, and generating a data extraction list corresponding to the data extraction task according to the data partition granularity; Extract the data capacity in the list, and determine the data extraction method for the source system; if the first preset data extraction method is used for data extraction, extract the data of each of the data partitions, and generate the first data file , saving the first data file to the target system; if the second preset data extraction method is used for data extraction, perform data extraction on the source system, and save the extracted data file to the target system. The invention realizes data table partition extraction, improves data extraction efficiency and reduces data extraction errors.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data extraction method and device. Background technique [0002] With the development of Internet technology, more and more systems need to carry out data transmission and application, which requires the data of some systems to be extracted and imported or exported to the corresponding destination system. [0003] Existing data extraction solutions are usually implemented through the following steps: identify the range of source system data tables that need to be exported; write export and import statements, export DMP files and transfer them to the target system, or import DMP files. The entire processing flow of the existing data extraction scheme needs to be controlled and executed by the operator, which will result in low data extraction efficiency due to manual intervention. Moreover, the export and import process of a large number of data tables is prone to error...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25
CPCG06F16/254G06F16/258
Inventor 林明欧阳小兵戴丽玛于鸿鹏陈宏亮张丹张素钊
Owner BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products