An automated ETL data processing tool and a method for using the same

A technology of data processing and tools, which is applied in the computer field, can solve the problems of increasing the workload of technical developers and low development efficiency, and achieve the effect of improving processing speed, development efficiency and applicability

Inactive Publication Date: 2019-02-19
安徽三实软件科技有限公司
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, data source technicians for different interface types need to develop different ETL processing tools for ETL processing, which not only increases the workload of technical developers, but also reduces development efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automated ETL data processing tool and a method for using the same

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0026] See attached figure 1 Shown, a kind of automatic ETL data processing tool of the present invention comprises data extraction module, data conversion module, task creation module, data loading module, data storage module and data output module;

[0027] The data extraction module is connected to the data conversion module, and the data extraction module is used to obtain the source data in the data source, and transfer the obtained source dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the computer field and discloses an automatic ETL data processing tool and a use method thereof. The automatic ETL data processing tool comprises a data extraction module, a data conversion module, a task creation module, a data loading module, a data storage module and a data output module; The data extraction module is connected with the data conversion module, The dataconversion module is connected with a task creation module, the task creation module is connected with a data loading module, the data loading module is connected with a data output module; and the data extraction module, the data conversion module, the task creation module and the data loading module are all connected with a data storage module. The automated ETL data processing tool of the present invention can reduce the situation that the frequently imported and exported ETL tool reduces the processing speed, and further effectively improves the processing speed and the development efficiency compared with the prior art.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an automatic ETL data processing tool and a method for using the same. Background technique [0002] With the rapid development of big data business, ETL processing of data has become very common. The process of ETL processing is roughly to clean, transform, and integrate data from different data sources after extraction, that is, data extraction, data conversion, data loading, etc., and put the processed data into the target data warehouse. At present, there are many different types of data sources, such as: relational Mysql, non-relational HBase, Hive for data warehouses, HDFS for file storage, and Elasticsearch for file indexing services with storage functions; and data sources of different data types may be with different interface types. However, data source technicians for different interface types need to develop different ETL processing tools for ETL processing, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25
Inventor 赵明
Owner 安徽三实软件科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap