Method and device for generating data warehouse ETL (Extraction, Transformation and Loading) codes

A data warehouse and code technology, applied in the field of data warehouse ETL code generation, can solve the problems of high professional technical requirements of ETL developers, inability to guarantee complete consistency of code style, and slow response of technology to business support, so as to reduce manual development, Improve test efficiency and improve development efficiency
CN103309904AActive Publication Date: 2013-09-18ADVANCED NEW TECH CO LTD
3 Cites 21 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
ADVANCED NEW TECH CO LTD
Publication Date
2013-09-18

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a method for generating data warehouse ETL (Extraction, Transformation and Loading) codes and a device for generating the data warehouse ETL codes, so as to solve various problems caused by independent development of current data warehouse ETL. The method comprises the steps: by aiming at business logic needed to be processed, corresponding file header variables and explanatory note information thereof are added; the business logic needed to be processed is presented by SQL (Structured Query Language) statements, and then the SQL statements are used as variable values to be filled into array variables; general technological logic of various businesses is extracted, and is used for authoring codes of an ETL development template, wherein the ETL development template is used for calling the variable values to process the business logic; and the codes of the ETL development template, file headers and explanatory note information thereof and the array variables filled with the variable values are organized to form an executable ETL code script. With the device and method disclosed by the invention, the development efficiency is improved, the code style is uniform, the codes are convenient to manage, and the test efficiency is also effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] This application relates to computer technology, in particular to a method and device for generating data warehouse ETL codes. Background technique

[0002] ETL is the process of data extraction (Extract), transformation (Transform), cleaning (Cleansing), and loading (Load). It is an important part of building a data warehouse. The user extracts the required data from the data source, after data cleaning, and finally loads the data into the data warehouse according to the pre-defined data warehouse model.

[0003] At present, the enterprise data warehouse ETL basically adopts the method of independent development, mostly based on process language development. Every time a new requirement or project is received, ETL developers need to develop a large number of process language codes in addition to sorting out business logic. For example, some enterprises use perl language (Practical Extraction and Report Language, practical report extraction language) ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More