Method, system and device for extracting, converting and loading data

A data extraction and loading system technology, applied in the direction of program control device, program loading/starting, etc., can solve the problem of large amount of development and achieve the effect of small amount of development

Active Publication Date: 2010-06-30
山东中创软件商用中间件股份有限公司
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the purpose of the present invention is to provide data extraction, conversion and loading methods, systems and devices to solve the problem of large amount of development in the traditional way when the ETL process is changed due to data conversion logic

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and device for extracting, converting and loading data
  • Method, system and device for extracting, converting and loading data
  • Method, system and device for extracting, converting and loading data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] For reference and clarity, technical terms, abbreviations or abbreviations used hereinafter are summarized as follows:

[0031] GUI, Graphical User Interface, Graphical User Interface;

[0032] Drools: It is an implementation of a rule engine based on Charles Forgy's RETE algorithm tailored for Java;

[0033] Java: a programming language;

[0034] Rete algorithm: Rete algorithm is a fast forward rule matching algorithm, and its matching speed has nothing to do with the number of rules. Rete is Latin, and the corresponding English is net, which is the network. The Rete algorithm performs pattern matching by forming a rete network, and utilizes two characteristics of rule-based systems, namely temporal redundancy and structural similarity, to improve system pattern matching efficiency;

[0035] Rule: A rule includes an antecedent and a consequent. Among them, the antecedent is also called the condition part, the mode part or the left hand side (Left Hand Side, LHS), t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a method, system and device for extracting, converting and loading data for solving the problem that the development workload of ETL flow is great when the data conversion logic is changed in prior art. The method includes that: a rule editor receives a data conversion configuration attribute value, and a data conversion rule is obtained according to the data conversion configuration attribute value; data extraction is performed; a rule engine loads the data conversion rule, and the extracted data is converted by using the data conversion rule; and the converted data is loaded. As indicated in the invention embodiment, when the data conversion logic is changed, the rule editor is utilized to re-customize a data conversion rule to achieve the purpose of updating the data conversion logic without developing the whole program repeatedly. Compared with the traditional method, the invention has a small amount of development workload.

Description

technical field [0001] The present invention relates to the technical field of data conversion, and more specifically, to a data extraction, conversion and loading method, system and device. Background technique [0002] ETL (Extract-Transform-Load) is used to describe the process of extracting, transforming, and loading data from the source to the destination. The term ETL is more commonly used in data warehouses, but its objects are not limited to data warehouses. The ETL process can be developed in any programming language. [0003] For the data conversion process in ETL, the traditional method is to embed the rules for data conversion operations into the program code. However, in the process of implementing the present invention, the inventor found that once the data conversion software written by embedding rules into the code is developed, it is not easy to change. The reality is that the data conversion logic often needs to be changed frequently, requiring developer...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/44G06F9/445
Inventor 陈俊戴毅雷玉玲刘宗福刘春皮开元
Owner 山东中创软件商用中间件股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap