Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and system

A data processing and data technology, applied in the field of data processing, can solve problems such as low processing efficiency and achieve the effect of high processing efficiency

Inactive Publication Date: 2014-10-29
TELEFON AB LM ERICSSON (PUBL)
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This approach requires ETL developers to have the ability to write scripts, and the processing efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system
  • Data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to enable those skilled in the art to better understand the solutions of the embodiments of the present invention, the embodiments of the present invention will be further described in detail below in conjunction with the drawings and implementations.

[0037] In the data processing method and system provided by the present invention, the ETL rules are encapsulated into a dynamic library file form, and the information of the dynamic library file is registered in the task table of the database in the background; Each task implements data ETL processing according to its corresponding ETL rule, and each task in the task table corresponds to an ETL rule. In this way, the processing of large amounts of data and multiple data sources can be realized without the need for users to have programming skills. It not only has high processing efficiency, but also is not affected by the system environment, and can be applied to non-visualized systems and visualized systems.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of data processing and discloses a data processing method and a system. The method comprises the following steps: ETL (Extraction-Transformation-Loading) rules are encapsulated to dynamic library file forms, and the information of the dynamic library file forms is registered in a task table of a data base at a back stage; each task of the task table is subject to ETL processing of the data according to the corresponding ETL rules through scanning the task table; and each task of the task table corresponds to an ETL rule. Through the invention, the processing for high-volume data and multiple data sources in both a non-visual system and a visible system is realized, thereby improving the processing efficiency.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method and system. Background technique [0002] ETL is the process of data extraction (Extract), transformation (Transform), and loading (Load). It is an important part of building a data warehouse. [0003] Usually, the user's data sources are distributed in various subsystems and nodes, and ETL is used to transfer the data on each subsystem to the server through automatic or manual control, for extraction, cleaning and conversion processing, and then loaded into the data warehouse. Because there are many existing business data sources, ensuring data consistency, truly understanding the business meaning of data, and integrating data across multiple platforms, multiple data sources, and multiple systems, it is possible to improve the quality of data to the greatest extent possible and cater to the ever-changing characteristics of business needs...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 钟国南
Owner TELEFON AB LM ERICSSON (PUBL)