Unlock instant, AI-driven research and patent intelligence for your innovation.

Metadata driven data preprocessing method

A data preprocessing and data processing technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of increasing the difficulty of metadata maintenance and use, affecting the efficiency, compatibility and reliability of software systems, etc. , to achieve the effects of reliability assurance, execution efficiency optimization, and compatibility improvement

Inactive Publication Date: 2006-01-18
SHANGHAI BAOSIGHT SOFTWARE CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the current existing data preprocessing methods are organized around the relevant algorithms, this results in the entire data preprocessing process being split into several relatively independent processing steps.
Each processing step adopts different metadata representation methods according to its own algorithm, which increases the difficulty of metadata maintenance and use, thus affecting the efficiency, compatibility and reliability of the entire software system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata driven data preprocessing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] Such as figure 1 As shown, the metadata-driven data preprocessing method of the present invention includes the following steps:

[0016] 1. Establish metadata storage 3 .

[0017] According to the characteristics of the industry and relevant industry norms, a metadata management standard is selected. In this specific embodiment, we adopt the CWM (Common Warehouse Metamodel) standard organized by OMG (International Object Management Organization); or define our own metadata management standards. According to the scale of the software system, select a suitable metadata storage method, such as text files, XML files, relational databases, special storage, etc. Define metadata access interfaces according to metadata management standards and metadata storage, including end user access interfaces, algorithm interfaces and storage interfaces. Build on the above work to create metadata storage for software systems.

[0018] 2. Various data preprocessing algorithms 4 are regi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data preprocessing method driven by metadata, which comprises the following steps: 1. establishing metadata storage; 2. registering each data preprocessing decimal scale into data manager; 3. defying data preprocessing workflow by the interface and reserving it into metadata manager. 4. Metadata manager drives each data preprocessing decimal scale to do data processing; 5. Data processing referent information is reserved into the metadata storage.

Description

technical field [0001] The invention relates to a data preprocessing method driven by metadata, and the data preprocessing is an important part of software systems such as data warehouse, data mining and business intelligence. Background technique [0002] Data preprocessing mainly refers to the process of data extraction, cleaning, conversion and loading, and the definition of data preprocessing process is represented by metadata in the software system. Since the current existing data preprocessing methods are all organized around relevant algorithms, this results in the entire data preprocessing process being split into several relatively independent processing steps. Each processing step uses different metadata representation methods according to its own algorithm, which increases the difficulty of metadata maintenance and use, thus affecting the efficiency, compatibility and reliability of the entire software system. Contents of the invention [0003] The technical pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 胡大斌
Owner SHANGHAI BAOSIGHT SOFTWARE CO LTD