Metadata management method and device

A management method and metadata technology, applied in the field of data warehouses, can solve the problems of poor intelligence, unfavorable popularization and application, and cumbersome operation of metadata management methods, so as to improve intelligence and ease of use, reduce user intervention, and realize automation Effect

Active Publication Date: 2009-02-11
NEW H3C BIG DATA TECH CO LTD
View PDF0 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This metadata management method based on explicit user intervention is less intelligent and cumbersome to operate, which is not conducive to popularization and application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata management method and device
  • Metadata management method and device
  • Metadata management method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0029] Aiming at the problems existing in the prior art, the present invention aims to provide a new ETL metadata management method, so that in the ETL processing process, the user only needs to configure the ETL data processing logic rules, and does not need to care about each step of the intermediate process data storage types and formats, realize the automation of ETL metadata management, and increase the intelligence and ease of use of the ETL system.

[0030] figure 2 Shows the flow chart of the ETL metadata management method in the present invention, including the following steps:

[0031] Step 201: For each step of ETL operation (extraction, transformation or loading), first determine the type of input data source, and then call the correspondi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata management method and a device. The method comprises the following steps: A. for each step of ETL operations, an input metadata is acquired firstly, and then the input metadata is transferred to a unified ETL metadata in an ETL system; B. aiming at each output field, adjusting ETL metadata according to ETL data processing logic rules; and C. transferring the adjusted ETL metadata into an output metadata according to the type of an output data source, and creating an output data structure in the output data sources according to the output metadata. The metadata management method and the device can realize the metadata management automation and reduce users' intervention.

Description

technical field [0001] The invention relates to data warehouse technology, in particular to a metadata management method and device. Background technique [0002] Data extraction, transformation and loading (ETL, Extraction Transformation Loading) is an important part of building a data warehouse. It is responsible for completing the process of transforming data from a data source to a target database, and is an important step in implementing a data warehouse. figure 1 A schematic diagram of the ETL processing process is shown. According to the pre-designed rules, the ETL system extracts data from different data sources to the temporary intermediate layer for cleaning, transformation and integration, and finally loads them into the target data source, so that different heterogeneous Data sources flow to unified target data. [0003] Among them, metadata is the data describing the data (data about data), mainly referring to the basic attributes such as the physical field typ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 杨静涛朱海涛
Owner NEW H3C BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap