Method for managing metadata of data warehouse, readable storage medium, and computer device

A technology of data warehouse and management method, applied in the field of data warehouse metadata management, computer readable storage medium and computer equipment, can solve the problems of inability to realize adjustment and update, and achieve the effect of improving the source data management method

Active Publication Date: 2018-12-07
玖富数科科技集团有限责任公司
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But it only stays in the cleaning of data, and the overall adjustment and update cannot be realized for the dependent data fields in the data warehouse

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for managing metadata of data warehouse, readable storage medium, and computer device
  • Method for managing metadata of data warehouse, readable storage medium, and computer device
  • Method for managing metadata of data warehouse, readable storage medium, and computer device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to illustrate the present invention more clearly, the present invention will be further described below in conjunction with preferred embodiments and accompanying drawings. Similar parts in the figures are denoted by the same reference numerals. Those skilled in the art should understand that the content specifically described below is illustrative rather than restrictive, and should not limit the protection scope of the present invention.

[0054] At present, in practical applications, data warehouses usually need to synchronize the data scattered in various business systems to the offline data storage environment at a certain frequency, for example, at a frequency of T+1. Existing data collection systems are usually based on fixed source libraries , source table, and source column to collect data. This collection scheme may cause scheduling errors or data errors when the source table changes, affecting data quality and environmental stability. Such as figur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for managing metadata of a data warehouse, a readable storage medium, and a computer device are disclosed. The method for managing metadata of a data warehouse includes detecting whether datastructure of each service source table of source warehouse of data warehouse changes in data extraction process, if so, generating early warning information and separately processing that changed service source table to complete data processing; performing consanguinity analysis in the data warehouse according to a target table corresponding to the changed service source table, and outputting a consanguinity relationship map; evaluating and modifying each data table involved in the data warehouse according to the consanguinity map. The method provided by the invention brings convenience to find the change of the service source table, and is convenient for the subsequent data developers to adjust, and the accuracy of the adjustment is verified through the blood relationship analysis, thereby reducing the problems caused by the inconsistent data structure, and reducing the probability of the daily scheduling flow of the data warehouse to report errors at the same time.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data warehouse metadata management method, a computer-readable storage medium and computer equipment. Background technique [0002] Metadata, also known as intermediary data and relay data, is the data describing data (data about data), mainly describing the information of data attributes (property), used to support such as indicating storage location, historical data, resource search and File recording and other functions. By describing business data through metadata and managing the metadata describing business data, effective management of business data can be realized. [0003] At present, in the field of data processing technology, in the Chinese patent documents, the name is "A Metadata Management System" with the application number CN201711049884.X, which introduces a metadata management system, including: a relational database module for Configure and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 袁义军
Owner 玖富数科科技集团有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap