A method and apparatus for data management

Abstract

An embodiment of the present application provides a data management method and apparatus. The method includes: determining a plurality of designated attribute information related to the target data according to a storage path corresponding to the target data for each target data in a data warehouse, and determining at least one field name contained in the target data according to a data content corresponding to the target data; constructing a metadata relationship map of a data warehouse based on a preset graph database according to a plurality of designated attribute information of each target data and at least one field name; based on the metadata relationship map, data management is carried out for each target data. The metadata of data warehouse is represented in the form of graph database, the corresponding metadata relational map is constructed to improve the management efficiency of metadata in data warehouse, and then combined with the metadata relational map, the data qualityof target data can be supervised more efficiently, the management efficiency of target data can be improved, and the management cost can be reduced.

Description

technical field [0001] The present application relates to the field of computers, in particular to a data management method and device. Background technique [0002] At present, with the rapid development of Internet technology, there are more and more demands for online business processing. Therefore, more and more data are generated in the process of business processing. In order to facilitate the management of stored data in the data warehouse, through pre- Construct the metadata of the data warehouse, and then perform life cycle management and data quality management on the stored data in the data warehouse based on the metadata. Among them, in the field of data warehouse, metadata is defined as the data describing the data and its environment. Data refers to structured data extracted from information resources to describe its characteristics and content. Metadata is mainly used to describe the information of data attributes, and can support such as indicating storage lo...

AI Technical Summary

Problems solved by technology

[0003] At present, the construction process of metadata in related technologies mainly includes: constructing metadata of a data warehouse based on a relational database. Specifically, it is necessary to use a pre-generated query algorithm to query the database multiple times to obtain the relationship between the attribute information of each target data. Dependency, especially for the complex dependency between attribute information, not only takes a long time, but also is prone to association errors; in addition, for the management process of stored data, it mainly includes: because a relational database is Information in a rectangular grid composed of multiple tables, each table can have a different number of rows and columns, if you need to obtain the target data to be managed, you need to traverse each piece of information in each information table, the whole process is time-consuming long

[0004] It can be seen that in the process of constructing metadata based on relational database, there are problems of low efficiency and high maintenance cost. Manage difficult problems

Images