Data mart management system based on Hadoop cluster and use method thereof

Abstract

The invention discloses a data mart management system based on a Hadoop cluster and a use method thereof and relates to the technical field of computers. According to the data mart management system,a cluster management subsystem is used for obtaining configuration information of a data mart and synchronizing the configuration information to a permission management subsystem and is also used forobtaining metadata information of the data mart and synchronizing the metadata information to a data management subsystem, the data management subsystem is used for synchronizing change information ofthe metadata in the data mart and then synchronizing the change information of the metadata to the permission management subsystem. The use method comprises the steps that an access interface subsystem receives an access request; corresponding permissions are obtained from the permission management subsystem, and response is given according to the request and permissions. By adopting the data mart management system, the technical problem is solved that management of the data mart is poor and accordingly data mart access performed by a user is complicated and consumes time, and thus the effects of reducing the operation and maintenance costs and improving data use timeliness are achieved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a Hadoop cluster-based data mart management system and its usage method, electronic equipment and computer-readable medium. Background technique [0002] With the expansion of enterprise business, a large amount of data will be generated in the process of operation management and production, and whether the data can be analyzed and calculated efficiently and quickly will directly affect the value and role of big data in applications. One of the ways of big data management is to use Hadoop-based cluster technology (Hadoop is a distributed system infrastructure that can be used to implement a distributed file system. Hadoop clusters distribute a large amount of data to different machines for processing) to establish data Data marts or data warehouses are used to manage data. Among them, data marts generally refer to small analytical databases, which are established to ana...

AI Technical Summary

Problems solved by technology

[0004] The data mart lacks effective management. When accessing and other operations, it is necessary to go to the bottom layer of the database to obtain the configuration information of the data mart. The process is cumbersome and time-consuming; the metadata information management of the data mart is weak and the timeliness is poor; users access the database The operation path is too long, which reduces the efficiency of data use. The data mart lacks an automatic management system integrating data management, data calculation and metadata management, so that users can quickly and efficiently query the required data from the data mart.

Images