Big data platform operation and maintenance management system

Abstract

The invention discloses a big data platform operation and maintenance management system. The system comprises a data loading management module, a script publishing management module and a data exportmanagement module, wherein the data loading management module is used for loading data from an upstream system; the script publishing management module is used for automatically realizing script publishing; and the data export management module is used for exporting the data to a downstream system. When data is loaded and exported to execute corresponding scripts, configuration information is readaccording to business encoding parameters, and corresponding loading / export logics are executed according to the configuration information so as to realize data loading / export; and during script publishing, script publishing catalogues are maintained, managed and processed in batches via a catalogue tree form, so that batch processed scripts can be rapidly searched, related information can be determined and publishing of the batch processed scripts can be completed. Compared with the prior art, the big data platform operation and maintenance management system is capable of enhancing the management level and processing efficiency of big data platforms, and satisfying the high-standard demands of users.

Description

technical field [0001] The present invention relates to big data technology, and more specifically, relates to a big data platform operation and maintenance management system. Background technique [0002] Big data technology refers to the ability to quickly obtain valuable information from various types of data. The big data platform is a platform for calculating the increasing amount of data generated in today's society, with the purpose of storing, computing, and displaying. [0003] A bank is a legally established financial institution operating money and credit business. During the official operation of the banking system, it needs to have business contacts with many other financial-related systems. In the process of connecting the banking system with other systems, a big data platform is needed to manage the business data between the banking system and other systems. According to the data flow between the big data platform and other systems, the systems that have bus...

AI Technical Summary

Problems solved by technology

[0004] In the existing technology, the management level of the overall project management and operation and maintenance management of the big data platform is poor, and the management efficiency is low

Faced with an increasingly large amount of data and complex and diverse financial services, the original big data platform is increasingly difficult to meet the high standard needs of users

Images