Cloud automatic early warning operation and maintenance monitoring system based on Hadoop

Abstract

The invention belongs to the technical field of software development, and specifically relates to a cloud automatic early warning operation and maintenance monitoring system based on Hadoop. The system of the invention provides a cloud-based automatic early warning system mainly in view of the current situation of passive service in an operation and maintenance service system, and the problems offrequent data collection, low real-time retrieval efficiency of massive data every day and the like, and the system can effectively perform real-time monitoring and data summarization on the data of services running every day, perform active and timely access on the operation states of other network devices, discover hidden dangers of the service system, merge and integrate the analytical data, extract valuable data and perform early warning, and provide easy-to-understand data tables and meet the scenes to perform decision analysis. The system adopts an open source Hadoop distributed computing platform and the Linux cluster technology to build a visual cloud monitoring system model, therefore the data processing speed can be expanded easily, the security is high, the cost is low, and distributed massive data processing is achieved.

Description

technical field [0001] The invention belongs to the technical field of software development, and in particular relates to a Hadoop-based cloud automatic early warning operation and maintenance monitoring system. Background technique [0002] Cloud computing is a comprehensive development of Distributed Computing, Parallel Computing and Grid Computing. The basic principle of cloud computing is that computing is distributed across a large number of distributed computers, making enterprise data center operations more similar to using the Internet, so enterprises can switch resources as needed for applications and access computers and storage systems as needed. Cloud computing is a revolutionary initiative that streams computing power as a commodity, spread, of course, over the Internet. Cloud computing is a new business model, and its core is still the data center at the back end of the cloud. Enterprises and individual users obtain computing power through high-speed Internet...

AI Technical Summary

Problems solved by technology

[0003] (1) Poor overall performance

As the scale of the network continues to expand, the management tasks become very heavy and complex

The multiplication of data that needs to be managed in the system makes it easy for workstations to be overwhelmed

[0004] (2) Insufficient scalability

[0005] (3) Insufficient flexibility

[0008] One is the scientific nature of the threshold, that is, the scientific nature of the experience threshold is difficult to guarantee, and the degree of configuration automation is low. The experience threshold does not adapt to environmental changes

And it presents the problem of single function, no analysis and no early warning

[0009] The second is how to reduce false alarms, that is, there is a lack of analysis of the generated alarms and the dependencies between alarms, so that it is impossible to identify real, root-cause alarms. The data scale is small, usually hundreds or thousands of hosts, Unsuitable for cloud scale, short monitoring cycle: data of the last week or month is stored, and historical analysis cannot be performed

[0010] The third is that it cannot handle big data, that is, it cannot collect and integrate large-scale data such as cloud platforms, so as to ensure real-time presentation of alarms, decentralized processing of data, and independent programs with each function to process different data sources, develop and deploy , Operation and maintenance are difficult, and the collection is deployed in layers, and the collection is layered and networked, which is not easy to manage and operate, and it is prone to untimely data collection or missed collection

[0011] Fourth, it is impossible to conduct a more intuitive analysis and processing of events that occur more conveniently and quickly, resulting in the inability to quickly and accurately process the emergency time

Images