A visual distributed system real-time monitoring operation and maintenance method and device

Abstract

The invention provides a visual real-time monitoring operation and maintenance method of a distributed system. The method comprises the steps that noninvasive event tracking is conducted in each application system, and log information of each application system is collected; open-source plug-ins are deployed on an operating system of applications, and hardware running information and operation loginformation of the operating system are collected; the collected various data information is transmitted to a stream-oriented computation framework cluster through a message-oriented middleware cluster, and the stream-oriented computation framework cluster stores the received data information into a file in an HBase or HDFS format; based on a Kibana framework in an ELK framework, it is achieved that various views are displayed in a Web page with the combination of report plug-ins in the industry, and data in the views is pushed and updated in real time through distributed caches. The visual real-time monitoring operation and maintenance method has the advantages that the operation and maintenance difficulty of the distributed system is greatly reduced, the operation and maintenance efficiency of a distributed application is improved, and a strong guarantee is provided for construction, deployment, operation, maintenance, upgrading, reconstruction and other processes of the system.

Description

technical field [0001] The invention relates to a visualized distributed system real-time monitoring operation and maintenance method and device. Background technique [0002] With the continuous advancement of technology, the development of IT has transformed from general construction to general operation and maintenance. Facing the multi-level, domain-specific, and social service-oriented characteristics of the telecommunications industry, the Telecom Internet-based Distributed Application Visualization Project is an Internet-based project for China Telecom. Distributed operation and maintenance provides a guarantee solution from IT availability to service availability, helping the rapid transformation of IT enterprise service-oriented organizations. [0003] In the process of transforming the traditional SSH architecture into a distributed application architecture, the technical characteristics and business characteristics of operation and maintenance have undergone great...

AI Technical Summary

Problems solved by technology

This makes it impossible for the business department to understand the implementation of marketing activities in real time, and to adjust marketing strategies and plans in a timely manner according to some business characteristics and changes in the marketing process to achieve better marketing results;

[0008] Invisible application interface calls: There are many interfaces in the IT system. According to the sorted out situation, there are as many as 1000+ interfaces, and more than dozens of supporting manufacturers are involved. There are a large number of interfaces that are executed in the background. Problems such as access security audit, surge in call data, and difficulty in abnormal location are not conducive to the development of maintenance work;

[0009] The application polling schedule is invisible: the polling scheduler in the background is often running for a long time, and it is very easy to have suspended animation, hang up, and occupy too much memory. monitoring and alarming through polling;

[0010] IT hardware investment decision-making is difficult: In the construction of IT systems in telecom enterprises, there are many business systems and high hardware investment costs. Replacement, elimination, etc., without fault data, physical examination data, and operating data to provide data support for hardware investment decisions;

[0011] Heavy operation and maintenance workload: Since the system under construction is a distributed business system, although the unified processing of business data is logically realized, but physically, it is supported by hundreds of PCs at the back end, and any system configuration The modification of files and the execution of data scripts all need to ensure the consistency of content and transaction consistency

Images