Internet platform big data operation and maintenance monitoring and intelligent analysis integrated platform

Abstract

The invention discloses an internet platform big data operation and maintenance monitoring and intelligent analysis integrated platform which comprises an operation and maintenance workbench, sub-platforms and a unified operation and maintenance knowledge base. The operation and maintenance workbench is used by management and operation and maintenance personnel and is used for managing the system and setting system functions; the sub-platform is used for providing full-chain operation and maintenance management and data analysis services from data acquisition, monitoring, alarm processing and standardized operation and maintenance operation to data visual analysis, knowledge management and resource configuration; and the unified operation and maintenance knowledge base is used for providing query, contribution, auditing and management of the unified operation and maintenance knowledge base. According to the invention, the integrated operation and maintenance platform integrating monitoring, management and control functions is constructed, the platform takes data as a core basis and value creation as a final target, and is tightly combined with an actual application scene, so that the data insight ability of an information department in the aspect of operation and maintenance operation is remarkably enhanced, and the operation and maintenance efficiency is improved. Therefore, the reliability of the platform and the continuity of services are ensured to a greater extent.

Description

Technical Field

[0001] The present invention relates to the technical field of artificial intelligence smart platform, and in particular to an integrated platform for big data operation and maintenance monitoring and intelligent analysis on an Internet platform. Background Art

[0002] In the context of the rapid development of Internet platforms, the core of the operation and maintenance support system focuses on building a highly integrated and intelligent operation and maintenance monitoring platform. This platform aims to achieve comprehensive coverage and efficient management of operation and maintenance work through advanced technical means, thereby ensuring the stable operation and continuous optimization of the Internet platform.

[0003] In the process of building this operation and maintenance support system, we first need to conduct an in-depth and detailed assessment of the Internet platform's operating scope, goals, processes, systems, and specifications. This assessment not only helps to clearly grasp the current operation and maintenance status, but also accurately identifies the gap between future expectations and the current situation, providing a strong basis for subsequent design and implementation.

[0004] However, although the current operation and maintenance support system has achieved remarkable results in the construction of a unified operation and maintenance monitoring platform, some shortcomings are still exposed in actual application. Specifically, the existing operation and maintenance monitoring platform still has certain limitations in terms of integration and intelligence, and it is difficult to fully adapt to the complex and changing operation and maintenance needs. This is mainly reflected in the platform's ability to process massive data, the accuracy of anomaly detection, and the timeliness of fault warning, which still need to be improved.

[0005] In addition, the gap assessment between the current situation and future expectations may not be accurate enough. This often makes it difficult to fully adapt to the actual operation and maintenance scenarios when designing user operation organizations, process system specifications and other services, thus affecting the efficiency and effectiveness of operation and maintenance work. For example, due to the lack of accurate understanding of operation and maintenance needs, the process system formulated may be too cumbersome or inflexible, which in turn increases the burden on operation and maintenance personnel and reduces work efficiency. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the prior art. To achieve the above purpose, an Internet platform big data operation and maintenance monitoring and intelligent analysis integrated platform is adopted to solve the problems raised in the above background technology.

[0007] An integrated platform for big data operation and maintenance monitoring and intelligent analysis on an Internet platform, including an operation and maintenance workbench, sub-platforms, and a unified operation and maintenance knowledge base;

[0008] The operation and maintenance workbench is used by management and maintenance personnel to manage the system and set system functions;

[0009] The sub-platform is used to provide full-chain operation and maintenance management and data analysis services from data collection, monitoring, alarm processing, standardized operation and maintenance operations to data visualization analysis, knowledge management and resource allocation;

[0010] The unified operation and maintenance knowledge base is used to provide unified operation and maintenance knowledge base query, contribution, review and management.

[0011] As a further technical solution of the present invention: the operation and maintenance workbench includes a system operation and maintenance workbench for use by management personnel and operation and maintenance personnel, which uses all open functions and performs system management on user workbenches, and a business operation and maintenance workbench for managing scopes and setting permissions.

[0012] As a further technical solution of the present invention: the sub-platform includes an operation sub-platform for providing data visualization analysis services to management personnel, business personnel, and operation and maintenance personnel, a tenant management platform for providing tenants with integrated operation and maintenance management platform services, a full-stack monitoring sub-platform for providing full IT resource monitoring and collection related to the business, a unified alarm sub-platform for unified access and processing of alarm messages and data indicators of various alarm sources, a standard operation sub-platform for providing standardized operation and maintenance scripts and commands to handle complex and redundant operation and maintenance requirements in specific scenarios, a data sub-platform for importing various massive operation and maintenance data, and cleaning, storing, converting, parsing and arranging the data, and a collection and control sub-platform for providing data collection of various IT resources, and uniformly and standardized scheduling and management of collection tasks and behaviors.

[0013] As a further technical solution of the present invention: the full-stack monitoring sub-platform includes an infrastructure monitoring module, an application performance monitoring module, and a dynamic environment monitoring module.

[0014] As a further technical solution of the present invention: the unified alarm sub-platform includes a centralized alarm management module and a third-party alarm integration module.

[0015] As a further technical solution of the present invention: the standard operation sub-platform includes a script management module, an orchestration management module, a scheduled task management module, and a scheduling scenario management module.

[0016] As a further technical solution of the present invention: the data sub-platform includes a model management module, a configuration item management module, a business management module, a topology management module, and a resource statistics module.

[0017] As a further technical solution of the present invention: the acquisition and control sub-platform includes a node management module, an agent management module, a self-monitoring module, and a policy management module.

[0018] Compared with the prior art, the present invention has the following technical effects:

[0019] By adopting the above technical solutions, we have innovatively built a comprehensive and efficient operation and maintenance management and data analysis system based on the Internet platform. The system deeply integrates the three core components of the operation and maintenance workbench, the multi-functional sub-platform and the unified operation and maintenance knowledge base. As the core operation interface for management and operation and maintenance personnel, the operation and maintenance workbench not only realizes the comprehensive management and flexible setting of the system, but also refines it into the system operation and maintenance workbench and the business operation and maintenance workbench according to role requirements. It is designed for technical personnel and management personnel to ensure the fine division of functions and flexible management of permissions. At the same time, our sub-platform system provides a full-chain operation and maintenance service from data collection to resource allocation, integrating multiple key functional modules such as operation, tenant management, full-stack monitoring, unified alarm, standard operation, data and acquisition control, etc., which not only realizes all-round monitoring and data collection of IT resources, but also significantly improves the intelligence and automation level of operation and maintenance work through functions such as data visualization analysis, alarm processing and standardized operation and maintenance operations. In addition, the introduction of a unified operation and maintenance knowledge base provides operation and maintenance personnel with convenient ways to query, contribute, review and manage knowledge, further enhancing the efficiency and quality of operation and maintenance work and promoting the continuous optimization and upgrading of operation and maintenance management. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings:

[0021] Figure 1 This is a schematic diagram of the structure of the integrated operation and maintenance monitoring platform of the embodiment disclosed in this application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] Please refer to Figure 1 ,In an embodiment of the present invention, an integrated platform for operation and maintenance monitoring and intelligent analysis of an Internet platform big data ,includes an operation and maintenance workbench, a sub-platform, and a unified operation and maintenance knowledge base;

[0024] The operation and maintenance workbench is used by management and operation and maintenance personnel to manage the system and set system functions;

[0025] Sub-platform, used to provide full-chain operation and maintenance management and data analysis services from data collection, monitoring, alarm processing, standardized operation and maintenance operations to data visualization analysis, knowledge management and resource allocation;

[0026] The unified operation and maintenance knowledge base is used to provide unified operation and maintenance knowledge base query, contribution, review and management.

[0027] In this embodiment, the entire platform functional architecture is mainly divided into two workbenches, six sub-platforms and a unified operation and maintenance knowledge base. Specifically:

[0028] In this embodiment, the operation and maintenance workbench includes a system operation and maintenance workbench for use by management personnel and operation and maintenance personnel, which uses all open functions and performs system management on user workbenches, and a business operation and maintenance workbench for managing scopes and setting permissions.

[0029] In this embodiment, the sub-platforms include an operation sub-platform for providing data visualization and analysis services to management personnel, business personnel, and operation and maintenance personnel, a tenant management platform for providing integrated operation and maintenance management platform services to tenants, a full-stack monitoring sub-platform for providing full IT resource monitoring and collection related to the business, a unified alarm sub-platform for unified access and processing of alarm messages and data indicators from various alarm sources, a standard operation sub-platform for providing standardized operation and maintenance scripts and commands to handle complex and redundant operation and maintenance requirements in specific scenarios, a data sub-platform for importing various massive operation and maintenance data, and for cleaning, storing, converting, parsing, and orchestrating the data, and a collection and control sub-platform for providing data collection of various IT resources, and for unified and standardized scheduling and management of collection tasks and behaviors.

[0030] The operation sub-platform provides data visualization analysis services to management personnel, business personnel, and operation and maintenance personnel, including multi-dimensional data analysis, various graphical data displays, data dashboards, and leadership cockpits.

[0031] In this embodiment, the full-stack monitoring sub-platform includes an infrastructure monitoring module, an application performance monitoring module, and a dynamic environment monitoring module. It mainly includes infrastructure, basic software, network, application system, dynamic environment monitoring and data collection.

[0032] In this embodiment, the unified alarm sub-platform includes a centralized alarm management module and a third-party alarm integration module. Among them, the alarm sources include alarm messages from the full-stack monitoring sub-platform, open source components, and third-party systems, and can filter, notify, respond, handle, classify, track, and perform multi-dimensional analysis on alarm events.

[0033] In a specific embodiment, a unified alarm sub-platform is constructed, which consists of two core modules: a centralized alarm management module and a third-party alarm integration module. The alarm sources of this platform are very extensive, covering alarm messages from the full-stack monitoring sub-platform, various open source components, and third-party systems. When these alarm sources generate alarm events, the unified alarm sub-platform can perform a series of efficient processing on them, including filtering irrelevant information, notifying relevant personnel in a timely manner, quickly responding to and handling alarms, accurately grading alarms, tracking alarm status throughout the process, and conducting in-depth analysis in multiple dimensions, thereby ensuring that alarm events are comprehensively and effectively managed.

[0034] In this embodiment, the standard operation sub-platform includes a script management module, an orchestration management module, a scheduled task management module, and a scheduling scenario management module. It provides standardized operation and maintenance scripts and commands to handle complex and redundant operation and maintenance requirements in specific scenarios, reduce non-standard operations of personnel, supplement the operation and maintenance experience of operators, and combine operation and maintenance data, indicators and AI analysis to enhance the automation processing capabilities of operation and maintenance work.

[0035] In this embodiment, the data sub-platform includes a model management module, a configuration item management module, a business management module, a topology management module, and a resource statistics module. Among them, it provides data services such as streaming computing and batch computing, and also provides IT resource configuration items, configuration information, and configuration item relationship management, providing data support for data consumption scenarios in the form of business topology, models, resource statistics, etc.

[0036] In this embodiment, the acquisition and control sub-platform includes a node management module, an agent management module, a self-monitoring module, and a policy management module. It provides data acquisition functions for various IT resources, and also performs unified and standardized scheduling and control of acquisition tasks and behaviors, including node management, automatic discovery, integrated services, probe management, fuse protection, etc., to avoid abnormal situations such as downtime caused by non-standard operations.

[0037] Embodiment 2

[0038] In a certain enterprise's IT operation and maintenance system, the operation and maintenance team adopted a comprehensive operation and maintenance management platform, which includes a standard operation sub-platform, a data sub-platform, and a procurement and control sub-platform, greatly improving the operation and maintenance efficiency and stability.

[0039] An example of focusing on operation and maintenance occurs in the application of the standard operation sub-platform. For example, one time, an enterprise needed to perform regular performance testing and maintenance on a batch of servers to prevent potential system failures. In the past, this work required operation and maintenance personnel to manually write and execute complex scripts, which was not only time-consuming and labor-intensive, but also prone to misoperation due to non-standard operations. However, with the help of the standard operation sub-platform, the operation and maintenance team can easily select preset performance testing scripts from the script management module, set the execution order and conditions of the detection tasks through the orchestration management module, and then use the scheduled task management module to set the execution cycle of the task. The entire process is highly automated, which not only greatly reduces the workload of operation and maintenance personnel, but also ensures the accurate execution of detection tasks through intelligent scheduling of the scheduling scenario management module.

[0040] In addition, the standard operation sub-platform also combines operation and maintenance data, indicators and AI analysis to conduct in-depth mining and early warning of detection results, helping the operation and maintenance team to promptly discover and deal with potential problems, effectively avoiding business interruptions caused by system failures. This example fully demonstrates the significant advantages of the standard operation sub-platform in improving operation and maintenance automation processing capabilities, reducing irregular operations, and supplementing operation and maintenance experience.

[0041] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents, and all should be included within the scope of protection of the present invention.

Claims

1. An integrated platform for big data operation and maintenance monitoring and intelligent analysis on an Internet platform, characterized in that: Includes operation and maintenance workbench, sub-platform, and unified operation and maintenance knowledge base; The operation and maintenance workbench is used by management and maintenance personnel to manage the system and set system functions; The sub-platform is used to provide full-chain operation and maintenance management and data analysis services from data collection, monitoring, alarm processing, standardized operation and maintenance operations to data visualization analysis, knowledge management and resource allocation; The unified operation and maintenance knowledge base is used to provide unified operation and maintenance knowledge base query, contribution, review and management.

2. According to claim 1, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The operation and maintenance workbench includes a system operation and maintenance workbench for use by management personnel and operation and maintenance personnel, which uses all open functions and performs system management on user workbenches, and a business operation and maintenance workbench for managing scopes and setting permissions.

3. According to claim 1, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The sub-platforms include an operations sub-platform for providing data visualization and analysis services to management personnel, business personnel, and operation and maintenance personnel, a tenant management platform for providing tenants with integrated operation and maintenance management platform services, a full-stack monitoring sub-platform for providing full IT resource monitoring and collection related to the business, a unified alarm sub-platform for unified access and processing of alarm messages and data indicators from various alarm sources, a standard operation sub-platform for providing standardized operation and maintenance scripts and commands to handle complex and redundant operation and maintenance requirements in specific scenarios, a data sub-platform for importing various massive operation and maintenance data, and for cleaning, storing, converting, parsing, and organizing the data, and a collection and control sub-platform for providing data collection for various IT resources, and for unified and standardized scheduling and management of collection tasks and behaviors.

4. According to claim 3, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis is characterized in that: The full-stack monitoring sub-platform includes an infrastructure monitoring module, an application performance monitoring module, and a dynamic environment monitoring module.

5. According to claim 3, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The unified alarm sub-platform includes a centralized alarm management module and a third-party alarm integration module.

6. According to claim 3, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The standard operation sub-platform includes a script management module, an orchestration management module, a scheduled task management module, and a scheduling scenario management module.

7. According to claim 3, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The data sub-platform includes a model management module, a configuration item management module, a business management module, a topology management module, and a resource statistics module.

8. According to claim 3, an integrated platform for Internet platform big data operation and maintenance monitoring and intelligent analysis, characterized in that: The acquisition and control sub-platform includes a node management module, an agent management module, a self-monitoring module, and a policy management module.

Images