An automated operation and maintenance monitoring system for realizing resource integration

Abstract

The present invention belongs to the field of network monitoring technology, and provides an automated operation and maintenance monitoring system for realizing resource integration. The system includes: a basic resource layer, including servers, switching devices, cache devices, and power stations, which are used to analyze the data format of the corresponding system; a virtualization layer, including virtualization abstract devices, virtual machines, and virtualization management platforms, wherein the virtualization abstract devices include virtual machine monitors and virtualization platforms, which are used to form an integrated computing resource pool; a basic platform layer, which is constructed with server clusters based on virtual machines; a service application layer, including a user interaction platform, which is used to form channels for internal and external network connections and data interactions; a functional architecture includes: a unified operation and maintenance subsystem, an operation and maintenance process management subsystem, and a monitoring and management subsystem, wherein the monitoring and management subsystem is used to monitor the QoS, operation status, and equipment information in the process; therefore, the present invention can meet the needs of massive data operation and maintenance, and realize the integration of different resources.

Description

Technical Field

[0001] The present invention relates to the technical field of network monitoring, and in particular to an automated operation and maintenance monitoring system for realizing resource integration. Background Art

[0002] In power grid operation and maintenance, the data center station is an infrastructure for centralized processing, caching, distribution, exchange and management of data information. Its main function is to receive data in different formats and protocols from various sites. For example, the substation collects data and uploads the data to data analysts through the monitoring system of the data center station. The Beidou base station receives the synchronous time synchronization signal from the Beidou satellite navigation system, interacts with the monitoring system in the substation and the monitoring system of the data center station, and provides clock synchronization time synchronization signals and positioning signals for the entire system.

[0003] At present, the construction of various subsystems of the power grid lacks overall planning, and a single system is tightly coupled with a single business application. At the same time, the collected data is difficult to share effectively, and there are problems such as errors and omissions in the data collection and transmission process, thus forming an overall "information island". In addition, with the increasing expansion of power grid business and application scale, the traditional data center architecture is difficult to centrally manage the operation information and alarm information of various equipment systems and business systems at multiple sites. In summary, the system does not efficiently utilize the high-value information contained in the data, and there is a phenomenon of "massive data and lack of information" in the operation and maintenance management of multi-site integration. Summary of the invention

[0004] In view of the above technical problems, the present invention provides an automated operation and maintenance monitoring system for realizing resource integration to solve the problems existing in the prior art.

[0005] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0006] According to one aspect of the present invention, an automated operation and maintenance monitoring system for realizing resource integration is disclosed, and the technical architecture of the system includes:

[0007] The basic resource layer includes servers, switching equipment, cache equipment, and power stations, which are connected to geographic information systems, marketing business applications, and power consumption information collection systems to analyze the data formats and specifications of the corresponding systems, clean and integrate data, collect and operate environmental data, and integrate fault data;

[0008] A virtualization layer, the virtualization layer includes a virtualization abstraction device, a virtual machine and a virtualization management platform, the virtualization abstraction device includes a virtual machine monitor and a virtualization platform, and is used to abstract the switching device, the cache device and the monitoring device of the power station to form an integrated computing resource pool, and the virtualization management platform is used to manage, log in and set up images for the virtual machine;

[0009] A basic platform layer, on which a server cluster based on virtual machines is constructed, and a data processing platform and a centralized management platform are formed on the server cluster. The data processing platform includes a data integration module, a data storage module, a data calculation module and a data analysis module, and the centralized management platform includes a data management module, a security management module and a configuration management module;

[0010] The service application layer includes a user interaction platform for forming a channel for internal and external network connection and data interaction;

[0011] The functional architecture of the system includes:

[0012] Unified operation and maintenance subsystem, which is used for service registration, service discovery, authentication, message notification, quick navigation, calendar maintenance, and providing visualization of charts, reports, topology information and environment maps based on the echarts icon library;

[0013] The operation and maintenance process management subsystem includes a daily management module, a service support module, a safety management module and a quality management module;

[0014] The monitoring and management subsystem is used to monitor and manage the QoS, operation status and equipment information in the process.

[0015] Furthermore, the virtualization layer also includes a network management module for implementing L2 network virtualization based on Openflow technology, and managing network resource configuration and policy control.

[0016] Furthermore, the virtualization layer also includes a storage management module, and the storage management module is used for distributed storage management, object storage management, and a virtualized storage gateway.

[0017] Furthermore, in the basic platform layer, the data integration module integrates access to multiple heterogeneous data sources and data types; the data storage module is used to build a distributed file system, storage database, and memory database data storage system; the data computing module is used to use big data batch computing technology to realize the preprocessing of massive data; the data analysis module uses big data technology and deep learning networks to mine effective information from massive data and analyze the relationship types between various data.

[0018] Furthermore, in the basic platform layer, the data management module is used to monitor and manage various data processing tasks to provide guarantees for data processing; the security management module is used to ensure the legitimacy of access to the data acquisition system, data caching system and business application system to ensure that access is only allowed after identity authentication; the configuration management module is used to change the configuration files of each module as a whole, and is used for the allocation of computing resources and cache resources of the centralized management platform.

[0019] Furthermore, in the operation and maintenance process management subsystem, the operation and maintenance process management subsystem exchanges messages with the daily management module, the service support module, the security management module and the quality management module based on multiple interface protocols or communication protocols and through a loosely coupled interface.

[0020] Furthermore, the monitoring management subsystem includes: establishing and maintaining data models, building configuration management CMDB, and maintaining audit data and project data during management.

[0021] Furthermore, the system also includes a terminal device, which is used to monitor the technical architecture and the functional architecture in real time, so that operation and maintenance personnel can view operation and maintenance information and warning information of the system through a mobile application.

[0022] The technical solution disclosed in this disclosure has the following beneficial effects:

[0023] The proposed multi-site converged cloud data center station solution uses a virtualization approach to manage physical devices, which can provide more flexible and scalable services, meet the needs of massive data operation and maintenance, and realize the integration of different resources;

[0024] The modular design realizes dynamic monitoring and control of different resource units, and reduces enterprise management costs with an efficient, stable and scalable operation and maintenance model;

[0025] It can perform big data statistics, analysis and management on heterogeneous data to ensure the reliability and efficiency of the data system. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1This is a structural block diagram of an automated operation and maintenance monitoring system for realizing resource integration in an embodiment of this specification. DETAILED DESCRIPTION

[0027] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, systems, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0028] In addition, the accompanying drawings are only schematic illustrations of the present disclosure. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities, which do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor systems and / or microcontroller systems.

[0029] like Figure 1 As shown, an embodiment of the present specification provides an automated operation and maintenance monitoring system for realizing resource integration. The system can be deployed on multiple servers. The technical architecture 110 of the system includes a basic resource layer 111, a virtualization layer 112, a basic platform layer 113, and a service application layer 114. The functional architecture 120 of the system includes a unified operation and maintenance subsystem 121, an operation and maintenance process management subsystem 122, and a monitoring management subsystem 123.

[0030] The basic resource layer 111 includes IT resources such as servers, switching devices, cache devices and site resources such as power stations. These hardware devices can provide data collection, computing, caching and information transmission functions for the cloud data center. The basic resource layer is connected to the geographic information system, marketing business applications, and power consumption information collection system to analyze the data format and specifications of the corresponding system, clean and integrate the data, collect and operate the environment data, and integrate the fault data.

[0031] The virtualization layer 112 includes a virtualization abstract device, a virtual machine and a virtualization management platform. The virtualization abstract device includes a virtual machine monitor and a virtualization platform, which are used to abstract the switching device, the cache device and the monitoring device of the power station to form an integrated computing resource pool. The virtualization management platform is used to manage, log in and set up images of the virtual machines.

[0032] Compared with the traditional data center layered architecture, the virtualization layer can improve the utilization of server resources, improve the security of the server, achieve secure isolation of different contents, and realize storage virtualization. Virtualization abstract devices, virtual machines, and virtualization management platforms are set up from bottom to top. In the virtualization layer, the virtualization management platform manages, logs in, and sets images for the virtual machines. Image settings include providing basic image management, capturing or customizing images, and other related functions, and migration management.

[0033] The virtualization layer 112 provides a network management module and a storage management module. The network management module is used to implement L2 network virtualization based on Openflow technology, and to manage network resource configuration and policy control. Specifically, the platform can control and forward the network through the interface provided by the SDN manufacturer or standardized technologies such as Openflow, thereby achieving the flexibility and centralization of the network and domain, that is, displaying functions such as Layer 2 network management, routing management, security management, and load balancing. The storage management module is used for distributed storage management, object storage management, and virtualized storage gateways, and is used to implement storage, backup, data transmission, and other management functions of heterogeneous storage resources such as distributed storage and SAN virtualized storage resources.

[0034] Virtual machines are one of the basic units for building an integrated cloud data center. Application servers and database servers are deployed on virtual machines to build an information system operating environment and a highly available computing environment for upper-level services or applications (such as big data processing, analysis, storage, and decision support). At the same time, corresponding functional modules are provided for the abstract management of physical resources.

[0035] A server cluster based on virtual machines is constructed on the basic platform layer 113, and a data processing platform and a centralized management platform are formed on the server cluster. The data processing platform includes a data integration module, a data storage module, a data calculation module and a data analysis module, and the centralized management platform includes a data management module, a security management module and a configuration management module.

[0036] Among them, the data integration module integrates access to multiple heterogeneous data sources and data types; the data storage module is used to build a distributed file system, storage database, and memory database data storage system to meet the needs of diversified business data and provide a stable computing environment for data filtering and cleaning; the data computing module is used to use big data batch computing technology to realize the preprocessing of massive data; the data analysis module uses big data technology and deep learning networks to mine effective information from massive data and analyze the relationship types between various data to provide a reliable basis for managers' decision-making. The data management module is used to monitor and manage various data processing tasks and provide guarantees for data processing; the security management module is used to ensure the legitimacy of access to the data acquisition system, data caching system, and business application system, ensuring that access can only be made after identity authentication, so as to better ensure the security of data and information and avoid data leakage; the configuration management module is used to change the configuration files of each module as a whole, as well as the allocation of computing resources and cache resources for the centralized management platform.

[0037] The service application layer 114 includes a user interaction platform, which is used to form a channel for internal and external network connection and data interaction, so that multiple users can interact collaboratively;

[0038] The system functional architecture 120 is based on the technical framework and provides various applications and business functions and an integrated management model required by the enterprise cloud data center IT system through modular design, which can effectively reduce operation and maintenance costs and improve operation and maintenance efficiency.

[0039] This embodiment proposes a functional architecture 120 of an operation and maintenance monitoring system, which can enable different sites to collaborate efficiently and orderly on the same platform, ensuring the safe and stable operation of each site. The functional architecture consists of a unified operation and maintenance portal subsystem, an operation and maintenance process management subsystem, and an operation and maintenance monitoring management subsystem.

[0040] The unified operation and maintenance subsystem 121 is used for service registration, service discovery, authentication, message notification, quick navigation, calendar maintenance, and providing a display of charts, reports, topology information and environment maps based on the echarts icon library in a visual form of calling API.

[0041] The operation and maintenance process management subsystem 122 includes a daily management module, a service support module, a security management module, and a quality management module. Based on the daily management module, the service support module, the security management module, and the quality management module, in the monitoring and management of daily management, full coverage and full-time infrastructure monitoring are provided, and an alarm can be issued in time after a fault is found. In addition, the operation and maintenance process management subsystem exchanges messages with the daily management module, the service support module, the security management module, and the quality management module through a loosely coupled interface based on multiple interface protocols or communication protocols.

[0042] The monitoring and management subsystem 123 is used to monitor and manage the QoS, operation status and equipment information in the process. When managing, the monitoring and management subsystem includes: establishing and maintaining data models, building configuration management CMDB, maintaining audit data and project data. The CMDB framework promotes the simplification of the data structure of multi-source information systems, so that data from multi-site devices, different terminals and operating systems can be uniformly managed.

[0043] In one embodiment, the system further includes a terminal device, and the terminal device is used to monitor the technical architecture and the functional architecture in real time, so that operation and maintenance personnel can view operation and maintenance information and warning information of the system through a mobile application.

[0044] The multi-site converged cloud data center solution proposed in the present invention adopts a virtualization method to manage physical equipment, which can provide more flexible and scalable services, meet the needs of massive data operation and maintenance, and realize the integration of different resources; the modular design realizes dynamic monitoring and control of different resource units, and cooperates with efficient, stable and scalable operation and maintenance models to reduce enterprise management costs; it can perform big data statistics, analysis and management on heterogeneous data to ensure the reliability and efficiency of the data system.

[0045] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal system, or a network device, etc.) to run the system according to the exemplary implementation of the present disclosure.

[0046] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiment of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0047] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

Claims

1. An automated operation and maintenance monitoring system for realizing resource integration, characterized in that: The technical architecture of the system includes: Basic resource layer, which includes servers, switching equipment, cache equipment, and power stations. The servers, switching equipment, cache equipment, and power stations are used to realize data collection, calculation, cache, and information transmission functions. The basic resource layer is connected to the geographic information system, marketing business applications, and electricity consumption information collection system to analyze the data format and specifications of the corresponding system, clean and integrate the data, collect and operate environmental data, and integrate fault data; A virtualization layer, the virtualization layer includes a virtualization abstract device, a virtual machine and a virtualization management platform arranged from bottom to top, the virtualization abstract device includes a virtual machine monitor and a virtualization platform, which are used to abstract the switching device, the cache device and the monitoring device of the power station to form an integrated computing resource pool, and the application server and the database server are deployed on the virtual machine to build an information system operating environment, the virtualization management platform is used to manage, log in and set up images for the virtual machine, and the image setting includes providing basic image management, capturing or customizing images, and migration management, the virtualization layer also includes a network management module and a storage management module, the network management module is used to control and forward the network based on Openflow technology to realize Layer 2 network management, routing management, security management, and load balancing functions, and the storage management module is used for distributed storage management, object storage management, and virtualized storage gateway to realize distributed storage, storage and actual backup of SAN virtualized storage resources, and data transmission management functions; A basic platform layer, on which a server cluster with virtual machines as units is constructed, and a data processing platform and a centralized management platform are formed on the server cluster. The data processing platform includes a data integration module, a data storage module, a data calculation module and a data analysis module. The centralized management platform includes a data management module, a security management module and a configuration management module. The data integration module integrates access to multiple heterogeneous data sources and data types; the data storage module is used to build a distributed file system, a storage database, and an in-memory database data storage system to meet the needs of diversified business data and provide a stable computing environment for data filtering and cleaning; the data calculation module is used to use big data batch computing technology to realize the preprocessing of massive data; the data analysis module mines effective information from massive data through big data technology and deep learning networks, and analyzes the relationship types between various data; the data management module is used to monitor and manage various data processing tasks to provide guarantees for data processing; the security management module is used to ensure the legitimacy of access to the data acquisition system, the data cache system and the business application system, and ensure that access can only be made after identity authentication; the configuration management module is used to change the configuration files of each module as a whole, and is used for the allocation of computing resources and cache resources of the centralized management platform; The service application layer includes a user interaction platform, which is used to form a channel for internal and external network connection and data interaction, so that multiple users can interact collaboratively; The functional architecture of the system includes: Unified operation and maintenance subsystem, which is used for service registration, service discovery, authentication, message notification, quick navigation, calendar maintenance, and providing visualization of charts, reports, topology information and environment maps based on the echarts icon library; An operation and maintenance process management subsystem, the operation and maintenance process management subsystem includes a daily management module, a service support module, a security management module and a quality management module, and the operation and maintenance process management subsystem exchanges messages with the daily management module, the service support module, the security management module and the quality management module based on multiple interface protocols or communication protocols and through a loosely coupled interface; The monitoring and management subsystem is used to monitor and manage the QoS, operation status and equipment information in the process. The monitoring and management subsystem includes: establishing and maintaining data models, building configuration management CMDB, maintaining audit data and project data.

2. The automatic operation and maintenance monitoring system for realizing resource integration according to claim 1, characterized in that: The system also includes a terminal device, which is used to monitor the technical architecture and the functional architecture in real time, so that operation and maintenance personnel can view operation and maintenance information and warning information of the system through a mobile application.

Images