Complex network equipment monitoring method and system

Abstract

The invention relates to a complex network equipment monitoring method and system, and belongs to the technical field of network equipment monitoring. A distributed equipment monitoring architecture is adopted, equipment monitoring tasks are distributed to a plurality of nodes, the monitoring tasks are distributed through a load balancing strategy, and high availability and expansibility of the system are ensured; meanwhile, the data responded by the protocol adaptation layer is the data of the unified data model, so that the data can be processed on the monitoring node, wrong data can be cleaned, the data can be converted into the data model meeting the requirements of the data table, the collected data can be analyzed and stored in the database, and the real-time performance and the reliability of the data are ensured. The protocol adaptation layer provided by the invention is compatible with multiple protocol types, coupling between protocols is reduced, and compatibility and flexibility of the protocols are improved; through a double-cluster deployment mode, the cluster scale is dynamically adjusted according to the number of devices, and the data acquisition capability and reliability are improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of network equipment monitoring, and in particular relates to a complex network equipment monitoring method and system. Background Art

[0002] With the rapid development of information technology and the Internet, the types and number of network devices are increasing, and the complexity of network systems is also increasing. In order to ensure the normal operation and security of the network, network equipment monitoring technology has become an important research direction. Network equipment monitoring technology mainly includes real-time monitoring and management of routers, switches, servers, firewalls and other equipment. By collecting the operating status and performance data of the equipment, analyzing and processing this data, potential problems can be discovered and solved in a timely manner, thereby ensuring the efficient, stable and safe operation of the network.

[0003] Currently, network equipment monitoring technologies mainly include the following:

[0004] (1) Simple Network Management Protocol (SNMP)

[0005] SNMP is one of the most widely used network management protocols. It collects various operating information of devices through SNMP agents on network devices and transmits this information to the SNMP management system for processing and analysis. The main advantages of SNMP are its simplicity and ease of implementation. Network administrators can use SNMP to obtain device status information, performance data, configuration parameters, etc., so as to monitor and manage devices. However, SNMP also has some shortcomings, such as its poor security and vulnerability to attacks. In addition, SNMP may encounter performance bottlenecks when processing large amounts of device data.

[0006] (2) Monitoring technology based on traffic analysis

[0007] Traffic analysis-based monitoring technology monitors the operating status and performance of devices by analyzing network traffic. Representative tools of this type of technology include NetFlow and sFlow. NetFlow was proposed by Cisco. By collecting and analyzing information from network traffic packets, it can provide detailed information about network usage, detect abnormal traffic and potential security threats. sFlow is a sampling technology that provides real-time network performance monitoring by sampling and analyzing network traffic. The advantage of traffic analysis technology is that it can provide detailed network usage and traffic patterns, which helps to discover abnormal behaviors and potential problems in the network. However, the implementation of this type of technology is relatively complex and requires large computing and storage resources.

[0008] (3) Log analysis technology

[0009] Log analysis technology collects and analyzes log files generated by network devices to obtain detailed information about device operation, including error information, access records, etc. Common log analysis tools include Syslog and Splunk. Syslog is a standard log transmission protocol that is widely used in various network devices. Splunk is a powerful log analysis platform that can analyze and process large amounts of log data in real time. Log analysis technology can help network administrators discover and locate faults in a timely manner, improving the maintainability and reliability of the network. Its disadvantage is that the amount of log data is large and the analysis and processing is complex. Especially when faced with massive log data, efficient analysis algorithms and powerful computing power are required.

[0010] In a complex network environment, monitoring multiple types of network devices such as routers, switches, servers, firewalls, etc. is a huge challenge. These devices usually support different protocols, such as ICMP, HTTP, HTTPS, SNMP, Syslog, etc., and their data formats and communication mechanisms vary greatly. In addition, the amount of status and performance data of network devices is huge, and how to collect and process this data in real time, efficiently and reliably is also a problem. The following are the main technical difficulties faced by current technologies in building network device monitoring systems:

[0011] (1) Multi-protocol compatibility issues: With the rapid development of information technology and the Internet, the types of network devices are increasing, and the protocols of different types of devices are different. This brings huge challenges to device monitoring. Whenever a new protocol device is connected to the network, the system must be re-adapted, which greatly increases the cost of system maintenance. How to be compatible and process data of multiple protocols on a unified platform will be a very difficult problem.

[0012] (2) Real-time and reliability of data collection: SNMP may encounter performance bottlenecks when processing large amounts of device data. Traffic analysis-based monitoring technology and log analysis technology have large computing and storage requirements. As the number of devices increases, the real-time nature of data collection cannot be guaranteed, which may result in data loss or delay. Summary of the invention

[0013] 1. Technical issues to be resolved

[0014] The technical problem to be solved by the present invention is how to provide a complex network equipment monitoring method and system to solve the problems of multi-protocol compatibility, data real-time performance and reliability.

[0015] (II) Technical solution

[0016] In order to solve the above technical problems, the present invention proposes a complex network equipment monitoring system, which includes: a system main service, a monitoring task scheduler, a monitoring node, a protocol adapter scheduler and a protocol adapter;

[0017] The system main service is the main service of the monitoring system. It is located in the situation display layer and is used to provide a data interface to the situation display page and issue monitoring tasks to the monitoring task scheduler. The system main service is the power source of the system and drives the normal operation of the monitoring system. Once it goes down, other services will also stop running.

[0018] The monitoring task scheduler is located in the monitoring service layer and is used to allocate and schedule components of monitoring nodes. The monitoring task scheduler records the status of monitoring nodes and monitoring tasks, and allocates and schedules monitoring tasks of monitoring nodes according to the real-time status, so that monitoring tasks can be processed efficiently.

[0019] The monitoring node is located in the monitoring service layer and is a service component for processing device status data. The data collected by the protocol adapter is processed by the monitoring node and the processed data is saved in the database.

[0020] The protocol adapter scheduler is located in the protocol adaptation layer and is used to allocate and schedule the protocol adapter. The protocol adapter scheduler records the protocol adapter status and the protocol adapter request status. According to the real-time status, it allocates and schedules the protocol adapter required by the monitoring node, so that the protocol adapter can be used efficiently.

[0021] The protocol adapter is located in the protocol adaptation layer and is used to connect to the network devices in the network device layer and obtain status data. The protocol adapter connects to the specified device through the specified protocol, obtains status data, and responds to the monitoring node; each protocol adapter can only connect to one protocol.

[0022] The present invention also provides a complex network equipment monitoring method, the method comprising the following steps:

[0023] S1. The system main service initiates a device monitoring task. When initiating a device monitoring task, the task parameters at least include the unique identifier of the network device and the monitoring protocol, otherwise the device monitoring task cannot be initiated; the system main service sends the device monitoring task to the monitoring task scheduler. After receiving the monitoring task, the monitoring task scheduler saves the monitoring task to the monitoring task list;

[0024] S2. The monitoring task scheduler queries whether there are other monitoring tasks that have not been assigned before the current monitoring task. If so, the previous monitoring tasks are assigned first until all tasks before the current task are assigned, and then the current monitoring task is assigned. After the monitoring task starts to be assigned, the monitoring task scheduler queries whether there are idle nodes in the monitoring node cluster. If not, the current task is in a waiting state until an idle monitoring node appears. The monitoring task scheduler assigns the current monitoring task to the idle monitoring node, and the current monitoring task is assigned.

[0025] S3. After receiving the monitoring task, the monitoring node requests the protocol adapter of the specified protocol from the protocol adapter scheduler according to the monitoring protocol parameters in the task data; after receiving the request, the protocol adapter scheduler adds the request to the request list;

[0026] S4. The protocol adapter scheduler checks whether there are any unprocessed requests with the same protocol before this request. If so, the previous requests with the same protocol are processed first, until all requests with the same protocol before this request are processed, and then the current request is processed.

[0027] S5. After the protocol adapter scheduler starts processing this request, it queries whether there is an idle adapter with the same protocol in the protocol adapter cluster. If not, this request is in a waiting state until an idle protocol adapter appears. The protocol adapter scheduler allocates the idle protocol adapter to the monitoring node. The monitoring node obtains the network device status data and processes the data by calling the data interface provided by the protocol adapter. The monitoring task is completed.

[0028] (III) Beneficial effects

[0029] The present invention provides a complex network device monitoring method and system, and the complex network device monitoring method and system of the present invention achieve the following objectives:

[0030] (1) Multi-protocol compatibility: The system is compatible with and can process data from multiple protocols, reducing complexity and maintenance costs.

[0031] (2) Real-time and reliability: Real-time and efficient data collection and processing are achieved, ensuring data integrity and real-time performance.

[0032] (3) Intuitive visual display: Rich charts and customized views improve the usability of the system and help users quickly understand and analyze data. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 is a structural diagram of the present invention;

[0034] Figure 2 is a system structure diagram of the present invention;

[0035] Figure 3 It is a flow chart of equipment monitoring of the present invention;

[0036] Figure 4 This is the working principle diagram of the protocol adaptation layer;

[0037] Figure 5 Data processing flow chart for monitoring services;

[0038] Figure 6 It is a system function module diagram of the present invention. DETAILED DESCRIPTION

[0039] In order to make the purpose, content and advantages of the present invention more clear, the specific implementation methods of the present invention are further described in detail below in conjunction with the drawings and examples.

[0040] The present invention proposes a complex network equipment monitoring method and system, aiming to solve the problems of multi-protocol compatibility, data real-time performance and reliability.

[0041] (1) Multi-protocol compatibility

[0042] The system designed by the present invention is compatible with and can process data of multiple protocols. Even if a device with a new protocol is connected to the network, the adaptation can be completed by converting the data of the protocol into a unified data format that meets the requirements of the system, thereby reducing the complexity and maintenance cost of the system.

[0043] (2) Real-time and reliability

[0044] The present invention distributes data processing nodes, load balances processing tasks, greatly improves data processing capabilities, achieves real-time and efficient data collection and processing, and ensures data integrity and real-time performance.

[0045] (3) Intuitive visual display

[0046] The complex network equipment monitoring system designed by the present invention provides intuitive visualization pages, rich charts and customized views, improves the usability of the system and helps users quickly understand and analyze data.

[0047] 1. Overall framework

[0048] The present invention designs a complex network equipment monitoring system that supports multi-protocol distributed network equipment monitoring. The scheme divides the complex network equipment monitoring framework into four layers, such as Figure 1 As shown:

[0049] The bottom layer is the network equipment layer, which is the infrastructure that constitutes the network environment, including routers, switches, servers, firewalls, etc.

[0050] The upper layer is the protocol adaptation layer, which is composed of different protocol adapters. Each protocol adapter is independent of each other and runs independently without affecting each other.

[0051] The next layer is the monitoring service layer, which consists of multiple monitoring nodes and is responsible for data cleaning, conversion, analysis, and storage.

[0052] The top layer is the situation display layer, which can display the changing trend of performance indicators, the topological relationship of network equipment, abnormal alarm information, etc.

[0053] (II) Architecture

[0054] Architecture such as Figure 2 As shown, the service components included in the complex network equipment monitoring system are: system main service, monitoring task scheduler, monitoring node, protocol adapter scheduler, protocol adapter, etc.

[0055] The system main service is the main service of the monitoring system. It is located in the situation display layer and is used to provide a data interface to the situation display page, issue monitoring tasks to the monitoring task scheduler, etc. The system main service, as the power source of the system, drives the normal operation of the monitoring system. Once it goes down, other services will also stop running.

[0056] The monitoring task scheduler is located in the monitoring service layer and is used to allocate and schedule components of monitoring nodes. The monitoring task scheduler records the status of monitoring nodes and monitoring tasks, and allocates and schedules monitoring tasks of monitoring nodes according to the real-time status, so that monitoring tasks can be processed efficiently.

[0057] The monitoring node, located in the monitoring service layer, is a service component for device status data processing. The data collected by the protocol adapter is processed by the monitoring node, and the processed data is saved in the database.

[0058] The protocol adapter scheduler is located in the protocol adaptation layer and is used to allocate and schedule protocol adapters. The protocol adapter scheduler records the protocol adapter status and protocol adapter request status. According to the real-time status, it allocates and schedules the protocol adapters required by the monitoring node, so that the protocol adapters can be used efficiently.

[0059] The protocol adapter is located in the protocol adaptation layer and is used to connect to the network devices in the network device layer and obtain status data. The protocol adapter connects to the specified device through the specified protocol, obtains status data, and responds to the monitoring node; each protocol adapter can only connect to one protocol.

[0060] The system adopts a dual cluster deployment architecture of monitoring node cluster and protocol adapter cluster. The monitoring process uses the system main service as the driving source. The system main service initiates the monitoring task according to the monitoring task arrangement. After receiving the monitoring task, the monitoring task scheduler assigns the monitoring task to the monitoring node according to the monitoring node cluster status, and the monitoring node performs the subsequent monitoring task; if the scale of the monitoring node cluster cannot meet the monitoring task requirements in time, the monitoring node cluster can be dynamically expanded to increase a certain number of monitoring nodes to meet the monitoring task requirements. After receiving the monitoring task, the monitoring node will request the protocol adapter from the protocol adapter scheduler; the protocol adapter scheduler assigns the protocol adapter of the specified protocol to the monitoring node according to the protocol adapter cluster status, and collects data for the network equipment; if there is no idle protocol adapter, the protocol adapter of the specified protocol can be added to meet the network equipment monitoring task; if there is no protocol adapter of the specified protocol, the protocol can be adapted separately, and the adapted protocol adapter can be registered to the protocol adapter scheduler.

[0061] The distributed equipment monitoring architecture of the present invention significantly improves the data acquisition capability and reliability of the system, ensures the real-time and integrity of the data, and avoids data loss and delay.

[0062] (III) Monitoring Process

[0063] The present invention also provides a complex network equipment monitoring method, such as Figure 3 As shown, the method comprises the following steps:

[0064] S1. The system main service initiates a device monitoring task. When initiating a device monitoring task, the task parameters at least include the unique identifier of the network device and the monitoring protocol, otherwise the device monitoring task cannot be initiated; the system main service sends the device monitoring task to the monitoring task scheduler. After receiving the monitoring task, the monitoring task scheduler saves the monitoring task to the monitoring task list;

[0065] S2. The monitoring task scheduler queries whether there are other monitoring tasks that have not been assigned before the current monitoring task. If so, the previous monitoring tasks are assigned first until all tasks before the current task are assigned, and then the current monitoring task is assigned. After the monitoring task starts to be assigned, the monitoring task scheduler queries whether there are idle nodes in the monitoring node cluster. If not, the current task is in a waiting state until an idle monitoring node appears. The monitoring task scheduler assigns the current monitoring task to the idle monitoring node, and the current monitoring task is assigned.

[0066] S3. After receiving the monitoring task, the monitoring node requests the protocol adapter of the specified protocol from the protocol adapter scheduler according to the monitoring protocol parameters in the task data; after receiving the request, the protocol adapter scheduler adds the request to the request list;

[0067] S4. The protocol adapter scheduler checks whether there are any unprocessed requests with the same protocol before this request. If so, the previous requests with the same protocol are processed first, until all requests with the same protocol before this request are processed, and then the current request is processed.

[0068] S5. After the protocol adapter scheduler starts processing this request, it queries whether there is an idle adapter with the same protocol in the protocol adapter cluster. If not, this request is in a waiting state until an idle protocol adapter appears. The protocol adapter scheduler allocates the idle protocol adapter to the monitoring node. The monitoring node obtains the network device status data and processes the data by calling the data interface provided by the protocol adapter. The monitoring task is completed.

[0069] (IV) Protocol Adaptation

[0070] In the device monitoring process, obtaining device status data is the most important part. In the modern complex network environment, it is particularly important to monitor various network devices. With the increase in the types and number of devices, different devices use different protocols for communication, which brings challenges to network monitoring. In order to solve the multi-protocol compatibility problem, the present invention designs an innovative protocol adaptation layer to convert data of different protocols into a unified data format for centralized management and monitoring.

[0071] The protocol adaptation layer can be regarded as an intermediate layer, located between the network device layer and the monitoring service layer. It receives data packets from various devices, parses and converts them into a unified format, and then passes the data to the monitoring service layer.

[0072] The working principle of the protocol adaptation layer is as follows Figure 4 As shown. Before starting the protocol adapter, you need to configure relevant parameter information, such as supported protocols, the IP address of the protocol adapter scheduler, etc. After starting, the protocol adapter will automatically connect to the protocol adapter scheduler according to the configured protocol adapter scheduler IP address and send a registration request; after the protocol adapter scheduler receives the registration request sent by the protocol adapter, it will save the connected protocol adapter information to the protocol adapter registry; when saving the protocol adapter information, the protocol adapter scheduler will group the protocol adapters according to the protocol type to reduce the retrieval time during allocation.

[0073] After the current monitoring node receives the assigned task, the monitoring node will initiate a request to the protocol adapter scheduler to obtain the protocol adapter; after the protocol adapter scheduler accepts the request, it will not immediately assign a protocol adapter to the monitoring node, but will save the request to the protocol adapter request table; in the protocol adapter request table, the protocol adapter scheduler will obtain the corresponding protocol type from the request, group the requests according to the protocol type, and queue each group of protocol adapter requests according to the request time, with each new request being queued at the end to form a queue; after saving, the protocol adapter scheduler will check whether there is an idle protocol adapter with the same protocol in the protocol adapter registry, and if so, the protocol adapter will be assigned to the first protocol adapter request in the same protocol request queue in the protocol adapter request table, and the status of the protocol adapter will be marked as "working"; and so on, whenever there is a new protocol adapter request or an idle protocol adapter, the protocol adapter scheduler will retrieve and assign it.

[0074] After the protocol adapter is assigned to a designated monitoring node, the monitoring node will initiate a device monitoring request to the protocol adapter, and the request parameters will include the connection information of the network device; after receiving the connection information, the protocol adapter will establish a protocol connection and data interaction with the designated device, obtain status information, and convert the protocol data into data of a unified data type, and respond to the monitoring node; after the protocol adapter completes the acquisition of the device status data, it will again send a restore status request to the protocol adapter scheduler. After receiving the request, the protocol adapter scheduler will restore its status to "idle", and the protocol adapter will complete a device monitoring task.

[0075] The protocol adaptation layer greatly simplifies network device monitoring in a multi-protocol environment by providing a unified data interface. This solution not only improves the compatibility and flexibility of the system, but also provides a solid foundation for future expansion and maintenance. Through this innovative design, network managers can more efficiently monitor and manage multiple devices in a complex network environment.

[0076] (V) Data processing

[0077] The present invention adopts a distributed equipment monitoring architecture, distributes equipment monitoring tasks to multiple nodes, and allocates monitoring tasks through a load balancing strategy to ensure the high availability and scalability of the system; at the same time, since the data responded by the protocol adaptation layer is data of a unified data model, the data can be processed on the monitoring node, erroneous data can be cleaned up, and converted into a data model that meets the requirements of the data table, and the collected data can be analyzed and saved in a database to ensure the real-time and reliability of the data.

[0078] The process of data processing by the monitoring node is as follows: Figure 5As shown. After receiving the device status data based on the unified data model returned by the protocol adapter, the monitoring node first cleans the data and verifies the legitimacy of the data, such as the device unique identifier is null, the IP address is repeated, etc. If the data is considered illegal, the data is discarded and the process ends; if the data meets the verification rules, the monitoring node will convert the data into data that meets different database table structures according to the database table structure, such as device basic data, device CPU data, device memory data, etc.; based on the above converted data, analyze whether the various parameter indicators of the device meet the alarm conditions, such as whether the device is offline, whether the CPU occupancy rate exceeds the threshold, whether the memory occupancy rate exceeds the threshold, etc.; if the parameter indicators of the device meet the alarm conditions, generate alarm data, such as device offline alarm, device CPU alarm, device memory alarm, etc.; finally, save the converted device status data and device alarm data to the database for system display and data audit.

[0079] (VI) System Design

[0080] Based on the above complex network equipment monitoring solution, the present invention designs a complex network equipment monitoring system to facilitate users to monitor and operate network equipment. The system functional architecture is as follows: Figure 6 As shown, the system is divided into five functional modules: home page status display, equipment asset management, network equipment topology, equipment alarm reminder, and system configuration management.

[0081] The home page status display module is used to summarize and display the status of network devices. It provides visual statistics through rich charts and dashboards, and can display information such as the top 5 alarm devices, unhandled alarms, asset overview, and abnormal device statistics.

[0082] The equipment asset management module is used to maintain the equipment asset list. In addition to maintaining the basic information of the equipment list, it can also view the operating status information of the key performance indicators of the equipment, such as CPU utilization, memory utilization change curve, etc.; it also has the remote operation and maintenance function of the equipment, supports remote connection protocols such as SSH and TELNET, and improves the user's operation and maintenance efficiency of remote network equipment.

[0083] The network device topology module is used to dynamically generate the topology of network devices and monitor data traffic in the network.

[0084] The device alarm reminder module is used for the alarm function of abnormal information of network equipment. The system divides the alarm information into categories such as performance indicator abnormal alarm, device offline alarm, illegal device access alarm, etc., and performs type and level statistics; it also supports the processing function of alarm information to record the user's processing operations on device alarm information.

[0085] The system configuration management module is used to configure and manage system-related parameters. The monitoring rule setting is to configure the rules for issuing monitoring tasks, which can realize the functions of pausing, starting, and controlling the issuance of monitoring tasks; the alarm threshold setting can set thresholds for different types of performance parameter indicators and different levels of abnormal alarms, such as setting the general level of CPU usage alarm thresholds, the important level of memory usage alarm thresholds, etc.; the collection log management is the query and management function of the device status data collection log.

[0086] The complex network equipment monitoring system of the present invention uses rich visualization means to enable users to intuitively see the operating status and performance data of network equipment, quickly discover problems, and improve the flexibility and ease of use of the system.

[0087] The key points of the present invention are:

[0088] The present invention designs a complex network device monitoring method and system, which is suitable for complex network device monitoring scenarios with a large number of devices and complex protocols. Through the protocol adaptation layer proposed in the present invention, it is compatible with multiple protocol types, reduces the coupling between protocols, and improves the compatibility and flexibility of protocols; through the dual-cluster deployment mode, the cluster scale is dynamically adjusted according to the number of devices, thereby improving data collection capabilities and reliability.

[0089] Effects of the present invention:

[0090] The complex network equipment monitoring method and system of the present invention achieve the following objectives:

[0091] (1) Multi-protocol compatibility: The system is compatible with and can process data from multiple protocols, reducing complexity and maintenance costs.

[0092] (2) Real-time and reliability: Real-time and efficient data collection and processing are achieved, ensuring data integrity and real-time performance.

[0093] (3) Intuitive visual display: Rich charts and customized views improve the usability of the system and help users quickly understand and analyze data.

[0094] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A complex network equipment monitoring system, characterized in that: The system includes: a system main service, a monitoring task scheduler, a monitoring node, a protocol adapter scheduler and a protocol adapter; The system main service is the main service of the monitoring system. It is located in the situation display layer and is used to provide a data interface to the situation display page and issue monitoring tasks to the monitoring task scheduler. The system main service is the power source of the system and drives the normal operation of the monitoring system. Once it goes down, other services will also stop running. The monitoring task scheduler is located in the monitoring service layer and is used to allocate and schedule components of monitoring nodes. The monitoring task scheduler records the status of monitoring nodes and monitoring tasks, and allocates and schedules monitoring tasks of monitoring nodes according to the real-time status, so that monitoring tasks can be processed efficiently. The monitoring node is located in the monitoring service layer and is a service component for processing device status data. The data collected by the protocol adapter is processed by the monitoring node and the processed data is saved in the database. The protocol adapter scheduler is located in the protocol adaptation layer and is used to allocate and schedule the protocol adapter. The protocol adapter scheduler records the protocol adapter status and the protocol adapter request status. According to the real-time status, it allocates and schedules the protocol adapter required by the monitoring node, so that the protocol adapter can be used efficiently. The protocol adapter is located in the protocol adaptation layer and is used to connect to the network devices in the network device layer and obtain status data. The protocol adapter connects to the specified device through the specified protocol, obtains status data, and responds to the monitoring node; each protocol adapter can only connect to one protocol.

2. The complex network equipment monitoring system according to claim 1, characterized in that: The system adopts a dual cluster deployment architecture of monitoring node cluster and protocol adapter cluster; The monitoring process uses the system main service as the driving source. The system main service initiates the monitoring task according to the monitoring task arrangement. After receiving the monitoring task, the monitoring task scheduler assigns the monitoring task to the monitoring node according to the monitoring node cluster status, and the monitoring node performs subsequent monitoring tasks. If the size of the monitoring node cluster cannot meet the monitoring task requirements in a timely manner, the monitoring node cluster can be dynamically expanded to add a certain number of monitoring nodes to meet the monitoring task requirements; After receiving the monitoring task, the monitoring node will request the protocol adapter from the protocol adapter scheduler; The protocol adapter scheduler allocates the protocol adapter of the specified protocol to the monitoring node according to the status of the protocol adapter cluster, and collects data from the network equipment; If there is no idle protocol adapter, a protocol adapter of the specified protocol can be added to meet the network device monitoring task; If there is no protocol adapter for the specified protocol, the protocol can be adapted separately, and the adapted protocol adapter can be registered with the protocol adapter scheduler.

3. The complex network equipment monitoring system according to claim 1, characterized in that: The protocol adaptation layer is an intermediate layer located between the network device layer and the monitoring service layer. It receives data packets from various devices, parses and converts them into a unified format, and then passes the data to the monitoring service layer.

4. The complex network equipment monitoring system according to claim 3, characterized in that: Before starting the protocol adapter, relevant parameter information needs to be configured; After startup, the protocol adapter will automatically connect to the protocol adapter scheduler according to the configured protocol adapter scheduler IP address and send a registration request; After receiving the registration request sent by the protocol adapter, the protocol adapter scheduler saves the connected protocol adapter information to the protocol adapter registry; when saving the protocol adapter information, the protocol adapter scheduler groups the protocol adapters according to the protocol type to reduce the retrieval time during allocation.

5. The complex network equipment monitoring system according to claim 4, characterized in that: After the current monitoring node receives the assigned task, it will initiate a request to the protocol adapter scheduler to obtain the protocol adapter; After the protocol adapter scheduler receives the request, it will not immediately assign a protocol adapter to the monitoring node, but will save the request to the protocol adapter request table; In the protocol adapter request table, the protocol adapter scheduler obtains the corresponding protocol type from the request, groups the requests by protocol type, and queues each group of protocol adapter requests according to the request time. Each new request is queued at the end of the queue to form a queue. After saving, the protocol adapter scheduler will check whether there is an idle protocol adapter with the same protocol in the protocol adapter registry. If so, it will assign the protocol adapter to the first protocol adapter request of the same protocol request queue in the protocol adapter request table and mark the status of the protocol adapter as "working"; By analogy, whenever there is a new protocol adapter request or an idle protocol adapter appears, the protocol adapter scheduler will retrieve and allocate it.

6. The complex network equipment monitoring system according to claim 5, characterized in that: After the protocol adapter is assigned to a designated monitoring node, the monitoring node will initiate a device monitoring request to the protocol adapter, and the request parameters include the connection information of the network device; After receiving the connection information, the protocol adapter performs protocol connection and data interaction with the specified device, obtains status information, and converts the protocol data into data of a uniform data type, and responds to the monitoring node; After the protocol adapter completes the acquisition of the device status data, it will send a restore status request to the protocol adapter scheduler again. After receiving the request, the protocol adapter scheduler will restore its status to "idle", and the protocol adapter completes a device monitoring task.

7. The complex network equipment monitoring system according to claim 6, characterized in that: After receiving the device status data based on the unified data model returned by the protocol adapter, the monitoring node first cleans the data and verifies the legitimacy of the data. If the data is considered illegal, the data is discarded and the process ends. If the data meets the verification rules, the monitoring node will convert the data into data that meets different database table structures based on the database table structure. Based on the above converted data, analyze whether the various parameter indicators of the equipment meet the alarm conditions. If the parameter indicators of the equipment meet the alarm conditions, generate alarm data. Finally, save the converted device status data and device alarm data to the database for system display and data auditing.

8. The complex network equipment monitoring system according to claim 7, characterized in that: Converting data into data that meets different database table structures includes: converting into device basic data, device CPU data, and device memory data; alarm conditions include: whether the device is offline, whether the CPU usage exceeds the threshold, whether the memory usage exceeds the threshold; alarm data includes: device offline alarm, device CPU alarm, and device memory alarm.

9. The complex network equipment monitoring system according to claim 1, characterized in that: The functional modules of the system include: home page situation display, equipment asset management, network equipment topology, equipment alarm reminder and system configuration management; The home page status display module is used to summarize and display the status of network devices. It uses rich charts and dashboards to perform visual statistics, displaying the top 5 alarm devices, unprocessed alarms, asset overview, and abnormal device statistics; The equipment asset management module is used to maintain the equipment asset list. In addition to maintaining the basic information of the equipment list, it can also view the operating status information of the key performance indicators of the equipment. It also has the remote operation and maintenance function of the equipment and supports the remote connection protocol; The network device topology module is used to dynamically generate the topology of network devices and monitor the data traffic in the network; The device alarm reminder module is used for the alarm function of abnormal information of network equipment. The system divides the alarm information into performance indicator abnormal alarm, device offline alarm, illegal device access alarm, and performs statistics by type and level; it also supports the processing function of alarm information, which is used to record the user's processing operation on the device alarm information; The system configuration management module is used to configure and manage system-related parameters; the monitoring rule setting is to configure the rules for issuing monitoring tasks, which is used to pause, start, and control the issuance of monitoring tasks; the alarm threshold setting is used to set thresholds for different types of performance parameter indicators and different levels of abnormal alarms; the collection log management is used to query and manage the equipment status data collection log.

10. A complex network device monitoring method based on the system according to any one of claims 1 to 9, characterized in that: The method comprises the following steps: S1. The system main service initiates a device monitoring task. When initiating a device monitoring task, the task parameters at least include the unique identifier of the network device and the monitoring protocol, otherwise the device monitoring task cannot be initiated; the system main service sends the device monitoring task to the monitoring task scheduler. After receiving the monitoring task, the monitoring task scheduler saves the monitoring task to the monitoring task list; S2. The monitoring task scheduler queries whether there are other monitoring tasks that have not been assigned before the current monitoring task. If so, the previous monitoring tasks are assigned first until all tasks before the current task are assigned, and then the current monitoring task is assigned. After the monitoring task starts to be assigned, the monitoring task scheduler queries whether there are idle nodes in the monitoring node cluster. If not, the current task is in a waiting state until an idle monitoring node appears. The monitoring task scheduler assigns the current monitoring task to the idle monitoring node, and the current monitoring task is assigned. S3, after receiving the monitoring task, the monitoring node requests the protocol adapter of the specified protocol from the protocol adapter scheduler according to the monitoring protocol parameters in the task data; After receiving the request, the protocol adapter scheduler adds the request to the request list; S4. The protocol adapter scheduler checks whether there are any unprocessed requests with the same protocol before this request. If so, the previous requests with the same protocol are processed first, until all requests with the same protocol before this request are processed, and then the current request is processed. S5. After the protocol adapter scheduler starts processing this request, it queries whether there is an idle adapter with the same protocol in the protocol adapter cluster. If not, this request is in a waiting state until an idle protocol adapter appears. The protocol adapter scheduler allocates the idle protocol adapter to the monitoring node. The monitoring node obtains the network device status data and processes the data by calling the data interface provided by the protocol adapter. The monitoring task is completed.

Images