Testing Methods and Systems for Monitoring Systems Based on Border Gateway Protocol

Abstract

This invention discloses a testing method and system for a monitoring system based on the Border Gateway Protocol (BMP). The method, applied to the monitoring system, includes: in response to establishing a session connection with a monitoring performance evaluation system, sending a test request to the monitoring performance evaluation system; receiving multiple BMP messages returned by the monitoring performance evaluation system based on the test request; performing corresponding operations based on the content of the multiple BMP messages, and counting the number of multiple BMP messages to obtain the processing result of the BMP messages; sending the processing result to the monitoring performance evaluation system, and receiving the performance test result sent by the monitoring performance evaluation system. This invention solves the technical problem of low accuracy in evaluating the stability of BMP monitoring systems when processing a large number of messages.

Description

Technical Field

[0001] This invention relates to the field of network monitoring technology, and more specifically, to a testing method and system for a monitoring system based on the Border Gateway Protocol. Background Technology

[0002] In current internet and enterprise network architectures, BGP (Border Gateway Protocol) serves as the primary routing protocol between autonomous systems, and its stability and performance are crucial for maintaining the healthy operation of large-scale networks. With the rise of data centers, the expansion of global IP backbones, and the increasing demand for WAN leased lines, the number of BGP sessions in networks has grown dramatically, significantly increasing the need for BMP (Border Gateway Protocol Monitoring Protocol) monitoring. The BMP protocol can monitor the state changes of BGP sessions in real time, including the establishment and termination of peer relationships and the updating and revocation of routing information, thus providing critical data for network troubleshooting, performance analysis, and security monitoring.

[0003] However, during the development and deployment of the BMP monitoring system, limitations in network equipment and resources prevent the establishment of numerous BMP session connections with the BMP monitoring service through a large number of network devices. Therefore, the stability of the BMP monitoring system's processing of Border Gateway Protocol (BGP) messages can only be evaluated based on a small number of network devices. However, the interaction of a small number of network devices cannot accurately and comprehensively reflect the complex interaction scenarios between a large number of network devices in a real network, resulting in low accuracy in assessing the processing stability of the BMP monitoring system.

[0004] There is currently no effective solution to the above problems. Summary of the Invention

[0005] This invention provides a testing method and system for a monitoring system based on the Border Gateway Protocol (BMP), which at least solves the technical problem of low accuracy in assessing the stability of BMP monitoring systems when processing a large number of messages.

[0006] According to one aspect of the present invention, a testing method for a monitoring system based on the Border Gateway Protocol (BGP) is provided, applied to the monitoring system, comprising: sending a test request to a monitoring performance evaluation system; receiving multiple BGP messages returned by the monitoring performance evaluation system based on the test request, wherein the multiple BGP messages are generated by multiple virtual devices pre-created in the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; performing corresponding operations based on the content of the multiple BGP messages, and counting the number of multiple BGP messages to obtain a processing result of the BGP messages, wherein the processing result includes: all processing data of operations performed on the content of the BGP messages, and all statistical data of counting the number of BGP messages; sending the processing result to the monitoring performance evaluation system, and receiving a performance test result sent by the monitoring performance evaluation system, wherein the performance test result is determined by the monitoring performance evaluation system based on the processing result, and the performance test result is used to characterize whether the stability of the monitoring system meets a preset performance standard.

[0007] Furthermore, based on the content of multiple Border Gateway Protocol (BGP) messages, corresponding operations are performed, and the number of multiple BGP messages is counted to obtain the processing results of the BGP messages. This includes: performing corresponding operations on the content of multiple BGP messages based on the test object and event information in the test request to obtain all processed data, wherein the all processed data includes at least: accurate processed data; counting the number of multiple received BGP messages to obtain all statistical data, wherein the all statistical data includes at least: accurate statistical data; and summarizing all processed data and all statistical data to obtain the processing result.

[0008] Furthermore, the method also includes: receiving the control results of the network control system controlling multiple virtual devices, wherein the network control system is communicatively connected to the monitoring system, and the control results include: monitoring results and management results, wherein the monitoring results are the results of the network control system monitoring the device status of multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of multiple virtual devices.

[0009] Furthermore, multiple virtual devices are Border Gateway Protocol (BGP) neighbors to each other, and test requests are created based on BGP neighbors and Virtual Private Network (VPN) services, which are created by the network control system.

[0010] Furthermore, the method also includes sending a stop test request to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending multiple border gateway protocol messages.

[0011] According to another aspect of the present invention, a testing method for a monitoring system based on the Border Gateway Protocol (BGP) is provided, applied to a monitoring performance evaluation system. The method includes: responding to a test request received from the monitoring system, controlling multiple virtual devices to generate multiple BGP messages and sending the multiple BGP messages to the monitoring system, wherein the multiple virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; receiving processing results sent by the monitoring system, wherein the processing results are obtained by the monitoring system processing the multiple BGP messages, and the processing results include: all processing data of the BGP messages by the monitoring system, and all statistical data of the BGP messages by the monitoring system; determining whether the stability of the monitoring system meets a preset performance standard based on the processing results, obtaining a performance test result of the monitoring system, and sending the performance test result to the monitoring system, wherein the performance test result is used to characterize whether the stability of the monitoring system meets the preset performance standard.

[0012] Furthermore, based on the processing results, it is determined whether the stability of the monitoring system meets the preset performance standards, and the performance test results of the monitoring system are obtained, including: obtaining the processing accuracy rate based on all processed data and accurate processed data, and obtaining the acquisition accuracy rate based on all statistical data and accurate statistical data; in response to the processing accuracy rate being greater than or equal to the preset processing accuracy rate, and the acquisition accuracy rate being greater than or equal to the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system meets the preset performance standards; in response to the processing accuracy rate being less than the preset processing accuracy rate, or the acquisition accuracy rate being less than the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standards.

[0013] Furthermore, the method also includes: receiving the control results of the network control system controlling multiple virtual devices, wherein the network control system is communicatively connected to the monitoring performance evaluation system, and the control results include: monitoring results and management results, wherein the monitoring results are the results of the network control system monitoring the device status of multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of multiple virtual devices.

[0014] Furthermore, the test request is sent by the monitoring system after establishing a session connection with the monitoring performance evaluation system.

[0015] Furthermore, all processed data must include at least: accurately processed data, and all statistical data must include at least: accurately statistical data.

[0016] Furthermore, before controlling multiple virtual devices to generate multiple Border Gateway Protocol (BGP) messages, the method further includes: synchronizing the resources of the network control system and the monitoring system, wherein the resources include at least: BGP neighbors, VPN services, and monitoring tasks. The BGP neighbors and VPN services are created by the network control system, and the monitoring tasks are located in test requests to enable multiple virtual devices to generate multiple BGP messages. The monitoring tasks include at least: monitoring objects and event information, and the monitoring tasks are created by the monitoring system based on BGP neighbors and VPN services; and controlling multiple virtual devices to establish session connections with the monitoring system.

[0017] According to another aspect of the present invention, a test system for a border gateway protocol monitoring system is also provided, comprising: a monitoring performance evaluation system for generating multiple virtual devices; a monitoring system communicatively connected to the monitoring performance evaluation system for sending test requests to the monitoring performance evaluation system, receiving multiple border gateway protocol messages sent by the multiple virtual devices, performing corresponding operations based on the content of the multiple border gateway protocol messages, counting the number of multiple border gateway protocol messages, obtaining the processing result of the border gateway messages, and sending the processing result to the monitoring performance evaluation system; wherein the monitoring performance evaluation system is further configured to obtain a performance test result of the monitoring system based on the processing result, and the performance test result is used to characterize whether the stability of the monitoring system meets a preset performance standard.

[0018] Furthermore, the system also includes: a network control system, communicatively connected to the monitoring performance evaluation system and the monitoring system, used to monitor the device status of multiple virtual devices to obtain monitoring results, manage the resources and configurations of multiple virtual devices to obtain management results, and create border gateway protocol neighbors for multiple virtual devices, and virtual private network services corresponding to multiple virtual devices; the monitoring system is also used to create monitoring tasks based on border gateway protocol neighbors and virtual private network services, the monitoring tasks are located in test requests, used to cause multiple virtual devices to generate multiple border gateway protocol messages, the monitoring tasks include at least: monitoring objects and event information; the monitoring system is also used to perform corresponding operations on the content of multiple border gateway protocol messages based on the test objects and event information in the test requests, to obtain all processed data, and to count the number of multiple border gateway protocol messages received, to obtain all statistical data, and to summarize all processed data and all statistical data to obtain processing results, wherein all statistical data includes at least: accurate statistical data, and all processed data includes at least: accurate processed data; the monitoring performance evaluation system is also used to synchronize the resources of the network control module and the monitoring system.

[0019] According to another aspect of the present invention, an electronic device is also provided, comprising: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods of various embodiments of the present invention during runtime.

[0020] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is executed, it controls the device where the computer-readable storage medium is located to perform the methods of various embodiments of the present invention.

[0021] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements the methods of various embodiments of the present invention.

[0022] According to another aspect of the present invention, a computer program product is also provided, including a non-volatile computer-readable storage medium storing a computer program that, when executed by a processor, implements the methods of various embodiments of the present invention.

[0023] According to another aspect of the present invention, a computer program is also provided, which, when executed by a processor, implements the methods of the various embodiments of the present invention.

[0024] In this embodiment of the invention, a test request is sent to the monitoring performance evaluation system, and corresponding operations are performed based on the Border Gateway Protocol (BMP) messages returned by the monitoring performance evaluation system to obtain the processing results of the aforementioned messages. The processing results include: all processing data of operations performed on the content of the BMP messages, and all statistical data of the number of the aforementioned BMP messages. Based on the processing results, the performance test results of the BMP monitoring system are generated. It should be noted that by creating multiple virtual devices through the monitoring performance evaluation system, and having multiple virtual devices send multiple BMP messages to the BMP monitoring system, the BMP monitoring system can be officially put into operation. Before deployment, a performance evaluation system was used to accurately assess the stability of the BMP monitoring system's message processing based on multiple Border Gateway Protocol (BGP) messages. This avoided the problem of low accuracy in assessing the stability of the BMP monitoring system when processing a large number of messages due to a small number of BGP messages in real network message interactions. This achieved the goal of evaluating the stability and performance indicators of the BMP monitoring system under high concurrency conditions, thus realizing the technical effect of comprehensively testing and evaluating the stability and performance indicators of the BMP monitoring system before deployment to the live network, and solving the technical problem of low accuracy in assessing the stability of the BMP monitoring system when processing a large number of messages. Attached Figure Description

[0025] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0026] Figure 1 This is a flowchart of a testing method for a monitoring system based on the Border Gateway Protocol according to an embodiment of the present invention;

[0027] Figure 2 This is a general schematic diagram of a testing method for a monitoring system based on the border gateway protocol according to an embodiment of the present invention;

[0028] Figure 3 This is a general flowchart of a testing method for a monitoring system based on the border gateway protocol according to an embodiment of the present invention;

[0029] Figure 4 This is a flowchart of another testing method for a monitoring system based on the Border Gateway Protocol according to an embodiment of the present invention;

[0030] Figure 5 This is a schematic diagram of a test system for a border gateway protocol monitoring system according to an embodiment of the present invention;

[0031] Figure 6 This is a schematic diagram of the detailed structure of a test system for a border gateway protocol monitoring system according to an embodiment of the present invention. Detailed Implementation

[0032] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0034] According to an embodiment of the present invention, an embodiment of a testing method for a monitoring system based on a border gateway protocol is provided, which is applied to a monitoring system. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0035] Figure 1 This is a flowchart of a testing method for a monitoring system based on the Border Gateway Protocol according to an embodiment of the present invention, as shown below. Figure 1 As shown, this method is applied to a monitoring system and includes the following steps:

[0036] Step S102: Send a test request to the performance monitoring and evaluation system.

[0037] The aforementioned monitoring performance evaluation system can be a physical or virtual electronic device capable of evaluating the performance of a BMP monitoring system. For example, it may include, but is not limited to, local servers, cloud servers, and virtual machines. The specific type is not limited in this embodiment, and technicians can set it according to actual evaluation needs. The aforementioned monitoring performance evaluation system is configured with a computer application capable of evaluating the performance of the BMP monitoring system. The aforementioned BMP monitoring system and the monitoring performance evaluation system can establish a communication connection. For example, the communication connections that can be established between the BMP monitoring system and the monitoring performance evaluation system include: TCP (Transmission Control Protocol) connections, UDP (User Datagram Protocol) connections, and MQTT (Message Queuing Telemetry Transport) connections, but are not limited to these. The type of data exchanged between the BMP monitoring system and the monitoring performance evaluation system can be BMP messages, but is not limited to these. As shown in Table 1, the BMP messages mentioned above include at least the following categories: initialization messages, PU (Peer Up Notification Message), RM (Route Monitoring) messages, PD (Peer Down Notification Message), SR (Statistics Report) messages, Termination messages, and Route Mirroring messages, but are not limited to these. The test request mentioned above can be a message indicating that the BMP monitoring system needs to undergo performance testing.

[0038] Table 1

[0039]

[0040] In an optional embodiment, the aforementioned session connection is a TCP connection. First, the BMP monitoring system selects an ISN (Initial Sequence Number) and sends a TCP segment with the SYN (Synchronize) flag to the monitoring performance evaluation system. Then, the BMP monitoring system receives the TCP segment and sends a TCP segment with both the SYN and ACK (Acknowledgment) flags as a response to the monitoring performance evaluation system. Finally, the monitoring performance evaluation system receives the TCP segment and returns a TCP segment with the ACK flag as a final response. At this point, the TCP connection is successfully established. The BMP monitoring system sends a BMP initialization message to the monitoring performance evaluation system. After receiving the message, the monitoring performance evaluation system performs necessary verification and processing, and then sends a BMP initialization response message to the BMP monitoring system. At this point, initialization is complete, and the BMP monitoring system can send a test request to the monitoring performance evaluation system, indicating that the BMP monitoring system needs to perform performance testing.

[0041] In another optional embodiment, the monitoring performance evaluation system and the BMP monitoring system establish a session connection via UDP. First, both the BMP monitoring system and the monitoring performance evaluation system create a UDP socket locally, which contains information required for network communication, such as IP address and port number. Then, the BMP monitoring system encapsulates the test request indicating that the system needs to be tested into a UDP datagram and sends the datagram to the IP address and port number of the monitoring performance evaluation system. The monitoring performance evaluation system's UDP socket listens for datagrams on the network. Finally, the monitoring performance evaluation system receives the datagram from the BMP monitoring system and extracts the aforementioned message from the datagram, thereby receiving the test request from the BMP monitoring system.

[0042] In another optional embodiment, the monitoring performance evaluation system and the BMP monitoring system establish a session connection via MQTT. First, the BMP monitoring system, acting as an MQTT client, connects to the MQTT broker server and selects the QoS (Quality of Service) of the message. For example, the QoS can be QoS0, meaning the message will be sent at most once, or the QoS can be QoS2, meaning the message will be delivered only once. Then, the BMP monitoring system encapsulates the test request indicating that the system needs to be tested into an MQTT message and specifies the topic to be sent. The monitoring performance evaluation system subscribes to the topic. Finally, the broker server distributes the message to the monitoring performance evaluation system according to the topic, thereby completing the sending of the test request by the BMP monitoring system.

[0043] Step S104: Receive multiple border gateway protocol messages returned by the monitoring performance evaluation system based on the test request. These multiple border gateway protocol messages are generated by multiple virtual devices pre-created in the monitoring performance evaluation system. Different virtual devices are used to simulate different real network devices in a real network environment.

[0044] The aforementioned Border Gateway Protocol (BGP) messages can be data used to exchange information between network devices. For example, the aforementioned BGP messages can be, but are not limited to, the message types described in Table 1. The aforementioned virtual devices can be devices created through software simulation or virtualization technology. For example, the aforementioned virtual devices can include one or more of the following: virtual routers, containerized devices, network function virtualization devices, but are not limited to these. The aforementioned real network devices can include one or more of the following: routers, switches, servers, but are not limited to these.

[0045] In an optional embodiment, the monitoring performance evaluation system can pre-configure the network environment using virtualization technology and create multiple virtual devices. When the monitoring performance evaluation system receives a test request sent by the BMP monitoring system, the multiple virtual devices generate multiple border gateway protocol messages and return the messages to the BMP monitoring system in a multi-threaded concurrent manner.

[0046] For example, the monitoring performance evaluation system can pre-create multiple virtual routers based on OpenVZ to simulate routers in a real network environment. When the monitoring performance evaluation system receives a test request sent by the BMP monitoring system, the aforementioned virtual routers generate an RM message containing a response to the test request. The monitoring performance evaluation system returns this message to the BMP monitoring system via a TCP connection and using a multi-threaded concurrent approach.

[0047] For example, the performance evaluation system can pre-create multiple containerized devices based on Docker to simulate switches in a real network environment. When the performance evaluation system receives a test request from the BMP monitoring system, the multiple containerized devices generate a PU message containing a response to the test request. The performance evaluation system returns this message to the BMP monitoring system via a UDP connection and in a multi-threaded concurrent manner.

[0048] For example, the performance evaluation system can pre-create multiple routers, containerized devices, and network function virtualization devices using Kubernetes and Docker to simulate routers, switches, and servers in a real network environment. When the performance evaluation system receives a test request from the BMP monitoring system, the aforementioned routers, containerized devices, and network function virtualization devices generate SR messages, which contain a response to the test request. The performance evaluation system then returns this message to the BMP monitoring system via an MQTT connection and in a multi-threaded concurrent manner.

[0049] Step S106: Perform corresponding operations based on the content of multiple border gateway protocol messages, and count the number of multiple border gateway protocol messages to obtain the processing results of the border gateway messages. The processing results include: all processing data of the operations performed on the content of the border gateway protocol messages, and all statistical data of the count of the number of border gateway protocol messages.

[0050] The above operations can refer to the analysis and processing of the message content returned by the monitoring performance evaluation system by the BMP monitoring system. For example, the above operations can include recording the update, synchronization, and clearing of resource information of virtual devices, but are not limited to these. The processing results can be data generated by the BMP monitoring system after performing specific operations.

[0051] In one optional embodiment, the BMP monitoring system can internally construct a counter. Each time the BMP monitoring system receives a Border Gateway Protocol (BGP) message returned by the monitoring performance evaluation system, the counter is incremented by one, thereby counting the total number of BGP messages received by the system. After receiving a BGP message, the BMP monitoring system can analyze and process its content, generating corresponding processing data. The BMP monitoring system can maintain a cache container to cache all of the aforementioned processing data, thus obtaining complete processing data from all the received message contents. For example, when the BMP monitoring system receives a Border Gateway Protocol (BGP) message returned by the monitoring performance evaluation system, the counter inside the BMP monitoring system increments by one. This message instructs the BMP monitoring system to record updates to virtual devices. The BMP monitoring system processes the data according to this instruction and caches the resulting processed data in its internal cache container. The BMP monitoring system repeats the above steps every time it receives a BGP message. When the current round of interaction between the system and the monitoring performance evaluation system ends, the counter inside the BMP monitoring system can collect all the statistical data from this round of interaction, and the cache container inside the system can cache all the processed data from this round of interaction.

[0052] Step S108: Send the processing result to the monitoring performance evaluation system and receive the performance test result sent by the monitoring performance evaluation system. The performance test result is determined by the monitoring performance evaluation system based on the processing result and is used to characterize whether the stability of the monitoring system meets the preset performance standard.

[0053] The performance test results mentioned above can be used to characterize whether the stability of the BMP monitoring system meets the preset performance standards. For example, the performance test results can be that the stability of the system meets the preset performance standards or that the stability of the system does not meet the preset performance standards.

[0054] In one optional embodiment, the monitoring performance evaluation system receives all processing data from the BMP monitoring system regarding the operation on the content of Border Gateway Protocol (BGP) messages, as well as all statistical data regarding the quantity of BGP messages. Based on this data, the system generates corresponding performance test results. For example, the monitoring performance evaluation system parses the data to obtain the total amount of data and processing time for different operations performed by the BMP monitoring system, thereby calculating the time overhead of each operation. By monitoring whether the variation in the time overhead of similar operations exceeds a preset range, the system's stability can be determined to meet a preset standard. Alternatively, the monitoring performance evaluation system parses the data to obtain the amount of data accurately processed by the BMP monitoring system for the aforementioned messages, as well as the total processing volume, thereby calculating the accuracy rate of the BMP monitoring system's message processing. By determining whether this accuracy rate is greater than or equal to a preset accuracy rate, the system's stability can be determined to meet a preset standard. For example, the monitoring performance evaluation system parses the above data to obtain the number of Border Gateway Protocol (BMP) messages counted by the BMP monitoring system, as well as the amount of data accurately processed by the BMP monitoring system. Based on the number of messages counted by the system and the total number of messages sent by the monitoring performance evaluation system, the statistical accuracy rate can be calculated. Based on the amount of data accurately processed by the BMP monitoring system and the total amount of data processed, the accuracy rate of the BMP monitoring system in processing the above messages can be calculated. By judging whether the statistical accuracy rate is greater than or equal to the preset statistical accuracy rate, and whether the processing accuracy rate is greater than or equal to the preset processing accuracy rate, it can be determined whether the stability of the BMP monitoring system meets the preset standard.

[0055] Through the above steps, a test request can be sent to the monitoring performance evaluation system, and corresponding operations can be performed based on the Border Gateway Protocol (BMP) messages returned by the monitoring performance evaluation system to obtain the processing results of the messages. The processing results include: all processing data of the operations performed on the content of the BMP messages, and all statistical data of the number of the BMP messages. Based on the processing results, the performance test results of the BMP monitoring system are generated. It should be noted that by creating multiple virtual devices through the monitoring performance evaluation system, and having multiple virtual devices send multiple BMP messages to the BMP monitoring system, the BMP monitoring system can be officially deployed. Before deployment, the stability of the BMP monitoring system's message processing was accurately assessed using a performance evaluation system based on multiple Border Gateway Protocol (BGP) messages. This avoided the problem of low accuracy in assessing the stability of the BMP monitoring system when processing a large number of messages due to a small number of BGP messages in real network message interactions. This achieved the goal of evaluating the stability and performance indicators of the BMP monitoring system under high concurrency conditions, thus realizing the technical effect of comprehensively testing and evaluating the stability and performance indicators of the BMP monitoring system before deployment to the live network, and ultimately solving the technical problem of low accuracy in assessing the stability of the BMP monitoring system when processing a large number of messages.

[0056] Furthermore, based on the content of multiple Border Gateway Protocol (BGP) messages, corresponding operations are performed, and the number of multiple BGP messages is counted to obtain the processing results of the BGP messages. This includes: performing corresponding operations on the content of multiple BGP messages based on the test object and event information in the test request to obtain all processed data, wherein the all processed data includes at least: accurate processed data; counting the number of multiple received BGP messages to obtain all statistical data, wherein the all statistical data includes at least: accurate statistical data; and summarizing all processed data and all statistical data to obtain the processing result.

[0057] The test object mentioned above can be a BMP monitoring system, but is not limited to it. The event information mentioned above can be information instructing the BMP monitoring system to perform specific operations. The accurately processed data mentioned above can be the data with accurate processing results among all the processed data mentioned above. The accurately statistical data mentioned above can be the data with accurate statistical results among all the statistical data mentioned above.

[0058] In one optional embodiment, the monitoring performance evaluation system can create multiple virtual devices. These virtual devices generate multiple Border Gateway Protocol (BMP) messages and send them to the BMP monitoring system. An internal counter within this system counts the number of received messages to obtain complete statistical data, which includes at least the data with accurate statistical results. The system analyzes and processes all received messages, caching all processed data in an internal cache container to obtain complete processed data, which also includes at least the data with accurate processing results. The BMP monitoring system then aggregates all processed data and all statistical data to obtain the processing result.

[0059] For example, the multiple virtual devices created by the performance evaluation system can be multiple virtual routers. These virtual routers generate multiple Border Gateway Protocol (BMP) messages. The content of these messages can be instructions to the BMP monitoring system to process the session requests of the virtual routers. Multiple virtual routers can send these messages to the BMP monitoring system concurrently using multi-threading. When the BMP monitoring system receives these messages, its internal counter counts the number of messages, obtaining all statistical data containing accurate statistics. Simultaneously, the system processes the session requests. After processing, the BMP monitoring system caches the processed data in its internal cache container, obtaining all processed data containing accurate processing data. The processing result is obtained by summarizing all processed data and all statistical data.

[0060] For example, multiple virtual devices can be a combination of multiple virtual routers and multiple containerized devices. These virtual routers and containerized devices generate multiple Border Gateway Protocol (BMP) messages. The content of these messages instructs the BMP monitoring system to process fault information from these virtual routers and containerized devices. The virtual routers and containerized devices can send these messages to the BMP monitoring system concurrently using multi-threading. When the BMP monitoring system receives these messages, its internal counter counts the number of messages, obtaining complete statistical data containing accurate statistics. Simultaneously, the fault information is processed. After processing, the BMP monitoring system caches the processed data in its internal cache container, obtaining complete processed data containing accurate processing data. The processing result is obtained by summarizing all processed data and all statistical data.

[0061] Furthermore, the method also includes: receiving the control results of the network control system controlling multiple virtual devices, wherein the network control system is communicatively connected to the monitoring system, and the control results include: monitoring results and management results, wherein the monitoring results are the results of the network control system monitoring the device status of multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of multiple virtual devices.

[0062] In an optional embodiment, considering that the monitoring system can analyze and evaluate the performance of the network control system by collecting the control results of the network control system controlling multiple virtual devices, and promptly detect virtual device faults or abnormal behavior of the network control system, the monitoring system can obtain the control results of the network control system controlling multiple virtual devices. Specifically, the control results can include monitoring results and management results. The monitoring results provide information on the current status of the virtual devices, including device operating status, performance indicators, network connection status, etc. This information is crucial for the monitoring system to promptly detect device faults, network anomalies, or performance bottlenecks, helping the monitoring system to quickly respond to and resolve problems, ensuring stable network operation. The management results reflect the network control system's management effectiveness of virtual device resources and configurations, including the rationality of resource allocation and the efficiency of configuration updates. By analyzing the management results, the monitoring system can optimize resource allocation strategies, improve resource allocation efficiency, ensure full resource utilization, and reduce resource waste and costs.

[0063] Furthermore, multiple virtual devices are Border Gateway Protocol (BGP) neighbors to each other, and test requests are created based on BGP neighbors and Virtual Private Network (VPN) services, which are created by the network control system.

[0064] The aforementioned Border Gateway Protocol (BGP) neighbors can refer to two or more virtual devices that exchange routing information in the network via the BGP protocol. The aforementioned Virtual Private Network (VPN) service can refer to a private network service simulated for the aforementioned virtual devices within the aforementioned network control system.

[0065] In an optional embodiment, the network control system establishes BGP neighbor relationships based on the multiple virtual devices to simulate complex network topologies, and establishes VPN services to simulate different network segments or virtual network environments, so as to test the performance of the BMP monitoring system in handling sessions from multiple different network environments.

[0066] Furthermore, the method also includes sending a stop test request to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending multiple border gateway protocol messages.

[0067] The aforementioned stop test request may be a message indicating that the BMP monitoring system needs to terminate the performance test.

[0068] In one optional embodiment, when the BMP monitoring system needs to stop testing, it can send a stop test request to the monitoring performance evaluation system. After receiving the request, the monitoring performance evaluation system sends a stop command to each virtual device. After receiving the command, the virtual device stops sending Border Gateway Protocol (BGP) messages to the BMP monitoring system.

[0069] Figure 2 This is a schematic diagram of a testing method for a monitoring system based on the Border Gateway Protocol (BGP) according to an embodiment of the present invention. The system includes: a monitoring performance evaluation system 201, a BGP monitoring system 204, and a network control system 206. The monitoring performance evaluation system 201 further includes: client-side network devices 2011 and 2012, edge devices 2013 and 2014, and virtual devices 2015, 2016, 2017, and 2018. Step 208 indicates that the monitoring performance evaluation system creates virtual devices; step 210 indicates that the network control system manages the virtual devices and creates BGP neighbors and VPN services; step 212 indicates that the BGP monitoring system creates BGP monitoring instances; step 214 indicates that a large number of BGP messages are constructed and reported to the BGP monitoring system; and step 216 indicates that the BGP monitoring system receives and analyzes the BGP messages.

[0070] For ease of understanding, Figure 3 This is a detailed flowchart of a testing method for a monitoring system based on the Border Gateway Protocol according to an embodiment of the present invention, as shown below. Figure 3As shown, the monitoring performance evaluation system configures interoperability between various systems, allocates IP addresses, and generates virtual devices. The network control system manages these virtual devices and configures BGP neighbor and VPN services for them. The BMP monitoring system creates BMP monitoring instances for these virtual devices. The monitoring performance evaluation system synchronizes resource information between the network management system and the BMP monitoring system, and controls the virtual devices to establish numerous session connections with the BMP monitoring system, enabling multiple virtual devices to send multiple generated BMP messages to the BMP monitoring system in parallel. After receiving these messages, the BMP monitoring system analyzes and processes them, then obtains the processing results containing all processed data and all statistical data, and sends the processing results to the monitoring performance evaluation system. All processed data includes at least accurate processed data, and all statistical data includes at least accurate statistical data. The monitoring performance evaluation system parses the processing results to obtain the processing accuracy rate and the acquisition accuracy rate. Based on the relationship between the processing accuracy rate and the preset processing accuracy rate, acquisition accuracy rate, and preset acquisition accuracy rate, it obtains the performance test results of the BMP monitoring system, and finally returns the performance test results to the BMP monitoring system. The monitoring performance evaluation system can close the connection during the sending of BMP messages, thereby stopping message sending. Subsequently, the monitoring performance evaluation system can clear the synchronized resource information mentioned above, thus ending the BMP monitoring performance evaluation.

[0071] According to another aspect of the present invention, an embodiment of a testing method for a monitoring system based on a border gateway protocol is provided, which is applied to a monitoring performance evaluation system. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0072] Figure 4 This is a flowchart of a testing method for a monitoring system based on the Border Gateway Protocol according to an embodiment of the present invention, as shown below. Figure 4 As shown, the method includes the following steps:

[0073] Step S302: In response to receiving a test request from the monitoring system, control multiple virtual devices to generate multiple border gateway protocol messages and send multiple border gateway protocol messages to the monitoring system. The multiple virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment.

[0074] In one optional embodiment, the monitoring performance evaluation system can pre-generate a large number of virtual devices based on Linux virtualization technology. Each virtual device has an independent IP address and network configuration to simulate different types of real network devices in a real network environment, such as routers and switches. After establishing a session connection with the monitoring performance evaluation system, the BMP monitoring system can send a test request to the monitoring performance evaluation system to evaluate the monitoring performance of the BMP monitoring system. Upon receiving the test request, the monitoring performance evaluation system can send instructions to the generated virtual devices, instructing them to start a BGP session and generate and send BGP packets within the session. Specifically, the aforementioned BGP packets may include PU messages, route update messages, route cancellation messages, etc., used to test monitoring functions such as the establishment and termination of BGP sessions and route information refresh. Upon receiving the instructions from the monitoring performance evaluation system, the virtual devices begin executing the BGP session, generate BGP packets according to the requirements in the test request, and send the packets to the BMP monitoring system via a TCP channel.

[0075] Step S304: Receive the processing results sent by the monitoring system. The processing results are obtained by the monitoring system processing multiple border gateway protocol messages. The processing results include: all processing data of the border gateway protocol messages by the monitoring system, and all statistical data of the border gateway protocol messages by the monitoring system.

[0076] In one optional embodiment, after the BMP monitoring system receives BGP messages sent by the aforementioned multiple virtual devices, the BMP monitoring system can generate processing results based on the processed BGP messages. These results may include all processed data and all statistical data. The BMP monitoring system then sends these processing results back to the monitoring performance evaluation system for assessment of the BMP monitoring system's performance in a simulated environment.

[0077] Step S306: Based on the processing results, determine whether the stability of the monitoring system meets the preset performance standards, obtain the performance test results of the monitoring system, and send the performance test results to the monitoring system. The performance test results are used to characterize whether the stability of the monitoring system meets the preset performance standards.

[0078] In one optional embodiment, the monitoring performance evaluation system acquires the total processed data volume and accurate processed data volume of the BMP monitoring system, as well as the total statistical data volume and accurate statistical data volume of the BMP monitoring system. This allows the system to calculate the processing accuracy rate and acquisition accuracy rate of the BMP monitoring system, respectively. If the processing accuracy rate is greater than or equal to the preset processing accuracy rate, and the acquisition accuracy rate is greater than or equal to the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the processing accuracy rate is less than the preset processing accuracy rate, or the acquisition accuracy rate is less than the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard, and finally, the performance test result is sent to the monitoring system.

[0079] Furthermore, based on the processing results, it is determined whether the stability of the monitoring system meets the preset performance standards, and the performance test results of the monitoring system are obtained, including: obtaining the processing accuracy rate based on all processed data and accurate processed data, and obtaining the acquisition accuracy rate based on all statistical data and accurate statistical data; in response to the processing accuracy rate being greater than or equal to the preset processing accuracy rate, and the acquisition accuracy rate being greater than or equal to the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system meets the preset performance standards; in response to the processing accuracy rate being less than the preset processing accuracy rate, or the acquisition accuracy rate being less than the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standards.

[0080] The aforementioned preset processing accuracy rate can be a pre-set percentage used to determine whether the processing accuracy rate meets the standard. This preset accuracy rate can be set according to actual needs, and its range can be 0%-100%, but is not limited to this. For example, the preset accuracy rate can be 90%, but is not limited to this. The aforementioned processing accuracy rate can be the percentage of accurately processed data to the total processed data. The aforementioned preset acquisition accuracy rate can be a pre-set percentage used to determine whether the acquisition accuracy rate meets the standard. This acquisition accuracy rate can be set according to actual needs, and its range can be 0%-100%, but is not limited to this. For example, the acquisition accuracy rate can be 100%, but is not limited to this. The aforementioned acquisition accuracy rate can be the percentage of accurately statistical data to the total statistical data. The aforementioned preset performance standard can be a condition used to determine whether the stability of the BMP monitoring system meets the standard.

[0081] In one optional embodiment, the monitoring performance evaluation system acquires the total processed data volume and accurate processed data volume of the BMP monitoring system, as well as the total statistical data volume and accurate statistical data volume of the BMP monitoring system. This allows the system to calculate the processing accuracy rate and acquisition accuracy rate of the BMP monitoring system, respectively. If the processing accuracy rate is greater than or equal to the preset processing accuracy rate, and the acquisition accuracy rate is greater than or equal to the preset acquisition accuracy rate, then the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the processing accuracy rate is less than the preset processing accuracy rate, or the acquisition accuracy rate is less than the preset acquisition accuracy rate, then the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard.

[0082] For example, when the preset processing accuracy rate is 90% and the preset acquisition accuracy rate is 100%, the number of data accurately processed by the BMP monitoring system can be 98,546,789, the total number of processed data can be 10,000,000, the number of data accurately acquired can be 10,000,000, and the total number of acquired data can be 10,000,000. In this case, the processing accuracy rate of the BMP monitoring system is 98.546789%, and the acquisition accuracy rate is 100%. Since the processing accuracy rate is greater than the preset processing accuracy rate and the acquisition accuracy rate is equal to the preset acquisition accuracy rate, the performance test result can be determined that the stability of the monitoring system meets the preset performance standard.

[0083] For example, when the preset processing accuracy rate is 80% and the preset acquisition accuracy rate is 90%, the number of data accurately processed by the BMP monitoring system can be 78,459,989, and the total number of data processed can be 10,000,000. The number of data accurately acquired can be 9,000,000, and the total number of data acquired can be 10,000,000. In this case, the processing accuracy rate of the BMP monitoring system is 78.459989%, and the acquisition accuracy rate is 90%. Since the processing accuracy rate is less than the preset processing accuracy rate, it can be determined that the performance test result is that the stability of the monitoring system does not meet the preset performance standard.

[0084] For example, when the preset processing accuracy rate is 95% and the preset acquisition accuracy rate is 99%, the number of data accurately processed by the BMP monitoring system can be 99,459,989, and the total number of data processed can be 10,000,000. The number of data accurately acquired can be 9,000,000, and the total number of data acquired can be 10,000,000. In this case, the processing accuracy rate of the BMP monitoring system is 99.459989%, and the acquisition accuracy rate is 90%. Since the acquisition accuracy rate is less than the preset acquisition accuracy rate, it can be determined that the performance test result is that the stability of the monitoring system does not meet the preset performance standard.

[0085] It should be noted that all the specific values ​​mentioned above, such as preset processing accuracy, preset acquisition accuracy, number of accurately processed data, and total number of processed data, are only illustrative examples. Staff can set them according to their actual needs, and there are no restrictions here.

[0086] Furthermore, the method also includes: receiving the control results of the network control system controlling multiple virtual devices, wherein the network control system is communicatively connected to the monitoring performance evaluation system, and the control results include: monitoring results and management results, wherein the monitoring results are the results of the network control system monitoring the device status of multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of multiple virtual devices.

[0087] In an optional embodiment, considering that the network control system is responsible for managing the operation of virtual devices, including monitoring device status and managing resources and configurations, the monitoring performance evaluation system can verify the performance of the network control system when managing a large number of virtual devices by receiving the control results from the network control system's control of multiple virtual devices, and whether it meets the expected performance indicators. Specifically, the control results can include monitoring results and management results. The monitoring results help the monitoring performance evaluation system assess the stability of virtual devices and the monitoring capabilities of the network control system. By analyzing these results, the monitoring performance evaluation system can identify whether there are abnormal device statuses, network failures, or system monitoring malfunctions, ensuring that the system can operate stably before deployment in a real network environment. The management results provide information on the network control system's resource allocation and configuration management of virtual devices. Based on this information, the monitoring performance evaluation system can optimize resource allocation strategies, adjust system configurations, ensure effective resource utilization, avoid resource waste, and improve system processing capabilities.

[0088] Furthermore, the test request is sent by the monitoring system after establishing a session connection with the monitoring performance evaluation system.

[0089] In an alternative embodiment, considering that by establishing a session connection between the monitoring system and the monitoring performance evaluation system, the monitoring performance evaluation system can efficiently send a large amount of test data to the BMP monitoring system to simulate high-concurrency requests and data traffic in a real network environment, and test the response capability and stability of the BMP monitoring system under extreme conditions, thereby enabling the monitoring performance evaluation system to construct performance evaluation results more accurately.

[0090] Furthermore, all processed data must include at least: accurately processed data, and all statistical data must include at least: accurately statistical data.

[0091] In one alternative embodiment, the aforementioned accurate data processing and accurate statistical data are the basis for evaluating the performance stability and efficiency of the BMP monitoring system. Based on the aforementioned accurate data processing and accurate statistical data, the monitoring performance evaluation system can more accurately evaluate the performance of the BMP monitoring system.

[0092] Furthermore, before controlling multiple virtual devices to generate multiple Border Gateway Protocol (BGP) messages, the method further includes: synchronizing the resources of the network control system and the monitoring system, wherein the resources include at least: BGP neighbors, VPN services, and monitoring tasks. The BGP neighbors and VPN services are created by the network control system, and the monitoring tasks are located in test requests to enable multiple virtual devices to generate multiple BGP messages. The monitoring tasks include at least: monitoring objects and event information, and the monitoring tasks are created by the monitoring system based on BGP neighbors and VPN services; and controlling multiple virtual devices to establish session connections with the monitoring system.

[0093] The resources of the aforementioned network control system can be various entities and information managed and scheduled within the network. The resources of the aforementioned monitoring system can be the data required to perform monitoring functions. The aforementioned monitoring task can refer to monitoring the state changes and activities of the monitored object. The aforementioned monitored object can be a virtual device in the network. The aforementioned event information can be information instructing the BMP monitoring system to process various requests generated by virtual devices in the network.

[0094] In one optional embodiment, the monitoring performance evaluation system generates multiple virtual devices, such as multiple virtual routers. After the multiple virtual devices complete registration in the network control system, the network control system configures BGP neighbors and virtual private network services for each virtual device and sends these configurations to the monitoring performance evaluation system via session connections. For example, the network control system can establish a TCP connection with the monitoring performance evaluation system. The BMP monitoring system creates monitoring tasks based on BGP neighbors and services. These monitoring tasks include at least a monitoring object and information instructing the BMP monitoring system to process various requests generated by the monitoring object. For example, the monitoring object can be the multiple virtual devices, and the information can be information instructing the BMP monitoring system to process session requests from the virtual devices. The BMP monitoring system sends a test request containing the monitoring task to the monitoring performance evaluation system. This system obtains resource information from the network control system and the monitoring system via session connections and completes resource synchronization. Finally, the system controls the multiple virtual devices to establish session connections with the BMP monitoring system and generates multiple BMP monitoring messages based on RFC standards, sending them to the BMP monitoring system in parallel.

[0095] According to another aspect of the present invention, a test system for a Border Gateway Protocol (BGP) monitoring system is also provided. It should be noted that this system can be used to execute the aforementioned method for testing a BGP-based monitoring system. Figure 5 This is a structural block diagram of a safety protection system for a construction area according to an embodiment of the present invention, such as... Figure 5 As shown, the system includes:

[0096] The monitoring performance evaluation system 402 is used to generate multiple virtual devices.

[0097] In one alternative embodiment, the performance evaluation system can generate a large number of virtual devices based on Linux's lightweight virtualization technology. These virtual devices can simulate routers and peers in a real network environment. For example, the performance evaluation system can generate a large number of virtual routers and containerized devices based on Docker; alternatively, it can combine Kubernetes and Docker to generate a large number of network function virtualization devices; and still another example, it can generate a large number of virtual routers and containerized devices based on OpenVZ.

[0098] The monitoring system 404 is communicatively connected to the monitoring performance evaluation system 402. It is used to send test requests to the monitoring performance evaluation system, receive multiple border gateway protocol messages sent by multiple virtual devices, perform corresponding operations based on the content of the multiple border gateway protocol messages, count the number of multiple border gateway protocol messages, obtain the processing results of the border gateway messages, and send the processing results to the monitoring performance evaluation system.

[0099] In one optional embodiment, the BMP monitoring system can send test requests to the monitoring performance evaluation system via a TCP connection. After the virtual routers generated by the monitoring performance evaluation system perform corresponding operations based on the messages returned by the monitoring performance evaluation system, the BMP monitoring system can receive Border Gateway Protocol (BGP) messages from multiple virtual routers via the TCP connection. The BMP monitoring system can obtain all acquired data for these messages through its internal counter. The BMP monitoring system processes these messages, and its internal cache container provides all processed data for these messages. Finally, the BMP monitoring system can send all acquired and processed data to the monitoring performance evaluation system via the TCP connection.

[0100] The monitoring performance evaluation system 402 is also used to obtain the performance test results of the monitoring system 404 based on the processing results. The performance test results are used to characterize whether the stability of the monitoring system meets the preset performance standards.

[0101] In one optional embodiment, the monitoring performance evaluation system acquires the total processed data volume and accurate processed data volume of the BMP monitoring system, as well as the total statistical data volume and accurate statistical data volume of the BMP monitoring system. This allows the system to calculate the processing accuracy rate and acquisition accuracy rate of the BMP monitoring system, respectively. If the processing accuracy rate is greater than or equal to the preset processing accuracy rate, and the acquisition accuracy rate is greater than or equal to the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the processing accuracy rate is less than the preset processing accuracy rate, or the acquisition accuracy rate is less than the preset acquisition accuracy rate, the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard, and finally, the performance test result is sent to the monitoring system.

[0102] Furthermore, the system also includes: a network control system 406, connected to the monitoring performance evaluation system 402 and the monitoring system 404, used to monitor the device status of multiple virtual devices to obtain monitoring results, manage the resources and configurations of multiple virtual devices to obtain management results, and create border gateway protocol neighbors for multiple virtual devices, and virtual private network services corresponding to multiple virtual devices; the monitoring system is also used to create monitoring tasks based on border gateway protocol neighbors and virtual private network services, the monitoring tasks are located in test requests, used to cause multiple virtual devices to generate multiple border gateway protocol messages, the monitoring tasks include at least: monitoring objects and event information; the monitoring system is also used to perform corresponding operations on the content of multiple border gateway protocol messages based on the test objects and event information in the test requests, to obtain all processed data, and to count the number of multiple border gateway protocol messages received, to obtain all statistical data, and to summarize all processed data and all statistical data to obtain processing results, wherein all statistical data includes at least: accurate statistical data, and all processed data includes at least: accurate processed data; the monitoring performance evaluation system is also used to synchronize the resources of the network control module and the monitoring system.

[0103] In one optional embodiment, after multiple virtual routers are created, the network control system can initialize the virtual routers through a TCP connection with the monitoring performance evaluation system, thereby managing the resources and configurations of multiple virtual devices to obtain management results. Furthermore, the network control system can create Border Gateway Protocol (BGP) neighbors and corresponding Virtual Private Network (VPN) services for the virtual routers. Then, the network control system can monitor the device status of the aforementioned multiple virtual devices through a TCP connection with the BGP monitoring system to obtain monitoring results. The BGP monitoring system can create BGP routing monitoring tasks based on BGP neighbors and VPN services. These monitoring tasks include at least the monitoring object (such as a specific virtual device or BGP neighbor) and event information (such as route updates, revocations, etc.). Besides creating test tasks, the BGP monitoring system can also perform corresponding operations on the content of multiple BGP messages based on the test object and event information in the test request, obtaining all processed data and counting the number of received BGP messages to obtain all statistical data. Subsequently, the BGP monitoring system can summarize all the processed data and all statistical data to obtain the aforementioned processing results. Specifically, to provide a data foundation for performance evaluation of the monitoring performance assessment system, all the aforementioned statistical data must include at least accurate statistical data, and all the aforementioned processed data must include at least accurately processed data. During the performance testing of the BMP monitoring system, the monitoring performance assessment system can continuously monitor the resource status of the network control module and the BMP monitoring system to ensure resource synchronization and consistency, and avoid anomalies and false tests caused by resource mismatch.

[0104] For ease of understanding, Figure 6 This is a schematic diagram illustrating the detailed structure of a test system for a border gateway protocol monitoring system according to an embodiment of the present invention, as shown below. Figure 6 As shown, the system includes: a network control system 602, a BMP monitoring system 604, and a BMP performance evaluation system 606.

[0105] The network control system 602 also includes a network management module 6011, which is used to manage virtual devices, that is, to manage the addition and configuration of these virtual devices. In addition, the module can also establish BGP neighbor relationships based on virtual devices to simulate complex network topologies and manage related VPN services.

[0106] The BMP monitoring system 604 also includes: a BMP monitoring management module 6041 and a BMP monitoring message management module 6042. The BMP monitoring management module 6041 can create corresponding BMP monitoring instances based on BGP neighbor relationships and specific business requirements. The BMP monitoring message management module 6042 is used to receive and process monitoring messages sent through the BMP protocol in real time.

[0107] The BMP performance evaluation system 606 also includes: a BMP monitoring configuration module 6061, a virtual device generation module 6062, a resource information synchronization module 6063, a BMP routing message encapsulation module 6024, and a BMP routing message sending module 6025. The BMP monitoring configuration module 6061 is used to configure the basic information of the BMP monitoring system and the network control system, ensuring correct interaction between them. The virtual device generation module 6062 can quickly create a large number of virtual devices based on Linux's lightweight virtualization technology. The resource information synchronization module 6063 is used to synchronize resource information from other systems (such as the network control system and the BMP monitoring system), including settings. The module configures backup information, BGP neighbor relationships, VPN services, and BMP monitoring instances. It also supports clearing synchronized resource information for new performance tests. The BMP routing message encapsulation module 6024 generates and encapsulates BMP messages based on the BMP message format and protocol specifications (RFC standard) to simulate various message types that a real network BMP monitoring system needs to handle. The BMP routing message sending module 6025 can send a large number of BMP messages in parallel to simulate high-concurrency scenarios and test the processing capacity and stability of the BMP monitoring system. Furthermore, this module supports stopping and restarting sessions for more flexible control of the testing process.

[0108] Embodiments of this application also provide an electronic device, including: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods in various embodiments of the present invention during runtime.

[0109] Embodiments of this application also provide a computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the computer-readable storage medium is located to perform the methods of various embodiments of the present invention.

[0110] Embodiments of this application also provide a computer program product, including a computer program that, when executed by a processor, implements the methods of various embodiments of the present invention.

[0111] Embodiments of this application also provide a computer program product, including a non-volatile computer-readable storage medium for storing a computer program that, when executed by a processor, implements the methods in various embodiments of the present invention.

[0112] Embodiments of this application also provide a computer program that, when executed by a processor, implements the methods described in the various embodiments of the present invention.

[0113] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0114] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0115] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0116] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0117] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0118] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method of testing a Border Gateway Protocol-based monitoring system, characterized by, The method applied to the monitoring system comprises: sending a test request to a monitoring performance evaluation system; receiving a plurality of border gateway protocol packets returned by the monitoring performance evaluation system based on the test request, wherein the plurality of border gateway protocol packets are generated by a plurality of virtual devices pre-created in the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; performing corresponding operations based on the contents of the plurality of border gateway protocol packets, and counting the number of the plurality of border gateway protocol packets to obtain a processing result of the plurality of border gateway protocol packets, wherein the processing result comprises all processing data of operating the contents of the plurality of border gateway protocol packets, and all statistical data of counting the number of the plurality of border gateway protocol packets; sending the processing result to the monitoring performance evaluation system, and receiving a performance test result sent by the monitoring performance evaluation system, wherein the performance test result is determined by the monitoring performance evaluation system based on the processing result, and the performance test result is used to represent whether the stability of the monitoring system meets a preset performance standard.

2. The method of claim 1, wherein, performing corresponding operations based on the contents of the plurality of border gateway protocol packets, and counting the number of the plurality of border gateway protocol packets to obtain a processing result of the plurality of border gateway protocol packets, comprising: performing corresponding operations on the contents of the plurality of border gateway protocol packets based on test objects and event information in the test request to obtain the all processing data, wherein the all processing data at least comprises accurate processing data; counting the number of the plurality of border gateway protocol packets received to obtain the all statistical data, wherein the all statistical data at least comprises accurate statistical data; summarizing the all processing data and the all statistical data to obtain the processing result.

3. The method according to any one of claims 1 to 2, characterized in that, The method further comprises: receiving a control result of a network control system controlling the plurality of virtual devices, wherein the network control system is in communication connection with the monitoring system, and the control result comprises a monitoring result and a management result, the monitoring result is a result of the network control system monitoring device states of the plurality of virtual devices, and the management result is a result of the network control system managing resources and configurations of the plurality of virtual devices.

4. The method of claim 3, wherein, The plurality of virtual devices are border gateway protocol neighbors of each other, and the test request is created based on the border gateway protocol neighbors and virtual private network services, wherein the border gateway protocol neighbors and the virtual private network services are created by the network control system.

5. The method according to any one of claims 1 to 2, characterized in that, The method further comprises: sending a stop test request to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending the plurality of border gateway protocol packets.

6. A test method of a border gateway protocol-based monitoring system, characterized by, The method applied to the monitoring performance evaluation system comprises: In response to receiving the test request sent by the monitoring system, the plurality of virtual devices are controlled to generate a plurality of border gateway protocol packets, and the plurality of border gateway protocol packets are sent to the monitoring system, wherein the plurality of virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; The processing result sent by the monitoring system is received, wherein the processing result is obtained by processing the plurality of border gateway protocol packets by the monitoring system, and the processing result includes all processing data of the border gateway protocol packets by the monitoring system and all statistical data of the border gateway protocol packets by the monitoring system; Based on the processing result, it is determined whether the stability of the monitoring system meets the preset performance standard, a performance test result of the monitoring system is obtained, and the performance test result is sent to the monitoring system, wherein the performance test result is used to represent whether the stability of the monitoring system meets the preset performance standard.

7. The method of claim 6, wherein, Based on the processing result, it is determined whether the stability of the monitoring system meets the preset performance standard, a performance test result of the monitoring system is obtained, and the performance test result is sent to the monitoring system, wherein the performance test result is used to represent whether the stability of the monitoring system meets the preset performance standard. Based on the processing result, it is determined whether the stability of the monitoring system meets the preset performance standard, a performance test result of the monitoring system is obtained, and the performance test result is sent to the monitoring system, wherein the performance test result is used to represent whether the stability of the monitoring system meets the preset performance standard. Based on the processing result, it is determined whether the stability of the monitoring system meets the preset performance standard, a performance test result of the monitoring system is obtained, and the performance test result is sent to the monitoring system, wherein the performance test result is used to represent whether the stability of the monitoring system meets the preset performance standard. The method further comprises:

8. The method of claim 6, wherein, The control result of the network control system on the plurality of virtual devices is received, wherein the network control system is in communication connection with the monitoring performance evaluation system, and the control result includes a monitoring result and a management result, the monitoring result is a result of monitoring device states of the plurality of virtual devices by the network control system, and the management result is a result of managing resources and configurations of the plurality of virtual devices by the network control system. The test request is sent by the monitoring system in a case of establishing a session connection with the monitoring performance evaluation system.

9. The method of claim 6, wherein, The all processing data at least includes accurate processing data, and the all statistical data at least includes accurate statistical data.

10. The method of claim 6, wherein, Before the plurality of virtual devices are controlled to generate a plurality of border gateway protocol packets, the method further comprises:

11. The method of claim 6, wherein, ​ synchronize resources of the network control system and resources of the monitoring system, wherein the resources at least include: a border gateway protocol neighbor, a virtual private network service, and a monitoring task, the border gateway protocol neighbor and the virtual private network service are created by the network control system, the monitoring task is in the test request, and the monitoring task is used to make the plurality of virtual devices generate the plurality of border gateway protocol packets, the monitoring task at least includes: a monitoring object and event information, and the monitoring task is created by the monitoring system based on the border gateway protocol neighbor and the virtual private network service; control the plurality of virtual devices to establish a session connection with the monitoring system.

12. A test system for a border gateway protocol monitoring system, characterized in that comprise: a monitoring performance evaluation system, used to generate a plurality of virtual devices; a monitoring system, in communication connection with the monitoring performance evaluation system, used to send a test request to the monitoring performance evaluation system, receive a plurality of border gateway protocol packets sent by the plurality of virtual devices, execute corresponding operations based on contents of the plurality of border gateway protocol packets, count a number of the plurality of border gateway protocol packets to obtain a processing result of the plurality of border gateway protocol packets, and send the processing result to the monitoring performance evaluation system; wherein the monitoring performance evaluation system is further used to obtain a performance test result of the monitoring system based on the processing result, and the performance test result is used to represent whether stability of the monitoring system meets a preset performance standard.

13. The system of claim 12, wherein, The system further comprises: a network control system, in communication connection with the monitoring performance evaluation system and the monitoring system, used to monitor device states of the plurality of virtual devices to obtain a monitoring result, manage resources and configurations of the plurality of virtual devices to obtain a management result, and create border gateway protocol neighbors of the plurality of virtual devices and virtual private network services corresponding to the plurality of virtual devices; the monitoring system is further used to create a monitoring task based on the border gateway protocol neighbors and the virtual private network services, the monitoring task is in the test request, and the monitoring task is used to make the plurality of virtual devices generate the plurality of border gateway protocol packets, the monitoring task at least includes: a monitoring object and event information; the monitoring system is further used to execute corresponding operations on contents of the plurality of border gateway protocol packets based on the test object in the test request and the event information to obtain all processing data, count a number of the plurality of border gateway protocol packets received to obtain all statistical data, and aggregate the all processing data and the all statistical data to obtain the processing result, wherein the all statistical data at least includes: accurate statistical data, and the all processing data at least includes: accurate processing data; and the monitoring performance evaluation system is further used to synchronize resources of a network control module and resources of the monitoring system.

14. An electronic device, comprising: comprise: a memory, storing an executable program; a processor, used to run the program, wherein the program executes the method in any one of claims 1 to 11 when running.

15. A computer readable storage medium, characterized in that, The computer readable storage medium comprises a stored executable program, wherein the executable program, when executed, controls a device in which the storage medium is located to perform the method of any one of claims 1 to 11.

16. A computer program product, characterised in that, A computer program which, when executed by a processor, implements the method of any one of claims 1 to 11.

Images