Method and system for testing monitoring system based on border gateway protocol

Abstract

The invention discloses a method and a system for testing a monitoring system based on a border gateway protocol. The method is applied to a monitoring system, and comprises the following steps: in response to establishment of session connection with a monitoring performance evaluation system, sending a test request to the monitoring performance evaluation system; receiving a plurality of border gateway protocol messages returned by the monitoring performance evaluation system based on the test request; executing corresponding operation based on the contents of the plurality of border gateway protocol messages, and counting the number of the plurality of border gateway protocol messages to obtain a processing result of the border gateway messages; and sending the processing result to a monitoring performance evaluation system, and receiving a performance test result sent by the monitoring performance evaluation system. The technical problem that the stability evaluation accuracy is low when a BMP monitoring system processes a large number of messages is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of network monitoring, and in particular to a testing method and system for a monitoring system based on a border gateway protocol. Background Art

[0002] In the current Internet and enterprise network architecture, BGP (Border Gateway Protocol) is the main routing protocol between autonomous systems. Its stability and performance are crucial to maintaining the healthy operation of large-scale networks. With the rise of data centers, the expansion of global IP backbone networks, and the increasing demand for WAN dedicated lines, the number of BGP sessions in the network has increased dramatically, and the demand for BMP (BGP Monitoring Protocol) monitoring has also increased significantly. The BMP protocol can monitor the status changes of BGP sessions in real time, including the establishment and termination of peer relationships, and the update and withdrawal of routing information, thereby providing key data for network troubleshooting, performance analysis, and security monitoring.

[0003] However, in the development and deployment of the BMP monitoring system, due to the limitations of network devices and network resources, it is impossible to establish a large number of BMP session connections with the BMP monitoring service through a large number of network devices. The stability of the BMP monitoring system in processing border gateway protocol messages can only be evaluated based on a small number of network devices. However, the interaction of a small number of network devices cannot accurately and comprehensively reflect the complex interaction scenarios between a large number of network devices in the real network, which leads to low accuracy in evaluating the processing stability of the BMP monitoring system.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiment of the present invention provides a testing method and system for a monitoring system based on a border gateway protocol, so as to at least solve the technical problem of low accuracy in evaluating the stability of a BMP monitoring system when processing a large number of messages.

[0006] According to one aspect of an embodiment of the present invention, a testing method for a monitoring system based on a border gateway protocol is provided, which is applied to a monitoring system and includes: sending a test request to a monitoring performance evaluation system; receiving a plurality of border gateway protocol messages returned by the monitoring performance evaluation system based on the test request, wherein the plurality of border gateway protocol messages are generated by a plurality of virtual devices pre-created in the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; performing corresponding operations based on the contents of the plurality of border gateway protocol messages, and counting the number of the plurality of border gateway protocol messages to obtain processing results of the border gateway messages, wherein the processing results include: all processing data for operating the contents of the border gateway protocol messages, and all statistical data for counting the number of border gateway protocol messages; sending the processing results to the monitoring performance evaluation system, and receiving a performance test result sent by the monitoring performance evaluation system, wherein the performance test result is determined by the monitoring performance evaluation system based on the processing result, and the performance test result is used to characterize whether the stability of the monitoring system meets a preset performance standard.

[0007] Furthermore, corresponding operations are performed based on the contents of multiple border gateway protocol messages, and the number of multiple border gateway protocol messages is counted to obtain processing results of border gateway messages, including: performing corresponding operations on the contents of multiple border gateway protocol messages based on the test objects and event information in the test request to obtain all processed data, wherein all processed data at least includes: accurate processing data; counting the number of multiple border gateway protocol messages received to obtain all statistical data, wherein all statistical data at least includes: accurate statistical data; summarizing all processed data and all statistical data to obtain processing results.

[0008] Furthermore, the method also includes: receiving control results of the network control system on multiple virtual devices, wherein the network control system is communicated with the monitoring system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

[0009] Further, the plurality of virtual devices are border gateway protocol neighbors of each other, and the test request is created based on the border gateway protocol neighbors and the virtual private network service, wherein the border gateway protocol neighbors and the virtual private network service are created by the network control system.

[0010] Furthermore, the method further includes: sending a stop test request to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending a plurality of border gateway protocol messages.

[0011] According to another aspect of an embodiment of the present invention, a testing method for a monitoring system based on the Border Gateway Protocol is provided, which is applied to a monitoring performance evaluation system, and the method includes: in response to receiving a test request sent by the monitoring system, controlling multiple virtual devices to generate multiple Border Gateway Protocol messages, and sending multiple Border Gateway Protocol messages to the monitoring system, wherein the multiple virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; receiving a processing result sent by the monitoring system, wherein the processing result is obtained by processing multiple Border Gateway Protocol messages by the monitoring system, and the processing result includes: all processing data of the Border Gateway Protocol messages by the monitoring system, and all statistical data of the Border Gateway Protocol messages by the monitoring system; determining whether the stability of the monitoring system meets the preset performance standards based on the processing results, obtaining the performance test results of the monitoring system, and sending the performance test results to the monitoring system, and the performance test results are used to characterize whether the stability of the monitoring system meets the preset performance standards.

[0012] Furthermore, based on the processing results, it is determined whether the stability of the monitoring system meets the preset performance standards, and a performance test result of the monitoring system is obtained, including: obtaining a processing accuracy based on all processed data and accurate processed data, and obtaining an acquisition accuracy based on all statistical data and accurate statistical data; in response to the processing accuracy being greater than or equal to the preset processing accuracy, and the acquisition accuracy being greater than or equal to the preset acquisition accuracy, determining that the performance test result is that the stability of the monitoring system meets the preset performance standards; in response to the processing accuracy being less than the preset processing accuracy, or the acquisition accuracy being less than the preset acquisition accuracy, determining that the performance test result is that the stability of the monitoring system does not meet the preset performance standards.

[0013] Furthermore, the method also includes: receiving control results of the network control system controlling multiple virtual devices, wherein the network control system is communicated with the monitoring performance evaluation system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

[0014] Furthermore, the test request is sent by the monitoring system when a session connection is established with the monitoring performance evaluation system.

[0015] Furthermore, all processed data at least include: accurately processed data, and all statistical data at least include: accurately statistical data.

[0016] Furthermore, before controlling multiple virtual devices to generate multiple border gateway protocol messages, the method also includes: synchronizing resources of the network control system and the resources of the monitoring system, wherein the resources include at least: border gateway protocol neighbors, virtual private network services and monitoring tasks, border gateway protocol neighbors and virtual private network services are created by the network control system, and the monitoring tasks are located in the test request, which are used to enable multiple virtual devices to generate multiple border gateway protocol messages, and the monitoring tasks include at least: monitoring objects and event information, and the monitoring tasks are created by the monitoring system based on border gateway protocol neighbors and virtual private network services; controlling multiple virtual devices to establish session connections with the monitoring system.

[0017] According to another aspect of an embodiment of the present invention, a test system for a border gateway protocol monitoring system is also provided, including: a monitoring performance evaluation system for generating multiple virtual devices; a monitoring system, which is communicatively connected to the monitoring performance evaluation system, and is used to send a test request to the monitoring performance evaluation system, receive multiple border gateway protocol messages sent by multiple virtual devices, perform corresponding operations based on the contents of the multiple border gateway protocol messages, and count the number of multiple border gateway protocol messages to obtain processing results of the border gateway messages, and send the processing results to the monitoring performance evaluation system; wherein the monitoring performance evaluation system is also used to obtain performance test results of the monitoring system based on the processing results, and the performance test results are used to characterize whether the stability of the monitoring system meets preset performance standards.

[0018] Furthermore, the system also includes: a network control system, which is communicatively connected with the monitoring performance evaluation system and the monitoring system, and is used to monitor the device status of multiple virtual devices to obtain monitoring results, manage the resources and configurations of multiple virtual devices to obtain management results, and create border gateway protocol neighbors of multiple virtual devices and virtual private network services corresponding to multiple virtual devices; the monitoring system is also used to create monitoring tasks based on border gateway protocol neighbors and virtual private network services, the monitoring tasks are located in the test request, and are used to enable multiple virtual devices to generate multiple border gateway protocol messages, and the monitoring tasks at least include: monitoring objects and event information; the monitoring system is also used to perform corresponding operations on the contents of multiple border gateway protocol messages based on the test objects and event information in the test request to obtain all processed data, and count the number of multiple border gateway protocol messages received to obtain all statistical data, and summarize all processed data and all statistical data to obtain processing results, wherein all statistical data at least include: accurate statistical data, and all processed data at least include: accurate processing data; the monitoring performance evaluation system is also used to synchronize resources of the network control module and resources of the monitoring system.

[0019] According to another aspect of an embodiment of the present invention, there is further provided an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the method in each embodiment of the present invention is executed when the program is running.

[0020] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium includes a stored executable program, wherein when the executable program is running, the device where the computer-readable storage medium is located is controlled to execute the methods in various embodiments of the present invention.

[0021] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the method in each embodiment of the present invention is implemented.

[0022] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method in each embodiment of the present invention is implemented.

[0023] According to another aspect of the embodiments of the present invention, a computer program is further provided. When the computer program is executed by a processor, the methods in the embodiments of the present invention are implemented.

[0024] In an embodiment of the present invention, a test request is sent to a monitoring performance evaluation system, and corresponding operations are performed based on the border gateway protocol message returned by the monitoring performance evaluation system to obtain the processing result of the above message, the processing result includes: all processing data of the content of the border gateway protocol message, and all statistical data of the number of the border gateway protocol message, and the performance test result of the BMP monitoring system is generated based on the processing result. It should be noted that by creating multiple virtual devices through the monitoring performance evaluation system, and sending multiple border gateway protocol messages to the BMP monitoring system by the multiple virtual devices, it can be realized when the BMP monitoring system is officially put into use. Before use, the monitoring performance evaluation system is used to accurately evaluate the stability of the BMP monitoring system's message processing based on multiple Border Gateway Protocol messages, thereby avoiding the problem of low accuracy in evaluating the stability of the BMP monitoring system when processing a large number of messages due to a small number of Border Gateway Protocol messages in real network message interactions, and achieving the purpose of evaluating the stability and performance indicators of the BMP monitoring system under high concurrency conditions, thereby achieving the technical effect of comprehensively testing and evaluating the stability and performance indicators of the BMP monitoring system before being put into the live network, and further solving the technical problem of low accuracy in evaluating the stability of the BMP monitoring system when processing a large number of messages. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0026] Figure 1 is a flow chart of a testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention;

[0027] Figure 2 is a general schematic diagram of a testing method for a monitoring system based on a border gateway protocol according to an embodiment of the present invention;

[0028] Figure 3 is an overall flow chart of a testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention;

[0029] Figure 4 is a flow chart of another testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention;

[0030] Figure 5 is a schematic diagram of a test system of a border gateway protocol monitoring system according to an embodiment of the present invention;

[0031] Figure 6 It is a schematic diagram of the detailed structure of a test system of a border gateway protocol monitoring system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] According to an embodiment of the present invention, an embodiment of a testing method for a monitoring system based on a border gateway protocol is provided, which is applied to a monitoring system. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0035] Figure 1 FIG. 1 is a flow chart of a testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention. Figure 1 As shown, the method is applied to a monitoring system and comprises the following steps:

[0036] Step S102: sending a test request to a monitoring performance evaluation system.

[0037] The above-mentioned monitoring performance evaluation system can be a physical electronic device or a virtual electronic device capable of evaluating the performance of the BMP monitoring system. For example, it can include but is not limited to: a local server, a cloud server, a virtual machine, etc. The specific type is not limited in this embodiment, and the technician can set it according to the actual evaluation needs. Among them, in the above-mentioned monitoring performance evaluation system, a computer application capable of evaluating the performance of the BMP monitoring system is configured. The above-mentioned BMP monitoring system and the monitoring performance evaluation system can establish a communication connection. For example, the communication connection that can be established between the above-mentioned BMP monitoring system and the monitoring performance evaluation system includes: TCP (Transmission Control Protocol, Transmission Control Protocol) connection, UDP (User Datagram Protocol, User Datagram Protocol) connection, MQTT (Message Queuing Telemetry Transport, Message Queuing Telemetry Transmission) connection, but not limited to this. Among them, the type of data exchanged between the BMP monitoring system and the monitoring performance evaluation system can be a BMP message, but not limited to this. As shown in Table 1, the above BMP messages include at least the following categories: initialization message, PU (Peer Up Notification Message, peer connection establishment notification) message, RM (Route Monitoring, route monitoring) message, PD (Peer Down Notification Message, peer connection establishment notification) message, SR (Statistics Report, statistical information) message, Termination (end) message, Route Mirror ing (route mirroring) message, but not limited to this. The above test request can be a message indicating that the BMP monitoring system needs to perform a performance test.

[0038] Table 1

[0039]

[0040] In an optional embodiment, the above session connection is a TCP connection. First, the BMP monitoring system selects an ISN (Initial Sequence Number) and sends a TCP segment with a SYN (Synchronize) flag to the monitoring performance evaluation system. Then, the BMP monitoring system receives the above TCP segment and sends a TCP segment with SYN and ACK (Acknowledgment) flags to the monitoring performance evaluation system as a response. Finally, the monitoring performance evaluation system receives the above TCP segment and returns a TCP segment with an ACK flag as a final response. At this time, the TCP connection is successfully established. The BMP monitoring system sends a BMP initialization message to the monitoring performance evaluation system. After receiving the above message, the monitoring performance evaluation system performs necessary verification and processing, and then sends a BMP initialization response message to the BMP monitoring system. At this time, the initialization is completed, and the BMP monitoring system can send a test request to the monitoring performance evaluation system, indicating that the BMP monitoring system needs to perform a performance test.

[0041] In another optional embodiment, the monitoring performance evaluation system and the BMP monitoring system establish a session connection via UDP. First, the BMP monitoring system and the monitoring performance evaluation system each create a UDP socket locally, which contains information required for network communication such as the IP address and port number. Then, the BMP monitoring system encapsulates the test request indicating that the system needs to be tested into a UDP datagram, and sends the datagram to the IP address and port number of the monitoring performance evaluation system. The UDP socket of the monitoring performance evaluation system listens for the datagram on the network. Finally, the monitoring performance evaluation system receives the datagram from the BMP monitoring system and extracts the above message from the datagram, thereby receiving the test request from the BMP monitoring system.

[0042] In another optional embodiment, the monitoring performance evaluation system and the BMP monitoring system establish a session connection via MQTT. First, the BMP monitoring system, as an MQTT client, connects to the MQTT proxy server and selects the QoS (Quality of Service) of the message. For example, the QoS may be QoS0, which means that the message is sent at most once. For another example, the quality of service level may be QoS2, which ensures that the message is delivered only once. Then, the BMP monitoring system encapsulates the test request indicating that the system needs to be tested into an MQTT message and specifies the topic to be sent. The monitoring performance evaluation system subscribes to the above topic. Finally, the proxy server distributes the above message to the monitoring performance evaluation system according to the topic, thereby completing the test request sending of the BMP monitoring system.

[0043] Step S104, receiving multiple border gateway protocol messages returned by the monitoring performance evaluation system based on the test request, wherein the multiple border gateway protocol messages are generated by multiple virtual devices pre-created in the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment.

[0044] The border gateway protocol message may be data used to exchange information between network devices. For example, the border gateway protocol message may be, but is not limited to, the message type described in Table 1. The virtual device may be a device created by software simulation or virtualization technology. For example, the virtual device may include one or more of the following: a virtual router, a containerized device, a network function virtualization device, but is not limited thereto. The real network device may include one or more of the following: a router, a switch, a server, but is not limited thereto.

[0045] In an optional embodiment, the above-mentioned monitoring performance evaluation system can use virtualization technology to pre-configure the network environment and create multiple virtual devices. When the monitoring performance evaluation system receives the test request sent by the BMP monitoring system, the above-mentioned multiple virtual devices generate multiple border gateway protocol messages and return the messages to the BMP monitoring system through multi-threaded concurrent means.

[0046] For example, the monitoring performance evaluation system can pre-create multiple virtual routers based on OpenVZ to simulate routers in a real network environment. When the monitoring performance evaluation system receives a test request sent by the BMP monitoring system, the multiple virtual routers generate an RM message, which includes a response to the test request. The monitoring performance evaluation system returns the message to the BMP monitoring system via a TCP connection and in a multi-threaded concurrent manner.

[0047] For another example, the monitoring performance evaluation system can pre-create multiple containerized devices based on Docker to simulate switches in a real network environment. When the monitoring performance evaluation system receives the test request sent by the BMP monitoring system, the above-mentioned multiple containerized devices generate a PU message, which includes a response to the above-mentioned test request. The monitoring performance evaluation system returns the message to the BMP monitoring system via a UDP connection and a multi-threaded concurrent manner.

[0048] For another example, the monitoring performance evaluation system can combine Kubernetes and Docker to pre-create multiple routers, containerized devices, and network function virtualization devices to simulate routers, switches, and servers in a real network environment. When the monitoring performance evaluation system receives the test request sent by the BMP monitoring system, the above-mentioned routers, containerized devices, and network function virtualization devices generate an SR message, which includes a response to the above-mentioned test request. The monitoring performance evaluation system returns the message to the BMP monitoring system through an MQTT connection and a multi-threaded concurrent approach.

[0049] Step S106, performing corresponding operations based on the contents of multiple border gateway protocol messages, and counting the number of multiple border gateway protocol messages to obtain processing results of border gateway messages, wherein the processing results include: all processing data of operations on the contents of border gateway protocol messages, and all statistical data on the number of border gateway protocol messages.

[0050] The above operation may be the analysis and processing of the message content returned by the above monitoring performance evaluation system by the BMP monitoring system. For example, the above operation may be: recording the update, synchronization and clearing resource information of the virtual device, but is not limited thereto. The above processing result may be the data generated after the BMP monitoring system performs a specific operation.

[0051] In an optional embodiment, a counter can be constructed inside the BMP monitoring system. When the BMP monitoring system receives each Border Gateway Protocol message returned by the monitoring performance evaluation system, the counter performs an increment operation, thereby being able to count the number of all Border Gateway Protocol messages received by the system. After the BMP monitoring system receives a Border Gateway Protocol message, it can analyze and process the content of the message and generate corresponding processing data. The BMP monitoring system can maintain a cache container inside, which caches all of the above-mentioned processing data, thereby obtaining all the processing data of the system operating on the content of all received messages. For example, when the BMP monitoring system receives a Border Gateway Protocol message returned by the monitoring performance evaluation system, the counter inside the BMP monitoring system performs an increment operation. The message instructs the BMP monitoring system to record the update of the virtual device. The BMP monitoring system processes according to the above instructions and caches the generated processed data into the cache container inside the system. The BMP monitoring system repeats the above steps each time it receives a Border Gateway Protocol message. When the current round of interaction between the system and the monitoring performance evaluation system ends, the counter inside the BMP monitoring system can count all the statistical data of this round of interaction, and the cache container inside the system can cache all the processed data of this round of interaction.

[0052] Step S108, sending the processing results to the monitoring performance evaluation system, and receiving the performance test results sent by the monitoring performance evaluation system, wherein the performance test results are determined by the monitoring performance evaluation system based on the processing results, and the performance test results are used to characterize whether the stability of the monitoring system meets the preset performance standards.

[0053] The above performance test results may be used to characterize whether the stability of the above BMP monitoring system meets the preset performance standards. For example, the above performance test results may be that the stability of the system meets the preset performance standards or the stability of the system does not meet the preset performance standards.

[0054] In an optional embodiment, the monitoring performance evaluation system receives all processing data of the BMP monitoring system operating on the content of the Border Gateway Protocol message, as well as all statistical data on the number of Border Gateway Protocol messages, and generates corresponding performance test results based on the above data. For example, the monitoring performance evaluation system parses the above data to obtain the total amount of data and duration of the BMP monitoring system performing different operations, thereby calculating the time overhead of each operation of the BMP monitoring system. By monitoring whether the change in the time overhead of similar operations exceeds a preset range, it can be determined whether the stability of the system meets the preset standard. For another example, the monitoring performance evaluation system parses the above data to obtain the amount of data accurately processed by the BMP monitoring system for the above message, as well as the total amount of processing, thereby calculating the accuracy of the BMP monitoring system processing the above message. By determining whether the accuracy is greater than or equal to the preset accuracy, it can be determined whether the stability of the system meets the preset standard. For another example, the monitoring performance evaluation system parses the above data to obtain the number of Border Gateway Protocol messages counted by the BMP monitoring system and the amount of data accurately processed for the above messages. The statistical accuracy can be calculated based on the number of messages counted by the system and the total amount of messages sent by the monitoring performance evaluation system. The accuracy of the statistics can be calculated based on the amount of data accurately processed by the BMP monitoring system for the above messages and the total amount of data processed. The accuracy of the BMP monitoring system in processing the above messages can be calculated. By judging whether the statistical accuracy is greater than or equal to the preset statistical accuracy, and whether the processing accuracy is greater than or equal to the preset processing accuracy, it can be judged whether the stability of the BMP monitoring system meets the preset standards.

[0055] Through the above steps, it is possible to send a test request to the monitoring performance evaluation system, and perform corresponding operations based on the border gateway protocol message returned by the monitoring performance evaluation system to obtain the processing result of the above message, and the processing result includes: all processing data of the operation on the content of the border gateway protocol message, and all statistical data on the number of the border gateway protocol messages, and generate the performance test result of the BMP monitoring system based on the processing result. It should be noted that by creating multiple virtual devices through the monitoring performance evaluation system, and sending multiple border gateway protocol messages to the BMP monitoring system by multiple virtual devices, it can be achieved when the BMP monitoring system is officially put into use. Before use, the stability of the BMP monitoring system's message processing is accurately evaluated based on multiple Border Gateway Protocol messages through the monitoring performance evaluation system, avoiding the problem of low accuracy in evaluating the stability of the BMP monitoring system when processing a large number of messages due to a small number of Border Gateway Protocol messages in real network message interactions, and achieving the purpose of evaluating the stability and performance indicators of the BMP monitoring system under high concurrency conditions, thereby achieving the technical effect of comprehensively testing and evaluating the stability and performance indicators of the BMP monitoring system before being put into the live network, and further solving the technical problem of low accuracy in evaluating the stability of the BMP monitoring system when processing a large number of messages.

[0056] Furthermore, corresponding operations are performed based on the contents of multiple border gateway protocol messages, and the number of multiple border gateway protocol messages is counted to obtain processing results of border gateway messages, including: performing corresponding operations on the contents of multiple border gateway protocol messages based on the test objects and event information in the test request to obtain all processed data, wherein all processed data at least includes: accurate processing data; counting the number of multiple border gateway protocol messages received to obtain all statistical data, wherein all statistical data at least includes: accurate statistical data; summarizing all processed data and all statistical data to obtain processing results.

[0057] The test object may be a BMP monitoring system, but is not limited thereto. The event information may be information instructing the BMP monitoring system to perform a specific operation. The accurate processed data may be data with accurate processing results among all the processed data. The accurate statistical data may be data with accurate statistical results among all the statistical data.

[0058] In an optional embodiment, the monitoring performance evaluation system can create multiple virtual devices, and the virtual devices generate multiple border gateway protocol messages and send them to the BMP monitoring system. The counter inside the system counts the number of all messages received to obtain all statistical data, and the above-mentioned all statistical data at least includes data with accurate statistical results. The system analyzes and processes all received messages, and caches all generated processed data in a cache container inside the system to obtain all processed data, and the above-mentioned all processed data at least includes data with accurate processing results. The BMP monitoring system summarizes all processed data and all statistical data to obtain processing results.

[0059] For example, the multiple virtual devices created by the monitoring performance evaluation system can be multiple virtual routers, and the multiple border gateway protocol messages generated by the multiple virtual routers can be the content of the above messages instructing the BMP monitoring system to process the session request of the virtual router. The multiple virtual routers can send the above messages to the BMP monitoring system in a multi-threaded concurrent manner. When the BMP monitoring system receives the above messages, the internal counter of the system counts the number of messages to obtain all statistical data including accurate statistical data. At the same time, the above session request is processed. After the processing is completed, the BMP monitoring system caches the processed data generated after the processing into the cache container inside the system to obtain all processed data including accurate processed data, and obtains the processing result by summarizing all processed data and all statistical data.

[0060] For another example, multiple virtual devices may be a combination of multiple virtual routers and multiple containerized devices. Multiple virtual routers and multiple containerized devices may generate multiple Border Gateway Protocol messages. The content of the messages may instruct the BMP monitoring system to process the fault information of the multiple virtual routers and containerized devices. The multiple virtual routers and containerized devices may send the messages to the BMP monitoring system in a multi-threaded concurrent manner. When the BMP monitoring system receives the messages, the internal counter of the system counts the number of messages to obtain all statistical data including accurate statistical data. At the same time, the above fault information is processed. After the processing is completed, the BMP monitoring system caches the processed data generated after the processing into the internal cache container of the system to obtain all processed data including accurate processed data. The processing result is obtained by summarizing all processed data and all statistical data.

[0061] Furthermore, the method also includes: receiving control results of the network control system on multiple virtual devices, wherein the network control system is communicated with the monitoring system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

[0062] In an optional embodiment, considering that the monitoring system can analyze and evaluate the performance of the network control system by collecting the control results of the network control system controlling multiple virtual devices, and timely discover the failure of the virtual device or the abnormal behavior of the network control system, the monitoring system can obtain the control results of the network control system controlling multiple virtual devices. Specifically, the above control results may include monitoring results and management results, wherein the above monitoring results provide information on the current state of the virtual device, including the operating status, performance indicators, network connection status, etc. of the device, which is crucial for the monitoring system to timely discover device failures, network anomalies or performance bottlenecks, and helps the monitoring system to quickly respond and solve problems to ensure the stable operation of the network. The above management results reflect the management effect of the network control system on the resources and configuration of virtual devices, including the rationality of resource allocation, the efficiency of configuration updates, etc. The monitoring system can optimize the resource allocation strategy, improve the efficiency of resource allocation, ensure the full utilization of resources, and reduce resource waste and costs by analyzing the management results.

[0063] Further, the plurality of virtual devices are border gateway protocol neighbors of each other, and the test request is created based on the border gateway protocol neighbors and the virtual private network service, wherein the border gateway protocol neighbors and the virtual private network service are created by the network control system.

[0064] The border gateway protocol neighbors may refer to two or more virtual devices that exchange routing information via the BGP protocol in a network. The virtual private network service may refer to a private network service simulated for the virtual device in the network control system.

[0065] In an optional embodiment, the above-mentioned network control system establishes BGP neighbor relationships based on the above-mentioned multiple virtual devices to simulate complex network topologies, and simulates different network segments or virtual network environments by establishing VPN services, so as to test the performance of the BMP monitoring system when processing sessions from multiple different network environments.

[0066] Furthermore, the method further includes: sending a stop test request to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending a plurality of border gateway protocol messages.

[0067] The above-mentioned stop test request may be a message indicating that the BMP monitoring system needs to terminate the performance test.

[0068] In an optional embodiment, when the BMP monitoring system needs to stop testing, it can send a stop test request to the monitoring performance evaluation system. After receiving the request, the monitoring performance evaluation system sends a stop instruction to each virtual device. After receiving the above instruction, the virtual device stops sending Border Gateway Protocol messages to the BMP monitoring system.

[0069] Figure 2 It is a general schematic diagram of a testing method of a monitoring system based on the border gateway protocol according to an embodiment of the present invention, comprising: a monitoring performance evaluation system 201, a BMP monitoring system 204, and a network control system 206. Among them, the monitoring performance evaluation system 201 also includes: client-side network devices 2011, 2012, edge devices 2013, 2014, virtual devices 2015, 2016, 2017, 2018. Step 208 indicates that the monitoring performance evaluation system creates a virtual device, step 210 indicates that the network control system manages the virtual device and creates a BGP neighbor and VPN service, step 212 indicates that the BMP monitoring system creates a BMP monitoring instance, step 214 indicates that a large number of BMP messages are constructed and reported to the BMP monitoring system, and step 216 indicates that the BMP monitoring system receives the BMP message and analyzes it.

[0070] For ease of understanding, Figure 3 FIG. 1 is a general and detailed flow chart of a testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention. Figure 3As shown, the monitoring performance evaluation system configures the intercommunication between various systems, allocates IP addresses, generates virtual devices, the network control system manages the above virtual devices, and configures BGP neighbors and VPN services for them, and the BMP monitoring system creates a BMP monitoring instance for the above virtual devices. The monitoring performance evaluation system synchronizes the resource information of the network management system and the BMP monitoring system, and controls the virtual devices to establish a large number of session connections with the BMP monitoring system, so that the above multiple virtual devices can send the generated multiple BMP messages to the BMP monitoring system in parallel. After receiving the above messages, the BMP monitoring system analyzes and processes them, and then obtains the processing results containing all the processing data and all the statistical data, and sends the processing results to the monitoring performance evaluation system, wherein all the processing data at least includes accurate processing data, and all the statistical data at least includes accurate statistical data. The monitoring performance evaluation system parses the above processing results to obtain the processing accuracy and the acquisition accuracy, and based on the relationship between the processing accuracy and the preset processing accuracy, the acquisition accuracy and the preset acquisition accuracy, obtains the performance test results of the BMP monitoring system, and finally returns the above performance test results to the BMP monitoring system. The monitoring performance evaluation system may close the connection during the process of sending the BMP message, thereby stopping the message sending. Subsequently, the monitoring performance evaluation system may clear the above-mentioned synchronized resource information, and the BMP monitoring performance evaluation is now completed.

[0071] According to another aspect of an embodiment of the present invention, an embodiment of a testing method for a monitoring system based on a border gateway protocol is provided, which is applied to a monitoring performance evaluation system. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0072] Figure 4 FIG. 1 is a flow chart of a testing method of a monitoring system based on a border gateway protocol according to an embodiment of the present invention. Figure 4 As shown, the method comprises the following steps:

[0073] Step S302, in response to receiving a test request sent by the monitoring system, controls multiple virtual devices to generate multiple border gateway protocol messages, and sends multiple border gateway protocol messages to the monitoring system, wherein the multiple virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment.

[0074] In an optional embodiment, the monitoring performance evaluation system can quickly generate a large number of virtual devices based on Linux virtualization technology in advance, and each virtual device has an independent IP address and network configuration to simulate different types of real network devices in a real network environment, such as routers, switches, etc. After the session connection established with the monitoring performance evaluation system, the BMP monitoring system can send a test request to the monitoring performance evaluation system to evaluate the monitoring performance of the BMP monitoring system. After receiving the test request, the monitoring performance evaluation system can send instructions to the generated virtual devices, instructing them to start a BGP session and generate and send BGP messages in the session. Specifically, the above-mentioned BGP messages may include PU messages, route update messages, route withdrawal messages, etc., which are used to test the establishment and release of BGP sessions, routing information refresh and other monitoring functions. After receiving the instructions of the monitoring performance evaluation system, the virtual device starts to execute the BGP session, generates BGP messages according to the requirements in the test request, and sends the messages to the BMP monitoring system through the TCP channel.

[0075] Step S304, receiving the processing results sent by the monitoring system, wherein the processing results are obtained by the monitoring system processing multiple Border Gateway Protocol messages, and the processing results include: all processing data of the monitoring system on the Border Gateway Protocol messages, and all statistical data of the monitoring system on the Border Gateway Protocol messages.

[0076] In an optional embodiment, after the BMP monitoring system receives the BGP messages sent by the above-mentioned multiple virtual devices, the BMP monitoring system can generate a processing result based on the processed BGP messages, and the result can include all processing data and all statistical data. The above processing result is sent back to the monitoring performance evaluation system by the BMP monitoring system, so that the monitoring performance evaluation system can evaluate the performance of the BMP monitoring system in the simulation environment.

[0077] Step S306, based on the processing results, determine whether the stability of the monitoring system meets the preset performance standards, obtain the performance test results of the monitoring system, and send the performance test results to the monitoring system. The performance test results are used to characterize whether the stability of the monitoring system meets the preset performance standards.

[0078] In an optional embodiment, the monitoring performance evaluation system obtains the total amount of processed data and accurate processed data of the BMP monitoring system, and simultaneously obtains the total amount of statistical data and accurate statistical data of the BMP monitoring system, so that the processing accuracy and acquisition accuracy of the BMP monitoring system can be calculated respectively. If the above processing accuracy is greater than or equal to the above preset processing accuracy, and the above acquisition accuracy is greater than or equal to the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the above processing accuracy is less than the above preset processing accuracy, or the above acquisition accuracy is less than the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard, and finally the performance test result is sent to the monitoring system.

[0079] Furthermore, based on the processing results, it is determined whether the stability of the monitoring system meets the preset performance standards, and a performance test result of the monitoring system is obtained, including: obtaining a processing accuracy based on all processed data and accurate processed data, and obtaining an acquisition accuracy based on all statistical data and accurate statistical data; in response to the processing accuracy being greater than or equal to the preset processing accuracy, and the acquisition accuracy being greater than or equal to the preset acquisition accuracy, determining that the performance test result is that the stability of the monitoring system meets the preset performance standards; in response to the processing accuracy being less than the preset processing accuracy, or the acquisition accuracy being less than the preset acquisition accuracy, determining that the performance test result is that the stability of the monitoring system does not meet the preset performance standards.

[0080] The above-mentioned preset processing accuracy rate may be a preset percentage used to determine whether the processing accuracy rate meets the standard. The preset accuracy rate may be set according to actual needs, and the range may be 0%-100%, but not limited thereto. For example, the preset accuracy rate may be 90%, but not limited thereto. The above-mentioned processing accuracy rate may be the percentage of the amount of accurately processed data to the total amount of processed data. The above-mentioned preset acquisition accuracy rate may be a preset percentage used to determine whether the acquisition accuracy rate meets the standard. The acquisition accuracy rate may be set according to actual needs, and the range may be 0%-100%, but not limited thereto. For example, the acquisition accuracy rate may be 100%, but not limited thereto. The above-mentioned acquisition accuracy rate may be the percentage of the amount of accurate statistical data to the total amount of statistical data. The above-mentioned preset performance standard may be a condition for determining whether the stability of the BMP monitoring system meets the standard.

[0081] In an optional embodiment, the monitoring performance evaluation system obtains the total amount of processed data and the amount of accurately processed data of the BMP monitoring system, and simultaneously obtains the total amount of statistical data and the amount of accurate statistical data of the BMP monitoring system, so that the processing accuracy and acquisition accuracy of the BMP monitoring system can be calculated respectively. If the above processing accuracy is greater than or equal to the above preset processing accuracy, and the above acquisition accuracy is greater than or equal to the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the above processing accuracy is less than the above preset processing accuracy, or the above acquisition accuracy is less than the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard.

[0082] For example, when the preset processing accuracy is 90% and the preset acquisition accuracy is 100%, the number of data accurately processed by the BMP monitoring system can be 98546789, the number of all processed data can be 10000000, the number of data accurately acquired can be 10000000, and the number of all acquired data can be 10000000. At this time, the processing accuracy of the BMP monitoring system is 98.546789%, and the acquisition accuracy is 100%. Since the processing accuracy is greater than the preset processing accuracy, and the acquisition accuracy is equal to the preset acquisition accuracy, it can be determined that the performance test result is that the stability of the monitoring system meets the preset performance standards.

[0083] For another example, when the preset processing accuracy is 80% and the preset acquisition accuracy is 90%, the number of data accurately processed by the BMP monitoring system can be 78459989, the number of all processed data can be 10000000, the number of data accurately acquired can be 9000000, and the number of all acquired data can be 10000000. At this time, the processing accuracy of the BMP monitoring system is 78.459989%, and the acquisition accuracy is 90%. Since the processing accuracy is less than the preset processing accuracy, it can be determined that the performance test result is that the stability of the monitoring system does not meet the preset performance standards.

[0084] For another example, when the preset processing accuracy is 95% and the preset acquisition accuracy is 99%, the number of data accurately processed by the BMP monitoring system can be 99459989, the number of all processed data can be 10000000, the number of accurately acquired data can be 9000000, and the number of all acquired data can be 10000000. At this time, the processing accuracy of the BMP monitoring system is 99.459989%, and the acquisition accuracy is 90%. Since the acquisition accuracy is less than the preset acquisition accuracy, it can be determined that the performance test result is that the stability of the monitoring system does not meet the preset performance standards.

[0085] It should be noted that all the specific values ​​​​mentioned above, such as the preset processing accuracy, the preset acquisition accuracy, the number of accurately processed data, the number of all processed data, etc., are only exemplary displays. The staff can set them according to actual needs and are not limited here.

[0086] Furthermore, the method also includes: receiving control results of the network control system controlling multiple virtual devices, wherein the network control system is communicated with the monitoring performance evaluation system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

[0087] In an optional embodiment, considering that the network control system is responsible for managing the operation of virtual devices, including monitoring of device status and management of resources and configuration, the monitoring performance evaluation system can verify whether the performance of the network control system in managing a large number of virtual devices meets the expected performance indicators by receiving the control results of the network control system controlling multiple virtual devices. Specifically, the above control results may include monitoring results and management results, wherein the above monitoring results can help the monitoring performance evaluation system evaluate the stability of virtual devices and the monitoring capabilities of the network control system. By analyzing these results, the monitoring performance evaluation system can identify whether there are abnormal device status, network failures or system monitoring failures, and ensure that the system can run stably before being deployed in a real network environment. The above management results provide the network control system's resource allocation and configuration management of virtual devices. Based on this information, the monitoring performance evaluation system can optimize the resource allocation strategy, adjust the system configuration, ensure the effective use of resources, avoid resource waste, and improve the system processing capacity.

[0088] Furthermore, the test request is sent by the monitoring system when a session connection is established with the monitoring performance evaluation system.

[0089] In an optional embodiment, considering that by establishing a session connection between the monitoring system and the monitoring performance evaluation system, the monitoring performance evaluation system can efficiently send a large amount of test data to the BMP monitoring system, simulate high concurrent requests and data traffic in a real network environment, and test the responsiveness and stability of the BMP monitoring system under extreme conditions, so that the monitoring performance evaluation system can construct performance evaluation results more accurately.

[0090] Furthermore, all processed data at least include: accurately processed data, and all statistical data at least include: accurately statistical data.

[0091] In an optional embodiment, the above-mentioned accurate processing data and accurate statistical data are the basis for evaluating the performance stability and efficiency of the BMP monitoring system. Based on the above-mentioned accurate processing data and accurate statistical data, the monitoring performance evaluation system can more accurately evaluate the performance of the BMP monitoring system.

[0092] Furthermore, before controlling multiple virtual devices to generate multiple border gateway protocol messages, the method also includes: synchronizing resources of the network control system and the resources of the monitoring system, wherein the resources include at least: border gateway protocol neighbors, virtual private network services and monitoring tasks, border gateway protocol neighbors and virtual private network services are created by the network control system, and the monitoring tasks are located in the test request, which are used to enable multiple virtual devices to generate multiple border gateway protocol messages, and the monitoring tasks include at least: monitoring objects and event information, and the monitoring tasks are created by the monitoring system based on border gateway protocol neighbors and virtual private network services; controlling multiple virtual devices to establish session connections with the monitoring system.

[0093] The resources of the network control system may be various entities and information managed and scheduled in the network. The resources of the monitoring system may be data required to implement the monitoring function. The monitoring task may refer to monitoring the state changes and activities of the monitored object. The monitored object may be a virtual device in the network. The event information may be information instructing the BMP monitoring system to process various requests generated by the virtual devices in the network.

[0094] In an optional embodiment, the monitoring performance evaluation system generates multiple virtual devices, for example, the monitoring performance evaluation system can generate multiple virtual routers. After multiple virtual devices complete registration in the above-mentioned network control system, the network control system will configure BGP neighbors and virtual private network services for each virtual device, and send them to the monitoring performance evaluation system through a session connection. For example, the network control system can establish a TCP connection with the monitoring performance evaluation system. The BMP monitoring system creates a monitoring task based on BGP neighbors and services. The above-mentioned monitoring task at least includes a monitoring object, and information indicating that the BMP monitoring system processes various requests generated by the above-mentioned monitoring object. For example, the above-mentioned monitoring object can be the above-mentioned multiple virtual devices, and the above-mentioned information can be information indicating that the BMP monitoring system processes the session request of the virtual device. The BMP monitoring system sends a test request containing the monitoring task to the monitoring performance evaluation system, and the system obtains the resource information of the network control system and the monitoring system through the session connection to complete the synchronization of resources. Finally, the system controls the above-mentioned multiple virtual devices to establish a session connection with the BMP monitoring system, and generates multiple BMP monitoring messages based on the RFC standard, and sends them to the BMP monitoring system in a parallel sending manner.

[0095] According to another aspect of an embodiment of the present invention, a test system for a border gateway protocol monitoring system is also provided. It should be noted that the system can be used to execute the test method of the monitoring system based on the border gateway protocol. Figure 5 is a structural block diagram of a safety protection system for a construction area according to an embodiment of the present invention. Figure 5 As shown, the system includes:

[0096] The monitoring performance evaluation system 402 is used to generate multiple virtual devices.

[0097] In an optional embodiment, the monitoring performance evaluation system can generate a large number of virtual devices based on Linux's lightweight virtualization technology, and the above virtual devices can simulate routers and peers in a real network environment. For example, the monitoring performance evaluation system can generate a large number of virtual routers and containerized devices based on Docker, and for another example, the monitoring performance evaluation system can generate a large number of network function virtualization devices in combination with Kubernetes and Docker, and for another example, the monitoring performance evaluation system can generate a large number of virtual routers and containerized devices based on OpenVZ.

[0098] The monitoring system 404 is communicatively connected to the monitoring performance evaluation system 402, and is used to send a test request to the monitoring performance evaluation system, receive multiple border gateway protocol messages sent by multiple virtual devices, perform corresponding operations based on the contents of the multiple border gateway protocol messages, and count the number of multiple border gateway protocol messages to obtain processing results of the border gateway messages, and send the processing results to the monitoring performance evaluation system.

[0099] In an optional embodiment, the BMP monitoring system can send a test request to the monitoring performance evaluation system through a TCP connection with the monitoring performance evaluation system. After the virtual router generated by the monitoring performance evaluation system performs a corresponding operation based on the message returned by the monitoring performance evaluation system, the BMP monitoring system can receive the Border Gateway Protocol message sent by multiple virtual routers through a TCP connection with the monitoring performance evaluation system, and all the acquisition data of the above message can be obtained through the counter inside the BMP monitoring system. The BMP monitoring system processes the above message, and all the processing data of the above message can be obtained through the cache container inside the system. Finally, the BMP monitoring system can send all the above acquisition data and all the processing data to the monitoring performance evaluation system through a TCP connection with the monitoring performance evaluation system.

[0100] The monitoring performance evaluation system 402 is also used to obtain a performance test result of the monitoring system 404 based on the processing result, and the performance test result is used to indicate whether the stability of the monitoring system meets a preset performance standard.

[0101] In an optional embodiment, the monitoring performance evaluation system obtains the total amount of processed data and accurate processed data of the BMP monitoring system, and simultaneously obtains the total amount of statistical data and accurate statistical data of the BMP monitoring system, so that the processing accuracy and acquisition accuracy of the BMP monitoring system can be calculated respectively. If the above processing accuracy is greater than or equal to the above preset processing accuracy, and the above acquisition accuracy is greater than or equal to the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system meets the preset performance standard. If the above processing accuracy is less than the above preset processing accuracy, or the above acquisition accuracy is less than the above preset acquisition accuracy, then the performance test result is determined to be that the stability of the monitoring system does not meet the preset performance standard, and finally the performance test result is sent to the monitoring system.

[0102] Furthermore, the system also includes: a network control system 406, which is connected to the monitoring performance evaluation system 402 and the monitoring system 404, and is used to monitor the device status of multiple virtual devices to obtain monitoring results, manage the resources and configurations of multiple virtual devices to obtain management results, and create border gateway protocol neighbors of multiple virtual devices and virtual private network services corresponding to multiple virtual devices; the monitoring system is also used to create monitoring tasks based on border gateway protocol neighbors and virtual private network services, the monitoring tasks are located in the test request, and are used to enable multiple virtual devices to generate multiple border gateway protocol messages, and the monitoring tasks at least include: monitoring objects and event information; the monitoring system is also used to perform corresponding operations on the contents of multiple border gateway protocol messages based on the test objects and event information in the test request to obtain all processed data, and count the number of multiple border gateway protocol messages received to obtain all statistical data, and summarize all processed data and all statistical data to obtain processing results, wherein all statistical data at least include: accurate statistical data, and all processed data at least include: accurate processing data; the monitoring performance evaluation system is also used to synchronize resources of the network control module and the resources of the monitoring system.

[0103] In an optional embodiment, after multiple virtual routers are created, the network control system can initialize the virtual routers through a TCP connection with the monitoring performance evaluation system, thereby managing the resources and configurations of multiple virtual devices to obtain management results. In addition, the network control system can also create a border gateway protocol neighbor and a corresponding virtual private network service for the virtual router. Then, the network control system can monitor the device status of the above multiple virtual devices through a TCP connection with the BMP monitoring system to obtain monitoring results. The BMP monitoring system can create a border gateway protocol routing monitoring task based on the border gateway protocol neighbor and the virtual private network service. The monitoring task at least includes a monitoring object (such as a specific virtual device or BGP neighbor) and event information (such as routing update, revocation, etc.). In addition to creating a test task, the BMP monitoring system can also perform corresponding operations on the content of multiple border gateway protocol messages based on the test object and event information in the test request to obtain all processed data, and count the number of multiple border gateway protocol messages received to obtain all statistical data. Subsequently, the BMP monitoring system can summarize all the above processed data and all statistical data to obtain the above processing results. Specifically, in order to provide the monitoring performance evaluation system with a data basis for performance evaluation, all the above statistical data at least include accurate statistical data, and all the above processed data at least include accurate processed data. During the performance test of the BMP monitoring system, the monitoring performance evaluation system can continuously monitor the resource status of the network control module and the BMP monitoring system to ensure the synchronization and consistency of resources and avoid anomalies and mistests caused by resource mismatch.

[0104] For ease of understanding, Figure 6 FIG. 4 is a schematic diagram of a detailed structure of a test system of a border gateway protocol monitoring system according to an embodiment of the present invention. Figure 6 As shown, the system includes: a network control system 602 , a BMP monitoring system 604 , and a BMP performance evaluation system 606 .

[0105] The network control system 602 also includes: a network management module 6011, which is used to manage virtual devices, that is, to manage the addition and configuration of these virtual devices. In addition, the module can also establish BGP neighbor relationships based on virtual devices to simulate complex network topology structures and manage related VPN services.

[0106] The BMP monitoring system 604 also includes: a BMP monitoring management module 6041 and a BMP monitoring message management module 6042, wherein the BMP monitoring management module 6041 can create corresponding BMP monitoring instances based on BGP neighbor relationships and specific business needs; the BMP monitoring message management module 6042 is used to receive and process monitoring messages sent via the BMP protocol in real time.

[0107] The BMP performance evaluation system 606 also includes: a BMP monitoring configuration module 6061, a virtual device generation module 6062, a resource information synchronization module 6063, a BMP routing message encapsulation module 6024, and a BMP routing message sending module 6025, wherein the BMP monitoring configuration module 6061 is used to configure the basic information of the BMP monitoring system and the network control system to ensure that the two can interact correctly; the virtual device generation module 6062 can quickly create a large number of virtual devices based on Linux's lightweight virtualization technology; the resource information synchronization module 6063 is used to synchronize resource information from other systems (such as the network control system and the BMP monitoring system), including the device The module can also support the configuration of BMP monitoring instances, such as backup information, BGP neighbor relationships, VPN services, and BMP monitoring instance configuration. In addition, the module also supports clearing synchronized resource information for new performance testing. The BMP routing message encapsulation module 6024 can generate and encapsulate BMP messages based on the BMP message format and protocol specification (RFC standard) to simulate various message types that the BMP monitoring system in a real network needs to process. The BMP routing message sending module 6025 can send a large number of BMP messages in parallel to simulate high-concurrency scenarios and test the processing capability and stability of the BMP monitoring system. In addition, the module also supports stopping and restarting sessions to more flexibly control the test process.

[0108] An embodiment of the present application further provides an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods in various embodiments of the present invention when running.

[0109] An embodiment of the present application further provides a computer-readable storage medium, which includes a stored executable program, wherein when the executable program is running, the device where the computer-readable storage medium is located is controlled to execute the methods in various embodiments of the present invention.

[0110] An embodiment of the present application further provides a computer program product, including a computer program, which implements the methods in various embodiments of the present invention when executed by a processor.

[0111] An embodiment of the present application further provides a computer program product, including a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium is used to store a computer program, and when the computer program is executed by a processor, the method in each embodiment of the present invention is implemented.

[0112] The embodiments of the present application further provide a computer program, which implements the methods in the above-mentioned embodiments of the present invention when executed by a processor.

[0113] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0114] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0115] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0116] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0117] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0118] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A testing method for a monitoring system based on a border gateway protocol, characterized in that: Applied to the monitoring system, the method comprises: Sending a test request to the monitoring performance evaluation system; Receiving a plurality of border gateway protocol messages returned by the monitoring performance evaluation system based on the test request, wherein the plurality of border gateway protocol messages are generated by a plurality of virtual devices pre-created in the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; Perform corresponding operations based on the contents of the plurality of border gateway protocol messages, and count the number of the plurality of border gateway protocol messages to obtain processing results of the border gateway messages, wherein the processing results include: all processing data of the operations on the contents of the border gateway protocol messages, and all statistical data of the statistics on the number of the border gateway protocol messages; The processing result is sent to the monitoring performance evaluation system, and a performance test result sent by the monitoring performance evaluation system is received, wherein the performance test result is determined by the monitoring performance evaluation system based on the processing result, and the performance test result is used to characterize whether the stability of the monitoring system meets the preset performance standard.

2. The method according to claim 1, characterized in that Executing corresponding operations based on the contents of the plurality of border gateway protocol messages, and counting the number of the plurality of border gateway protocol messages to obtain processing results of the border gateway messages, including: Performing corresponding operations on the contents of the plurality of border gateway protocol messages based on the test object and event information in the test request to obtain the entire processed data, wherein the entire processed data at least includes: accurate processed data; Counting the number of the plurality of BGP messages received to obtain the total statistical data, wherein the total statistical data at least includes: accurate statistical data; Summarize all the processing data and all the statistical data to obtain the processing result.

3. The method according to any one of claims 1 to 2, characterized in that The method further comprises: Receive control results of the network control system controlling the multiple virtual devices, wherein the network control system is communicatively connected to the monitoring system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

4. The method according to claim 3, characterized in that The multiple virtual devices are border gateway protocol neighbors of each other, and the test request is created based on the border gateway protocol neighbors and virtual private network services, wherein the border gateway protocol neighbors and the virtual private network services are created by the network control system.

5. The method according to any one of claims 1 to 2, characterized in that: The method further comprises: A stop test request is sent to the monitoring performance evaluation system, wherein the stop test request is used to control the monitoring performance evaluation system to stop sending the multiple border gateway protocol messages.

6. A testing method for a monitoring system based on a border gateway protocol, characterized in that: Applied to a monitoring performance evaluation system, the method comprises: In response to receiving a test request sent by the monitoring system, controlling a plurality of virtual devices to generate a plurality of border gateway protocol messages, and sending the plurality of border gateway protocol messages to the monitoring system, wherein the plurality of virtual devices are generated by the monitoring performance evaluation system, and different virtual devices are used to simulate different real network devices in a real network environment; Receive a processing result sent by the monitoring system, wherein the processing result is obtained by the monitoring system processing the multiple border gateway protocol messages, and the processing result includes: all processing data of the border gateway protocol messages by the monitoring system, and all statistical data of the border gateway protocol messages by the monitoring system; Based on the processing result, determine whether the stability of the monitoring system meets the preset performance standard, obtain the performance test result of the monitoring system, and send the performance test result to the monitoring system. The performance test result is used to characterize whether the stability of the monitoring system meets the preset performance standard.

7. The method according to claim 6, characterized in that Determining whether the stability of the monitoring system meets a preset performance standard based on the processing result, and obtaining a performance test result of the monitoring system, including: Obtaining a processing accuracy rate based on the entire processed data and the accurate processed data, and obtaining an acquisition accuracy rate based on the entire statistical data and the accurate statistical data; In response to the processing accuracy being greater than or equal to the preset processing accuracy, and the acquisition accuracy being greater than or equal to the preset acquisition accuracy, determining that the performance test result is that the stability of the monitoring system meets the preset performance standard; In response to the processing accuracy being less than the preset processing accuracy, or the acquisition accuracy being less than the preset acquisition accuracy, it is determined that the performance test result is that the stability of the monitoring system does not meet a preset performance standard.

8. The method according to claim 6, characterized in that The method further comprises: Receive control results of the network control system controlling the multiple virtual devices, wherein the network control system is communicatively connected to the monitoring performance evaluation system, and the control results include: monitoring results and management results, the monitoring results are the results of the network control system monitoring the device status of the multiple virtual devices, and the management results are the results of the network control system managing the resources and configurations of the multiple virtual devices.

9. The method according to claim 6, characterized in that The test request is sent by the monitoring system when a session connection is established with the monitoring performance evaluation system.

10. The method according to claim 6, characterized in that The total processed data at least includes: accurate processed data, and the total statistical data at least includes: accurate statistical data.

11. The method according to claim 6, characterized in that Before controlling the plurality of virtual devices to generate a plurality of border gateway protocol messages, the method further includes: Perform resource synchronization on the resources of the network control system and the resources of the monitoring system, wherein the resources at least include: a border gateway protocol neighbor, a virtual private network service, and a monitoring task, the border gateway protocol neighbor and the virtual private network service are created by the network control system, the monitoring task is located in the test request, and is used to enable the multiple virtual devices to generate the multiple border gateway protocol messages, the monitoring task at least includes: a monitoring object and event information, and the monitoring task is created by the monitoring system based on the border gateway protocol neighbor and the virtual private network service; Control the multiple virtual devices to establish a session connection with the monitoring system.

12. A test system for a border gateway protocol monitoring system, characterized in that: include: Monitoring performance evaluation system for generating multiple virtual devices; A monitoring system, which is in communication connection with the monitoring performance evaluation system, is used to send a test request to the monitoring performance evaluation system, receive a plurality of border gateway protocol messages sent by the plurality of virtual devices, perform corresponding operations based on the contents of the plurality of border gateway protocol messages, count the number of the plurality of border gateway protocol messages, obtain a processing result of the border gateway message, and send the processing result to the monitoring performance evaluation system; The monitoring performance evaluation system is further used to obtain a performance test result of the monitoring system based on the processing result, and the performance test result is used to characterize whether the stability of the monitoring system meets a preset performance standard.

13. The system according to claim 12, characterized in that The system further comprises: A network control system, which is in communication with the monitoring performance evaluation system and the monitoring system, and is used to monitor the device states of the multiple virtual devices to obtain monitoring results, manage the resources and configurations of the multiple virtual devices to obtain management results, and create border gateway protocol neighbors of the multiple virtual devices and virtual private network services corresponding to the multiple virtual devices; The monitoring system is further used to create a monitoring task based on the border gateway protocol neighbor and the virtual private network service, the monitoring task is located in the test request, and is used to enable the multiple virtual devices to generate the multiple border gateway protocol messages, and the monitoring task includes at least: monitoring objects and event information; The monitoring system is also used to perform corresponding operations on the contents of the multiple border gateway protocol messages based on the test object in the test request and the event information to obtain all processed data, and to count the number of the multiple border gateway protocol messages received to obtain all statistical data, and to summarize all processed data and all statistical data to obtain the processing results, wherein all statistical data at least include: accurate statistical data, and all processed data at least include: accurate processing data; the monitoring performance evaluation system is also used to synchronize resources of the network control module and resources of the monitoring system.

14. An electronic device, characterized in that: include: A memory storing an executable program; A processor, configured to run the program, wherein the program executes the method according to any one of claims 1 to 11 when running.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored executable program, wherein when the executable program is executed, the device where the storage medium is located is controlled to execute the method according to any one of claims 1 to 11.

16. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 11.

Images