Switch performance test system, method and device, storage medium and program product

Abstract

The invention discloses a switch performance test system, method and device, a storage medium and a program product, and relates to the technical field of network device testing, and the switch performance test system comprises a test scheduler, an automatic flow generation module, a real-time performance monitoring module and a data analysis module. Due to the fact that the test flow can be generated through the automatic flow generation module, comprehensive testing can be conducted on multiple key performance indexes (such as throughput, delay, packet loss rate and routing convergence time) of the MPLS switch and the VPLS switch at the same time, the limitation that a traditional method only aims at testing of a single protocol or a single index is overcome, and more complete performance evaluation is provided. Automatic configuration of the test environment is achieved through the test scheduler, manual participation in the test process is reduced, and the test efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of network device testing technology, and in particular to switch performance testing systems, methods, devices, storage media, and program products. Background Technology

[0002] In modern communication networks, Multi-Protocol Label Switching (MPLS) and Virtual Private LAN Service (VPLS) technologies are widely used in carrier networks and enterprise networks, providing efficient packet forwarding and highly isolated virtual private network services.

[0003] However, most existing testing methods for switches based on MPLS and VPLS technologies currently focus on single network protocol or device function testing, such as bandwidth testing and latency testing, and lack comprehensive performance evaluation in multi-protocol environments. Summary of the Invention

[0004] The main purpose of this application is to provide a switch performance testing system, method, device, storage medium and program product, which aims to solve the technical problem that current testing focuses on a single network protocol or device function testing and lacks comprehensive performance evaluation in a multi-protocol environment.

[0005] To achieve the above objectives, this application proposes a switch performance testing method, which includes: The system includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module; The test scheduler is used to acquire test tasks and configure the test environment according to the test tasks to obtain the test environment; The automated traffic generation module is used to generate test traffic according to the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; The real-time performance monitoring module is used to monitor the network data parameters of the switch when the test traffic is transmitted in the test environment; The data analysis module is used to automatically identify the network data parameters and obtain the performance test results of the switch.

[0006] In one embodiment, the test scheduler is further configured to establish a switch network topology based on the test task; The test scheduler is also used to configure each switch in the switch network topology to obtain a configured test environment.

[0007] In one embodiment, the automated traffic generation module is used to obtain generated traffic parameters in the test environment according to the test task; The automated traffic generation module is also used to generate test traffic based on the generated traffic parameters.

[0008] In one embodiment, the data analysis module is further configured to determine network indicator data corresponding to each switch based on the network data parameters.

[0009] In one embodiment, the data analysis module is further configured to perform statistical analysis based on the network indicator data to determine the performance indicators of the switch; The data analysis module is also used to perform trend analysis based on the network indicator data to determine the performance change trend of the switch. The data analysis module is also used to determine the performance test results of the switch based on the performance indicators and the performance change trend.

[0010] In one embodiment, the system further includes: a report generation module; The report generation module is used to perform switch diagnosis based on the performance test results and obtain switch diagnosis results. The report generation module is also used to generate a performance test report based on the performance test results and the switch diagnostic results.

[0011] Furthermore, to achieve the above objectives, this application also proposes a switch performance testing method, which is used in the switch performance testing system described above, the system comprising: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module; the method comprising: The test scheduler acquires test tasks and configures the test environment according to the test tasks to obtain the test environment; The automated traffic generation module generates test traffic based on the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; The real-time performance monitoring module monitors the network data parameters of the switch when the test traffic is transmitted in the test environment. The data analysis module automatically identifies the network data parameters to obtain the performance test results of the switch.

[0012] In addition, to achieve the above objectives, this application also proposes a switch performance testing device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the switch performance testing method described above.

[0013] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the switch performance testing method described above.

[0014] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the switch performance testing method described above.

[0015] One or more technical solutions proposed in this application have at least the following technical effects: The switch performance testing system of this application includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module. The test scheduler is used to acquire test tasks and configure the test environment according to the test tasks to obtain the test environment. The automated traffic generation module is used to generate test traffic according to the test tasks; wherein, the test traffic is used to perform switch performance testing based on the test environment. The real-time performance monitoring module is used to monitor the network data parameters of the switch when the test traffic is transmitted in the test environment. The data analysis module is used to automatically identify the network data parameters to obtain the performance test results of the switch. Because the automated traffic generation module generates test traffic, it can simultaneously perform comprehensive testing on multiple key performance indicators of MPLS and VPLS switches (such as throughput, latency, packet loss rate, routing convergence time, etc.), overcoming the limitations of traditional methods that only test a single protocol or single indicator, and providing a more complete performance evaluation. The test scheduler enables automatic configuration of the test environment, reducing manual intervention in the testing process and improving testing efficiency. Attached Figure Description

[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram of the module structure and workflow provided in Embodiment 1 of the switch performance testing system of this application; Figure 2 This is a schematic diagram of the scenario structure provided in Embodiment 2 of the switch performance testing method of this application; Figure 3 This is a schematic diagram of the functional module structure provided in Embodiment 3 of the switch performance testing system of this application; Figure 4 This is a flowchart illustrating the switch performance testing method provided in this application. Figure 5 This is a schematic diagram of the hardware operating environment involved in the switch performance testing method in this application.

[0019] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0020] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0021] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0022] This application proposes a switch performance testing system, comprising: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module. The test scheduler acquires test tasks and configures the test environment accordingly. The automated traffic generation module generates test traffic based on the test tasks; this test traffic is used for switch performance testing within the test environment. The real-time performance monitoring module monitors the network metrics data of the switch during test traffic transmission within the test environment. The data analysis module automatically identifies network metrics data to obtain the switch's performance test results. The automated traffic generation module generates test traffic to comprehensively test multiple key performance indicators (such as throughput, latency, packet loss rate, and routing convergence time) of MPLS and VPLS switches simultaneously, overcoming the limitations of traditional methods that only test a single protocol or single indicator, and providing a more complete performance evaluation. The test scheduler enables automatic configuration of the test environment, reducing manual intervention in the testing process and improving testing efficiency. Through intelligent scheduling and optimized traffic generation algorithms, the system can complete equivalent performance testing with fewer hardware devices and lower traffic load, reducing reliance on expensive testing instruments and saving testing costs. The test scheduler in this embodiment can use standardized interfaces (such as SNMP, NetFlow, CLI adapter, etc.) to adapt to MPLS / VPLS switches from different manufacturers, enabling unified testing in a multi-vendor mixed environment and solving the problem of non-universal testing tools caused by equipment differences.

[0023] Reference Figure 1 , Figure 1 This is a schematic diagram of the module structure and workflow provided in Embodiment 1 of the switch performance testing system of this application.

[0024] like Figure 1 As shown in the embodiments of this application, the system includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module.

[0025] It should be noted that the aforementioned test scheduler can be a functional module built into an automated testing framework, used to receive test tasks, parse test requirements, and coordinate and schedule test resources. Through the test scheduler, the execution of the entire test task can be driven based on a preset process.

[0026] In this embodiment of the application, the test scheduler can acquire test tasks and determine the network topology corresponding to the test environment based on the test tasks. Based on the network topology, the test environment can be configured to generate a test environment for performance testing of the switch. That is, the test scheduler is used to acquire test tasks and configure the test environment according to the test tasks to obtain the test environment.

[0027] In some embodiments of this application, when the test scheduler obtains a test task, it can first establish a typical MPLS and VPLS network topology based on the test requirements of the test task. By simulating different network topologies, the performance of the switches in various test environments can be comprehensively tested. Specifically, the network topology configuration determined based on the test requirements in this application embodiment may include: point-to-point topology, which simulates a simple switch interconnection method to test the basic data forwarding performance of the switches; star topology, which connects multiple edge switches through a central switch, suitable for testing the performance between multiple VPLS points; and ring topology, which can be used to test network convergence time and ring network failover performance. That is, the test scheduler is also used to establish a switch network topology according to the test task; the test scheduler is also used to configure each switch in the switch network topology to obtain a configured test environment.

[0028] It is understood that a test task may include one or more test task requirements, and the embodiments of this application do not limit this.

[0029] In some embodiments of this application, the switch and routing protocol configuration can also be performed based on a test environment. Specifically, when a configured test environment is obtained, MPLS label switching protocol and VPLS virtualization network services can be configured on the switch device.

[0030] For example, MLPS configuration: MPLS label switching routing protocol can be configured for each switch to enable label switching across multiple routing nodes. VPLS configuration: Virtual Local Area Network (VLAN) and Media Access Control Address (MAC) address learning mechanisms can be configured for each VPLS switch, while ensuring the isolation and data security of the virtual private network.

[0031] It is understood that Label Switching Routing Protocol (LSP) is a protocol used in MPLS networks to automatically distribute and exchange label binding information between devices (such as routers / switches) to establish Label Switching Paths (LSPs). Through LSPs, traditional Internet Protocol (IP) routing can be transformed into high-speed switching based on fixed-length labels. The LSPs used in this application embodiment may be Label Distribution Protocol (LDP), Resource Reservation Protocol (RSVP), etc., and this application embodiment is not limited to these.

[0032] It should be understood that the aforementioned label binding information can be an identifier assigned to a data packet, and each device can make forwarding decisions based on the label binding information. By configuring different network topologies and routing protocols in a test environment, traffic forwarding and switching by switches in a real network environment can be simulated.

[0033] For example, in a VPLS network, a star topology consisting of three switches is configured, with the central switch connected to multiple edge switches. The traffic forwarding and switching process of this VPLS network can be as follows: 1) Data flows from edge switch A and are tagged with VPLS labels. 2) The central switch receives the traffic, parses the labels, and forwards it to the target switch B. 3) During transmission, the MPLS label ensures that the data flows along a predetermined LSP, bypassing the traditional IP routing decision process, thereby improving efficiency and performance. 4) After receiving the data, the target switch B removes the labels and forwards the data to the final target device. This process can simulate real network data flow and help test the forwarding capabilities, latency, and packet loss of the switches.

[0034] It should be noted that, in order to generate test traffic, this application embodiment provides an automated traffic generation scheme. This application embodiment uses a traffic generator within an automated traffic generation module to simulate network traffic of different types and scales. Specifically, the traffic generator can generate test traffic based on the following test task generation parameters: 1. Protocol type: Supports different transmission protocols such as TCP and UDP to meet the needs of different test scenarios. 2. Traffic type: Includes normal traffic, burst traffic, simulated network attack traffic, etc. 3. Traffic size and rate: Dynamically adjusts the traffic size and sending rate according to test requirements. 4. Packet size and interval: Supports setting the size and interval of data packets to simulate different business scenarios. That is, the automated traffic generation module is used to generate test traffic according to the test task; wherein, the test traffic is used for switch performance testing based on the test environment.

[0035] In some embodiments of this application, to achieve continuous monitoring of various performance indicators of each switch, a real-time performance monitoring module is also provided. This real-time performance monitoring module can monitor, but is not limited to, the following network data parameters: 1. Bandwidth usage: Real-time detection of the switch's input / output bandwidth to ensure stability even under high traffic conditions. 2. Latency and jitter: Monitoring data packet transmission latency and calculating latency jitter to evaluate the switch's response speed under different loads. 3. Packet loss rate: Recording packet loss data to help determine network reliability. 4. Route convergence time: Monitoring the route convergence time of MPLS and VPLS switches during topology changes. In other words, the real-time performance monitoring module is used to monitor the network data parameters of the switches when the test traffic is transmitted in the test environment.

[0036] It is understandable that the above network data parameters can be key performance indicators collected by the real-time performance monitoring module from the switch under test and its network, and can be used to quantitatively evaluate the performance of an MPLS / VPLS switch.

[0037] It should be noted that once the network data parameters of each switch in the simulated test environment are determined, data analysis and intelligent report generation can be performed based on these parameters. Specifically, during the testing process, the collected network data parameters can be automatically identified through performance bottleneck analysis, statistical analysis, and trend analysis, thereby obtaining the performance test results of each switch. That is, the data analysis module is used to automatically identify the network data parameters and obtain the performance test results of the switches.

[0038] The switch performance testing system of this application embodiment includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module. The test scheduler is used to acquire test tasks and configure the test environment according to the test tasks to obtain the test environment. The automated traffic generation module is used to generate test traffic according to the test tasks; wherein, the test traffic is used to perform switch performance testing based on the test environment. The real-time performance monitoring module is used to monitor the network data parameters of the switch when the test traffic is transmitted in the test environment. The data analysis module is used to automatically identify the network data parameters to obtain the performance test results of the switch. Because the automated traffic generation module generates test traffic to comprehensively test multiple key performance indicators (such as throughput, latency, packet loss rate, routing convergence time, etc.) of MPLS and VPLS switches simultaneously, it overcomes the limitations of traditional methods that only test a single protocol or single indicator, providing a more complete performance evaluation. The test scheduler enables automatic configuration of the test environment, reducing manual intervention in the testing process and improving testing efficiency.

[0039] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 2 , Figure 2 This is a schematic diagram of the scenario structure provided in Embodiment 2 of the switch performance testing method of this application.

[0040] like Figure 2 As shown in the embodiment of this application, the automated traffic generation module is used to obtain the generated traffic parameters in the test environment according to the test task; The automated traffic generation module is also used to generate test traffic based on the generated traffic parameters.

[0041] In this embodiment of the application, through an automated traffic generation tool, testers can set parameters such as the start time, end time, and packet size of traffic injection according to their needs, to simulate different traffic scenarios such as high load and low load, and fully test the performance of the switch under various load conditions.

[0042] In some embodiments of this application, testers can set traffic injection parameters. Specifically, these parameters may include: (1) start and end times, i.e., determining the time window for traffic injection, which can simulate traffic peaks or troughs during a certain period; (2) packet size, i.e. simulating the transmission of data packets of different sizes, which can test the impact of different packet sizes on network performance. For example, small packets (64 bytes) will increase the processing burden of the switch, while large packets (1500 bytes) may occupy more bandwidth; (3) traffic rate, i.e. specifying the rate of traffic injection, such as how many data packets per second (PPS) or how many bits per second (bps); and (4) traffic mode, which can set different traffic modes, such as constant traffic, burst traffic, or traffic simulating user behavior. Burst traffic can simulate instantaneous peaks in the network, helping to test the switch's ability to handle a large amount of traffic in a short period of time.

[0043] In some embodiments of this application, testers can configure low-load scenarios. For example, (1) start time: traffic is injected starting from the first second after the test begins; (2) end time: low-load state is maintained for the first 10 seconds of the test; (3) packet size: set to a large packet of 1500 bytes to simulate normal network traffic; (4) traffic rate: set to a stable traffic of 10 Mbps, so that the traffic is relatively low and will not put too much pressure on the switch; (5) traffic mode: constant traffic mode, sending 1000 data packets per second to simulate a low-load network environment.

[0044] In some embodiments of this application, testers can set up high-load scenarios. For example, (1) start time: traffic is injected at the 11th second of the test to simulate a sudden network traffic surge; (2) end time: continues until the 20th second of the test to simulate a short-term high traffic surge; (3) packet size: set to a small packet of 64 bytes to test the switch's processing capacity under small packet transmission; (4) traffic rate: set to a traffic rate of 100 Mbps, with the traffic far exceeding the switch's processing capacity; (5) traffic mode: burst traffic, sending 5000 data packets per second to simulate a sudden traffic surge during peak periods in the network.

[0045] The automated traffic generation module in this embodiment obtains the generated traffic parameters under the test environment according to the test task; and generates test traffic based on the generated traffic parameters. Since the generated traffic parameters under the test environment are obtained according to the test requirements of the test task, precise matching and dynamic adaptation between the generated traffic and the test environment are achieved, ensuring that the generated traffic conforms to the current test environment.

[0046] Based on the first and / or second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to the first and / or second embodiments described above can be referred to the above description and will not be repeated hereafter. Based on this, please refer to... Figure 3 , Figure 3 This is a schematic diagram of the functional module structure provided in Embodiment 3 of the switch performance testing system of this application.

[0047] In this embodiment of the application, the data analysis module is further configured to determine the network indicator data corresponding to each switch based on the network data parameters.

[0048] It should be noted that the network data parameters in the embodiments of this application may include bandwidth usage, latency and jitter, packet loss rate, routing convergence time, etc.

[0049] In some embodiments of this application, the judgment conditions of the real-time performance monitoring module can be determined first. Specifically, the judgment conditions may include: (1) Functional adaptability: The real-time performance monitoring module can comprehensively and accurately monitor the above performance indicators. For example, for bandwidth usage, the real-time performance monitoring module can distinguish between input and output bandwidth and can provide real-time feedback on the dynamic changes in bandwidth; for latency and jitter, the real-time performance monitoring module can accurately measure the transmission latency of each data packet and accurately calculate the jitter value; for packet loss rate, the real-time performance monitoring module can reliably record packet loss and avoid omissions or misrecordings; for routing convergence time, the real-time performance monitoring module can capture and record the time required for the routing convergence process in a timely manner when the topology changes. (2) Compatibility: The real-time performance monitoring module can be compatible with the interface protocols (such as SNMP, NetFlow, sFlow, etc.) supported by the switch. Different switches may support different interface protocols, and the real-time performance monitoring module can communicate with the switch through these protocols to obtain accurate performance data. For example, if the switch mainly supports the SNMP protocol, then the real-time performance monitoring module can have complete SNMP protocol parsing and processing capabilities to ensure that it can successfully obtain data from the switch. (3) Performance and stability: When facing high traffic and complex network environments, the real-time performance monitoring module itself can have high performance and stability, and cannot experience problems such as data collection delay, loss or tool crash due to increased network load. For example, in high load scenarios, the real-time performance monitoring module can continuously and stably collect data to ensure the integrity and timeliness of the data. (4) Ease of use and scalability: The real-time performance monitoring module can have a user-friendly interface, making it convenient for testers to configure and operate. At the same time, the real-time performance monitoring module can have good scalability and can adapt to future changes such as network expansion and performance index increases. For example, when it is necessary to add a certain performance index to monitor, the real-time performance monitoring module can easily expand its functions.

[0050] It should be noted that, based on the above judgment conditions, this application embodiment can select a combination of multiple tools to implement the performance monitoring of the real-time performance monitoring module. For example, a general network management tool that supports the SNMP protocol can be used to obtain basic information at the device level, while combining it with a professional network performance analysis tool (such as SolarWinds NetworkPerformance Monitor). This tool has strong functional adaptability, can comprehensively monitor various performance indicators, is compatible with multiple interface protocols, has good performance and stability, and also provides a user-friendly interface and a certain degree of scalability.

[0051] In some embodiments of this application, the real-time performance monitoring module can collect data from the device in real time by integrating with a switch interface (such as SNMP, NetFlow, sFlow, etc.).

[0052] In some embodiments of this application, the real-time performance monitoring module is used to achieve data acquisition and real-time transmission. This module can use network traffic monitoring tools (such as Wireshark and Tshark) to capture network packets, ensuring data integrity and accuracy. These tools can capture and analyze network packets in detail, helping to verify the accuracy of the data collected by the performance monitoring module, and also obtaining additional network information for more in-depth performance analysis. The real-time performance monitoring module in this application can also utilize an SNMP agent, installing data acquisition tools on each switch to monitor device-level performance indicators such as CPU, memory, and interface usage. The SNMP agent can proactively send device performance data to the performance monitoring module at set time intervals, achieving real-time data transmission.

[0053] In some embodiments of this application, the real-time performance monitoring module is used to achieve data storage and access. The real-time performance monitoring module of this application can store the collected performance data in a centralized database, such as MySQL or a time-series database (InfluxDB). MySQL is suitable for storing structured performance data, facilitating complex queries and analysis; while InfluxDB, as a time-series database, can efficiently store and process time-series data, offering advantages for analyzing performance metrics over time. Through the database, testers can easily query and analyze historical test data.

[0054] In some embodiments of this application, during the testing process, various network data parameters can be collected through the tools integrated in the real-time performance monitoring module. By inputting these network data parameters into the data analysis module, the following operations can be performed: (1) Automated identification logic: This application embodiment can use creative technical features based on a combination of threshold and machine learning algorithms to identify performance bottlenecks. First, a reasonable threshold range is set for each performance indicator. When the threshold range is exceeded, it can be considered that there is a problem with the performance indicator. For example, for bandwidth usage, the threshold range of normal bandwidth usage is set to [0, 80%]. When the bandwidth usage exceeds 80%, it is initially determined that there may be a bandwidth bottleneck. For latency, the threshold of normal latency is set to [0, 100ms]. If it exceeds 100ms, it is considered that the latency is too high and there may be a performance problem. (2) Statistical analysis: Statistical analysis is performed on the collected data to calculate key performance indicators such as average, standard deviation, and peak value. For example, calculating the average bandwidth usage over a period of time can help understand the average load of the network; calculating the standard deviation of latency can help assess the fluctuation of latency, and the larger the standard deviation, the more unstable the latency; peak data can help understand the maximum pressure the network bears during the test. (3) Trend analysis: Perform trend analysis on the changes in indicators during the test to help determine the stability and performance continuity of the switch. For example, draw a curve of bandwidth usage over time to observe whether bandwidth usage shows a gradual upward or downward trend, or whether there are periodic fluctuations. If bandwidth usage continues to rise and approaches the upper limit of the switch's processing capacity, it may indicate that the switch will experience a performance bottleneck in the future; if latency gradually increases over time, it may indicate that the switch has a performance degradation problem. That is, the data analysis module is also used to perform statistical analysis based on the network indicator data to determine the performance indicators of the switch; the data analysis module is also used to perform trend analysis based on the network indicator data to determine the performance change trend of the switch; the data analysis module is also used to determine the performance test results of the switch based on the performance indicators and the performance change trend.

[0055] It should be noted that the specific values ​​of the above threshold range, the types and calculation methods of the above key performance indicators, and the specific methods used for trend analysis can be set according to the needs of actual applications, and this application embodiment does not limit them.

[0056] In some embodiments of this application, when the above tests are completed and performance test results are obtained, a visualization report can be generated based on the performance test results by a report generation module. This visualization report may include, but is not limited to: (1) a performance curve graph: presenting the changing trends of indicators such as bandwidth and latency through a time series graph; (2) an indicator comparison graph: comparing the performance of different switches or configurations through bar charts or line graphs to help select the most suitable device; and (3) a detailed diagnostic report: listing possible problems, such as high packet loss rate and excessively long routing convergence time. That is, the system also includes: a report generation module; the report generation module is used to perform switch diagnosis based on the performance test results to obtain switch diagnosis results; the report generation module is also used to generate a performance test report based on the performance test results and the switch diagnosis results.

[0057] In some embodiments of this application, the automated testing framework of the switch performance testing system of this application can be composed of the following core components: (1) Test scheduler: responsible for scheduling and executing various test tasks, automatically configuring devices such as switches, traffic generators, and monitoring tools, and coordinating the test process; (2) Test script: automated scripts written in Python or other scripting languages ​​to execute tasks such as traffic injection, data acquisition, and performance monitoring; (3) Result storage and report generation: automatically saving test results and generating intelligent reports. By using this automated testing framework, testers do not need to manually configure test tasks and test equipment, which greatly improves test efficiency.

[0058] It should be noted that the automated testing framework in this application can use standardized interfaces (such as NetFlow, sFlow, SNMP) to ensure compatibility with MPLS and VPLS switches from different vendors. For devices from different vendors, the system adapts through plug-ins and adapters to ensure that various switches can accurately provide performance data during testing. By integrating MPLS and VPLS devices from multiple vendors for joint testing, the universality of the testing scheme is verified, and compatibility issues between different devices are resolved through comparative testing, log analysis, and other methods.

[0059] This application embodiment uses a data analysis module to determine the network indicator data corresponding to each switch based on network data parameters. Statistical analysis is performed on the network indicator data to determine the switch's performance indicators; trend analysis is performed on the network indicator data to determine the switch's performance change trend; and the performance test results are determined based on the performance indicators and performance change trends. This application embodiment achieves automation and intelligence in the testing process by highly integrating traffic generation, performance monitoring, and result analysis. Furthermore, the automated testing framework adopts a compatibility design, enabling the testing methods to be adapted to MPLS and VPLS equipment from different manufacturers, thus possessing strong universality.

[0060] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the switch performance testing method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0061] This application also provides a method for testing switch performance; please refer to [reference needed]. Figure 4 , Figure 4 This is a flowchart illustrating the switch performance testing method provided in an embodiment of this application. The switch performance testing method is applied to the switch performance testing system described above. The system includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module; the method includes: Step S10: The test scheduler obtains the test task and configures the test environment according to the test task to obtain the test environment; Step S20: The automated traffic generation module generates test traffic according to the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; Step S30: The real-time performance monitoring module monitors the network data parameters of the switch when the test traffic is transmitted in the test environment; In step S40, the data analysis module automatically identifies the network data parameters to obtain the performance test results of the switch.

[0062] The switch performance testing method provided in this application, based on the switch performance testing system in the above embodiments, can solve the technical problem that current tests focus on single network protocols or device function testing, lacking comprehensive performance evaluation under multi-protocol environments. Compared with the prior art, the beneficial effects of the switch performance testing method provided in this application are the same as those of the switch performance testing system provided in the above embodiments, and other technical features in the switch performance testing method are the same as those disclosed in the system of the above embodiments, and will not be repeated here.

[0063] This application provides a switch performance testing device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the switch performance testing method in Embodiment 1 above.

[0064] The following is for reference. Figure 5 The diagram illustrates a structural schematic of a switch performance testing device suitable for implementing embodiments of this application. The switch performance testing device in this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The switch performance testing equipment shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0065] like Figure 5As shown, the switch performance testing equipment may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1002 or a program loaded from storage device 1003 into random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the switch performance testing equipment. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the switch performance testing equipment to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows switch performance testing equipment with various systems, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0066] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0067] The switch performance testing equipment provided in this application, employing the switch performance testing method described in the above embodiments, can solve the technical problem that current tests focus on single network protocols or device function testing, lacking comprehensive performance evaluation under multi-protocol environments. Compared with the prior art, the beneficial effects of the switch performance testing equipment provided in this application are the same as those of the switch performance testing method provided in the above embodiments, and other technical features of this switch performance testing equipment are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0068] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0069] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0070] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, which are used to execute the switch performance testing method in the above embodiments.

[0071] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory, optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0072] The aforementioned computer-readable storage medium may be included in the switch performance testing equipment; or it may exist independently and not be assembled into the switch performance testing equipment.

[0073] The aforementioned computer-readable storage medium carries one or more programs, which, when executed by the switch performance testing equipment, cause the switch performance testing equipment to: The test scheduler acquires test tasks and configures the test environment according to the test tasks to obtain the test environment; The automated traffic generation module generates test traffic based on the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; The real-time performance monitoring module monitors the network data parameters of the switch when the test traffic is transmitted in the test environment. The data analysis module automatically identifies the network data parameters to obtain the performance test results of the switch.

[0074] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0075] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0076] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0077] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described switch performance testing method. This addresses the technical problem that current testing focuses on a single network protocol or device function test, lacking comprehensive performance evaluation under multi-protocol environments. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the switch performance testing method provided in the above embodiments, and will not be repeated here.

[0078] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the switch performance testing method described above.

[0079] The computer program product provided in this application can solve the technical problem that current testing focuses on single network protocol or device function testing, lacking comprehensive performance evaluation in multi-protocol environments. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the switch performance testing method provided in the above embodiments, and will not be repeated here.

[0080] The above description is only a part of the embodiments of this application and does not limit the scope of protection of this application. All equivalent structural transformations made under the technical concept of this application and using the content of this application specification and drawings, or direct / indirect applications in other related technical fields, are included in the scope of protection of this application.

Claims

1. A switch performance testing system, characterized in that, The system includes: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module; The test scheduler is used to acquire test tasks and configure the test environment according to the test tasks to obtain the test environment; The automated traffic generation module is used to generate test traffic according to the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; The real-time performance monitoring module is used to monitor the network data parameters of the switch when the test traffic is transmitted in the test environment; The data analysis module is used to automatically identify the network data parameters and obtain the performance test results of the switch.

2. The switch performance testing system as described in claim 1, characterized in that, The test scheduler is also used to establish the switch network topology based on the test task; The test scheduler is also used to configure each switch in the switch network topology to obtain a configured test environment.

3. The switch performance testing system as described in claim 1, characterized in that, The automated traffic generation module is used to obtain the generated traffic parameters in the test environment according to the test task; The automated traffic generation module is also used to generate test traffic based on the generated traffic parameters.

4. The switch performance testing system as described in claim 1, characterized in that, The data analysis module is also used to determine the network indicator data corresponding to each switch based on the network data parameters.

5. The switch performance testing system as described in claim 4, characterized in that, The data analysis module is also used to perform statistical analysis based on the network indicator data to determine the performance indicators of the switch. The data analysis module is also used to perform trend analysis based on the network indicator data to determine the performance change trend of the switch. The data analysis module is also used to determine the performance test results of the switch based on the performance indicators and the performance change trend.

6. The switch performance testing system as described in claim 1, characterized in that, The system also includes: a report generation module; The report generation module is used to perform switch diagnosis based on the performance test results and obtain switch diagnosis results. The report generation module is also used to generate a performance test report based on the performance test results and the switch diagnostic results.

7. A method for testing the performance of a switch, characterized in that, The switch performance testing method is applied to the switch performance testing system as described in any one of claims 1-6, the system comprising: a test scheduler, an automated traffic generation module, a real-time performance monitoring module, and a data analysis module; the method comprises: The test scheduler acquires test tasks and configures the test environment according to the test tasks to obtain the test environment; The automated traffic generation module generates test traffic based on the test task; wherein, the test traffic is used to perform switch performance testing based on the test environment; The real-time performance monitoring module monitors the network data parameters of the switch when the test traffic is transmitted in the test environment. The data analysis module automatically identifies the network data parameters to obtain the performance test results of the switch.

8. A switch performance testing device, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the switch performance testing method as described in claim 7.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the switch performance testing method as described in claim 7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the switch performance testing method as described in claim 7.

Images