Method and system for automatically testing interaction stability among multiple planes in network communication equipment

Abstract

The invention provides an automatic testing method and system for stability of interaction among multiple planes in network communication equipment, and the method comprises the steps: compiling a test case document through test case management software according to the stability testing requirements of the network communication equipment of an out-of-band model, an in-band model and / or a hybrid model, compiling an automatic test script according to the test case in the test case document; and the test execution software imports the test case document and the automatic test script, and executes the automatic test script of the out-of-band model, the in-band model and / or the hybrid model to complete the automatic test. According to the invention, high-frequency and long-time simulation of all interaction scenes can be realized to test the stability of the equipment management channel, test errors caused by manual test are avoided, and the human resource cost is saved; meanwhile, parallel management channel stability testing of multiple execution machines, multiple types of equipment and multiple network testing environments can be achieved by deploying multiple execution environments, and the testing efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of network communication equipment testing, and in particular to an automated testing method and system for the interaction stability between multiple planes within a network communication equipment. Background Art

[0002] like Figure 1 As shown, the current network communication equipment system is usually composed of a management plane and a business plane. The management plane mainly serves as a human-machine interface for parameter configuration. Users use the management plane to complete equipment management, parameter configuration, status query and other functions involving interaction between the two planes. The business plane forwards and processes network business traffic according to the configuration parameters issued by the management plane. The two planes interact through the internal channel of the device, which is the device management channel (hereinafter referred to as the "management channel"). The stability of data interaction between devices through the management channel determines the stability of the internal interaction between the two planes. Therefore, the stability of data interaction in the device management channel has a crucial impact on the stability of network communication equipment business processing.

[0003] Currently, the interaction stability test of the management channel of network communication equipment can only be carried out by manually operating the business system construction of the management plane to simulate the data interaction between the two planes and conduct a limited number of tests. It is impossible to test the stability of the equipment management channel at a high frequency, for a long time, and by simulating all interaction scenarios. Summary of the invention

[0004] The present invention aims to provide a method and system for automated testing of the interaction stability between multiple planes within a network communication device, so as to solve the difficulty of testing the interaction stability between multiple planes within the above-mentioned network communication device.

[0005] The present invention provides an automated testing method for the stability of interaction between multiple planes within a network communication device, comprising:

[0006] Prepare test cases through test case management software according to the test requirements of out-of-band model, in-band model and / or hybrid model of network communication equipment stability test, and prepare automated test scripts based on the test cases;

[0007] The test execution software imports the test case documents and automated test scripts, and executes the automated test scripts to complete the automated test:

[0008] When executing the automated test script of the out-of-band model, the test execution software calls the user operation simulation software, and the user operation simulation software directly calls the user configuration software running on the management plane of the network communication device under test to perform stability testing, and writes the stability test results back to the test case document;

[0009] When executing the automated test script of the in-band model, the test execution software calls the user operation simulation software, and the user operation simulation software calls the in-band management traffic simulation software to perform stability testing, and writes the stability test results back to the test case document;

[0010] When executing the automated test script of the hybrid model, the test execution software calls the user operation simulation software, the user operation simulation software calls the in-band management traffic simulation software and the user configuration software of the tested network communication equipment management platform to perform stability testing, and writes the stability test results back to the test case document.

[0011] In some embodiments, when executing an automated test script of an out-of-band model, the test execution software calls the user operation simulation software according to the protocol, and the user operation simulation software calls the user configuration software to simulate the operations of the business plane of the network communication device under test to perform device management, parameter configuration, and status query, thereby constructing a long-term top-down interaction scenario between the management plane and the business plane in the network communication device under test, thereby completing the stability test.

[0012] In some embodiments, when executing an automated test script of an in-band model, the test execution software calls the user operation simulation software, the user operation simulation software sends management protocol messages including device management, parameter configuration and status query operations to the in-band management traffic simulation software, the in-band management traffic simulation software forwards the management protocol messages to the business plane of the network communication device under test, the business plane sends the management protocol message related data to the management plane, the management plane returns the configuration or query results, thereby constructing a long-term interaction scenario from bottom to top between the management plane and the business plane in the network communication device under test, thereby completing the stability test.

[0013] In some embodiments, when executing the automated test script of the hybrid model, the automated test scripts of the out-of-band model and the in-band model are executed concurrently or alternately.

[0014] In some embodiments, the execution time and stability test results of each stability test are recorded, and when the expected number of tests is reached, a stability test performance curve and a success rate report are generated.

[0015] In some embodiments, the automated test scripts have a one-to-one correspondence with the test cases in the test case document.

[0016] In some embodiments, the writing of the test case document follows a unified format; the components of the test case in the test case document include the test case name, test model, prerequisites, test steps, execution times and expected results.

[0017] The present invention also provides an automated testing system for the interaction stability between multiple planes within a network communication device, comprising an automated testing execution machine and an in-band management traffic simulation server connected to each other; the automated testing execution machine and the in-band management traffic simulation server are both connected to each network communication device under test;

[0018] The automated test execution machine runs test case management software, test execution software and user operation simulation software; the in-band management traffic simulation server runs in-band management traffic simulation software;

[0019] The test case management software, test execution software, user operation simulation software and in-band management traffic simulation software are used to execute the above-mentioned automated testing method for the stability of interaction between multiple planes within the network communication device.

[0020] In some embodiments, the test execution software and the user operation simulation software define an internal communication protocol, including data format, command type, and error handling mechanism.

[0021] In some embodiments, the automated test execution machine, the in-band management traffic simulation server, and the network communication device under test are connected via Ethernet.

[0022] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0023] The present invention can simulate all interactive scenarios for high frequency and long time to test the stability of the device management channel, avoid the waste of human resources caused by manual operation, and at the same time can realize parallel management channel stability testing of multiple execution machines, multiple types of equipment, and multiple network test environments by deploying multiple execution environments, thereby achieving higher testing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of the logical structure of network communication equipment.

[0025] Figure 2 Schematic diagram of the software architecture in the system and the method for automated testing of the stability of interactions between multiple planes within a network communication device in an embodiment of the present invention.

[0026] Figure 3 The present invention is a flowchart of a method for automatically testing the stability of interactions between multiple planes within a network communication device according to an embodiment of the present invention.

[0027] Figure 4 Schematic diagram of a typical environment of a system for automatically testing the stability of interactions between multiple planes within a network communication device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0029] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] Design principle:

[0031] like Figure 2 As shown, an automated testing method for the interaction stability between multiple planes within a network communication device proposed in an embodiment of the present invention is implemented by combining four major software systems: test case management software, user operation simulation software, test execution software, and in-band management traffic simulation software.

[0032] This method implements three management channel stability automation test models: in-band model, out-of-band model and hybrid model by scheduling four major software systems.

[0033] The in-band model refers to a test model of the interaction scenario between the management plane and the business plane by simulating the business traffic of the device management, parameter configuration, status query and other operations of the network communication device under test, and then sending the business traffic to the business plane of the network communication device under test. The business plane uploads the traffic to the management plane through the management channel for processing and returns the result along the original path.

[0034] The out-of-band model refers to calling the user configuration software running on the management plane of the network communication device under test to simulate the equipment management, parameter configuration, status query and other operations of the network communication device under test, and constructing a test model for the interaction scenario between the management plane and the business plane in the network communication device under test.

[0035] The hybrid model described in the present invention refers to a test model that executes the out-of-band model and the in-band model concurrently (in-band and out-of-band are executed simultaneously) or alternately.

[0036] The user configuration software is software running on the management plane of the network communication device under test, and the user configuration software provides a human-machine interface for the network communication device user to manage the device.

[0037] Based on the above design principles, such as Figure 3As shown, an automatic testing method for the interaction stability between multiple planes in a network communication device proposed in an embodiment of the present invention includes the following steps:

[0038] S100, compiling a test case document through a test case management software according to the test requirements of an out-of-band model, an in-band model and / or a hybrid model of a network communication device stability test, and compiling an automated test script according to the test cases in the test case document;

[0039] S200, the test execution software imports the test case documents and automated test scripts, and executes the automated test scripts to complete the automated test:

[0040] When executing the automated test script of the out-of-band model, the test execution software calls the user operation simulation software, and the user operation simulation software directly calls the user configuration software running on the management plane of the network communication device under test to perform stability testing, and writes the stability test results back to the test case document;

[0041] When executing the automated test script of the in-band model, the test execution software calls the user operation simulation software, and the user operation simulation software calls the in-band management traffic simulation software to perform stability testing, and writes the stability test results back to the test case document;

[0042] When executing the automated test script of the hybrid model, the test execution software calls the user operation simulation software, the user operation simulation software calls the in-band management traffic simulation software and the user configuration software of the tested network communication equipment management platform to perform stability testing, and writes the stability test results back to the test case document.

[0043] In some embodiments, the out-of-band model is performed by directly calling the user configuration software of the network communication device under test. In the out-of-band model, the test execution software interacts with the network communication device under test through the user operation simulation software, and automatically calls the user configuration software in the network communication device under test through the user operation simulation software to simulate user operations, and continuously sends operations such as device management, parameter configuration, and status query for the business plane of the network communication device under test for a long time and high frequency. In this way, testers can verify whether the management channel can stably send or query configuration and status information to the business plane under the out-of-band model. Therefore, when executing the automated test script of the out-of-band model, the automated test method for the stability of interactions between multiple planes within the network communication device specifically includes the following steps:

[0044] S211, compile a test case document through a test case management software according to the device model and the network communication device stability test requirements of the management channel stability out-of-band model.

[0045] S212, compile an automated test script according to the test cases in the test case document.

[0046] S213, the test execution software imports the test case documents and automated test scripts.

[0047] S214, execute the automated test script to complete the automated test: the test execution software calls the user operation simulation software, the user operation simulation software sends management protocol messages including device management, parameter configuration and status query operations to the in-band management traffic simulation software, the in-band management traffic simulation software forwards the management protocol messages to the business plane of the network communication device under test, the business plane sends the management protocol message related data to the management plane, and the management plane returns the configuration or query results.

[0048] S215, the test execution software calculates the time for completing the test execution and the result of the test execution and saves them.

[0049] S216, the test execution software determines whether the expected number of tests for this round of stability test is reached. If so, a stability test performance curve and a success rate report are generated; if not, the next test is continued.

[0050] In some embodiments, the in-band model is a test of management operations by uploading management data to the management plane through the management channel through the business plane of the network communication device under test. This method is usually used for remote management and maintenance of equipment. In the in-band model, the in-band management traffic simulation server running the in-band management traffic simulation software is connected to the business network port of the business plane of the network communication device under test, and the test execution software sequentially calls the user operation simulation software and the in-band management traffic simulation software to perform high-frequency and long-term continuous operations such as device management, parameter configuration, and status query to verify the stability of the management channel under the in-band model. Therefore, when executing the automated test script of the in-band model, the automated test method for the stability of interactions between multiple planes within the network communication device specifically includes the following steps:

[0051] S221, compile a test case document through test case management software according to the device model and the network communication device stability test requirements of the management channel stability in-band model.

[0052] S222, compile an automated test script according to the test cases in the test case document.

[0053] S223, the test execution software imports the test case documents and automated test scripts.

[0054] S224, execute the automated test script to complete the automated test: the test execution software calls the user operation simulation software, the user operation simulation software sends management protocol messages including device management, parameter configuration and status query operations to the in-band management traffic simulation software, the in-band management traffic simulation software forwards the management protocol messages to the business plane of the network communication device under test, the business plane sends the management protocol message related data to the management plane, the management plane returns the configuration or query results, thereby constructing a long-term interaction scenario from bottom to top between the management plane and the business plane in the network communication device under test, thereby completing the stability test.

[0055] S225, the test execution software calculates the time for completing the test execution and the result of the test execution and saves them.

[0056] S226, the test execution software determines whether the expected number of tests for this round of stability test has been reached. If so, a stability test performance curve and a success rate report are generated; if not, the next test is continued.

[0057] In some embodiments, the hybrid model combines the characteristics of both the in-band model and the out-of-band model. The hybrid model supports both concurrent execution of the two test models and alternating execution of the two test models. On the one hand, the stability of the communication device interacting through the management channel when the two test models are executed concurrently is verified; on the other hand, the stability of the switching of the management mode of the communication device management channel is verified. Therefore, when executing the automated test script of the hybrid model, the automated test method for the stability of the interaction between multiple planes within the network communication device specifically includes the following steps:

[0058] S231, compile a test case document through test case management software according to the device model and the network communication device stability test requirements of the management channel stability hybrid model.

[0059] S232, compile an automated test script according to the test cases in the test case document.

[0060] S233, the test execution software imports the test case documents and automated test scripts.

[0061] S234, concurrently or alternately execute the automated test scripts of the out-of-band model and the in-band model to complete the automated test:

[0062] The test execution software calls the user operation simulation software. The user operation simulation software can simultaneously send equipment management, parameter configuration and status query operations on the business plane of the network communication equipment under test to the in-band management traffic simulation software and the management plane of the network communication equipment under test according to the parallel execution parameters sent by the test execution software, and receive the result data returned by the network communication equipment under test respectively.

[0063] The test execution software calls the user operation simulation software. The user operation simulation software can send equipment management, parameter configuration and status query operations on the network communication equipment under test to the in-band management traffic simulation software and the management plane of the network communication equipment under test in turn according to the alternating execution parameters sent by the test execution software, and receive the result data returned by the management plane of the network communication equipment under test and the in-band management traffic simulation software respectively.

[0064] S235, the test execution software calculates the time when the test is completed and the result of the test execution and saves them.

[0065] S236, the test execution software determines whether the expected number of tests for this round of stability test has been reached. If so, a stability test performance curve and a success rate report are generated; if not, the next test is continued.

[0066] In order to realize the above-mentioned automated testing method for the interaction stability between multiple planes within the network communication equipment, as Figure 4 As shown, the corresponding provided automated test system for the interaction stability between multiple planes within a network communication device includes an automated test execution machine and an in-band management traffic simulation server connected to each other; the automated test execution machine and the in-band management traffic simulation server are both connected to each network communication device under test;

[0067] The automated test execution machine runs test case management software, test execution software and user operation simulation software; the in-band management traffic simulation server runs in-band management traffic simulation software;

[0068] The test case management software, test execution software, user operation simulation software and in-band management traffic simulation software are used to execute the above-mentioned automated testing method for the stability of interaction between multiple planes within the network communication device.

[0069] In some embodiments, the automated test execution machine, the in-band management traffic simulation server and the network communication device under test are connected via Ethernet, such as Figure 4 In the example, Ethernet connection is achieved through a network switch.

[0070] In some embodiments, the test execution software is one of the key components to ensure the efficient implementation of the present invention, and runs on an automated test execution machine. Testers can use the test execution software to batch import test case documents and automated test scripts. The automated test scripts have a one-to-one correspondence with the test cases in the test case documents, so the test execution software has a matching function, which can automatically identify and establish an association relationship between the automated test scripts and the test cases in the test case documents. This process is the basis for feeding back and writing detailed test results into the original test case documents when performing stability testing. In this way, testers can easily analyze the test results, thereby improving the transparency and efficiency of the testing process.

[0071] In some embodiments, the test execution software provides an execution environment for the automated test script and interacts with the user operation simulation software. The automated test script passes the relevant data required for device management, parameter configuration and / or status query of the tested network communication device in the test case document to the user operation simulation software in an agreed format. Therefore, the test execution software can configure and design the following mechanisms:

[0072] (1) Execution environment: The test execution software provides a platform on which automated test scripts can be executed, including a runtime environment that is capable of interpreting or compiling the scripting language and providing the necessary system resources (such as memory, CPU, etc.) to run the test.

[0073] (2) Calling interface: The test execution software contains a large number of API interfaces, which allow the automated test script to interact with the user operation simulation software. This interaction mainly includes operations such as management of the network communication equipment under test, parameter configuration, and status query.

[0074] (3) Parameter transfer: Through the above API interface, the automated test script can transfer the data specified by the test case in the test case document to the user operation simulation software in a predefined format. The specified data includes relevant data parameters for device management, parameter configuration, status query and other operations of the network communication device under test, which are used to simulate the interaction scenario between the management plane and the business plane.

[0075] (4) The test execution software and the user operation simulation software are connected via an Ethernet network to achieve mutual communication between the software. This mechanism ensures reliable communication between the two.

[0076] (5) Communication protocol design: The test execution software and user operation simulation software define internal communication protocols, including data format, command type and error handling mechanism, to ensure the accuracy and consistency of data transmission. Among them, the message data format is transmitted according to a custom and easy-to-parse data message protocol to facilitate data exchange across systems; the command types mainly include initialization request, test data transmission, execution command, status acquisition, return result, etc.

[0077] (6) Calling the automated test script: The test execution software sends the test case parameters defined in the automated test script to the user operation simulation software via the Ethernet network. These parameters mainly include data related to the device management, parameter configuration, status query and other operations of the network communication device under test. After receiving the data related to these operations, the user operation simulation software performs the next step of processing according to the relevant data.

[0078] (7) Status feedback and result return: After the user operation simulation software completes the corresponding operation, it will feed back the execution result to the test execution software via Ethernet. The result may include a success flag, error code, log information, etc., for the test execution software to analyze and record the test results. The test execution software updates the execution result in the test case document based on the received result, and may continue to call the user operation simulation software to perform the next step according to the automated test script corresponding to the subsequent test case.

[0079] In some embodiments, the user operation simulation software is one of the key components of the stability test, running on the automated test execution machine, and mainly includes three functions:

[0080] (1) Provide a calling interface for the test execution software;

[0081] (2) Call the user configuration software of the network communication device under test through the Ethernet interface to perform equipment management, parameter configuration, status query and other operations;

[0082] (3) Sending business traffic corresponding to operations such as management, parameter configuration, and status query of the network communication equipment under test to the in-band management traffic simulation software via Ethernet simulates the interaction scenario between the management plane and the business plane.

[0083] The user operation simulation software integrates the user management configuration interface automation operation interface of different models of the tested network communication equipment through interface integration. The test execution software calls these operation interfaces through the software interaction protocol to simulate the interaction scenario between the management plane and the business plane for the equipment management, parameter configuration, status query and other operations of the tested network communication equipment. After the operation is completed, the operation result fed back by the tested network communication equipment through the user configuration software is received and sent to the test execution software.

[0084] The user operation simulation software integrates a protocol conversion function, which is mainly used for in-band models and hybrid models. The protocol conversion function is to convert the device management, parameter configuration, status query and other operations of the tested network communication equipment into corresponding management protocol messages according to the agreed protocol format, and send the management protocol message to the in-band management traffic simulation software via Ethernet. After the sending is completed, the user operation simulation software receives the operation execution result message fed back by the in-band management traffic simulation software, and parses the management protocol message according to the protocol format. The user operation simulation software parses the fedback management protocol message and sends the result to the test execution software, and the test execution software determines whether the operation is successful based on the result.

[0085] The management protocol message refers to a specific protocol message that, after receiving the management protocol message, the service plane uploads the management protocol message to the management plane for processing and returns a processing result message according to the protocol corresponding to the management protocol message.

[0086] In some embodiments, the in-band management traffic simulation software is one of the key components for in-band stability testing and runs on an in-band management traffic simulation server. The in-band management traffic simulation server that provides an operating environment for the in-band management traffic simulation software has multiple network interfaces, one of which is interconnected with an automated test execution machine, and the other network interfaces are interconnected with Ethernet or optical ports of the network communication device under test.

[0087] The in-band management traffic simulation software mainly includes two functions: management protocol message forwarding and receiving user operation simulation software control.

[0088] Management protocol message forwarding function: (1) After receiving the management protocol message sent by the user operation simulation software, forward the management protocol message to the Ethernet or optical interface of the business plane of the network communication device under test; (2) Receive the management protocol message sent by the business plane of the network communication device under test and forward the management protocol message to the user operation simulation software via Ethernet.

[0089] Receive user operation simulation software control function: The user operation simulation software sends control commands to the in-band management traffic simulation software through Ethernet according to a custom protocol. The control commands mainly include continuously sending management messages at a certain rate, stopping sending, starting sending, sending times, etc.

[0090] In some embodiments, the test case management software is a human-machine interface for testers to compile test cases, which consists of test case documents and automated test scripts described in natural language. The test case management software manages the organization, association and storage of channel stability test case documents and automated test scripts to ensure the structured and orderly nature of the test cases. The test case management software tracks test execution results and summarizes and queries test data.

[0091] The writing of the test case document follows a unified format to facilitate testers to accurately design, execute and maintain test cases. In some embodiments, the components of the test case in the test case document include the test case name, test model, prerequisites, test steps, execution times and expected results. The specific description is as follows:

[0092] (1) Test case name: Describe the purpose and function of the test case concisely and clearly.

[0093] (2) Test model: out-of-band model / in-band model / hybrid model.

[0094] (3) Preconditions: Define the state or configuration that needs to be met before executing the test case, including the execution step number of the prerequisite, the execution operation of the prerequisite, and the expected execution result.

[0095] (4) Test steps: List the specific steps for executing the test in detail. Each step includes the serial number, the operation to be performed, and the expected result.

[0096] (5) Number of executions: Indicates the number of times the test case needs to be executed to ensure the adequacy of the test.

[0097] (6) Expected results: Describe the expected results after each step is completed, which is used to verify whether the test is successful.

[0098] Testers need to design corresponding test cases based on different device models and characteristics, and record them in detail in the automated test documentation.

[0099] Based on detailed test case documents, testers use automated test script languages ​​to design and implement automated test scripts. According to the test prerequisites, specific test steps, and expected test results, these static descriptions are converted into dynamic, executable code logic, thereby automatically executing test tasks, collecting test results, and writing the results back to the test case documents.

[0100] Furthermore, when writing automated test scripts, testers can improve the maintainability and readability of the scripts through the one-to-one correspondence between the automated test scripts and the test cases in the test case documents. By adopting a modular design approach and a reasonable exception handling mechanism, they can ensure that the automated test scripts can adapt to changes in future software versions and can provide timely feedback when abnormal situations occur, facilitating subsequent troubleshooting and repair.

[0101] In addition, testers can customize different test cases according to different device models to support diverse test scenarios, which can achieve the versatility of automated test scenarios.

[0102] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An automated testing method for the stability of multi-plane interactions within a network communication device, characterized in that: include: Prepare test case documents through test case management software according to the test requirements of out-of-band model, in-band model and / or hybrid model of network communication equipment stability test, and prepare automated test scripts based on the test cases in the test case documents; The test execution software imports the test case documents and automated test scripts, and executes the automated test scripts to complete the automated test: When executing the automated test script of the out-of-band model, the test execution software calls the user operation simulation software, and the user operation simulation software directly calls the user configuration software running on the management plane of the network communication device under test to perform stability testing, and writes the stability test results back to the test case document; When executing the automated test script of the in-band model, the test execution software calls the user operation simulation software, and the user operation simulation software calls the in-band management traffic simulation software to perform stability testing, and writes the stability test results back to the test case document; When executing the automated test script of the hybrid model, the test execution software calls the user operation simulation software, the user operation simulation software calls the in-band management traffic simulation software and the user configuration software of the tested network communication equipment management platform to perform stability testing, and writes the stability test results back to the test case document.

2. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: When executing the automated test script of the out-of-band model, the test execution software calls the user operation simulation software according to the protocol, and the user operation simulation software calls the user configuration software to simulate the operations of the business plane of the network communication device under test to perform device management, parameter configuration and status query, thereby constructing a long-term top-down interaction scenario between the management plane and the business plane in the network communication device under test, thereby completing the stability test.

3. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: When executing the automated test script of the in-band model, the test execution software calls the user operation simulation software, and the user operation simulation software sends management protocol messages including device management, parameter configuration and status query operations to the in-band management traffic simulation software. The in-band management traffic simulation software forwards the management protocol messages to the business plane of the network communication device under test. The business plane sends the management protocol message related data to the management plane, and the management plane returns the configuration or query results, thereby constructing a long-term interaction scenario from bottom to top between the management plane and the business plane in the network communication device under test, thereby completing the stability test.

4. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: When executing the automated test script of the hybrid model, the automated test scripts of the out-of-band model and the in-band model are executed concurrently or alternately.

5. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: Record the execution time and stability test results of each stability test. When the expected number of tests is reached, generate a stability test performance curve and success rate report.

6. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: The automated test scripts have a one-to-one correspondence with the test cases in the test case document.

7. The method for automated testing of the stability of interaction between multiple planes within a network communication device according to claim 1, characterized in that: The writing of the test case document follows a unified format; the components of the test case in the test case document include the test case name, test model, prerequisites, test steps, execution times and expected results.

8. An automated testing system for the stability of multi-plane interactions within a network communication device, characterized in that: It includes an automated test execution machine and an in-band management traffic simulation server connected to each other; the automated test execution machine and the in-band management traffic simulation server are both connected to each network communication device under test; The automated test execution machine runs test case management software, test execution software and user operation simulation software; the in-band management traffic simulation server runs in-band management traffic simulation software; The test case management software, test execution software, user operation simulation software and in-band management traffic simulation software are used to execute the automated testing method for the interaction stability between multiple planes within a network communication device as described in any one of claims 1-7.

9. The automated testing system for the interaction stability between multiple planes within a network communication device according to claim 8, characterized in that: The test execution software and user operation simulation software define internal communication protocols, including data formats, command types and error handling mechanisms.

10. The automated testing system for the interaction stability between multiple planes inside a network communication device according to claim 8, characterized in that: The automated test execution machine, the in-band management traffic simulation server and the tested network communication device are connected via Ethernet.

Images