Performance index testing method, device and system and computer equipment

Abstract

The invention relates to a performance index testing method, device and system and computer equipment. The method is applied to test equipment and comprises the following steps: acquiring rule issuing time of a plurality of test rules; and obtaining the receiving time of the effective flow message corresponding to each test rule, testing the performance index of each test rule according to the issuing time of each rule and the receiving time of each effective flow message, and determining the performance index test result of each test rule, each effective flow message is obtained after the network equipment takes effect on each test rule. By adopting the method, the rule issuing time of a plurality of test rules and the receiving time of the effective flow message corresponding to each test rule can be obtained at the same end, namely, the test end, so that clock skew generated when the rule issuing time and the receiving time are obtained at the two ends respectively can be eliminated, and on the basis, the test efficiency is improved. Performance indexes of all test rules can be accurately tested, and the accuracy of performance index test results is improved.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a performance indicator testing method, device, system and computer equipment. Background Art

[0002] With the development of communication technology, network equipment is widely used. Among them, determining the performance of network equipment plays an important role in measuring whether the network equipment can operate normally. In practical applications, the performance of network equipment can be determined by testing the performance indicators of each network rule in the network equipment.

[0003] Taking the performance indicator of rule effectiveness delay as an example, in the relevant technology, the rule effectiveness delay of each test rule is mainly tested based on the rule issuance time collected when the test device sends the test rule to the network device and the transfer time of the rule effectiveness traffic after the network device responds to the test rule, to determine the rule effectiveness delay test result of each test rule.

[0004] However, in the related art, when testing the performance indicators of network rules, there is a problem of inaccurate test results. Summary of the invention

[0005] Based on this, it is necessary to provide a performance indicator testing method, device, system and computer equipment to address the above technical problems, which can improve the accuracy of test results in the process of testing the performance indicators of network rules.

[0006] In a first aspect, an embodiment of the present application provides a performance indicator testing method, which is applied to a testing device, and the method includes:

[0007] Obtain the rule issuing time of multiple test rules; and obtain the receiving time of the valid flow message corresponding to each test rule; each valid flow message is obtained after the network device takes effect for each test rule;

[0008] According to the issuing time of each rule and the receiving time of each valid traffic message, the performance index of each test rule is tested to determine the performance index test result of each test rule.

[0009] The technical solution in the embodiment of the present application is applied to a test device to obtain the rule issuance time of multiple test rules; and to obtain the reception time of the valid traffic message corresponding to each test rule, and according to the issuance time of each rule and the reception time of each valid traffic message, the performance indicator of each test rule is tested to determine the performance indicator test result of each test rule, wherein each valid traffic message is obtained after the network device takes effect for each test rule; the above method can obtain the rule issuance time of multiple test rules and the reception time of the valid traffic message corresponding to each test rule at the same end, that is, the test end, thereby eliminating the clock deviation generated when the rule issuance time and the reception time are obtained at both ends respectively, and on this basis, the performance indicator of each test rule can be tested. Carry out precise testing, improve the accuracy of performance indicator test results, and improve the reliability of performance indicator test results; at the same time, the above method can obtain the rule issuance time and reception time under the same clock (i.e., the same end), so as to avoid the process of executing clock conversion for the rule issuance time and reception time, thereby speeding up the test speed of performance indicators and improving the test efficiency of performance indicators; in addition, the above method tests the performance indicators of different test rules through the same set of solutions, which can improve the reliability of the performance indicator test results of different test rules; furthermore, the above method only requires one test device to realize the performance indicator test of each test rule of the network device, and this method greatly simplifies the operational difficulty of setting up the test environment and executing the test.

[0010] In one embodiment, obtaining the receiving time of the valid flow message corresponding to each test rule includes:

[0011] Obtaining valid traffic messages corresponding to each test rule sent by the network device, and adding a timestamp to each valid traffic message;

[0012] The receiving time of each valid flow message is determined according to the timestamp of each valid flow message.

[0013] The technical solution in the embodiment of the present application obtains the valid flow message corresponding to each test rule sent by the network device, adds a timestamp to each valid flow message, and determines the receiving time of each valid flow message according to the timestamp of each valid flow message; in the above method, the test device can simultaneously obtain the receiving time of each valid flow message, so that the rule issuance time and the receiving time of each valid flow message are obtained under the same clock, which can eliminate the clock deviation generated when the rule issuance time and the receiving time are obtained at both ends, so as to provide a reliable timestamp for subsequent performance indicator tests and avoid affecting the subsequent performance indicator test processing; at the same time, the above method can obtain each valid flow message forwarded by the network device, so as to help the test device obtain the receiving time of each valid flow message at the same end; in addition, the performance indicator test system in the above method supports the test device to capture packets through two-end communication to receive each valid flow message sent by the network device, and then can obtain the receiving time of each valid flow message at the same end, so as to provide reliable rule issuance time and receiving time for further testing.

[0014] In one embodiment, the timestamp of the valid traffic message includes the timestamps of multiple sub-messages; and determining the receiving time of each valid traffic message according to the timestamp of each valid traffic message includes:

[0015] For any test rule, obtain the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule;

[0016] The minimum timestamp is determined as the time when the valid traffic message of the test rule is received.

[0017] The technical solution in the embodiment of the present application, for any test rule, obtains the minimum timestamp among the timestamps of each sub-message in the effective traffic message of the test rule, and determines the minimum timestamp as the receiving time of the effective traffic message of the test rule; the above method can be applicable to scenarios in which each test rule includes multiple sub-rules, so that the accuracy of the receiving time of the effective traffic message of the test rule obtained in such complex scenarios is higher; at the same time, the above method does not require the participation of complex algorithms, thereby reducing the complexity of obtaining the receiving time of the effective traffic message in such complex scenarios, and improving the speed and efficiency of obtaining the receiving time of the effective traffic message.

[0018] In one embodiment, the performance index of each test rule is tested according to the issuing time of each rule and the receiving time of each valid traffic message, and the performance index test result of each test rule is determined, including:

[0019] According to the issuing time of each rule and the receiving time of the valid flow message of each test rule, the performance index value of each test rule is obtained;

[0020] Obtain the maximum performance indicator value among the performance indicator values ​​of each test rule;

[0021] According to the maximum performance indicator value, the performance indicator test result of each test rule is determined.

[0022] The technical solution in the embodiment of the present application obtains the performance indicator value of each test rule according to the issuance time of each rule and the reception time of the valid traffic message of each test rule, obtains the maximum performance indicator value among the performance indicator values ​​of each test rule, and determines the performance indicator test result of each test rule according to the maximum performance indicator value; the above method does not require the participation of complex algorithms, thereby speeding up the determination of performance indicator test results and improving the efficiency of determining performance indicator test results, and the above method does not require testers to learn additional professional knowledge, which can reduce the complexity of the performance indicator testing method; in addition, the above method determines the performance indicator value of the test rule through the rule issuance time and reception time obtained under the same clock, which can improve the accuracy and reliability of the performance indicator value, and on this basis, can improve the correctness of the determined performance indicator test result.

[0023] In one embodiment, determining the performance indicator test result of each test rule according to the maximum performance indicator value includes:

[0024] When the maximum performance indicator value is greater than the preset indicator threshold, the performance indicator test result of each test rule is determined to be a test failure;

[0025] When the maximum performance indicator value is less than the indicator threshold, the performance indicator test result of each test rule is determined to be a test pass.

[0026] The technical solution in the embodiment of the present application can determine the performance indicator test result of each test rule as test failure when the maximum performance indicator value is greater than the preset indicator threshold, and determine the performance indicator test result of each test rule as test pass when the maximum performance indicator value is less than the indicator threshold. The above method can determine the performance indicator test result of the test rule according to the size relationship between the maximum performance indicator value and the indicator threshold. The processing process is relatively simple and does not require the participation of complex algorithms, thereby speeding up the determination of the performance indicator test results and improving the efficiency of determining the performance indicator test results.

[0027] In one embodiment, the method further comprises:

[0028] Determine the performance test results of the network equipment based on the performance indicator test results of each test rule.

[0029] The technical solution in the embodiment of the present application can determine the performance test results of the network device based on the performance indicator test results of each test rule, so as to provide reference information for whether the network device can operate normally, and can also provide reference information for optimizing the performance of the network device to ensure the reliability of the network device.

[0030] In a second aspect, an embodiment of the present application provides a performance indicator testing method, which is applied to a network device, and the method includes:

[0031] In response to multiple test rules sent by the test device, each test rule is validated to obtain a valid flow message corresponding to each test rule;

[0032] The valid traffic message corresponding to each test rule is sent to the test equipment, which instructs the test equipment to obtain the receiving time of the valid traffic message corresponding to each test rule, and tests the performance index of each test rule according to the rule issuing time of each test rule and the receiving time of each valid traffic message.

[0033] The technical solution in the embodiment of the present application is applied to a network device, and in response to multiple test rules sent by the test device, each test rule is validated, and a valid flow message corresponding to each test rule is obtained, and the valid flow message corresponding to each test rule is sent to the test device, instructing the test device to obtain the receiving time of the valid flow message corresponding to each test rule, and according to the rule issuance time of each test rule and the receiving time of each valid flow message, the performance indicator of each test rule is tested; the above method can obtain the rule issuance time of multiple test rules and the receiving time of the valid flow message corresponding to each test rule at the same end, that is, the test end, thereby eliminating the clock deviation generated when the rule issuance time and the receiving time are obtained at both ends respectively, and on this basis, each test rule can be tested. The performance indicators of the test rules are accurately tested, the accuracy of the performance indicator test results is improved, and the reliability of the performance indicator test results is improved; at the same time, the above method can obtain the rule issuance time and the receiving time under the same clock (that is, the same end), so that the process of performing clock conversion on the rule issuance time and the receiving time can be avoided, thereby speeding up the test speed of the performance indicators and improving the test efficiency of the performance indicators; in addition, the above method tests the performance indicators of different test rules through the same set of solutions, which can improve the reliability of the performance indicator test results of different test rules; furthermore, the above method only requires one test device to realize the performance indicator test of each test rule of the network device, and this method greatly simplifies the operational difficulty of setting up the test environment and executing the test.

[0034] In one embodiment, each test rule is validated to obtain a valid flow message corresponding to each test rule, including:

[0035] According to each test rule, each test flow message is matched and processed to obtain a valid flow message corresponding to each test rule.

[0036] The technical solution in the embodiment of the present application can match and process each test traffic message according to each test rule to obtain a valid traffic message corresponding to each test rule, and then forward the valid traffic message to the test equipment to help improve the accuracy of the performance indicator test results.

[0037] In a third aspect, an embodiment of the present application provides a performance indicator testing device, the device comprising:

[0038] An acquisition module is used to acquire the rule issuing time of multiple test rules; and to acquire the receiving time of the valid flow message corresponding to each test rule; each valid flow message is obtained after the network device takes effect for each test rule;

[0039] The test module is used to test the performance index of each test rule according to the issuance time of each rule and the reception time of each valid flow message, and determine the performance index test result of each test rule.

[0040] In a fourth aspect, an embodiment of the present application provides a performance indicator testing device, the device comprising:

[0041] A response module, used for responding to multiple test rules sent by the test device, performing validation processing on each test rule, and obtaining a valid flow message corresponding to each test rule;

[0042] The sending module is used to send the valid traffic message corresponding to each test rule to the test equipment, instruct the test equipment to obtain the receiving time of the valid traffic message corresponding to each test rule, and test the performance indicators of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

[0043] In a fifth aspect, an embodiment of the present application provides a performance indicator test system, the system comprising: a test device and a network device, the test device and the network device being communicatively connected;

[0044] A test device, used to perform the steps of the method of any embodiment of the first aspect above;

[0045] A network device, used to execute the steps of the method of any embodiment in the second aspect above.

[0046] In a sixth aspect, an embodiment of the present application further provides a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the steps of the method of any one of the embodiments of the first and second aspects above when executing the computer program.

[0047] In the seventh aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method of any embodiment of the first aspect and the second aspect are implemented.

[0048] In an eighth aspect, an embodiment of the present application further provides a computer program product, the computer program product comprising a computer program, which, when executed by a processor, implements the steps of the method of any one of the embodiments of the first and second aspects above.

[0049] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] FIG1 is an application environment diagram of a performance indicator testing method in one embodiment;

[0051] FIG2 is a schematic diagram of a flow chart of a performance index testing method in one embodiment;

[0052] FIG3 is a schematic flow chart of a performance indicator testing method in another embodiment;

[0053] FIG4 is a schematic flow chart of a performance indicator testing method in another embodiment;

[0054] FIG5 is a schematic diagram of a flow chart of a performance indicator testing method in another embodiment;

[0055] FIG6 is a schematic diagram of a flow chart of a performance indicator testing method in another embodiment;

[0056] FIG7 is a block diagram of a performance index testing device according to an embodiment;

[0057] FIG8 is a structural block diagram of a performance index testing device in another embodiment;

[0058] FIG. 9 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0059] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0060] In the field of communications, network equipment is used to connect various servers, PCs, application terminals and other nodes to each other, and is a dedicated hardware device that constitutes an information communication network, and is widely used. Among them, determining the performance of network equipment plays an important role in measuring whether the network equipment can operate normally. In practical applications, the performance of the network equipment can be determined by testing the performance indicators of each network rule in the network equipment. Taking the performance indicator as the rule effective delay as an example, in the related art, the rule effective delay of each test rule is mainly tested based on the rule issuance time collected when the test device issues the test rule to the network device and the transfer time of the rule effective traffic after the network device responds to the test rule, and the rule effective delay test result of each test rule is determined. However, in the process of testing the performance indicators of network rules in the related art, there will be a problem of inaccurate test results. Based on this, the embodiment of the present application provides a performance indicator testing method, and there will be a problem of inaccurate test results in the process of testing the performance indicators of network rules.

[0061] The performance index test method provided in the embodiment of the present application can be applied to the application environment diagram shown in Figure 1. The application environment includes a performance index test system, and the performance index test system can include a test device and a network device to be tested. The test device and the network device are connected by communication, and the communication method can be a high-speed Internet, a local area network or an optical fiber connection. Optionally, the above-mentioned test device can be a server, or a computer device, and the present embodiment does not limit the specific form of the test device. Optionally, the computer device can be a personal computer, a desktop computer, a laptop computer and other devices. At the same time, the above-mentioned network device can be a router, a switch, a hub, a bridge, a firewall, a gateway, a network security device, a splitter, etc., and the present embodiment does not limit the specific form of the network device. The following embodiment introduces the specific process of the performance index test method as the execution subject of the performance index test method.

[0062] As shown in FIG. 2 , it is a flow chart of a performance index testing method provided in an embodiment of the present application. The method is applied to a testing device and can be implemented by the following steps:

[0063] S101, obtaining the rule issuing time of multiple test rules; and obtaining the receiving time of the valid flow message corresponding to each test rule. Wherein, each valid flow message is obtained after the network device takes effect for each test rule.

[0064] In actual applications, rules are used to determine the security and reliability of traffic packets entering the network. Therefore, during the performance index test, the test equipment can simulate multiple test rules and send each test rule to the network device, and record the rule sending time of multiple test rules in the process of sending multiple test rules, that is, obtain the rule sending time of multiple test rules. Among them, the rule sending time of the test rule can also be understood as the time when the test device sends the test rule to the network device.

[0065] It should be noted here that, when the test device receives and responds to the performance indicator test instruction of the network device, multiple test rules may be sent to the network device.

[0066] Each of the above test rules also represents a type of test rules, and each test rule may include at least one sub-rule; each sub-rule may include information such as the purpose of the rule, the action of the rule, and the condition of the rule. Optionally, the purpose of the rule may include information such as the protocol type of the traffic message, limiting the bandwidth usage and the priority of ensuring key services; the rule action may include information such as allowing, denying, redirecting, limiting speed, marking priority, etc.; the rule condition may include characteristics such as the source address, destination address, port number, protocol number, protocol type, and data packet size of the traffic message. Optionally, the sub-rule may be a Media Access Control Address (MAC) rule, a five-tuple rule, a Virtual Local Area Network (VLAN) rule, a Multi-Protocol Label Switching (MPLS) rule, a protocol rule, a host (HOST) rule, a Server Name Indication (SNI) rule, a full-packet floating rule, etc.

[0067] At the same time, the network device can receive multiple test traffic messages sent by the test device or traffic generator, and obtain valid traffic messages corresponding to each test rule based on multiple test traffic messages, and send the valid traffic messages corresponding to each test rule to the test device. Correspondingly, the test device can receive the valid traffic messages corresponding to each test rule and obtain the receiving time of the valid traffic messages corresponding to each test rule.

[0068] It should be noted here that the test device or traffic generator can increase the packet sending speed of the test traffic message to the network device to improve the test accuracy of the performance indicator.

[0069] The above-mentioned validation of multiple test rules based on multiple test traffic messages can be understood as a process of matching and processing multiple test traffic messages according to the rule purpose and rule action in each test rule.

[0070] Optionally, the test traffic message may be generated by a test device or a traffic generator, and the format of the test traffic message may be a virtual local area network (VLAN), multiprotocol label switching (MPLS), Internet Protocol (IP), transmission control protocol (TCP), user datagram protocol (UDP), stream control transmission protocol (SCTP), tunneling protocol, hypertext transfer protocol (HTTP), hypertext transfer protocol secure (HTTPS), etc.

[0071] Exemplarily, referring to FIG. 1, the communication connection between the test device and the network device is realized by the communication port connection, and any port in the test device can realize the communication connection with the port that matches the port type in the network device to form a communication link; correspondingly, multiple communication links can be pre-built between the test device and the network device. Among them, the management port, input port and output port in FIG. 1 are all ports of the network device. Optionally, the above-mentioned port types can be optical ports or electrical ports. Among them, any three communication links of all the communication links between the test device and the network device can transmit test rules, test flow messages and valid flow messages respectively. FIG. 1 only shows three communication links, and the test device sends a test flow message to the network device, and the communication link to which port 1 belongs transmits the test rule, the communication link to which port 2 belongs transmits the test flow message, and the communication link to which port 3 belongs transmits the valid flow message as an example schematic diagram. Optionally, the port types of different ports on the test device may be the same or different, and this embodiment of the present application is not limited.

[0072] S102: Test the performance index of each test rule according to the issuing time of each rule and the receiving time of each valid traffic message, and determine the test result of the performance index of each test rule.

[0073] In an embodiment of the present application, the performance indicator of the test rule is taken as an example to illustrate that it is the rule effectiveness delay. Specifically, the test equipment can test the performance indicator of each test rule according to the issuance time of each rule and the reception time of each valid traffic message, and determine the performance indicator test results of each test rule.

[0074] In one implementation, the test device can pre-train an algorithm model, and then input the time of issuing each rule and the time of receiving each valid traffic message into the algorithm model. The algorithm model tests the performance indicators of each test rule and outputs the performance indicator test results of each test rule.

[0075] In another implementation, the test device can perform format conversion processing, arithmetic operation processing, analysis processing and / or matching processing according to the time when each rule is issued and the time when each valid traffic message is received, so as to complete the test of the performance index of each test rule and obtain the performance index test result of each test rule. Optionally, the arithmetic operation can be implemented by at least one of logical operation, addition operation, multiplication operation, logarithmic operation, subtraction operation, etc.

[0076] The technical solution in the embodiment of the present application is applied to a test device to obtain the rule issuance time of multiple test rules; and to obtain the reception time of the valid traffic message corresponding to each test rule, and according to the issuance time of each rule and the reception time of each valid traffic message, the performance indicator of each test rule is tested to determine the performance indicator test result of each test rule, wherein each valid traffic message is obtained after the network device takes effect for each test rule; the above method can obtain the rule issuance time of multiple test rules and the reception time of the valid traffic message corresponding to each test rule at the same end, that is, the test end, thereby eliminating the clock deviation generated when the rule issuance time and the reception time are obtained at both ends respectively, and on this basis, the performance indicator of each test rule can be tested. Carry out precise testing, improve the accuracy of performance indicator test results, and improve the reliability of performance indicator test results; at the same time, the above method can obtain the rule issuance time and reception time under the same clock (i.e., the same end), so as to avoid the process of executing clock conversion for the rule issuance time and reception time, thereby speeding up the test speed of performance indicators and improving the test efficiency of performance indicators; in addition, the above method tests the performance indicators of different test rules through the same set of solutions, which can improve the reliability of the performance indicator test results of different test rules; furthermore, the above method only requires one test device to realize the performance indicator test of each test rule of the network device, and this method greatly simplifies the operational difficulty of setting up the test environment and executing the test.

[0077] The process of obtaining the receiving time of the valid flow message corresponding to each test rule is described below. In one embodiment, as shown in FIG3 , the step of obtaining the receiving time of the valid flow message corresponding to each test rule in S101 can be implemented in the following manner:

[0078] S111. Acquire valid traffic messages corresponding to each test rule sent by the network device, and add a timestamp to each valid traffic message.

[0079] In actual applications, the test device can receive valid traffic messages corresponding to each test rule sent by the network device, and add a timestamp, that is, time, to each received valid traffic message in real time.

[0080] S121. Determine the receiving time of each valid flow message according to the timestamp of each valid flow message.

[0081] Each of the above test rules includes a sub-rule, and correspondingly, each test rule corresponds to a valid traffic message. In this case, the test device can directly determine the timestamp of the valid traffic message corresponding to each test rule as the receiving time of the valid traffic message corresponding to the test rule.

[0082] In addition, in some scenarios, the timestamp of the valid traffic message corresponding to each test rule may not be equal to the reception time of the valid traffic message corresponding to the test rule. In this case, the test device can pre-train a processing model, and then input the timestamp of the valid traffic message corresponding to each test rule into the processing model, and the processing model outputs the reception time of the valid traffic message corresponding to each test rule.

[0083] Optionally, the above processing model can be implemented by at least one of a convolutional neural network model, a fully connected neural network model, a long short-term memory neural network model, a recurrent neural network model, a residual neural network model, etc.

[0084] It should be noted here that the reception time of the valid traffic message corresponding to the above test rule can be understood as the effective time of the test rule.

[0085] The technical solution in the embodiment of the present application obtains the valid flow message corresponding to each test rule sent by the network device, adds a timestamp to each valid flow message, and determines the receiving time of each valid flow message according to the timestamp of each valid flow message; in the above method, the test device can simultaneously obtain the receiving time of each valid flow message, so that the rule issuance time and the receiving time of each valid flow message are obtained under the same clock, which can eliminate the clock deviation generated when the rule issuance time and the receiving time are obtained at both ends, so as to provide a reliable timestamp for subsequent performance indicator tests and avoid affecting the subsequent performance indicator test processing; at the same time, the above method can obtain each valid flow message forwarded by the network device, so as to help the test device obtain the receiving time of each valid flow message at the same end; in addition, the performance indicator test system in the above method supports the test device to capture packets through two-end communication to receive each valid flow message sent by the network device, and then can obtain the receiving time of each valid flow message at the same end, so as to provide reliable rule issuance time and receiving time for further testing.

[0086] In some scenarios, each test rule includes multiple sub-rules, and each sub-rule corresponds to a sub-message, that is, the valid flow message corresponding to each test rule includes multiple sub-messages. The following describes the process of determining the receiving time of each valid flow message according to the timestamp of each valid flow message in this scenario. In one embodiment, the timestamp of the above-mentioned valid flow message includes the timestamps of multiple sub-messages; as shown in Figure 4, the step of determining the receiving time of each valid flow message according to the timestamp of each valid flow message in the above S121 may include:

[0087] S1211. For any test rule, obtain the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule.

[0088] In the embodiment of the present application, each of the above test rules may include multiple different sub-rules, but the types of these multiple sub-rules are the same. In practical applications, for any test rule, the test device can receive the sub-messages corresponding to each sub-rule in the test rule sent by the network device, add a timestamp to each received sub-message in real time, and store the sub-message carrying the timestamp to its own corresponding path.

[0089] Specifically, for each test rule, the test device can obtain the timestamp of each sub-message in the valid traffic message of the pre-stored test rule, and find the minimum value of each timestamp or compare each timestamp to obtain the minimum timestamp among the timestamps, that is, the timestamp when the test device receives the first sub-message in the valid traffic message corresponding to the same type of test rule.

[0090] S1212. Determine the minimum timestamp as the reception time of the valid traffic message of the test rule.

[0091] It should be noted here that in the embodiment of the present application, there is a high-speed communication connection between the test device and the network device. Therefore, the transmission time of each valid traffic message from the network device to the test device can be ignored. Naturally, the sending time of each valid traffic message sent by the network device to the test device and the receiving time of each valid traffic message received by the test device can be equal.

[0092] In an embodiment of the present application, based on the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule obtained in the previous steps, the minimum timestamp can be determined as the reception time of the valid traffic message of the test rule.

[0093] The technical solution in the embodiment of the present application, for any test rule, obtains the minimum timestamp among the timestamps of each sub-message in the effective traffic message of the test rule, and determines the minimum timestamp as the receiving time of the effective traffic message of the test rule; the above method can be applicable to scenarios in which each test rule includes multiple sub-rules, so that the accuracy of the receiving time of the effective traffic message of the test rule obtained in such complex scenarios is higher; at the same time, the above method does not require the participation of complex algorithms, thereby reducing the complexity of obtaining the receiving time of the effective traffic message in such complex scenarios, and improving the speed and efficiency of obtaining the receiving time of the effective traffic message.

[0094] In one embodiment, as shown in FIG. 5 , the step of testing the performance indicators of each test rule according to the issuing time of each rule and the receiving time of each valid traffic message in S102 to determine the test results of the performance indicators of each test rule can be implemented in the following manner:

[0095] S112. Obtain the performance indicator value of each test rule according to the issuing time of each rule and the receiving time of the valid traffic message of each test rule.

[0096] Specifically, for any test rule, the test device can perform arithmetic operations, comparison processing, matching processing and / or analysis processing on the rule issuance time of the test rule and the reception time of the valid traffic message corresponding to the test rule to obtain the performance indicator value of the test rule.

[0097] In addition, the test device may also process the rule issuance time of the test rule and the reception time of the valid traffic message corresponding to the test rule according to a preset processing strategy to obtain the performance indicator value of the test rule.

[0098] S122. Obtain the maximum performance indicator value among the performance indicator values ​​of each test rule.

[0099] In practical applications, the test equipment can find the maximum value of the performance indicator value of each test rule or perform comparison processing on the performance indicator value of each test rule to obtain the maximum performance indicator value among the performance indicator values.

[0100] S132. Determine the performance indicator test result of each test rule according to the maximum performance indicator value.

[0101] Among them, the test equipment can pre-train an algorithm model, and then input the maximum performance indicator value into the algorithm model, and the algorithm model outputs the performance indicator test results of each test rule.

[0102] In addition, the test equipment can also perform arithmetic operations on the maximum performance index value, and obtain the performance index test results of each test rule according to the arithmetic operation results.

[0103] In one embodiment, the step of determining the performance indicator test result of each test rule according to the maximum performance indicator value in S132 may include:

[0104] When the maximum performance indicator value is greater than the preset indicator threshold, the performance indicator test result of each test rule is determined to be test failure; when the maximum performance indicator value is less than the indicator threshold, the performance indicator test result of each test rule is determined to be test passed.

[0105] In an embodiment of the present application, the testing device can determine whether the maximum performance indicator value is greater than a preset indicator threshold. When the maximum performance indicator value is greater than the preset indicator threshold, the performance indicator test result of each test rule is determined to be a test failure; when the maximum performance indicator value is less than the indicator threshold, the performance indicator test result of each test rule is determined to be a test pass.

[0106] Among them, the above-mentioned indicator threshold can be determined by the user or determined based on historical experience values, which is not limited in the embodiments of the present application.

[0107] This embodiment can determine the performance indicator test result of each test rule as test failure when the maximum performance indicator value is greater than a preset indicator threshold, and determine the performance indicator test result of each test rule as test pass when the maximum performance indicator value is less than the indicator threshold. The above method can determine the performance indicator test result of the test rule according to the size relationship between the maximum performance indicator value and the indicator threshold. The processing process is relatively simple and does not require the participation of complex algorithms, thereby speeding up the determination of the performance indicator test results and improving the efficiency of determining the performance indicator test results.

[0108] The technical solution in the embodiment of the present application obtains the performance indicator value of each test rule according to the issuance time of each rule and the reception time of the valid traffic message of each test rule, obtains the maximum performance indicator value among the performance indicator values ​​of each test rule, and determines the performance indicator test result of each test rule according to the maximum performance indicator value; the above method does not require the participation of complex algorithms, thereby speeding up the determination of performance indicator test results and improving the efficiency of determining performance indicator test results, and the above method does not require testers to learn additional professional knowledge, which can reduce the complexity of the performance indicator testing method; in addition, the above method determines the performance indicator value of the test rule through the rule issuance time and reception time obtained under the same clock, which can improve the accuracy and reliability of the performance indicator value, and on this basis, can improve the correctness of the determined performance indicator test result.

[0109] In some scenarios, some applications can be completed based on the obtained performance indicator test results of each test rule of the network device, and an application is described below. In one embodiment, after executing the steps in S102 above, the method may further include the following steps: determining the performance test results of the network device according to the performance indicator test results of each test rule and other performance indicator test results of the network device.

[0110] In practical applications, the test device can pre-train a device performance test model, and then input the performance indicator test results of each test rule and other performance indicator test results of the network device into the device performance test model, and the device performance test model outputs the performance test results of the network device. Optionally, the above-mentioned device performance test model can be a combination of at least one of a star network model, a bus network model, a ring network model, a tree network model, etc. Optionally, the other performance indicators of the above-mentioned network device can include at least one of the rate, bandwidth, throughput, delay, delay-bandwidth product, round-trip time RTT, utilization, and packet loss rate of the network device.

[0111] In one embodiment, the step of determining the performance test result of the network device based on the performance indicator test results of each test rule and other performance indicator test results of the network device may include: when the performance indicator test results of each test rule and other performance indicator test results are both passed, determining that the performance test result of the network device is a performance test pass.

[0112] In this embodiment, when the performance indicator test results of each test rule are passed, the performance test results of the network device can be determined in combination with other performance indicator test results of the network device, so as to provide reference information on whether the network device can operate normally and ensure the reliability of the network device.

[0113] The technical solution in the embodiment of the present application can determine the performance test results of the network device based on the performance indicator test results of each test rule and other performance indicator test results of the network device, so as to provide reference information for whether the network device can operate normally, and can also provide reference information for optimizing the performance of the network device to ensure the reliability of the network device.

[0114] In one embodiment, the present application also provides a performance indicator testing method, which is applied to a testing device, and the method includes the following process:

[0115] (1) Obtaining the rule issuance time of multiple test rules; and obtaining the valid traffic message corresponding to each test rule sent by the network device, and adding a timestamp to each valid traffic message; each valid traffic message is obtained after the network device takes effect on each test rule; the timestamp of the valid traffic message includes the timestamps of multiple sub-messages;

[0116] (2) For any test rule, obtain the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule;

[0117] (3) Determine the minimum timestamp as the time when the valid traffic message of the test rule is received;

[0118] (4) Obtain the performance index value of each test rule based on the issuance time of each rule and the reception time of the valid traffic message of each test rule;

[0119] (5) Obtaining the maximum performance index value among the performance index values ​​of each test rule;

[0120] (6) When the maximum performance indicator value is greater than the preset indicator threshold, the performance indicator test result of each test rule is determined to be a test failure;

[0121] (7) When the maximum performance indicator value is less than the indicator threshold, the performance indicator test result of each test rule is determined to be a test pass.

[0122] The execution process of the above (1) to (7) can be specifically referred to the description of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0123] In order to solve the problem of inaccurate performance index test results existing in the related art, the embodiment of the present application also provides a performance index test method, which can improve the accuracy of the performance index test results in the process of testing the performance index of the network rule. The performance index test method will introduce how to improve the accuracy of the performance index test from the network device side. The specific process of the performance index test method will be specifically introduced in the following embodiment, and the specific process of the performance index test method will be introduced with the execution subject being the network device in the performance index test system in Figure 1.

[0124] As shown in FIG6 , it is a flow chart of a performance indicator testing method provided in an embodiment of the present application. The method is applied to a network device and can be implemented by the following steps:

[0125] S201. In response to multiple test rules sent by a test device, each test rule is validated to obtain a valid flow message corresponding to each test rule.

[0126] Specifically, the network device may respond to multiple test rules sent by the test device, and based on multiple test traffic messages sent by the test device or the traffic generator, perform validation processing on each test rule to obtain a valid traffic message corresponding to each test rule.

[0127] In one embodiment, the network device can pre-train an effectiveness processing model, and then input multiple test traffic messages and each test rule into the effectiveness processing model. The effectiveness processing model performs effectiveness processing on each test rule and then outputs the valid traffic message corresponding to each test rule.

[0128] In another embodiment, the network device may process a plurality of test traffic packets according to the rule purpose and rule action in each test rule to complete the validation processing of each test rule.

[0129] S202. Send the valid traffic message corresponding to each test rule to the test equipment, instruct the test equipment to obtain the receiving time of the valid traffic message corresponding to each test rule, and test the performance index of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

[0130] In actual applications, the network device can send the valid traffic messages corresponding to each test rule to the test device, instruct the test device to obtain the receiving time of the valid traffic messages corresponding to each test rule, and test the performance indicators of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

[0131] In an embodiment of the present application, the test device can receive valid traffic messages corresponding to each test rule sent by the network device, and add a timestamp, i.e., time, to each received valid traffic message in real time, and then determine the reception time of each valid traffic message based on the timestamp of each valid traffic message.

[0132] In one implementation, the test device can pre-train an algorithm model, and then input the time of issuing each rule and the time of receiving each valid traffic message into the algorithm model. The algorithm model tests the performance indicators of each test rule and outputs the performance indicator test results of each test rule.

[0133] In another implementation, the test device can perform format conversion processing, arithmetic operation processing, analysis processing and / or matching processing according to the time when each rule is issued and the time when each valid traffic message is received, so as to complete the test of the performance index of each test rule and obtain the performance index test result of each test rule. Optionally, the arithmetic operation can be implemented by at least one of logical operation, addition operation, multiplication operation, logarithmic operation, subtraction operation, etc.

[0134] The technical solution in the embodiment of the present application is applied to a network device, and in response to multiple test rules sent by the test device, each test rule is validated, and a valid flow message corresponding to each test rule is obtained, and the valid flow message corresponding to each test rule is sent to the test device, instructing the test device to obtain the receiving time of the valid flow message corresponding to each test rule, and according to the rule issuance time of each test rule and the receiving time of each valid flow message, the performance indicator of each test rule is tested; the above method can obtain the rule issuance time of multiple test rules and the receiving time of the valid flow message corresponding to each test rule at the same end, that is, the test end, thereby eliminating the clock deviation generated when the rule issuance time and the receiving time are obtained at both ends respectively, and on this basis, each test rule can be tested. The performance indicators of the test rules are accurately tested, the accuracy of the performance indicator test results is improved, and the reliability of the performance indicator test results is improved; at the same time, the above method can obtain the rule issuance time and the receiving time under the same clock (that is, the same end), so that the process of performing clock conversion on the rule issuance time and the receiving time can be avoided, thereby speeding up the test speed of the performance indicators and improving the test efficiency of the performance indicators; in addition, the above method tests the performance indicators of different test rules through the same set of solutions, which can improve the reliability of the performance indicator test results of different test rules; furthermore, the above method only requires one test device to realize the performance indicator test of each test rule of the network device, and this method greatly simplifies the operational difficulty of setting up the test environment and executing the test.

[0135] The process of performing validation processing on each test rule to obtain the valid flow message corresponding to each test rule is described below. In one embodiment, the step in S201 may include: performing matching processing on each test flow message according to each test rule to obtain the valid flow message corresponding to each test rule.

[0136] In an embodiment of the present application, the test rule and the type of the corresponding test traffic message match. Specifically, for any test rule, the network device can match and process the test traffic message corresponding to the test rule according to the rule purpose in the test rule to obtain the valid traffic message corresponding to the test rule. It should be noted here that the valid traffic message corresponding to the test rule can be understood as the traffic message required to be transferred out by the test rule.

[0137] The technical solution in the embodiment of the present application can match and process each test traffic message according to each test rule to obtain a valid traffic message corresponding to each test rule, and then forward the valid traffic message to the test equipment to help improve the accuracy of the performance indicator test results.

[0138] In one embodiment, the present application also provides a performance indicator testing method, which is applied to a network device, and the method includes the following process:

[0139] (1) In response to multiple test rules sent by the test device, each test traffic message is matched according to each test rule to obtain a valid traffic message corresponding to each test rule;

[0140] (2) Send the valid traffic message corresponding to each test rule to the test equipment, instruct the test equipment to obtain the receiving time of the valid traffic message corresponding to each test rule, and test the performance indicators of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

[0141] The execution process of (1) to (2) above may be specifically referred to the description of the above embodiment. The implementation principle and technical effect thereof are similar and will not be described in detail here.

[0142] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0143] Based on the same inventive concept, the embodiment of the present application also provides a performance indicator test device for implementing the above-mentioned performance indicator test method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above-mentioned method, so the specific limitations in the one or more performance indicator test device embodiments provided below can refer to the limitations of the performance indicator test method above, and will not be repeated here.

[0144] In one embodiment, FIG7 is a schematic diagram of the structure of a performance indicator test device in an embodiment of the present application. The performance indicator test device provided in the embodiment of the present application can be applied to a test device. As shown in FIG7 , the performance indicator test device in the embodiment of the present application may include: an acquisition module 11 and a test module 12, wherein:

[0145] The acquisition module 11 is used to obtain the rule issuing time of multiple test rules; and obtain the receiving time of the valid flow message corresponding to each test rule; each valid flow message is obtained after the network device takes effect for each test rule;

[0146] The test module 12 is used to test the performance index of each test rule according to the issuance time of each rule and the reception time of each valid traffic message, and determine the test result of the performance index of each test rule.

[0147] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0148] In one embodiment, the acquisition module 11 includes: a timestamp adding unit and a determining unit, wherein:

[0149] A timestamp adding unit, used for acquiring valid flow messages corresponding to each test rule sent by the network device, and adding a timestamp to each valid flow message;

[0150] The determination unit is used to determine the receiving time of each valid flow message according to the time stamp of each valid flow message.

[0151] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0152] In one embodiment, the timestamp of the valid traffic message includes the timestamps of multiple sub-messages; and the determining unit is specifically configured to:

[0153] For any test rule, obtain the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule;

[0154] The minimum timestamp is determined as the time when the valid traffic message of the test rule is received.

[0155] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0156] In one embodiment, the test module 12 includes: an indicator value acquisition unit, a maximum value acquisition unit and a test result determination unit, wherein:

[0157] An indicator value acquisition unit, used to obtain the performance indicator value of each test rule according to the issuance time of each rule and the reception time of the valid flow message of each test rule;

[0158] A maximum value acquisition unit, used to obtain the maximum performance indicator value among the performance indicator values ​​of each test rule;

[0159] The test result determination unit is used to determine the performance indicator test result of each test rule according to the maximum performance indicator value.

[0160] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0161] In one embodiment, the test result determination unit is specifically used for:

[0162] When the maximum performance indicator value is greater than the preset indicator threshold, the performance indicator test result of each test rule is determined to be a test failure;

[0163] When the maximum performance indicator value is less than the indicator threshold, the performance indicator test result of each test rule is determined to be a test pass.

[0164] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0165] In another embodiment, FIG8 is a schematic diagram of the structure of a performance indicator test device in an embodiment of the present application. The performance indicator test device provided in the embodiment of the present application can be a network device. As shown in FIG8, the performance indicator test device in the embodiment of the present application can include: a response module 21 and a sending module 22, wherein:

[0166] The response module 21 is used to respond to multiple test rules sent by the test device, perform validation processing on each test rule, and obtain a valid flow message corresponding to each test rule;

[0167] The sending module 22 is used to send the valid traffic message corresponding to each test rule to the test equipment, instruct the test equipment to obtain the receiving time of the valid traffic message corresponding to each test rule, and test the performance indicators of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

[0168] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0169] In one embodiment, the response module 21 is specifically used for:

[0170] According to each test rule, each test flow message is matched and processed to obtain a valid flow message corresponding to each test rule.

[0171] The performance indicator testing device provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0172] Based on the same inventive concept, the embodiment of the present application also provides a performance index test system, as shown in FIG1 , the system includes: a test device and a network device, the test device and the network device are communicatively connected; wherein:

[0173] A test device, used to perform the steps of any one of the embodiments in FIG. 2 to FIG. 5 ;

[0174] A network device, used to execute the steps of any one of the embodiments in FIG. 6 .

[0175] In actual applications, the test equipment and the network equipment are connected by communication, and the communication method can be high-speed Internet, local area network or optical fiber connection, that is, high-speed communication connection.

[0176] The performance indicator testing system provided in the embodiment of the present application can be used to execute the technical solution in the above-mentioned performance indicator testing method embodiment of the present application. Its implementation principle and technical effect are similar and will not be repeated here.

[0177] For the specific definition of the performance index test device, please refer to the definition of the performance index test method above, which will not be repeated here. Each module in the above-mentioned performance index test device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0178] In one embodiment, a computer device is also provided, which may be a server, and its internal structure diagram may be as shown in FIG9 . The computer device includes a processor, a memory, and a network interface connected via a system bus. Among them, the processor of the computer device is used to provide processing capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store each test rule, each valid traffic message, and the timestamp of each valid traffic message. The network interface of the computer device is used to communicate with an external endpoint via a network connection. When the computer program is executed by the processor, a performance indicator testing method is implemented.

[0179] Those skilled in the art will understand that the structure shown in FIG. 9 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0180] In one embodiment, a computer device is also provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the technical solution in the above-mentioned performance indicator testing method embodiment of the present application is implemented. The implementation principle and technical effect are similar and will not be repeated here.

[0181] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the technical solution of the above-mentioned performance indicator testing method of the present application is implemented. The implementation principle and technical effect are similar and will not be repeated here.

[0182] In one embodiment, a computer program product is provided, including a computer program, which, when executed by a processor, implements the technical solution of the above-mentioned performance indicator testing method of the present application. The implementation principle and technical effect are similar and will not be repeated here.

[0183] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0184] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0185] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A performance index testing method, characterized in that: Applied to testing equipment, the method comprises: Obtaining the rule issuing time of multiple test rules; and obtaining the receiving time of the valid flow message corresponding to each of the test rules; each of the valid flow messages is obtained after the network device takes effect for each of the test rules; According to the issuing time of each of the rules and the receiving time of each of the valid traffic messages, the performance index of each of the test rules is tested to determine the test result of the performance index of each of the test rules.

2. The method according to claim 1, characterized in that The obtaining of the receiving time of the valid flow message corresponding to each of the test rules includes: Obtaining valid traffic messages corresponding to each of the test rules sent by the network device, and adding a timestamp to each of the valid traffic messages; The receiving time of each of the valid flow messages is determined according to the timestamp of each of the valid flow messages.

3. The method according to claim 2, characterized in that The timestamp of the valid traffic message includes the timestamps of multiple sub-messages; Determining the receiving time of each of the valid flow messages according to the timestamp of each of the valid flow messages includes: For any test rule, obtain the minimum timestamp among the timestamps of each sub-message in the valid traffic message of the test rule; The minimum timestamp is determined as the reception time of the valid traffic message of the test rule.

4. The method according to any one of claims 1 to 3, characterized in that The step of testing the performance index of each test rule according to the issuing time of each rule and the receiving time of each valid flow message, and determining the test result of the performance index of each test rule includes: Obtaining the performance indicator value of each test rule according to the issuing time of each rule and the receiving time of the valid flow message of each test rule; Obtaining the maximum performance indicator value among the performance indicator values ​​of each of the test rules; According to the maximum performance indicator value, the performance indicator test result of each test rule is determined.

5. The method according to claim 4, characterized in that Determining the performance indicator test result of each test rule according to the maximum performance indicator value includes: When the maximum performance indicator value is greater than a preset indicator threshold, determining that the performance indicator test result of each of the test rules is a test failure; When the maximum performance indicator value is less than the indicator threshold, it is determined that the performance indicator test result of each test rule is a test pass.

6. A performance index testing method, characterized in that: Applied to a network device, the method comprises: In response to multiple test rules sent by the test device, each of the test rules is validated to obtain a valid flow message corresponding to each of the test rules; The valid traffic message corresponding to each of the test rules is sent to the test device, instructing the test device to obtain the receiving time of the valid traffic message corresponding to each of the test rules, and test the performance indicators of each of the test rules according to the rule issuance time of each of the test rules and the receiving time of each of the valid traffic messages.

7. The method according to claim 6, characterized in that The step of performing validation processing on each of the test rules to obtain a valid flow message corresponding to each of the test rules includes: According to each of the test rules, each of the test flow messages is matched and processed to obtain a valid flow message corresponding to each of the test rules.

8. A performance index testing device, characterized in that: The device comprises: An acquisition module, used to acquire the rule issuing time of multiple test rules; and to acquire the receiving time of the valid flow message corresponding to each of the test rules; each of the valid flow messages is obtained after the network device takes effect on each of the test rules; The test module is used to test the performance index of each test rule according to the issuance time of each rule and the reception time of each valid flow message, and determine the performance index test result of each test rule.

9. A performance index testing device, characterized in that: The device comprises: A response module, used for responding to a plurality of test rules sent by the test device, performing validation processing on each of the test rules, and obtaining a valid flow message corresponding to each of the test rules; A sending module is used to send the valid traffic message corresponding to each test rule to the test device, instruct the test device to obtain the receiving time of the valid traffic message corresponding to each test rule, and test the performance indicators of each test rule according to the rule issuance time of each test rule and the receiving time of each valid traffic message.

10. A performance index testing system, characterized in that: The system comprises: a test device and a network device, wherein the test device and the network device are communicatively connected; The test device is used to perform the steps of the method described in any one of claims 1 to 5; The network device is used to execute the steps of any one of the methods in claims 6-7.

11. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

Images