A method and device for efficiently testing network management specifications and concurrent performance

Abstract

The application discloses a method and device for testing network specifications and concurrent performance with high efficiency, which comprises the following steps: establishing a plurality of Cloud processes, wherein one Cloud process can simulate a test device; based on the Cloud process, an environment is established in which the Cloud process can transmit data with a first network; preset specifications of the first network are obtained, a plurality of Cloud processes send first test information to the first network, and actual specifications of the first network are obtained, wherein the preset specifications represent the number of maximum load test devices of the first network; based on the actual specifications, the preset specifications are corrected; a number of Cloud processes equal to the number of the preset specifications are selected, and concurrent second test information is sent to the first network; and based on responses of the first network to the second test information, concurrent performance of the first network is determined. The application can reduce the test threshold, save the test cost and improve the test efficiency.

Description

Technical Field

[0001] The present invention relates to the technical field of network management testing, and in particular to a method and device for efficiently testing network management specifications and concurrent performance. Background Art

[0002] The NMS is a management system used to manage devices. Devices can be registered and brought online through the NMS. The NMS can perform various operations and maintenance, such as distributing device configurations, updating signature databases, and upgrading the system. Before going online, the NMS must be tested for specifications and concurrent performance to ensure it can manage the specified number of devices.

[0003] Most network management specification tests involve selecting a specific number of devices based on the set specifications to determine whether the network manager can manage the specified number of devices and the concurrent performance of that number of devices at the network management station. If a network manager is set to manage 3,000 devices, configuring all 3,000 devices and conducting the corresponding specification and concurrent performance tests would not only be costly but also require manual configuration of 3,000 computers, making the test inefficient.

[0004] Based on the above reasons, there is an urgent need for a low-cost and efficient method to test network management specifications and concurrent performance. Summary of the Invention

[0005] The present application provides a method for efficiently testing network management specifications and concurrent performance, which is used to solve the problems of low efficiency and high cost in network management specifications and concurrent performance testing in related technologies.

[0006] A first aspect of the present application provides a method for efficiently testing network management specifications and concurrent performance, comprising:

[0007] Establishing multiple Cloud processes, wherein one Cloud process can simulate one test device;

[0008] Based on the Cloud process, establishing an environment in which the Cloud process can transmit data to the first network management system;

[0009] Obtaining preset specifications of the first network manager, wherein the plurality of Cloud processes send first test information to the first network manager to obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager;

[0010] Modifying the preset specifications based on the actual specifications;

[0011] Selecting the preset number of Cloud processes and sending concurrent second test information to the first network manager;

[0012] The concurrency performance of the first network manager is determined based on a response of the first network manager to the second test information.

[0013] In one practicable manner, the step of establishing, based on the Cloud process, an environment in which the Cloud process can transmit data with the first network management system includes:

[0014] Build the Cloud process operating environment based on the library files that the Cloud process depends on;

[0015] The information of the test device is configured for each Cloud process, wherein the information of the test device at least includes the IP address and port number of the first network manager to which registration is to be initiated.

[0016] In one practicable manner, the step of configuring the relevant information of the test device for each Cloud process, wherein the relevant information includes at least the IP address and port number of the first network manager, includes:

[0017] Get the IP address and port number of the second network management system;

[0018] Based on the IP address and port number of the second network manager, the information of the test device is configured for each Cloud process, wherein the information of the test device includes at least the IP address and port number of the first network manager to which registration is to be initiated and the IP address and port number of the second network manager.

[0019] In one practicable manner, the step of obtaining preset specifications of the first network manager, wherein the plurality of Cloud processes send first test information to the first network manager, and obtaining actual specifications of the first network manager includes:

[0020] Determining the number of the Cloud processes according to preset specifications of the first network management;

[0021] Divide the Cloud processes into multiple groups of Cloud processes according to the number of the Cloud processes;

[0022] The plurality of groups of the Cloud processes send the first test information to the first network manager in sequence in groups;

[0023] Determine the actual specifications of the first network manager according to the response of the first network manager to receiving the first test information.

[0024] In one practicable manner, the step of revising the preset specifications based on the actual specifications includes:

[0025] If the actual specification is smaller than the preset specification, modify the setting procedure of the preset specification;

[0026] executing again the step of sending the first test information to the first network manager by the plurality of Cloud processes to obtain the actual specifications of the first network manager;

[0027] If the actual specification is equal to the preset specification, the setting procedure of modifying the preset specification is stopped.

[0028] In one practicable manner, the step of selecting the preset number of Cloud processes and sending concurrent second test information to the first network manager includes:

[0029] Configuring the second test information of the Cloud process based on the test requirements of the first network management;

[0030] According to the preset specifications of the first network manager, the Cloud process configured with the second test information is called, and the second test information is concurrently sent to the first network manager.

[0031] In one practicable manner, the step of determining the concurrency performance of the first network manager based on the response of the first network manager to the second test information includes:

[0032] Obtaining a preset response time of the first network manager, wherein the preset response time represents the time required for the first network manager to process the preset number of concurrent messages of the Cloud process;

[0033] Obtaining a response time of the first network manager to the second test information;

[0034] The concurrency performance of the first network manager is determined based on a comparison between the response time of the first network manager to the second test information and the preset response time.

[0035] A second aspect of the present application provides a device for efficiently testing network management specifications and concurrent performance, which is applied to the aforementioned method for efficiently testing network management specifications and concurrent performance. The device includes:

[0036] A Cloud process establishment unit, configured to establish multiple Cloud processes, wherein one Cloud process can simulate one test device;

[0037] A Cloud process building unit, configured to establish an environment for data transmission between the Cloud process and the first network management system based on the Cloud process;

[0038] a preset specification processing unit, configured to obtain preset specifications of the first network manager, wherein the plurality of Cloud processes send first test information to the first network manager, and obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager;

[0039] a preset specification correction unit, configured to correct the preset specification based on the actual specification;

[0040] A concurrent performance testing unit, configured to select the Cloud processes of the preset number of specifications and send concurrent second test information to the first network manager;

[0041] The concurrency performance determining unit is configured to determine the concurrency performance of the first network manager based on the response of the first network manager to the second test information.

[0042] A third aspect of the present application provides an electronic device, including:

[0043] processor;

[0044] a memory for storing instructions executable by the processor;

[0045] The processor is used to read the executable instructions from the memory and execute the instructions to implement the above-mentioned method for efficiently testing network management specifications and concurrent performance.

[0046] The fourth aspect of the present application provides a computer-readable storage medium having computer program instructions stored thereon, characterized in that when the program instructions are executed by a processor, the steps of the aforementioned method for efficiently testing network management specifications and concurrent performance are implemented.

[0047] Beneficial effects of the present invention:

[0048] Establish multiple Cloud processes and use the Cloud processes to simulate test equipment; build an environment for the Cloud processes to simulate data transmission required for the test equipment; obtain the preset specifications of the preset first network manager, select multiple Cloud processes to send a first test message to the first network manager, obtain the actual specifications of the first network manager, and then modify the preset specifications based on the actual specifications, so that all Cloud processes that call the preset number of specifications can be managed by the first network manager. In addition, call the preset number of Cloud processes and send concurrent second test messages to the first network manager at the same time, and determine the concurrency performance of the first network manager based on the first network manager's response to the second test information. Using the Cloud process to simulate test equipment eliminates the need for actual equipment setup, simplifies the time to configure each device, and lowers the test threshold; then use the concurrency of multiple Cloud processes to test the concurrency performance of the first network manager, thereby improving test efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0050] Figure 1 This is a flow chart of a method for efficiently testing network management specifications and concurrent performance of the present invention;

[0051] Figure 2 A flowchart of a method for efficiently testing network management specifications and concurrent performance of the present invention for establishing an environment in which a Cloud process can run on a Linux server of an Ubuntu system;

[0052] Figure 3 A flow chart of determining the actual specifications of a first network manager in a method for efficiently testing network manager specifications and concurrent performance according to the present invention;

[0053] Figure 4 A flowchart of correcting preset specifications for a method of efficiently testing network management specifications and concurrent performance according to the present invention;

[0054] Figure 5 A flow chart of a method for efficiently testing network management specifications and concurrent performance of the present invention for sending concurrent second test information to a first network management;

[0055] Figure 6 A flow chart of determining the concurrent performance of a first network manager in a method for efficiently testing network manager specifications and concurrent performance of the present invention;

[0056] Figure 7 A flowchart of an embodiment of a method for efficiently testing network management specifications and concurrent performance according to the present invention;

[0057] Figure 8 This is a schematic diagram of the principle of initiating registration of a method for efficiently testing network management specifications and concurrent performance of the present invention. DETAILED DESCRIPTION

[0058] The following will clearly and completely describe the technical solutions of the present invention in conjunction with the embodiments. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0059] As a management system for managing devices, the network management system (NMS) requires testing of its specifications and concurrent performance before going live, allowing developers to determine whether it can handle concurrent operations within those specifications. In actual testing, if the NMS specification is set at 3,000 devices, 3,000 devices must be configured. These 3,000 devices then send test messages to the NMS to test whether it can handle 3,000 computers within the NMS specifications, thereby enabling various operations such as concurrent registration and online access, policy issuance, device version upgrades, and device signature database upgrades. For the NMS to achieve these functions, the NMS specifications must first be determined, and then concurrency must be performed based on those specifications to determine its concurrent performance. As mentioned above, achieving the NMS specifications and concurrent performance requires 3,000 devices. The cost of 3,000 devices and the time required to configure them are both enormous. Clearly, the testing cost is too high and the testing efficiency is too low.

[0060] Based on the above reasons, this application proposes a method for efficiently testing network management specifications and concurrent performance, and uses a test device to send a registration request to the network management as an example. It should be understood that the test device is a device used to test network management specifications and concurrent performance, and the registration information sent by the test device is only for illustrative purposes. It does not mean that the test device can only send registrations and use the sent registration requests to determine the specifications and concurrent performance of the network management. The specific content of the method for efficiently testing network management specifications and concurrent performance is as follows:

[0061] See also Figures 1 to 8 In a first aspect, the present application provides a method for efficiently testing network management specifications and concurrent performance, comprising the following steps:

[0062] S101: Establish multiple Cloud processes, where one Cloud process can simulate one test device.

[0063] The request sent by the test device to the network management is initiated by the Cloud process. For this reason, multiple Cloud processes are established, and each Cloud process simulates a test device, that is, the test device is virtualized.

[0064] Specifically, we set up a Linux server running Ubuntu and migrated the cloud processes on the test devices to the Linux server. Since each cloud process represents a test device, we created a corresponding number of cloud processes on the Linux server based on the number of test devices.

[0065] S102: Based on the Cloud process, establish an environment in which the Cloud process can transmit data with the first network management system.

[0066] Understandably, if the Cloud process is to run on an Ubuntu Linux server and transmit data to the first NMS, it needs to establish a suitable operating environment. Once the Cloud process has established an environment for data transmission with the first NMS, it can send test information to the first NMS, allowing for subsequent testing of the NMS's specifications and concurrency performance.

[0067] Specifically, establishing an environment in which the Cloud process can run under a Linux server of the Ubuntu system includes steps S1021 and S1022.

[0068] like Figure 2 As shown, S1021: Build a Cloud process running environment based on the library files that the Cloud process depends on.

[0069] The Cloud process requires corresponding library files for information transmission. Therefore, you first need to determine the library files required by the Cloud process. This library file can be built based on the test information, or you can pre-build all possible library files. Then, use the library files to implement the variables, functions, or classes required by the Cloud process during runtime.

[0070] S1022: Configure the information of the test device for each Cloud process, wherein the information of the test device at least includes the IP address and port number of the first network manager to which registration is to be initiated.

[0071] Among them, when each Cloud process simulates the test equipment, it is necessary to establish a serial number of the corresponding test equipment for the Cloud process, and each serial number represents a test device. At the same time, it is also necessary to configure test information for the Cloud process. When registration is used as the test information, it is necessary to configure the registration name and registration password for the Cloud process, and use the Cloud process to send the registration name and registration password to the first network manager to simulate the registration action of the test equipment on the first network manager. For example, if it is only necessary to determine the preset specifications of the first network manager, it is sufficient to send a message to the first network manager, and use the information to determine whether the first network manager can receive it. Here, when registration is used as the test information, it is necessary to configure the registration name and registration password so that when the concurrent performance of the network manager is tested in the subsequent steps, there is no need to configure the Cloud process additionally, thereby reducing the workload.

[0072] It should be noted that if you want to find the first network manager, you need to test the device information including the IP address and port number of the first network manager so that the registration initiated by the Cloud process can be transmitted to the first network manager.

[0073] It is understandable that if the Cloud process configures the information of the test device by initiating registration, the information of the test device includes the serial number, registration name, registration password, and the IP address and port number of the first network management to which registration is to be initiated.

[0074] The serial number can be used to identify the simulated device that initiates the registration, the registration name and registration password are used to determine whether the network manager has received the test information, and the first network manager IP address and port number are used as the receiving address.

[0075] It should also be noted that if two network managers need to perform a network manager specification test, steps S1023 and S1024 are included.

[0076] S1023: Obtain the IP address and port number of the second network manager.

[0077] The Linux server of the Ubuntu system is used to obtain the IP address and port number of the second network manager that needs to perform the network manager specification test as the receiving address of the Cloud process.

[0078] S1024: Based on the IP address and port number of the second network manager, configure the information of the test device for each Cloud process, wherein the information of the test device includes at least the IP address and port number of the first network manager to which registration is to be initiated and the IP address and port number of the second network manager.

[0079] Among them, when the Cloud process needs to perform specification testing for two or more network managers, if the preset specifications of the two network managers are the same, the information of the test equipment needs to include the IP address and port number of the test network manager. For example, if the specifications of the first network manager and the second network manager are tested, the information of the test equipment needs to include the IP address and port number of the first network manager and the IP address and port number of the second network manager. The Cloud process sends corresponding test information based on the IP address and port number so that both the first network manager and the second network manager can receive the test information. If the preset specifications of the two network managers are different, such as the preset specifications of the first network manager are smaller than the preset specifications of the second network manager, in this case, the Cloud process of the number of preset specifications of the first network manager is configured based on the first network manager. The Cloud process needs to include the IP addresses and port numbers of the first network manager and the second network manager; the Cloud process of the second network manager that exceeds the preset specifications of the first network manager only needs to include the IP address and port number of the second network manager.

[0080] In this embodiment, when testing the preset specifications of multiple network managers, the IP addresses and port numbers of multiple network managers need to be configured when configuring the test equipment information in the Cloud process. When testing the preset specifications of the network managers, the Cloud process can initiate corresponding test information based on the configured IP addresses and port numbers so that each network manager can receive the corresponding test information.

[0081] S103: Obtain preset specifications of the first network manager, multiple Cloud processes send first test information to the first network manager, and obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager.

[0082] The preset specifications of the first network management system are the number of management devices set by the designer based on actual needs. Since these preset specifications are manually set and require verification, the Cloud process simulates test equipment for actual verification. The Cloud process is used to determine the actual specifications of the first network management system.

[0083] Specifically, determining the actual specifications of the first network manager includes steps S1031 to S1034.

[0084] like Figure 3 As shown, S1031: Determine the number of Cloud processes according to the preset specifications of the first network management.

[0085] Among them, the designer sets the number of test devices with the maximum load of the first network manager according to needs, and establishes a corresponding number of Cloud processes based on the number of test devices with the maximum load. The corresponding number of Cloud processes represents the test devices with the maximum load of the first network manager.

[0086] S1032: Divide the Cloud processes into multiple groups of Cloud processes according to the number of the Cloud processes.

[0087] Among them, a corresponding number of Cloud processes are grouped, and the grouping rules can be set as needed. For example, one group can be set, that is, the number of Cloud processes in this group is the preset specification number of the first network management. Two groups, three groups or four groups can also be set, and the Cloud processes are allocated to the set groups. The allocation method can be even distribution or step-by-step distribution. This solution does not limit the grouping method.

[0088] S1033: The plurality of Cloud processes send first test information to the first network manager in sequence in groups.

[0089] The actual specifications of the test equipment that can be managed by the first network manager can be gradually determined in groups.

[0090] The first test information includes the IP address and port number of the first network manager, and a piece of data information.

[0091] S1034: Determine the actual specifications of the first network manager according to the response of the first network manager to receiving the first test information.

[0092] After receiving the first test information, the first network manager responds to the first test information. For example, after sending 3000 data messages to the first network manager, the first network manager responds with 2980 messages. It can be determined that the actual specification of the first network manager is 2980, which does not meet the preset specification of 3000 messages.

[0093] In this way, it can be determined whether there is a discrepancy between the first network management preset specifications and the actual specifications, so that the designer can modify the first network management preset specifications in subsequent steps.

[0094] S104: Based on the actual specifications, modify the preset specifications.

[0095] The preset specification for the first network manager is assumed to be 3,000 test devices, meaning that the first network manager can manage 3,000 test devices. Based on the calculation that the first network manager responded to 2,980 Cloud processes, there is a difference of 20 Cloud processes, indicating that the first network manager's actual response did not meet the preset specification. Therefore, the preset specification needs to be revised. This revision method includes at least optimizing the system to improve the first network manager's responsiveness so that the number of Cloud processes responded by the first network manager matches the preset specification.

[0096] It should be noted that the revised preset specifications include S1041 to S1043.

[0097] like Figure 4 As shown, S1041: If the actual specification is smaller than the preset specification, the setting procedure of the preset specification is corrected.

[0098] Among them, if the actual specification is 2980 Cloud processes, and the preset specification set by the first network manager is 3000 Cloud processes, the actual specification is smaller than the preset specification, then the setting program of the preset specification needs to be corrected. The correction method includes at least optimizing the program of the first network manager or increasing the hardware of the first network manager to improve the processing capacity of the first network manager.

[0099] S1042: Execute multiple Cloud processes again to send first test information to the first network manager to obtain actual specifications of the first network manager.

[0100] Among them, after correcting the setting procedure of the preset specifications, multiple Cloud processes initiate tests to the first network manager again, and compare the actual specifications of the first network manager this time with the preset specifications, and repeat the steps of correcting the setting procedure of the preset specifications and the Cloud process initiating tests to the first network manager.

[0101] S1043: If the actual specification is equal to the preset specification, stop the setting process of correcting the preset specification.

[0102] When the actual specification responded by the first network manager is equal to the preset specification, the setting procedure of correcting the preset specification is stopped, that is, the first network manager can respond to the preset number of test devices and meet the requirements of managing the test devices.

[0103] In this embodiment, the preset specifications for the first network manager are the number of test devices that the designer intends the first network manager to manage. However, these preset specifications are merely preset by the designer and have not been verified. Multiple Cloud processes are required to initiate tests on the first network manager to obtain the actual specifications and verify the preset specifications. The actual specifications are compared with the preset specifications. If the specifications are unequal, the first network manager is optimized or its processing capacity is increased, thereby improving its responsiveness. The Cloud process repeats the actions of initiating tests on the first network manager and correcting the first network manager until the preset specifications of the first network manager equal the actual specifications, ensuring that the first network manager can handle the preset number of test devices.

[0104] S105: Select a preset number of Cloud processes and send a concurrent second test message to the first network manager.

[0105] The second concurrent test information is sent to the first network manager, and the second concurrent test information includes information that the first network manager needs to execute in order to determine the concurrent performance of the second network manager. For example, the second concurrent test information includes a registration name and a registration password.

[0106] Specifically, sending concurrent second test information to the first network manager includes steps S1051 and S1052.

[0107] like Figure 5 As shown, S1051: Based on the test requirements of the first network management, configure the second test information of the Cloud process.

[0108] The test requirements can be determined based on the actual situation of the first network management system. The test requirements can be for audio and video processing or text processing. Audio and video processing and text processing have different focuses, and the concurrency performance of the first network management system also differs. Therefore, it is necessary to configure the second test information of the Cloud process based on the test requirements of the first network management system. For example, if the first network management system focuses on text processing, the registration name and password can be configured for the second test information.

[0109] It can be understood that if the first test information has been configured with the serial number, registration name, registration password, and information such as the first network management IP address and port number to which registration is to be initiated, the Cloud process can directly send the first test information as the second test information without the need for additional configuration of the second test information.

[0110] S1052: According to the preset specifications of the first network manager, the Cloud process configured with the second test information is retrieved, and the concurrent second test information is sent to the first network manager.

[0111] A preset number of Cloud processes configured with second test information are set to send concurrent second test information. After receiving the concurrent second test information, the first network manager performs concurrent processing to determine the concurrent performance of the first network manager.

[0112] In this embodiment, the second test information is configured based on the first network administrator's testing requirements, allowing the first network administrator to specifically test concurrency performance. Furthermore, information that supports concurrency, such as the registration name and password, can be configured in the first test information. The Cloud process can then directly send the first test information as the second test information, saving the time required to configure the second test information.

[0113] S106: Determine the concurrency performance of the first network manager based on the response of the first network manager to the second test information.

[0114] The concurrency performance of the first network manager is determined based on the time it takes the first network manager to respond to the concurrent second test message. For example, if the first network manager receives the concurrent second test message and processes it within 3 minutes, the concurrency performance of the first network manager is considered excellent; if the processing time is between 3 and 5 minutes, the concurrency performance of the first network manager is considered average; and if the processing time is between 5 and 8 minutes, the concurrency performance of the first network manager is considered poor.

[0115] The concurrency performance of the first network manager is judged according to the response time of the first network manager, so that designers can adaptively modify the concurrency performance of the first network manager.

[0116] Specifically, determining the concurrency performance of the first network manager includes S1061 to S1063.

[0117] like Figure 6 As shown, S1061: Obtain the preset response time of the first network manager, wherein the preset response time represents the time required for the first network manager to process a preset number of Cloud process concurrent information.

[0118] The preset response time of the first network manager is used as the criterion for judging the concurrency performance of the first network manager. This is the ideal time required to process the number of Cloud processes specified by the first network manager. This ideal time is used as the criterion for judging the processing performance of the first network manager and will be adjusted accordingly depending on the number of specified specifications. For example, a designer may specify the time required to process a Cloud process. Then, by multiplying the time required for a Cloud process by the number of specified specifications of the first network manager, the ideal time can be calculated.

[0119] S1062: Obtain the response time of the first network manager to the second test information.

[0120] The first network manager will obtain a response time based on the received concurrent second test information. The response time is the time required for the first network manager to actually process the concurrent second test information.

[0121] S1063: Determine the concurrency performance of the first network manager based on a comparison between the response time of the first network manager to the second test information and a preset response time.

[0122] The concurrency performance of the first network manager is determined by comparing the time actually required for the first network manager to process the concurrent second test information with the preset response time.

[0123] It is understandable that the preset response time can be a time period, for example, 3-5 minutes. The designer can determine the concurrency performance of the first network management system by comparing the time actually required for the first network management system to process the concurrent second test information with the preset response time.

[0124] In this embodiment, the second test information is sent to the first network manager by using the number of Cloud processes preset by the first network manager. The concurrency performance of the first network manager is judged based on the response time of the first network manager, thereby saving test costs and improving test efficiency.

[0125] In one embodiment, establishing a Linux server of the Ubuntu system includes debugging commands.

[0126] After obtaining the preset specifications of the first network manager, multiple Cloud processes sending first test information to the first network manager, and obtaining the actual specifications of the first network manager, a debugging command can be used to display the Cloud processes whose actual specifications differ from the preset specifications. The debugging command locates the Cloud processes with the differences.

[0127] For example, taking registration information as an example, the preset specification of the first network manager is 3000 units, and the actual specification is 2980 units. The difference of 20 units can be used to locate the reason why the first network manager did not respond through debugging commands.

[0128] For example, the debugging commands for registration status are enabled; debugging commands for various web request messages interacting with the first network management system are enabled; and debugging commands for various failure and error messages when interacting with the first network management system are enabled. The above debugging commands can be enabled individually or all at once.

[0129] By using debugging commands, the first network management system that manages the test equipment can be located to determine why the test equipment cannot be registered, at which registration process failed, and other issues. Based on the debugging commands or other reasons causing the actual specifications to be inconsistent with the preset specifications, the low cost of correcting the preset specifications of the first network management can be reduced. The specifications and network management performance of the network management equipment can be tested efficiently and conveniently. The debugging commands can be used as a positioning tool for correcting basic problems with preset specifications. Multiple network management systems can also be tested in parallel to improve test efficiency and reduce test costs.

[0130] Example

[0131] like Figure 7 and Figure 8 As shown, the steps of the method for efficiently testing network management specifications and concurrent performance of the present application include:

[0132] S201: Install a Linux server with Ubuntu system to form a test equipment simulation system;

[0133] S202: Port the Cloud process on the test device to the Ubuntu system, run it, and enable the Cloud process to simulate 500 test devices;

[0134] S203: On the Ubuntu system, run the test device simulation system, use the Cloud process to simulate any number of test devices, and initiate registration with the network management system under test.

[0135] S204: Run the test equipment simulation system to perform network management specification and concurrent performance testing, as well as basic problem location.

[0136] Among them, in step S202, the Cloud process is found on the test device simulation system and the Cloud process is transplanted to the Ubuntu system; the library files that the Cloud process depends on are configured; the serial number, registration name, registration password, and IP address and port number of the tested network management system to which registration is to be initiated are configured for the Cloud process simulation test device; and the number of Cloud process simulation devices is set.

[0137] Next, in step S203, adjust the number of simulated devices controlled by the test device simulation system; adjust the concurrent time of the simulated devices controlled by the test device simulation system; and set the relevant parameters of the device simulation system. Next, the test device simulation system can be used to test network management specifications and performance. For example, if the Cloud process value is set to 501 in the test device simulation system, 500 virtual devices can be simulated on the Linux server to initiate registration with the network management system. If the test device startup sleep time is set to 0 in the test device simulation system or the code corresponding to the sleep time is commented out, the network management performance of concurrently registering and managing 500 devices can be tested. To test other specification values, simply modify the number of test devices and the sleep time.

[0138] Finally, the test device simulation system has a debug command that displays the registration process for the test device simulation system to personnel. This command allows personnel to identify basic issues, such as why the test device is not registering and where the registration process failed. If the test device registration password is inconsistent with the password on the network management system, the debug command printout can be used to determine the error process and conduct further troubleshooting.

[0139] A second aspect of the present application provides an apparatus for efficiently testing network management specifications and concurrent performance, which is applied to the aforementioned method for efficiently testing network management specifications and concurrent performance. The apparatus includes:

[0140] A Cloud process establishment unit is used to establish multiple Cloud processes, where one Cloud process can simulate one test device;

[0141] A cloud process building unit, for establishing an environment for data transmission between the cloud process and the first network management system based on the cloud process;

[0142] a preset specification processing unit, configured to obtain preset specifications of a first network manager, wherein the plurality of Cloud processes send first test information to the first network manager, and obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager;

[0143] A preset specification correction unit, used to correct the preset specifications based on the actual specifications;

[0144] A concurrent performance testing unit, configured to select a preset number of Cloud processes and send concurrent second test information to the first network management system;

[0145] The concurrency performance determining unit is configured to determine the concurrency performance of the first network manager based on the response of the first network manager to the second test information.

[0146] A third aspect of the present application provides an electronic device, characterized by comprising:

[0147] processor;

[0148] a memory for storing processor-executable instructions;

[0149] The processor is used to read executable instructions from the memory and execute the instructions to implement the above-mentioned method for efficiently testing network management specifications and concurrent performance.

[0150] The fourth aspect of the present application provides a computer-readable storage medium having computer program instructions stored thereon, characterized in that when the program instructions are executed by a processor, the steps of the aforementioned method for efficiently testing network management specifications and concurrent performance are implemented.

[0151] The above embodiments merely represent specific implementations of the present invention. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, all of which fall within the scope of protection of the present invention.

Claims

1. A method for efficiently testing network management specifications and concurrent performance, characterized in that the method include: Establishing multiple Cloud processes, wherein one Cloud process can simulate one test device; Based on the Cloud process, establishing an environment in which the Cloud process can transmit data to the first network management system; Obtaining preset specifications of the first network manager, wherein the plurality of Cloud processes send first test information to the first network manager to obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager; If the actual specification is smaller than the preset specification, modify the setting procedure of the preset specification; executing again the step of sending the first test information to the first network manager by the plurality of Cloud processes to obtain the actual specifications of the first network manager; If the actual specification is equal to the preset specification, stopping the process of modifying the preset specification; Selecting the preset number of Cloud processes and sending concurrent second test information to the first network manager; The concurrency performance of the first network manager is determined based on a response of the first network manager to the second test information.

2. The method for efficiently testing network management specifications and concurrent performance according to claim 1, characterized in that: The step of establishing, based on the Cloud process, an environment in which the Cloud process can transmit data with the first network management system includes: Build the Cloud process operating environment based on the library files that the Cloud process depends on; The information of the test device is configured for each Cloud process, wherein the information of the test device at least includes the IP address and port number of the first network manager to which registration is to be initiated.

3. The method for efficiently testing network management specifications and concurrent performance according to claim 2, characterized in that: The step of configuring the relevant information of the test device for each Cloud process, wherein the relevant information includes at least the IP address and port number of the first network manager, includes: Get the IP address and port number of the second network management system; Based on the IP address and port number of the second network manager, the information of the test device is configured for each Cloud process, wherein the information of the test device includes at least the IP address and port number of the first network manager to which registration is to be initiated and the IP address and port number of the second network manager.

4. The method for efficiently testing network management specifications and concurrent performance according to claim 1, characterized in that: The step of obtaining preset specifications of the first network manager, the plurality of Cloud processes sending first test information to the first network manager, and obtaining actual specifications of the first network manager includes: Determining the number of the Cloud processes according to preset specifications of the first network management; Divide the Cloud processes into multiple groups of Cloud processes according to the number of the Cloud processes; The plurality of groups of the Cloud processes send the first test information to the first network manager in sequence in groups; Determine the actual specifications of the first network manager according to the response of the first network manager to receiving the first test information.

5. The method for efficiently testing network management specifications and concurrent performance according to claim 1, characterized in that: The step of selecting the preset number of Cloud processes and sending concurrent second test information to the first network manager includes: Configuring the second test information of the Cloud process based on the test requirements of the first network management; According to the preset specifications of the first network manager, the Cloud process configured with the second test information is called, and the second test information is concurrently sent to the first network manager.

6. The method for efficiently testing network management specifications and concurrent performance according to claim 1, characterized in that: The step of determining the concurrency performance of the first network manager based on the response of the first network manager to the second test information includes: Obtaining a preset response time of the first network manager, wherein the preset response time represents the time required for the first network manager to process the preset number of concurrent messages of the Cloud process; Obtaining a response time of the first network manager to the second test information; The concurrency performance of the first network manager is determined based on a comparison between the response time of the first network manager to the second test information and the preset response time.

7. A device for efficiently testing network management specifications and concurrent performance, characterized in that: The method for efficiently testing network management specifications and concurrent performance according to any one of claims 1 to 6, the device comprising: A Cloud process establishment unit, configured to establish multiple Cloud processes, wherein one Cloud process can simulate one test device; A Cloud process building unit, configured to establish an environment for data transmission between the Cloud process and the first network management system based on the Cloud process; a preset specification processing unit, configured to obtain preset specifications of the first network manager, wherein the plurality of Cloud processes send first test information to the first network manager, and obtain actual specifications of the first network manager, wherein the preset specifications represent the number of maximum load test devices of the first network manager; a preset specification correction unit configured to correct a setting procedure of the preset specification if the actual specification is smaller than the preset specification; executing again the step of sending the first test information to the first network manager by the plurality of Cloud processes to obtain the actual specifications of the first network manager; If the actual specification is equal to the preset specification, stopping the process of modifying the preset specification; A concurrent performance testing unit, configured to select the Cloud processes of the preset number of specifications and send concurrent second test information to the first network manager; The concurrency performance determining unit is configured to determine the concurrency performance of the first network manager based on the response of the first network manager to the second test information.

8. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method for efficiently testing network management specifications and concurrent performance as described in any one of claims 1-6.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method for efficiently testing network management specifications and concurrent performance described in any one of claims 1-6 are implemented.

Images