A performance testing method and device

Abstract

The present application provides a performance testing method and device, which relates to the field of software testing and can quickly create a high-load network situation to meet testing needs. The method includes: after connecting to the target base station, the first terminal to be tested can execute the target instruction triggered by the user to obtain a first execution result; then start the software to be tested, and execute the target instruction based on the started software to be tested to obtain a second execution result; finally, based on at least one execution result, determine the performance test result of the software to be tested. The target base station is used to provide data transmission services to the first terminal to be tested; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees the data transmission services of multiple connected terminals; the second execution result is obtained based on the remaining bandwidth of the target base station. The embodiment of the present application is used in the software testing process.

Description

Technical Field

[0001] The present application relates to the field of software testing, and in particular to a performance testing method and device. Background Art

[0002] Performance testing of software under test refers to the process of running the software under test under specified conditions and evaluating whether the software under test meets the design requirements based on the comparison of the execution results of the same instructions on the terminal device before and after the software under test is run.

[0003] Currently, when performing performance testing on software under test, the test is usually conducted on a terminal connected to a target base station in a real-world environment. However, when testing the software under test installed on a terminal under high network load, the probability of high network load in real life is often too low to meet the testing requirements, resulting in an inability to effectively test the performance of the software under test. High network load refers to a situation where the network bandwidth occupied by the terminal connected to the target base station reaches the bandwidth threshold. Summary of the Invention

[0004] The present application provides a performance testing method and device that can quickly create a high-load network situation to meet testing needs.

[0005] To achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, the present application provides a performance testing method, applied to a first terminal to be tested, the method comprising:

[0007] Connect to a target base station; the target base station is used to provide data transmission services to the first terminal to be tested.

[0008] Execute the target instruction triggered by the user to obtain a first execution result; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0009] The software to be tested is started, and the target instruction is executed based on the started software to obtain a second execution result; the software to be tested is the associated software when the target instruction is executed; the second execution result is obtained based on the remaining bandwidth of the target base station.

[0010] Based on at least one execution result, a performance test result of the software to be tested is determined; the at least one execution result includes a first execution result and a second execution result.

[0011] The performance testing method provided by the present application is that after connecting to the target base station, the first terminal to be tested can execute the target instruction triggered by the user to obtain a first execution result; then start the software to be tested, and execute the target instruction based on the started software to be tested to obtain a second execution result; finally, based on at least one execution result, determine the performance test result of the software to be tested. Among them, the target base station is used to provide data transmission services to the first terminal to be tested; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees the data transmission services of multiple connected terminals; the second execution result is obtained based on the remaining bandwidth of the target base station; at least one execution result includes the first execution result and the second execution result. Through this method, the first execution result and the second execution result can be obtained based on the remaining bandwidth after the target base station guarantees the data transmission services of multiple connected terminals, that is, the first execution result and the second execution result can be obtained under high network load conditions, which meets the testing needs and improves the efficiency of performance testing of the software to be tested.

[0012] Optionally, the at least one execution result further includes a third execution result; and determining a performance test result of the software to be tested based on the at least one execution result includes:

[0013] The performance test result of the software to be tested is determined based on the first execution result, the second execution result and the third execution result; the third execution result is obtained by the second terminal to be tested based on the target instruction triggered by the user.

[0014] The performance testing method provided herein can also determine the performance test result of the software under test based on the first, second, and third execution results, where the third execution result is obtained by the second terminal under test based on a target instruction triggered by a user. This method allows the execution results of the first and second terminals under test to form a control group, making the performance test results of the software under test more rigorous.

[0015] In a second aspect, the present application provides a performance testing method, applied to a target base station, the method comprising:

[0016] Determine the remaining bandwidth; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0017] Connect to the terminal to be tested and use the remaining bandwidth to transmit data with the terminal to be tested, so that the terminal to be tested obtains a first execution result and a second execution result, and determines the performance test result of the software to be tested based on at least one execution result; the at least one execution result includes the first execution result and the second execution result; the first execution result is obtained by the terminal to be tested executing a target instruction triggered by the user before starting the software to be tested; the second execution result is obtained by the terminal to be tested executing the target instruction triggered by the user after starting the software to be tested.

[0018] Optionally, determine the remaining bandwidth, including:

[0019] Determine the number of terminals to be used.

[0020] Based on the bandwidth threshold and the number of terminals to be used, the guaranteed bit rate GBR of each terminal to be used is determined so that each terminal to be used uses GBR to access the cloud server; the bandwidth threshold is the maximum bandwidth of the target base station in ensuring data transmission services for multiple connected terminals.

[0021] The remaining bandwidth is determined based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with GBR when accessing the cloud server.

[0022] Optionally, connecting to the terminal to be tested and using the remaining bandwidth to transmit data with the terminal to be tested includes:

[0023] Detects bandwidth usage.

[0024] If the occupied bandwidth reaches the bandwidth threshold, the terminal to be tested is connected, and data transmission is performed with the terminal to be tested based on the remaining bandwidth.

[0025] In a third aspect, the present application provides a performance testing device, comprising:

[0026] The first connecting unit is configured to connect to a target base station; the target base station is configured to provide a data transmission service to the first terminal to be tested.

[0027] The first execution unit is used to execute the target instruction triggered by the user to obtain a first execution result; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0028] The second execution unit is used to start the software to be tested and execute the target instruction based on the started software to be tested to obtain a second execution result; the software to be tested is the associated software when executing the target instruction; the second execution result is obtained based on the remaining bandwidth of the target base station.

[0029] The first determining unit is configured to determine a performance test result of the software to be tested based on at least one execution result; the at least one execution result includes a first execution result and a second execution result.

[0030] Optionally, the at least one execution result further includes a third execution result; and the first determining unit is specifically configured to:

[0031] The performance test result of the software to be tested is determined based on the first execution result, the second execution result and the third execution result; the third execution result is obtained by the second terminal to be tested based on the target instruction triggered by the user.

[0032] In a fourth aspect, the present application provides a performance testing device, comprising:

[0033] The second determining unit is configured to determine a remaining bandwidth; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for a plurality of connected terminals.

[0034] The second connection unit is used to connect to the terminal to be tested and use the remaining bandwidth to transmit data with the terminal to be tested, so that the terminal to be tested obtains the first execution result and the second execution result, and determines the performance test result of the software to be tested based on at least one execution result; the at least one execution result includes the first execution result and the second execution result; the first execution result is obtained by the terminal to be tested executing the target instruction triggered by the user before starting the software to be tested; the second execution result is obtained by the terminal to be tested executing the target instruction triggered by the user after starting the software to be tested.

[0035] Optionally, the second determining unit is specifically configured to:

[0036] Determine the number of terminals to be used.

[0037] Based on the bandwidth threshold and the number of terminals to be used, the guaranteed bit rate GBR of each terminal to be used is determined so that each terminal to be used uses GBR to access the cloud server; the bandwidth threshold is the maximum bandwidth of the target base station in ensuring data transmission services for multiple connected terminals.

[0038] The remaining bandwidth is determined based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with GBR when accessing the cloud server.

[0039] Optionally, the second connection unit is specifically configured to:

[0040] Detects bandwidth usage.

[0041] If the occupied bandwidth reaches the bandwidth threshold, the terminal to be tested is connected, and data transmission is performed with the terminal to be tested based on the remaining bandwidth.

[0042] In a fifth aspect, the present application provides a performance testing device, comprising: a processor and a communication interface; the communication interface and the processor are coupled, and the processor is used to run a computer program or instructions to implement the performance testing method described in the first aspect and any possible implementation of the first aspect, or to implement the performance testing method described in the second aspect and any possible implementation of the second aspect.

[0043] In the sixth aspect, the present application provides a computer-readable storage medium, which stores instructions. When the instructions are executed on a terminal, the terminal executes the performance testing method described in the first aspect and any possible implementation of the first aspect, or executes the performance testing method described in the second aspect and any possible implementation of the second aspect.

[0044] In the seventh aspect, an embodiment of the present application provides a computer program product comprising instructions. When the computer program product is run on a performance testing device, the performance testing device executes the performance testing method described in the first aspect and any possible implementation of the first aspect, or executes the performance testing method described in the second aspect and any possible implementation of the second aspect.

[0045] In an eighth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run a computer program or instructions to implement the performance testing method described in the first aspect and any possible implementation of the first aspect, or to implement the performance testing method described in the second aspect and any possible implementation of the second aspect.

[0046] Specifically, the chip provided in the embodiment of the present application also includes a memory for storing computer programs or instructions. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A network architecture diagram of a performance testing method provided in an embodiment of the present application;

[0048] Figure 2 An interactive flow chart of a performance testing method provided in an embodiment of the present application;

[0049] Figure 3 An interactive flow chart of another performance testing method provided in an embodiment of the present application;

[0050] Figure 4 A flow chart of a method for establishing a connection with a terminal to be tested provided in an embodiment of the present application;

[0051] Figure 5A flow chart of a performance testing method provided in an embodiment of the present application;

[0052] Figure 6 A flow chart of a performance testing method provided in an embodiment of the present application;

[0053] Figure 7 A structural block diagram of a performance testing device provided in an embodiment of the present application;

[0054] Figure 8 A structural block diagram of a performance testing device provided in an embodiment of the present application;

[0055] Figure 9 A schematic structural diagram of a performance testing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The performance testing method and device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0057] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0058] The terms "first" and "second" and the like in the specification and drawings of this application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.

[0059] Furthermore, the terms "including," "having," and any variations thereof, as used in the description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0060] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0061] Figure 1 A network architecture diagram of a performance testing method provided in an embodiment of the present application, such as Figure 1As shown, the network architecture diagram may include a cloud server 101, a terminal to be tested 102, a terminal to be used 103, and a base station 104. The terminal to be tested 102 and the terminal to be used 103 may include, but are not limited to, mobile phones, portable computers, and other terminal devices, and the number of the terminal to be tested 102 and the terminal to be used 103 may be one or more.

[0062] The terminal to be tested 102 and the terminal to be used 103 may include a transceiver, a processor, and memory, each of which may be connected to the processor. The transceiver can be used to receive or transmit messages or data and may include, but is not limited to, at least one amplifier, a tuner, one or more oscillators, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. The memory can be used to store data generated locally or sent by a server during a network conference. The processor may be the control center of the terminal device, connecting various components of the terminal device, such as the transceiver and memory, using various interfaces and circuits. Optionally, the processor may include one or more processing units; preferably, the processor may integrate an application processor and a modem processor, wherein the application processor primarily handles the operating system and the modem processor primarily handles wireless communications. The processor may also be a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device.

[0063] The terminal to be tested 102 and the terminal to be used 103 can access the cloud server through the base station 104. The base station 104 can configure GBR (Guaranteed Bit Rate) for the terminal to be tested 102 or the terminal to be used 103 based on its own theoretical air interface bandwidth to ensure the minimum guaranteed bandwidth of the terminal to be tested 102 or the terminal to be used 103 when accessing the cloud server.

[0064] In the embodiment of the present application, the base station 104 may also be an indoor distributed device. The following embodiment is described using the base station as an example.

[0065] Performance testing of software under test refers to the process of running the software under test under specified conditions and evaluating whether the software under test meets the design requirements based on the comparison of the execution results of the same instructions on the terminal device before and after the software under test is run.

[0066] Currently, in a 4G (Generation) network environment, when a performance test is performed on a software to be tested, the test is usually performed on a terminal to be tested that has established a connection relationship with a target base station in a real environment. However, when the software to be tested installed in the terminal to be tested needs to be tested in a high-network-load environment, the probability of a high-network-load situation occurring in real life is often very low, resulting in an inability to effectively test the performance of the software to be tested. For example, in a 4G network, when a performance test is performed on an SDK (Software Development Kit) video accelerator, it is necessary to perform an acceleration test on a video that experiences a freeze during live video playback under a high-network-load situation. However, because the probability of a high-network-load situation occurring in a real environment is very low, this cannot meet the test requirements, resulting in an inability to effectively test the performance of the video accelerator.

[0067] Based on this, the present application provides a performance testing method. After connecting to a target base station, the first terminal to be tested can execute a target instruction triggered by the user to obtain a first execution result; then the software to be tested is started, and the target instruction is executed based on the started software to be tested to obtain a second execution result; finally, based on at least one execution result, the performance test result of the software to be tested is determined. The target base station is used to provide data transmission services to the first terminal to be tested; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals; the second execution result is obtained based on the remaining bandwidth of the target base station; and at least one execution result includes the first execution result and the second execution result. Through this method, the first execution result and the second execution result can be obtained based on the remaining bandwidth after the target base station guarantees data transmission services for multiple connected terminals, that is, the first execution result and the second execution result can be obtained under high network load conditions, meeting testing needs and improving the efficiency of performance testing of the software to be tested.

[0068] Figure 2 An interactive flow chart of a performance testing method provided in an embodiment of the present application, such as Figure 2 As shown, the method includes the following steps:

[0069] Step S201: The target base station establishes a connection with the terminal to be used;

[0070] Step S202: The target base station configures a GBR for the terminal to be used;

[0071] In the embodiment of the present application, the number of terminals to be used may be one or more, and this application does not limit this.

[0072] In an optional embodiment, after the target base station establishes a connection relationship with the terminal to be used, it can determine the number of each terminal to be used; then, based on the bandwidth threshold and the number of each terminal to be used, determine the guaranteed bit rate GBR of each terminal to be used; and configure each terminal to be used based on the determined GBR of each terminal to be used, wherein the bandwidth threshold is the maximum bandwidth of the target base station in ensuring data transmission services for multiple connected terminals, that is, the bandwidth threshold is the critical value at which the network load reaches a high load.

[0073] For example, in one embodiment, assuming there are two terminals to be used and the bandwidth threshold is 140 Mbps, when the actual network bandwidth reaches 140 Mbps, the network will be overloaded. Therefore, the GBR for each terminal to be used can be set to 70 Mbps, meaning the minimum guaranteed bandwidth for each terminal to be used is 70 Mbps.

[0074] Step S203: The terminal to be used accesses the cloud server using GBR;

[0075] In the embodiment of the present application, after GBR is configured for each terminal to be used in step S202, each terminal to be used can use GBR to access the cloud server to quickly occupy the air interface bandwidth of the target base station and create a high-load network scenario.

[0076] Step S204: The first terminal to be tested establishes a connection with the target base station.

[0077] Step S205: The first terminal to be tested executes the target instruction triggered by the user to obtain a first execution result.

[0078] After establishing a connection with the target base station, the first terminal to be tested can respond to a user-triggered target instruction, execute the target instruction, and obtain a first execution result. The first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station ensures data transmission services for multiple connected terminals.

[0079] In the embodiment of the present application, the number of the first terminals to be tested may be one or more, and this application does not impose any limitation on this.

[0080] In the embodiment of the present application, the remaining bandwidth may be the difference between the theoretical air interface bandwidth of the target base station and the bandwidth threshold. The theoretical air interface bandwidth of the target base station may be pre-set or determined based on the number of terminals allowed to access the target base station and the bandwidth required for data transmission by each terminal, which is not limited in this application.

[0081] Step S206: The first terminal to be tested starts the software to be tested, and executes the target instruction triggered by the user based on the started software to be tested to obtain a second execution result.

[0082] After obtaining the first execution result through step S205, the first terminal to be tested can start the software to be tested in response to the user's startup instruction for the software to be tested, and continue to execute the target instruction triggered by the user to obtain the second execution result, wherein the test software can be application software installed in the terminal to be tested.

[0083] Step S207: The first terminal to be tested determines a performance test result of the software to be tested based on the first execution result and the second execution result.

[0084] In the embodiment of the present application, the software to be tested can be video acceleration software or audio acceleration software, which is not limited in the present application. The following description uses video acceleration software as an example, wherein the video acceleration software can restore smooth video playback when a video freezes during video playback.

[0085] Exemplarily, in one embodiment, assuming that the software to be tested is video acceleration software, before opening the video acceleration software, the first terminal to be tested can respond to the video playback instruction input by the user for a 35-second target video file, play the target video file, and obtain a first execution result. Assuming the first execution result, that is, the duration of playing the target video file is 50 seconds, that is, the video playback is stuck; the first terminal to be tested can respond to the user's startup instruction for the video acceleration software, start the video acceleration software, and continue to play the target video file, and obtain a second execution result. Assuming the second execution result, that is, the duration of playing the target video file is 35 seconds, that is, the video playback resumes to be smooth, therefore, it can be determined that the performance test result of the software to be tested is excellent.

[0086] In another embodiment, assuming that the first execution result is 50 seconds and the second execution result is 45 seconds, it can be determined that the performance test result of the video acceleration software is relatively good, that is, the video acceleration software has a certain acceleration effect, but the acceleration effect still needs to be improved.

[0087] In another embodiment, assuming that the first execution result is 50 seconds and the second execution result is 50 seconds, it can be determined that the performance test result of the video acceleration software is poor, that is, the video acceleration software has no effect.

[0088] In an optional implementation, the above steps S204 to S207 may be replaced by the following steps: Figure 3 As shown, the replacement steps include:

[0089] Step S301: A first terminal to be tested establishes a connection with a target base station.

[0090] Step S302: The second terminal to be tested establishes a connection with the target base station.

[0091] Step S303: The first terminal to be tested executes the target instruction triggered by the user to obtain a first execution result.

[0092] Step S304: The second terminal to be tested executes the target instruction triggered by the user to obtain a third execution result.

[0093] After establishing a connection with the target base station, the second terminal to be tested can respond to the target instruction triggered by the user, execute the target instruction, and obtain a third execution result, wherein the third execution result is obtained based on the remaining bandwidth of the target base station.

[0094] In the embodiment of the present application, the number of the second terminals to be tested may be one or more, which is not limited in the present application.

[0095] Step S305 : The first terminal to be tested starts the software to be tested, and executes the target instruction triggered by the user based on the started software to be tested, to obtain a second execution result.

[0096] Step S306: The first terminal to be tested determines a performance test result of the software to be tested based on the first execution result, the second execution result, and the third execution result.

[0097] Exemplarily, in one embodiment, assuming that the software to be tested is SDK video acceleration software, the SDK video acceleration software can accelerate videos that have a stuck phenomenon during live video playback. The first terminal to be tested and the second test terminal can respond to the user's playback instruction for the same live video, play the live video, and obtain a first execution result and a third execution result. Assuming that the first execution result and the third execution result both indicate that the live video has a stuck phenomenon during playback; the first terminal to be tested can respond to the user's startup instruction for the SDK video acceleration software, start the SDK video acceleration software, and continue to play the live video, and obtain a second execution result. Assuming that the second execution result indicates that the live video has no stuck phenomenon during playback, that is, the video playback has resumed smoothness, while the second test terminal still has a stuck phenomenon when playing the live video (that is, the third execution result still indicates that the live video has a stuck phenomenon during playback), it can be determined that the performance test result of the software to be tested is excellent.

[0098] In the above embodiment, when testing the performance of the video acceleration software, only when the network load reaches a high load will the video playback experience a lag phenomenon. At this time, the video accelerator is used to test the performance of the video accelerator. Therefore, in this application, by configuring GBR for each terminal to be used, ensuring the minimum bandwidth of each terminal to be used when accessing the server, a high-load network environment can be quickly created to meet the test conditions and thereby improve test efficiency.

[0099] In an optional embodiment, before establishing a connection with the first terminal to be tested, the target base station may also detect the occupied bandwidth occupied by the terminal to be used in the process of accessing the server. When the occupied bandwidth reaches the bandwidth threshold, a connection is established with the terminal to be tested to ensure that when the first terminal to be tested establishes a connection with the target base station, the network environment meets the test conditions, that is, to ensure that the network environment is a high-load network environment.

[0100] Specifically, Figure 4 To implement the specific implementation method of step S204 above, the method is executed by the target base station, such as Figure 4 As shown, the method includes the following steps:

[0101] Step S401: Detecting the occupied bandwidth corresponding to the terminal to be used;

[0102] The occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with GBR when accessing the cloud server.

[0103] Step S402: Check whether the occupied bandwidth is less than the bandwidth threshold; if so, execute step S403; if not, execute step S401;

[0104] Step S403: Establish a connection with the first terminal to be tested.

[0105] Specifically, the target base station can monitor the actual air interface bandwidth of the target base station in real time through the network monitoring platform. That is, the occupied bandwidth occupied by the terminal to be used when accessing the server using the GBR configured by the target base station continues to be monitored. If the occupied bandwidth is less than the bandwidth threshold, the monitoring continues. If the occupied bandwidth is greater than or equal to the bandwidth threshold, a connection is established with the first terminal to be tested.

[0106] For example, in one embodiment, assuming that the bandwidth threshold is 140M, the occupied bandwidth occupied by the terminal to be used in the process of accessing the server using the GBR configured by the target base station is 100M, that is, the occupied bandwidth is less than the bandwidth threshold. The target base station can continue to monitor the occupied bandwidth until the occupied bandwidth reaches 140M.

[0107] In another embodiment, assuming that the bandwidth threshold is 140M, the occupied bandwidth occupied by the terminal to be used in the process of accessing the server using the GBR configured by the target base station is 140M, that is, the occupied bandwidth is equal to the bandwidth threshold, and the target base station can establish a connection with the first terminal to be tested.

[0108] Based on the same inventive concept, the embodiment of the present application further provides a performance testing method, which is applied to a first terminal to be tested, such as Figure 5 As shown, the method includes:

[0109] Step S501: Connect to a target base station.

[0110] The target base station is used to provide a data transmission service to the first terminal to be tested.

[0111] Step S502: Execute the target instruction triggered by the user to obtain a first execution result.

[0112] The first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0113] Step S503 , starting the software to be tested, and executing the target instruction based on the started software to be tested to obtain a second execution result.

[0114] The software to be tested is associated software when executing the target instruction; the second execution result is obtained based on the remaining bandwidth of the target base station.

[0115] Step S504: determining a performance test result of the software to be tested based on at least one execution result.

[0116] The at least one execution result includes a first execution result and a second execution result.

[0117] Based on the same inventive concept, the embodiment of the present application also provides a performance testing method applied to a target base station, such as Figure 6 As shown, the method includes:

[0118] Step S601: Determine the remaining bandwidth.

[0119] The remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0120] Step S602: Connect each terminal to be used so that the terminal to be used accesses the cloud server using GBR.

[0121] Step S603: connecting to the terminal to be tested and using the remaining bandwidth to perform data transmission with the terminal to be tested, so that the terminal to be tested obtains the first execution result and the second execution result, and determining the performance test result of the software to be tested based on at least one execution result.

[0122] At least one execution result includes a first execution result and a second execution result; the first execution result is obtained by the terminal under test executing the target instruction triggered by the user before starting the software under test; the second execution result is obtained by the terminal under test executing the target instruction triggered by the user after starting the software under test.

[0123] In the embodiment of the present application, the performance test device can be divided into functional modules or functional units according to the above method example. For example, each functional module or functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

[0124] Figure 7 A schematic diagram of a performance testing device provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the device includes:

[0125] The first connecting unit 701 is configured to connect to a target base station; the target base station is configured to provide a data transmission service to the first terminal to be tested.

[0126] The first execution unit 702 is used to execute the target instruction triggered by the user to obtain a first execution result; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals.

[0127] The second execution unit 703 is used to start the software to be tested and execute the target instruction based on the started software to be tested to obtain a second execution result; the software to be tested is the associated software when executing the target instruction; the second execution result is obtained based on the remaining bandwidth of the target base station.

[0128] The first determining unit 704 is configured to determine a performance test result of the software to be tested based on at least one execution result; the at least one execution result includes a first execution result and a second execution result.

[0129] Optionally, the at least one execution result further includes a third execution result; and the first determining unit 704 is specifically configured to:

[0130] The performance test result of the software to be tested is determined based on the first execution result, the second execution result and the third execution result; the third execution result is obtained by the second terminal to be tested based on the target instruction triggered by the user.

[0131] Figure 8 A schematic diagram of another performance testing device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the device includes:

[0132] The second determining unit 801 is configured to determine a remaining bandwidth; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for a plurality of connected terminals.

[0133] The second connection unit 802 is used to connect to the terminal to be tested and use the remaining bandwidth to transmit data with the terminal to be tested, so that the terminal to be tested obtains the first execution result and the second execution result, and determines the performance test result of the software to be tested based on at least one execution result; the at least one execution result includes the first execution result and the second execution result; the first execution result is obtained by the terminal to be tested executing the target instruction triggered by the user before starting the software to be tested; the second execution result is obtained by the terminal to be tested executing the target instruction triggered by the user after starting the software to be tested.

[0134] Optionally, the second determining unit 801 is specifically configured to:

[0135] Determine the number of terminals to be used.

[0136] Based on the bandwidth threshold and the number of terminals to be used, the guaranteed bit rate GBR of each terminal to be used is determined so that each terminal to be used uses GBR to access the cloud server; the bandwidth threshold is the maximum bandwidth of the target base station in ensuring data transmission services for multiple connected terminals.

[0137] The remaining bandwidth is determined based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with GBR when accessing the cloud server.

[0138] Optionally, the second connection unit 802 is specifically configured to:

[0139] Detects bandwidth usage.

[0140] If the occupied bandwidth reaches the bandwidth threshold, the terminal to be tested is connected, and data transmission is performed with the terminal to be tested based on the remaining bandwidth.

[0141] Figure 9A schematic diagram of another possible structure of the performance testing device involved in the above embodiments is shown. The performance testing device includes a processor 901 and a communication interface 902. The processor 901 is used to control and manage the operation of the performance testing device, and the communication interface 902 is used to support communication between the performance testing device and other network entities. The performance testing device may also include a memory 903 and a bus 904. The memory 903 is used to store program code and data of the performance testing device.

[0142] Among them, the memory 903 can be a memory in a performance testing device, etc., and the memory can include a volatile memory, such as a random access memory; the memory can also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory can also include a combination of the above types of memory.

[0143] The processor 901 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processor may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, or a combination of a DSP and a microprocessor.

[0144] The bus 904 may be an Extended Industry Standard Architecture (EISA) bus or the like. The bus 904 may be divided into an address bus, a data bus, a control bus, or the like. For ease of representation, Figure 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0145] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0146] An embodiment of the present application provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is caused to execute the performance testing method in the above method embodiment.

[0147] An embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a computer, the computer executes the performance testing method in the method flow shown in the above method embodiment.

[0148] Among them, the computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a register, a hard disk, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above, or any other form of computer-readable storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an application-specific integrated circuit (ASIC). In the embodiments of the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0149] An embodiment of the present invention provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the performance testing method provided in the present application.

[0150] Since the performance testing device, computer-readable storage medium, and computer program product in the embodiments of the present invention can be applied to the above method, the technical effects that can be obtained can also refer to the above method embodiments, and the embodiments of the present invention will not be repeated here.

[0151] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0152] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0153] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0154] The above are only specific embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A performance testing method, characterized in that: Applied to a first terminal to be tested, the method includes: Connecting to a target base station; the target base station is used to provide data transmission services to the first terminal to be tested; Execute the target instruction triggered by the user to obtain a first execution result; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees the data transmission service of multiple connected terminals; the remaining bandwidth is determined by the target base station based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used configured with a guaranteed bit rate GBR; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with the GBR when accessing the cloud server; the GBR of each terminal to be used is determined by the target base station based on a bandwidth threshold and the number of each terminal to be used; the bandwidth threshold is the maximum bandwidth of the target base station after guaranteeing the data transmission service of multiple connected terminals, that is, the bandwidth threshold is the critical value of the network load reaching a high load; when the occupied bandwidth reaches the bandwidth threshold, the network environment is a high-load network environment; Starting the software to be tested, and executing the target instruction based on the started software to be tested to obtain a second execution result; the software to be tested is associated software when executing the target instruction; the second execution result is obtained based on the remaining bandwidth of the target base station; Based on at least one execution result, a performance test result of the software to be tested is determined; the at least one execution result includes the first execution result and the second execution result.

2. The method according to claim 1, characterized in that The at least one execution result further includes a third execution result; and determining the performance test result of the software to be tested based on the at least one execution result includes: A performance test result of the software to be tested is determined based on the first execution result, the second execution result, and the third execution result; the third execution result is obtained by the second terminal to be tested based on the target instruction triggered by the user.

3. A performance testing method, characterized in that: Applied to a target base station, the method includes: Determining a remaining bandwidth; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals; connecting to a terminal under test and performing data transmission with the terminal under test using the remaining bandwidth, so that the terminal under test obtains a first execution result and a second execution result, and determining a performance test result of the software under test based on at least one execution result; the at least one execution result includes the first execution result and the second execution result; the first execution result is obtained by the terminal under test executing a target instruction triggered by a user before starting the software under test; the second execution result is obtained by the terminal under test executing the target instruction triggered by the user after starting the software under test; The determining of the remaining bandwidth includes: Determine the number of each terminal to be used; Determining, based on the bandwidth threshold and the number of the terminals to be used, a guaranteed bit rate (GBR) for each terminal to be used, so that each terminal to be used uses the GBR to access the cloud server; the bandwidth threshold is the maximum bandwidth of the target base station after guaranteeing data transmission services for multiple connected terminals, that is, the bandwidth threshold is a critical value at which the network load reaches a high load; The remaining bandwidth is determined based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with the GBR when accessing the cloud server; when the occupied bandwidth reaches the bandwidth threshold, the network environment is a high-load network environment.

4. The method according to claim 3, characterized in that The connecting to the terminal to be tested and using the remaining bandwidth to perform data transmission with the terminal to be tested includes: detecting the occupied bandwidth; If the occupied bandwidth reaches the bandwidth threshold, the terminal to be tested is connected, and data transmission is performed with the terminal to be tested based on the remaining bandwidth.

5. A performance testing device, characterized in that: The device comprises: A first connecting unit, configured to connect to a target base station; the target base station is configured to provide a data transmission service to the first terminal to be tested; a first execution unit, configured to execute a target instruction triggered by a user to obtain a first execution result; the first execution result is obtained based on the remaining bandwidth of the target base station; the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for a plurality of connected terminals; the remaining bandwidth is determined by the target base station based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each to-be-used terminal configured with a guaranteed bit rate (GBR); the occupied bandwidth refers to the bandwidth occupied by each to-be-used terminal configured with the GBR when accessing a cloud server; the GBR of each to-be-used terminal is determined by the target base station based on a bandwidth threshold and the number of each to-be-used terminal; the bandwidth threshold is the maximum bandwidth of the target base station after guaranteeing data transmission services for a plurality of connected terminals, that is, the bandwidth threshold is the critical value at which the network load reaches a high load; when the occupied bandwidth reaches the bandwidth threshold, the network environment is a high-load network environment; a second execution unit, configured to start the software to be tested, and execute the target instruction based on the started software to be tested to obtain a second execution result; the software to be tested is associated software when the target instruction is executed; and the second execution result is obtained based on the remaining bandwidth of the target base station; The first determining unit is configured to determine a performance test result of the software to be tested based on at least one execution result; the at least one execution result includes the first execution result and the second execution result.

6. The device according to claim 5, characterized in that The at least one execution result further includes a third execution result; and the first determining unit is specifically configured to: A performance test result of the software to be tested is determined based on the first execution result, the second execution result, and the third execution result; the third execution result is obtained by the second terminal to be tested based on the target instruction triggered by the user.

7. A performance testing device, characterized in that: The device comprises: A second determining unit is configured to determine a remaining bandwidth, wherein the remaining bandwidth is the bandwidth remaining after the target base station guarantees data transmission services for multiple connected terminals; a second connection unit, configured to connect to a terminal under test and perform data transmission with the terminal under test using the remaining bandwidth, so that the terminal under test obtains a first execution result and a second execution result, and determine a performance test result of the software under test based on at least one execution result; the at least one execution result includes the first execution result and the second execution result; the first execution result is obtained by the terminal under test executing a target instruction triggered by a user before starting the software under test; and the second execution result is obtained by the terminal under test executing the target instruction triggered by the user after starting the software under test; The second determining unit is specifically configured to: Determine the number of each terminal to be used; Determining, based on the bandwidth threshold and the number of the terminals to be used, a guaranteed bit rate (GBR) for each terminal to be used, so that each terminal to be used uses the GBR to access the cloud server; the bandwidth threshold is the maximum bandwidth of the target base station after guaranteeing data transmission services for multiple connected terminals, that is, the bandwidth threshold is a critical value at which the network load reaches a high load; The remaining bandwidth is determined based on the theoretical air interface bandwidth of the target base station and the occupied bandwidth corresponding to each terminal to be used; the occupied bandwidth refers to the bandwidth occupied by each terminal to be used configured with the GBR when accessing the cloud server; when the occupied bandwidth reaches the bandwidth threshold, the network environment is a high-load network environment.

8. The device according to claim 7, characterized in that The second connecting unit is specifically used to: detecting the occupied bandwidth; If the occupied bandwidth reaches the bandwidth threshold, the terminal to be tested is connected, and data transmission is performed with the terminal to be tested based on the remaining bandwidth.

9. A performance testing device, characterized in that: include: A processor and a communication interface; the communication interface is coupled to the processor, and the processor is used to run a computer program or instruction to implement the performance testing method according to any one of claims 1-2 or any one of claims 3-4.

10. A computer-readable storage medium storing instructions, characterized in that: When a computer executes the instruction, the computer executes the performance testing method described in any one of claims 1-2 or any one of claims 3-4.

Images