Stability test method, to-be-tested device, server, medium and product

Abstract

The invention provides a stability test method, a to-be-tested device, a server, a medium and a product. According to one example of the application, the method is applied to a server, and the method can comprise: sending a simulation request to a device to be tested, so that the device to be tested executes a simulation operation based on simulation configuration data of a service scene, the simulation request being used for indicating execution of the simulation operation, and the simulation configuration data being configured based on a test requirement of the service scene; and in response to the received acquisition data sent by the to-be-tested equipment, performing stability analysis on simulation acquisition data in the acquisition data.

Description

Technical Field

[0001] The present application relates to the technical field of stability testing, and in particular to a stability testing method, a device to be tested, a server, a medium and a product. Background Art

[0002] In the era of mobile Internet, with the popularity of mobile devices such as smartphones and tablets, the stability of software applications has become an important indicator of product quality. Due to the wide variety of mobile devices and complex and diverse business logic, how to comprehensively, efficiently and reliably evaluate the stability of software applications has always been a difficult challenge.

[0003] Current stability testing methods usually only test the functions and performance of the application itself, which makes it difficult to cover all possible usage scenarios and potential problems. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present application provides a stability testing method, a device to be tested, a server, a medium and a product.

[0005] According to a first aspect of any embodiment of the present application, a stability testing method is provided, the method being applied to a server, the method comprising:

[0006] Sending a simulation request to the device under test so that the device under test performs a simulation operation based on simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario;

[0007] In response to receiving the collected data sent by the device under test, stability analysis is performed on the collected data; the collected data includes: simulation collected data generated by the simulation operation.

[0008] According to a second aspect of any embodiment of the present application, a stability testing method is provided, the method being applied to a device under test, the method comprising:

[0009] Receiving a simulation request sent by a server, wherein the simulation request is used to instruct to perform a simulation operation;

[0010] Based on simulation configuration data of the business scenario, the simulation operation is performed, wherein the simulation configuration data is configured based on the test requirements of the business scenario;

[0011] The collected data is sent to the server so that the server performs stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

[0012] According to a third aspect of any embodiment of the present application, a server is provided, the server comprising:

[0013] A request sending module, used to send a simulation request to the device under test, so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario;

[0014] The data analysis module is used to perform stability analysis on the collected data in response to receiving the collected data sent by the device under test; the collected data includes: simulation collected data generated by the simulation operation.

[0015] According to a fourth aspect of any embodiment of the present application, a device under test is provided, the device under test comprising:

[0016] A request receiving module, used for receiving a simulation request sent by a server, wherein the simulation request is used for instructing to perform a simulation operation;

[0017] An operation execution module, configured to execute the simulation operation based on simulation configuration data of the business scenario, wherein the simulation configuration data is configured based on the test requirements of the business scenario;

[0018] The data sending module is used to send the collected data to the server so that the server can perform stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

[0019] According to a fifth aspect of any embodiment of the present application, there is provided an electronic device, including:

[0020] processor;

[0021] a memory for storing processor-executable instructions;

[0022] The processor executes the executable instructions to implement the method executed by the server or the method executed by the device under test in any of the above-mentioned embodiments of the present application.

[0023] According to the sixth aspect of any embodiment of the present application, a computer-readable storage medium is provided, on which computer instructions are stored. When the instructions are executed by a processor, a method executed by the server or a method executed by the device under test in any embodiment of the present application is implemented.

[0024] According to the seventh aspect of any embodiment of the present application, a computer program product is provided, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, it implements the method executed by the server or the method executed by the device under test in any embodiment of the present application as described above.

[0025] The technical solution provided by this application may have the following beneficial effects:

[0026] According to the above embodiments, a simulation request is sent to the device under test so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario. In response to receiving the collected data sent by the device under test, a stability analysis is performed on the collected data. Since the simulation configuration data is configured based on the test requirements of the business scenario, the simulation operation can be used to simulate the actual usage behavior of the user. The simulation collected data can capture potential stability problems in complex business scenarios, thereby improving the stability of the business scenarios.

[0027] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in the specification and constitute a part of this application, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.

[0029] Figure 1 is a flow chart of a stability testing method according to an exemplary embodiment of the present application;

[0030] Figure 2 is an interactive diagram of a stability testing method according to an exemplary embodiment of the present application;

[0031] Figure 3 is a flow chart of another stability testing method according to an exemplary embodiment of the present application;

[0032] Figure 4 is a flow chart of a method for establishing connection and unlocking according to an exemplary embodiment of the present application;

[0033] Figure 5 is a flow chart of a method for collecting data according to an exemplary embodiment of the present application;

[0034] Figure 6 is a structural schematic diagram of an electronic device according to an exemplary embodiment of the present application;

[0035] Figure 7 is a block diagram of a server according to an exemplary embodiment of the present application;

[0036] Figure 8 It is a block diagram of a device under test shown in the present application according to an exemplary embodiment. DETAILED DESCRIPTION

[0037] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0038] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0039] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0040] Current stability testing methods usually only evaluate applications. For example, a business scenario may involve multiple applications, and frequent switching between different applications may occur in this business scenario. This limitation may cause stability problems for applications in complex business scenarios.

[0041] In order to solve the above problems, the present application proposes a stability testing method. Before introducing the stability testing method, in order to make the description of the method easier to understand, some concepts involved in the subsequent description of the embodiments of the present application are first explained:

[0042] 1)Agent service

[0043] Agent service refers to a concept in the field of computer science and artificial intelligence. It is a software entity that can perceive the environment, make decisions and take actions. Agent service is autonomous and adaptable, and can make decisions in uncertain, complex or dynamic environments to achieve specific goals.

[0044] 2)Schema

[0045] Schema is a way to define and process specific types of Uniform Resource Identifiers (URIs). Schema is used for deep linking, allowing apps to open specific content or perform specific actions through specific URIs.

[0046] 3) Monkey

[0047] Monkey is a tool used to stress test the stability of an application. Monkey can test the performance and stability of an application by simulating a large number of random user events.

[0048] To further illustrate the present application, the following examples are provided:

[0049] See also Figure 1 , Figure 1 This is a flow chart of a stability testing method according to an exemplary embodiment of the present application. The stability testing method can be applied to the server, which can be an Agent service of a product verification test system, or an intercommunication server between multiple heterogeneous systems, or a server cluster or distributed system composed of multiple physical servers.

[0050] The stability testing method may include the following steps:

[0051] Step 102: Send a simulation request to the device under test so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario.

[0052] In this step, the server may send a simulation request to the device under test, instructing the device under test to perform a simulation operation.

[0053] After receiving the simulation request, the device under test automatically performs simulation operations based on the simulation configuration data of the business scenario and according to the process and request information of the business scenario defined in the simulation configuration data, so as to simulate the actual operation behavior of the user for the application in the device under test.

[0054] The device under test may be an electronic device such as a learning machine, a computer, a tablet computer, a smart phone, a personal digital assistant, etc., and one or more applications may be installed in the device under test.

[0055] The simulation request is used to instruct the device under test to perform simulation operations. The simulation configuration data is data configured based on the test requirements of the business scenario, which is used to define the data structure and business process. The simulation configuration data may include: application identification, business scenario identification, business parameters and other data of the application.

[0056] The simulation configuration data may be Schema data. For example, the Schema data may be tal: / / experiment / course_list?course_id=1&subject=2, where experiment is an application identifier, course_list is a business scenario identifier, and course_id=1 and subject=2 are business parameters.

[0057] The simulation operation is used to simulate the actual operation behavior of the user on the application in the device under test. The simulation operation may include: cross-application operation, multi-task switching and other real usage modes.

[0058] The execution mode of the simulation operation may be, for example, by executing the Monkey command. Those skilled in the art may also perform the simulation operation in other ways, and if the simulation collection data can be obtained, the corresponding solution falls within the protection scope of this application.

[0059] In order to further introduce the interaction process between the server and the device under test, Figure 2 An interactive diagram showing a stability testing method is shown in Figure 1. Figure 2 As shown, the server 21 sends a simulation request to the device under test 22. After receiving the simulation request, the device under test 22 performs a simulation operation based on the simulation configuration data of the business scenario.

[0060] Step 104: in response to receiving the collected data sent by the device under test, performing stability analysis on the collected data; the collected data includes: simulation collected data generated by the simulation operation.

[0061] In this step, the device under test collects data generated by the simulation operation to obtain simulation collection data in the collection data, and sends the collected collection data to the server.

[0062] In response to receiving the collected data sent by the device under test, the server performs stability analysis on the collected data. For example, it can detect information such as Crash and Application Not Responding (ANR) in the simulated collected data, analyze the performance of these data in business scenarios, and use various algorithms and models to identify abnormal patterns in the simulated collected data, calculate performance indicators, etc., and generate a stability report on the collected data.

[0063] The server can also display the stability report in a visual interface, and intuitively display the distribution of stability issues, trend changes and other information through charts, dashboards, etc., which can improve the efficiency of stability problem analysis and decision-making. The stability report can also be classified and displayed by different versions and application dimensions to help developers quickly locate problems.

[0064] The collected data is the data generated by the device under test during operation, which can be a Dropbox file, etc.

[0065] The collected data may include: simulation collected data generated by simulation operation. Simulation collected data is data generated by the device under test performing simulation operation, which is used to analyze stability issues in business scenarios.

[0066] The stability report is used to analyze stability issues in the collected data. The stability report can include data such as Crash and ANR.

[0067] Please continue reading Figure 2 The device under test 22 collects the data generated by the simulation operation to obtain the simulation collection data in the collection data. The device under test 22 sends the collected collection data to the sending service end 21. The service end 21 receives the collection data sent by the device under test 22 and performs stability analysis on the collection data.

[0068] In one embodiment, the server may store the received collected data in a database for subsequent query and analysis.

[0069] During the iterative optimization process of the application, the server obtains the historical collected data sent by the device under test last time, compares the historical collected data with the collected data received this time, and generates a regression test report for the business scenario.

[0070] The historical collected data is the collected data sent by the device under test last time, which is used to compare the difference in stability between the new and old versions of the application.

[0071] As described above, by obtaining the historical collection data sent by the device under test last time, comparing the historical collection data with the collection data, and generating a regression test report for the business scenario, it is ensured that the optimization effect is continuously evaluated during the iterative optimization process of the application, so that the overall quality of the application is steadily improved. In addition, it can help developers quickly locate the specific link or code segment where the problem occurs, thereby shortening the time to fix the problem.

[0072] The stability testing method of this embodiment sends a simulation request to the device under test so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario, and performs a stability analysis on the collected data in response to receiving the collected data sent by the device under test. Since the simulation configuration data is configured based on the test requirements of the business scenario, the simulation operation can be used to simulate the actual usage behavior of the user. The simulation collected data can capture potential stability problems in complex business scenarios, thereby improving the stability of the business scenarios.

[0073] In addition, by performing simulation operations based on simulation configuration data and collecting and analyzing the collected data of the device under test, it is possible to accurately collect simulation collected data in business scenarios, thereby greatly improving the accuracy of stability problem location and analysis.

[0074] See also Figure 3 , Figure 3 FIG. 1 is a flow chart of another stability test method according to an exemplary embodiment of the present application. The stability test method can be applied to a device under test, and the method may include the following steps:

[0075] Step 302: Receive a simulation request sent by the server, where the simulation request is used to instruct to perform a simulation operation.

[0076] In this step, the device under test receives the simulation request sent by the server.

[0077] Step 304: Execute simulation operations based on simulation configuration data of the business scenario, where the simulation configuration data is configured based on the test requirements of the business scenario.

[0078] In this step, the device under test automatically performs simulation operations based on the simulation configuration data of the business scenario and according to the process and request information of the business scenario defined in the simulation configuration data, by executing Monkey commands, etc., to simulate the actual operation behavior of the user for the application in the device under test.

[0079] Step 306: Send the collected data to the server so that the server performs stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

[0080] In this step, the device under test collects data generated by the simulation operation, obtains collected data, and sends the collected data to the server.

[0081] In response to the received collected data, the server performs stability analysis on the collected data, analyzes the performance of the collected data in the business scenario, and generates a stability report.

[0082] The stability testing method of this embodiment receives a simulation request sent by the server, performs simulation operations based on the simulation configuration data of the business scenario, and sends collected data to the server, so that the server performs stability analysis on the collected data. Since the simulation configuration data is configured based on the test requirements of the business scenario, the simulation operation can be used to simulate the user's actual usage behavior. The simulation collected data can capture potential stability problems in complex business scenarios, thereby improving the stability of the business scenarios.

[0083] In the above-mentioned embodiment, it is introduced that stability analysis is performed on the simulation data generated by the simulation operation of the device to be tested to capture potential stability problems in the business scenario. In the following embodiment, the preparation work and test process of the stability test will be described in more detail, and can be applied to any of the above embodiments.

[0084] In one embodiment, see Figure 4 , Figure 4 A flow chart of a method for establishing a connection and unlocking is shown. The method for establishing a connection and unlocking may include the following steps:

[0085] Step 402: The server starts.

[0086] In this step, the server is started and can work normally.

[0087] Step 404: The server establishes a connection with the device under test.

[0088] In this step, the server establishes a connection with the device under test to ensure that data can be exchanged between the server and the device under test.

[0089] Step 406: Check whether the device identification belongs to the device identification set.

[0090] In this step, the server obtains the device identification of the device under test and verifies whether the device identification belongs to the device identification set.

[0091] If it is determined that the device identification belongs to the device identification set, step 408 is executed;

[0092] If it is determined that the device identification does not belong to the device identification set, step 418 is executed.

[0093] Step 408: Check whether the device under test is in the power-on state.

[0094] In this step, when the server determines that the device identification belongs to the device identification set, it verifies whether the device under test is in the power-on state.

[0095] If it is determined that the device under test is not in the power-on state, execute step 410;

[0096] If it is determined that the device under test is in the power-on state, step 412 is executed.

[0097] Step 410: Execute the power-on unlocking operation.

[0098] In this step, the server performs a power-on and unlocking operation on the device under test when determining that the device under test is not in a power-on state.

[0099] Step 412: Check whether the device under test is in a locked screen state.

[0100] In this step, the server verifies whether the device under test is in a locked screen state after determining that the device under test is in a powered-on state.

[0101] If it is determined that the device under test is in a locked screen state, execute step 414;

[0102] If it is determined that the device under test is not in the screen lock state, step 416 is executed.

[0103] Step 414: Execute screen unlocking operation.

[0104] In this step, when it is determined that the device under test is in a screen-locked state, the server performs a screen unlocking operation on the device under test.

[0105] Step 416: Send a simulation request.

[0106] In this step, the server sends a simulation request to the device under test and performs a subsequent stability test process.

[0107] Step 418: End the process.

[0108] In this step, when the server determines that the device identifier does not belong to the device identifier set, there is no need to perform stability testing on the device to be tested, and the process ends.

[0109] The device identification is the identification information of the device to be tested, which may be model information, MAC information, etc. The device identification set is used to identify the set of devices to be tested, and may be set and adjusted based on test requirements.

[0110] The unlock operation is used to convert the device under test into a usable state, which may include a power-on unlock operation and a screen unlock operation.

[0111] The unlock operation may be performed, for example, by sending an unlock instruction to the device under test through an Android Debug Bridge (ADB) command, or by using an emulator or automated testing tool to simulate a user's touch or key operation to unlock the device under test, which is not limited in the embodiments of the present application.

[0112] As described above, by obtaining the device identification of the device under test and performing an unlocking operation on the device under test when it is determined that the device identification belongs to a device identification set, it can be ensured that only authorized devices can participate in the testing process, thereby protecting the test data and system security. In addition, integrating the unlocking operation into the automated testing process can significantly reduce the manpower cost of testing.

[0113] In one embodiment, the device under test can collect data for the application. Figure 5 , Figure 5 A flow chart of a method for collecting data is shown.

[0114] The device under test can verify the type of data to be collected according to the request received from the server. For example, the server sends a single application collection request to the device under test, and the device under test receives the single application collection request sent by the server and obtains the application identifier in the single application collection request.

[0115] The device under test verifies whether the application identifier belongs to the application identifier set. If it is determined that the application identifier belongs to the application identifier set, the single application data corresponding to the single application of the device under test is collected by executing Monkey instructions to obtain collected data.

[0116] When it is determined that the application identifier does not belong to the application identifier set, there is no need to collect data and the process ends.

[0117] The single application collection request is used to indicate the collection of data for a single application. The application identifier is used to indicate the single application to be tested, which may be the application name, package name and other information of the single application.

[0118] The collected data may also include: single application data. Single application data is the collected data generated by the user's actual operation on a single application of the device under test.

[0119] As described above, by sending a single application collection request to the device under test through the server, the device under test obtains the application identifier in the single application collection request, and collects the single application data corresponding to the single application when it is determined that the application identifier belongs to the application identifier set. This can ensure that the data collection operation is only performed on a specific application, avoid confusion and errors in the collected data, and help capture stability risks of a single application in subsequent stability analysis.

[0120] In one embodiment, please continue to refer to Figure 5 The server can send a whole-machine application collection request to the device under test. The device under test receives the whole-machine application collection request sent by the server, and collects single application data corresponding to all applications of the device under test by executing Monkey instructions to obtain collected data.

[0121] The whole machine application collection request is used to instruct data collection for all applications of the device under test. The collected data may also include: whole machine application data. The whole machine application data is the data generated by the user's actual operation on all applications of the device under test.

[0122] As described above, a whole-machine application collection request is sent to the device under test through the server, and the device under test collects whole-machine application data corresponding to all applications in the device under test. The whole-machine application data can cover the running conditions of all applications on the device under test, which is convenient for comprehensive analysis of the stability performance of the device under test at the application level and helps to discover potential stability risks.

[0123] In one embodiment, please continue to refer to Figure 5 When the device under test receives the simulation request, it can execute the simulation operation corresponding to the simulation configuration data by executing the Monkey instruction according to the simulation configuration data built into the device under test, collect the simulation collection data generated by the simulation operation, and obtain the collection data.

[0124] Specifically, the simulation configuration data may include at least one of the following: configuration data of multiple business scenarios and configuration data of a single business scenario. The multiple business scenario may be a multi-business scenario across applications or a multi-business scenario of a single application.

[0125] The device under test can perform simulation operations based on the configuration data of multiple business scenarios across applications, and collect simulation data in multiple business scenarios during the cross-application interaction process. The device under test can also perform simulation operations based on the configuration data of multiple business scenarios of a single application, and collect simulation data in multiple business scenarios during the single application interaction process.

[0126] The device under test may also perform simulation operations according to the configuration data of a single service scenario, and collect simulation data under the specified single service scenario.

[0127] In the process of executing simulation operations based on simulation configuration data, the server can monitor through Log logs to determine whether the simulation operations are within the business scenarios defined by the simulation configuration data.

[0128] The built-in method of simulation configuration data, for example, can be to build-in simulation configuration data through an automated test script, and can also send simulation configuration data to the device under test through the server, which is not limited in this embodiment of the present application.

[0129] As described above, by performing simulation operations based on the simulation configuration data of the business scenarios built into the device under test, the simulation operations are made closer to the actual business scenarios corresponding to the simulation configuration data, ensuring that various complex user behaviors and boundary conditions in multiple business scenarios and / or single business scenarios are covered.

[0130] Figure 6 1 is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present application. The electronic device may be, for example, a mobile phone, a computer, a digital broadcast terminal, a message transceiver, a game console, a tablet device, a personal digital assistant, a server, a smart home appliance, a car computer, etc. Figure 6 At the hardware level, the electronic device includes a processor 602, an internal bus 604, a network interface 606, a memory 608, and a non-volatile memory 610, and may also include hardware required for other services. The processor 602 reads the corresponding computer program from the non-volatile memory 610 into the memory 608 and then runs it, forming a server or a device under test at the logical level. Of course, in addition to the software implementation, this application does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0131] Figure 7 is a block diagram of a server according to an exemplary embodiment of the present application. Figure 7 , the server may include: a request sending module 702 and a data analysis module 704, wherein:

[0132] The request sending module 702 is used to send a simulation request to the device under test, so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario;

[0133] The data analysis module 704 is used to perform stability analysis on the collected data in response to receiving the collected data sent by the device under test; the collected data includes: simulation collected data generated by the simulation operation.

[0134] In one example, the data analysis module 704, when used to perform stability analysis on the collected data in response to receiving the collected data sent by the device under test, includes: obtaining the historical collected data last sent by the device under test; comparing the historical collected data with the collected data, and generating a regression test report for the business scenario.

[0135] In one example, before the request sending module 702 is used to send a simulation request to the device under test, it further includes: obtaining a device identification of the device under test; and performing an unlocking operation on the device under test when it is determined that the device identification belongs to a device identification set.

[0136] In one example, the collected data also includes: single application data, which is the collected data generated by the user's actual operation on a single application of the device under test; the data analysis module 704, before being used to respond to the collection data sent by the device under test and perform stability analysis on the collected data, also includes: sending a single application collection request to the device under test, so that the device under test obtains the application identifier in the single application collection request, and when it is determined that the application identifier belongs to an application identifier set, collecting the single application data corresponding to the single application; the application identifier is used to indicate the single application to be tested.

[0137] In one example, the collected data also includes: whole-machine application data, which is data generated by the user's actual operation of all applications of the device under test; the data analysis module 704, before being used to respond to the collected data sent by the device under test and perform stability analysis on the collected data, also includes: sending a whole-machine application collection request to the device under test, so that the device under test collects the whole-machine application data corresponding to all applications.

[0138] In one example, the simulation configuration data is built into the device under test; the simulation configuration data includes at least one of the following: configuration data for multiple business scenarios and configuration data for a single business scenario.

[0139] Figure 8 is a block diagram of a device under test according to an exemplary embodiment of the present application. Figure 8 , the device under test may include: a request receiving module 802, an operation execution module 804 and a data sending module 806, wherein:

[0140] The request receiving module 802 is used to receive a simulation request sent by the server, wherein the simulation request is used to instruct to perform a simulation operation;

[0141] The operation execution module 804 is used to execute the simulation operation based on the simulation configuration data of the business scenario, wherein the simulation configuration data is configured based on the test requirements of the business scenario;

[0142] The data sending module 806 is used to send the collected data to the server so that the server performs stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

[0143] In one example, the collected data also includes: single application data, which is the collected data generated by the user's actual operation on a single application of the device to be tested; the data sending module 806, before being used to send the collected data to the server, also includes: in response to receiving a single application collection request sent by the server, obtaining an application identifier in the single application collection request, wherein the application identifier is used to indicate the single application to be tested; when it is determined that the application identifier belongs to an application identifier set, collecting the single application data corresponding to the single application.

[0144] In one example, the collected data also includes: whole machine application data, which is data generated by the user's actual operation of all applications of the device under test; the data sending module 806, before being used to send the collected data to the server, also includes: in response to receiving a whole machine application collection request sent by the server, collecting the whole machine application data corresponding to all applications.

[0145] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0146] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying creative labor.

[0147] In an exemplary embodiment, a non-temporary computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor to implement a method executed by the server or a method executed by the device under test in any of the above embodiments.

[0148] The non-temporary computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc., and the present application does not limit this.

[0149] In an exemplary embodiment, a computer program product including a computer program / instruction is also provided. The computer program / instruction can be executed by a processor to implement the method executed by the server or the method executed by the device under test in any of the above embodiments.

[0150] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0151] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the inventions claimed herein. The present application is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0152] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A stability testing method, characterized in that: The method is applied to the server, and the method includes: Sending a simulation request to the device under test so that the device under test performs a simulation operation based on simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario; In response to receiving the collected data sent by the device under test, stability analysis is performed on the collected data; the collected data includes: simulation collected data generated by the simulation operation.

2. The method according to claim 1, characterized in that: The step of performing stability analysis on the collected data in response to receiving the collected data sent by the device under test includes: Obtain the historical collection data sent last time by the device under test; The historical collected data is compared with the collected data to generate a regression test report for the business scenario.

3. The method according to claim 1, characterized in that Before sending the simulation request to the device under test, the method further includes: Obtaining a device identification of the device under test; In the case where it is determined that the device identification belongs to a device identification set, an unlocking operation is performed on the device under test.

4. The method according to claim 1, characterized in that The collected data also includes: single application data, which is collected data generated by the user's actual operation on a single application of the device under test; Before performing stability analysis on the collected data in response to receiving the collected data sent by the device under test, the method further includes: A single application collection request is sent to the device under test so that the device under test obtains the application identifier in the single application collection request, and when it is determined that the application identifier belongs to an application identifier set, the single application data corresponding to the single application is collected; the application identifier is used to indicate the single application to be tested.

5. The method according to claim 1, characterized in that The collected data also includes: whole machine application data, which is data generated by the user's actual operation of all applications of the device under test; Before performing stability analysis on the collected data in response to receiving the collected data sent by the device under test, the method further includes: A whole-machine application collection request is sent to the device under test, so that the device under test collects the whole-machine application data corresponding to all the applications.

6. The method according to claim 1, characterized in that The simulation configuration data is built in the device under test; the simulation configuration data includes at least one of the following: configuration data for multiple business scenarios and configuration data for a single business scenario.

7. A stability testing method, characterized in that: The method is applied to a device under test, and the method comprises: Receiving a simulation request sent by a server, wherein the simulation request is used to instruct to perform a simulation operation; Based on simulation configuration data of the business scenario, the simulation operation is performed, wherein the simulation configuration data is configured based on the test requirements of the business scenario; The collected data is sent to the server so that the server performs stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

8. The method according to claim 7, characterized in that The collected data also includes: single application data, which is collected data generated by the user's actual operation on a single application of the device under test; Before sending the collected data to the server, the method further includes: In response to receiving the single application acquisition request sent by the server, obtaining an application identifier in the single application acquisition request, where the application identifier is used to indicate the single application to be tested; When it is determined that the application identifier belongs to an application identifier set, the single application data corresponding to the single application is collected.

9. The method according to claim 7, characterized in that: The collected data also includes: whole machine application data, which is data generated by the user's actual operation of all applications of the device under test; Before sending the collected data to the server, the method further includes: In response to receiving the whole-machine application collection request sent by the server, the whole-machine application data corresponding to all the applications are collected.

10. A server, characterized in that: The server includes: A request sending module, used to send a simulation request to the device under test, so that the device under test performs a simulation operation based on the simulation configuration data of the business scenario; wherein the simulation request is used to instruct the execution of the simulation operation, and the simulation configuration data is configured based on the test requirements of the business scenario; The data analysis module is used to perform stability analysis on the collected data in response to receiving the collected data sent by the device under test; the collected data includes: simulation collected data generated by the simulation operation.

11. A device under test, characterized in that: The device under test comprises: A request receiving module, used for receiving a simulation request sent by a server, wherein the simulation request is used for instructing to perform a simulation operation; An operation execution module, configured to execute the simulation operation based on simulation configuration data of the business scenario, wherein the simulation configuration data is configured based on the test requirements of the business scenario; The data sending module is used to send the collected data to the server so that the server can perform stability analysis on the collected data; wherein the collected data includes: simulation collected data generated by the simulation operation.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 6 or the method according to any one of claims 7 to 9 by running the executable instructions.

13. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the instruction is executed by the processor, the method described in any one of claims 1 to 6 or the method described in any one of claims 7 to 9 is implemented.

14. A computer program product having a computer program / instructions stored thereon, characterized in that: When the computer program / instruction is executed by a processor, the method according to any one of claims 1 to 6 or the method according to any one of claims 7 to 9 is implemented.

Images