Method and device for testing application program

Abstract

The embodiment of the invention provides an application program testing method and device, and relates to the technical field of software development. The method comprises the steps of obtaining a target compiling file, wherein the target file is a file obtained by compiling a source code of a target function module; updating a target application program of a reference version according to the target compiling file to obtain a target application program of an updated version; testing the target application program of the updated version to obtain a first performance index set; according to the first performance index set and a second performance index set, the influence of the target function module on the performance of the target application program is obtained, and the second performance index set is a performance index set obtained by testing the target application program of the reference version.

Description

Technical Field

[0001] The present application relates to the field of software development technology, and in particular to a method and device for testing an application program. Background Art

[0002] As software development becomes increasingly complex, the traditional software model of a single person or multiple teams can no longer meet the needs of work. As a new development model, collaborative software development has been widely used due to its efficiency, convenience and flexibility.

[0003] When developing applications through software collaboration, different functional modules of the application are generally developed by different development teams. When the application needs to be updated, each development team will develop a new version of the functional module or a newly added functional module, and then integrate the new version of the functional module and the newly added functional module into a new version of the application. During the application testing phase, testers can only perform overall performance testing on the new version of the application in a black box manner, and cannot obtain the impact of a single functional module on the application performance. Summary of the invention

[0004] In view of this, an embodiment of the present application provides a method and device for testing an application program, which is used to solve the problem of being unable to obtain the impact of a single functional module of an application program on the performance of the application program when performing software testing.

[0005] In order to achieve the above purpose, the embodiments of the present application provide the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a method for testing an application, comprising:

[0007] Obtaining a target compiled file, wherein the target file is a file obtained by compiling the source code of the target functional module;

[0008] updating the target application of the base version according to the target compilation file to obtain the target application of the updated version;

[0009] Testing the updated version of the target application to obtain a first performance indicator set;

[0010] According to the first performance indicator set and the second performance indicator set, the influence of the target functional module on the performance of the target application is obtained, wherein the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application.

[0011] As an optional implementation of the embodiment of the present application, the updating of the target application of the baseline version according to the target compilation file to obtain the target application of the updated version includes:

[0012] Determine whether the target application of the base version includes a compiled file of the target functional module of the old version;

[0013] If not, integrating the target compiled file into the target application of the base version to obtain the target application of the updated version;

[0014] If so, the compilation file of the target function module of the old version in the target application of the base version is replaced with the target compilation file to obtain the target application of the updated version.

[0015] As an optional implementation of the embodiment of the present application, the testing of the updated version of the target application to obtain the first performance indicator set includes:

[0016] Creating a test client in the cloud server, and configuring the operating environment of the test client as a test environment;

[0017] Running the updated version of the target application on the test client based on the test program and / or the test service, and recording the tracking data reported by the performance tracking point when the performance tracking point in the updated version of the target application is triggered;

[0018] The first performance indicator set is obtained according to the buried data.

[0019] As an optional implementation of the embodiment of the present application, obtaining the influence of the target functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set includes:

[0020] Obtaining difference values ​​of each performance indicator; the difference value of any performance indicator is the difference between the value of the performance indicator in the first performance indicator set and the value of the performance indicator in the second performance indicator set;

[0021] According to the difference values ​​of various performance indicators, the influence of the target functional module on the performance of the target application is obtained.

[0022] As an optional implementation of the embodiment of the present application, the method further includes:

[0023] Determine whether the difference value of each performance indicator is greater than the difference threshold corresponding to each performance indicator;

[0024] When the difference value of one or more performance indicators is greater than the corresponding difference threshold, an alarm message is output.

[0025] As an optional implementation of the embodiment of the present application, the method further includes:

[0026] When the difference values ​​of the various performance indicators are all smaller than the corresponding difference thresholds, the target application of the baseline version is updated to the target application of the updated version, and the first performance indicator set is saved.

[0027] As an optional implementation of the embodiment of the present application, the method further includes:

[0028] Generating a comparison chart or a comparison table of at least one performance indicator according to the first performance indicator set and the second performance indicator set;

[0029] Output a comparison chart or a comparison table of the at least one performance indicator.

[0030] In a second aspect, an embodiment of the present application provides a testing device for an application program, including:

[0031] An acquisition unit, used to acquire a target compiled file, wherein the target file is a file obtained by compiling the source code of the target functional module;

[0032] An updating unit, configured to update the target application of the base version according to the target compilation file to obtain the target application of the updated version;

[0033] A testing unit, configured to test the updated version of the target application to obtain a first performance indicator set;

[0034] The processing unit is used to obtain the impact of the target functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set, wherein the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application.

[0035] As an optional implementation of the embodiment of the present application, the update unit is specifically used to determine whether the target application of the baseline version includes the compilation file of the target functional module of the old version; if not, integrating the target compilation file into the target application of the baseline version to obtain the target application of the updated version; if so, replacing the compilation file of the target functional module of the old version in the target application of the baseline version with the target compilation file to obtain the target application of the updated version.

[0036] As an optional implementation of the embodiment of the present application, the test unit is specifically used to create a test client in the cloud server and configure the operating environment of the test client as a test environment; run the updated version of the target application on the test client based on the test program and / or the test service, and record the performance tracking data reported by the performance tracking point when the performance tracking point in the updated version of the target application is triggered;

[0037] The first performance indicator set is obtained according to the buried data.

[0038] As an optional implementation of the embodiment of the present application, the processing unit is specifically used to obtain the difference values ​​of each performance indicator; the difference value of any performance indicator is the difference between the value of the performance indicator in the first performance indicator set and the value of the performance indicator in the second performance indicator set; based on the difference values ​​of each performance indicator, the impact of the target functional module on the performance of the target application is obtained.

[0039] As an optional implementation of the embodiment of the present application, the processing unit is also used to determine whether the difference value of each performance indicator is greater than the difference threshold corresponding to each performance indicator; when the difference value of one or more performance indicators is greater than the corresponding difference threshold, an alarm message is output.

[0040] As an optional implementation of the embodiment of the present application, the processing unit is also used to update the target application of the baseline version to the target application of the updated version and save the first performance indicator set when the difference values ​​of each performance indicator are less than the corresponding difference threshold.

[0041] As an optional implementation of the embodiment of the present application, the processing unit is also used to generate a comparison chart or comparison table of at least one performance indicator based on the first performance indicator set and the second performance indicator set; and output the comparison chart or comparison table of the at least one performance indicator.

[0042] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, wherein the memory is used to store a computer program and the processor is used to enable the electronic device to implement the test method of the application described in any of the above embodiments when executing the computer program.

[0043] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which, when the computer program is executed by a computing device, enables the computing device to implement a testing method for any of the above-mentioned applications.

[0044] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to implement a testing method for any of the above-mentioned applications.

[0045] The application testing method provided by the embodiment of the present application, after obtaining the target compiled file obtained by compiling the source code of the target functional module, the target application of the benchmark version is updated according to the target compiled file to obtain the updated version of the target application, and the updated version of the target application is tested to obtain a first performance indicator set, and then the impact of the target functional module on the performance of the target application is obtained according to the first performance indicator set and the second performance indicator set obtained by testing the target application of the benchmark version. Since the first performance indicator set in the application testing method provided by the embodiment of the present application is obtained by testing the updated version of the target application obtained by updating the benchmark version of the target application based on the file obtained by compiling the source code of a single functional module, and the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application, compared with the second performance indicator set, the changes in the performance indicators in the first performance indicator set are all caused by the single functional module, so the embodiment of the present application can obtain the impact of the single functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set, so the embodiment of the present application can solve the problem that the impact of the single functional module of the application on the performance of the application cannot be obtained when performing software testing. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0048] Figure 1 A schematic diagram of a software development architecture provided for an embodiment of the present application;

[0049] Figure 2 One of the step flow charts of the method for testing an application provided in an embodiment of the present application;

[0050] Figure 3 A second flowchart of the method for testing an application program provided in an embodiment of the present application;

[0051] Figure 4 A comparison chart of performance indicators provided in the embodiments of the present application;

[0052] Figure 5 A schematic diagram of the structure of a testing device for an application provided in an embodiment of the present application;

[0053] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0055] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein. Obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.

[0056] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way. In addition, in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more.

[0057] The application testing method provided in the embodiment of the present application can be applied to a software development architecture. A possible software development architecture is first described below.

[0058] Reference Figure 1 As shown, the software development architecture includes: multiple code development systems 11, a continuous integration system 12, a testing system 13, and a release system 14.

[0059] Multiple code development systems 11 are used to develop source codes of different functional modules of the application. The code development system 11 can manage codes based on the GitLab warehouse management system (an open source project for warehouse management systems, using Git as a code management tool and a network service built on this basis), including: workspace 111, indexstage 112, local repository 113 and remote repository 114. Among them, the code written by the developer in the workspace is first saved in the indexstage, and can be pushed from the indexstage to the local warehouse for storage. The modified and verified code in the local warehouse can be pushed to the remote warehouse.

[0060] The continuous integration system 12 includes a compiler 121 and a compilation product library 122. When the source code of a newly pushed function module in the remote warehouse of any code development system 11 is detected, the source code of the function module is read for compilation and the compilation result is saved in the compilation product library to trigger testing.

[0061] The test system 13 includes: a construction module 131, an environment configuration module 132, a point-of-use confirmation module 133, a monitoring platform 134, and a data post-processing module 135. The construction module is used to construct a cloud client for running an application in a cloud server, and the environment configuration module is used to configure the operating environment of the cloud client constructed by the construction module to a test environment close to the real operating environment; the point-of-use confirmation module is used to collect the point-of-use data reported by the point-of-use, and report the point-of-use data to the monitoring platform; the monitoring platform is used to clean and calculate the point-of-use data, and send the calculation results to the data post-processing module; the post-processing module is used to compare the performance difference between the current version and the benchmark version, and when the performance difference between the current version and the benchmark version is less than the alarm threshold, it automatically enters the release stage, otherwise it triggers an alarm.

[0062] The publishing system 14 includes: an application publishing management platform 141 and a dashboard platform 142. The application publishing management platform 141 is used to manage and publish new versions of application programs; the dashboard platform 142 is used to output detailed test information of new versions of application programs.

[0063] The present application embodiment provides a method for testing an application program. Figure 2 As shown, the testing method of the application includes the following steps:

[0064] S21. Obtain target compilation file.

[0065] The target file is a file obtained by compiling the source code of the target functional module.

[0066] In the embodiment of the present application, the target functional module may be a newly developed functional module, or may be a functional module that already exists in the original application but needs to be updated. When the target functional module is a functional module that already exists in the original application but needs to be updated, the source code of the target functional module is the source code of the updated target functional module.

[0067] In some embodiments, the method for obtaining the target compiled file can be: monitoring the remote warehouse corresponding to each functional module, when monitoring that a new version of the source code is pushed to the remote warehouse corresponding to any functional module, the functional module is used as the target functional module, and the new version of the source code is compiled to obtain the target compiled file.

[0068] S22: Update the target application of the base version according to the target compilation file to obtain the target application of the updated version.

[0069] In some embodiments, the base version of the target application may be the latest released version of the target application.

[0070] S23: Testing the updated version of the target application to obtain a first performance indicator set.

[0071] Exemplarily, the first performance indicator set may include: real-time factor (RTF), central processing unit (CPU) utilization, memory utilization, etc.

[0072] S24. Obtain the impact of the target functional module on the performance of the target application program according to the first performance indicator set and the second performance indicator set.

[0073] The second performance indicator set is a performance indicator set obtained by testing the target application of the benchmark version.

[0074] In some embodiments, the benchmark version of the target application may be tested to obtain a second performance indicator set.

[0075] In other embodiments, the second performance indicator set may be read from a storage space storing test results of the benchmark version of the target application.

[0076] The application testing method provided by the embodiment of the present application, after obtaining the target compiled file obtained by compiling the source code of the target functional module, the target application of the benchmark version is updated according to the target compiled file to obtain the updated version of the target application, and the updated version of the target application is tested to obtain a first performance indicator set, and then the impact of the target functional module on the performance of the target application is obtained according to the first performance indicator set and the second performance indicator set obtained by testing the target application of the benchmark version. Since the first performance indicator set in the application testing method provided by the embodiment of the present application is obtained by testing the updated version of the target application obtained by updating the benchmark version of the target application based on the file obtained by compiling the source code of a single functional module, and the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application, compared with the second performance indicator set, the changes in the performance indicators in the first performance indicator set are all caused by the single functional module, so the embodiment of the present application can obtain the impact of the single functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set, so the embodiment of the present application can solve the problem that the impact of the single functional module of the application on the performance of the application cannot be obtained when performing software testing.

[0077] As an extension and refinement of the above embodiment, the present application embodiment also provides another application testing method, referring to Figure 3 As shown, the testing method of the application includes the following steps:

[0078] S301, obtaining a target compilation file.

[0079] The target file is a file obtained by compiling the source code of the target functional module.

[0080] S302: Determine whether the target application of the base version includes a compiled file of the target functional module of the old version.

[0081] That is, whether the target functional module is a newly added functional module, or a functional module that originally existed in the target application but needs to be updated.

[0082] In the above step S302, if the target application of the base version does not include the compiled file of the target functional module of the old version, the following step S303 is executed:

[0083] S303: Integrate the target compiled file into the target application of the baseline version to obtain the target application of the updated version.

[0084] In some embodiments, the base version of the target application is saved in the form of compiled files of multiple functional modules. In this case, the target compiled files and the compiled files of the multiple functional modules can be directly integrated to obtain the updated version of the target application.

[0085] For example: the target application of the baseline version includes: compilation file a of function module A, compilation file b of function module B and compilation file c of function module C, the target function module is function module D, and the target compilation file is compilation file d, then the target application of the updated version includes compilation file a of function module A, compilation file b of function module B, compilation file c of function module C and compilation file d of function module D.

[0086] In the above step S302, if the target application of the base version includes the compiled file of the target functional module of the old version, the following step S304 is executed:

[0087] S304: Replace the compilation file of the target function module of the old version in the target application of the base version with the target compilation file to obtain the target application of the updated version.

[0088] For example: the target application of the baseline version includes: the compilation file ① of function module 1, the compilation file ② of function module 2 and the compilation file ③ of function module 3, the target function module is function module 3, and the target compilation file is compilation file ⑶, then the target application of the updated version includes the compilation file ① of function module 1, the compilation file ② of function module 2 and the compilation file ⑶ of function module 3.

[0089] After obtaining the target application of the updated version by executing the above step S303 or step S304, continue to execute the following steps:

[0090] S305: Create a test client in the cloud server, and configure the operating environment of the test client as a test environment.

[0091] That is, the client running the target application program for testing the updated version is a virtual client on the cloud server, and the operating environment of the client is configured as a test environment.

[0092] S306: Run the updated version of the target application on the test client based on the test program and / or the test service, and record the performance tracking data reported by the performance tracking when the performance tracking in the updated version of the target application is triggered.

[0093] S307: Obtain the first performance indicator set according to the tracking data.

[0094] In some embodiments, obtaining the first set of performance indicators based on the buried point data includes sorting, filtering, format conversion, and calculation operations on the buried point data to obtain the first set of performance indicators.

[0095] S308: Obtain the difference value of each performance indicator.

[0096] The difference value of any performance indicator is the difference between the value of the performance indicator in the first performance indicator set and the value of the performance indicator in the second performance indicator set.

[0097] For example, for the performance indicator RTF, if the value of RTF in the first performance indicator set is 3823ms and the value of RTF in the second performance indicator set is 3540ms, the difference value of the performance indicator RTF that can be obtained is 3823ms-3540ms=283ms.

[0098] S309: Obtain the impact of the target functional module on the performance of the target application program according to the difference values ​​of each performance indicator.

[0099] For example, if the first performance indicator and the second performance indicator both include RTF and CPU utilization, the influence of the target functional module on the RTF and CPU utilization of the target application can be determined according to the difference value of the performance indicator RTF and the difference value of the CPU utilization.

[0100] In some embodiments, the application testing method provided by the embodiments of the present application also includes: determining whether the difference value of each performance indicator is greater than the difference threshold corresponding to each performance indicator, and outputting an alarm message when the difference value of one or more performance indicators is greater than the corresponding difference threshold.

[0101] Exemplarily, the implementation method of outputting the alarm information may include: sending the alarm information to a designated user or a designated account via instant communication software, email, or a mobile communication terminal.

[0102] In some embodiments, the alarm information may also carry identification information and a difference value of a performance indicator whose difference value is greater than a corresponding difference threshold.

[0103] In some embodiments, the application testing method provided by the embodiments of the present application also includes: when the difference values ​​of each performance indicator are less than the corresponding difference threshold, updating the target application of the baseline version to the target application of the updated version, and saving the first performance indicator set.

[0104] After the development of the source code of other functional modules of the target application is completed, it is also necessary to use other functional modules as target functional modules to execute the application testing method provided in the embodiment of the present application. If all newly added or updated functional modules are updated and tested based on the same baseline version of the target application, it will result in the inability to obtain the performance impact between the updated or newly added functional modules. For example: the version update of the target application includes: newly added functional module 1 and updated functional module 2. If the newly added functional module 1 and the updated functional module 2 are updated and tested based on the target application of the same baseline version to obtain the impact of the newly added functional module 1 and the updated functional module 2 on the performance of the target application, it is very likely that because the mutual performance impact between the newly added functional module 1 and the updated functional module 2 is not considered, the impact on the target application that includes both the newly added functional module 1 and the updated functional module 2 is not the superposition of the performance impact of the newly added functional module 1 and the performance impact of the updated functional module 2, thereby causing the performance of the target application to deteriorate. The above-mentioned embodiment updates the target application of the baseline version to the target application of the updated version. After completing the development of the source code of other functional modules of the target application, when executing the application testing method provided by the embodiment of the present application, the impact of the current functional module on the performance of the latest version of the application can be obtained, thereby avoiding the mutual influence between the newly added or updated functional modules of the application, which leads to the performance degradation of the target application.

[0105] In addition, the above embodiment will also save the first set of performance indicators, so when obtaining the impact of the next newly added or updated functional module on the performance of the target application, the first set of performance indicators saved can be directly read without repeatedly testing the updated version of the target application, thereby improving the testing efficiency of the application.

[0106] In some embodiments, the application testing method provided by the embodiment of the present application further includes:

[0107] A comparison graph or a comparison table of at least one performance indicator is generated according to the first performance indicator set and the second performance indicator set, and the comparison graph or the comparison table of the at least one performance indicator is output.

[0108] For example, a comparison table of a certain performance index may be shown in Table 1 below:

[0109] Table 1

[0110] Calculated value (ms) Average value (ms) P95(ms) Standard deviation (ms) Updated version 5603.5 5603.5 6074.85 375.84 Baseline version 5535.67 5535.67 6234.56 600.87 Difference +67.83 +67.83 -159.75 -225.03

[0111] Among them, Table 1 respectively shows the calculated value, average value, top 95% (P95) value and standard deviation of the performance indicator of the updated version of the target application and the benchmark version of the target application, as well as the difference in the calculated value, average value P95 value and standard deviation of the performance indicator between the updated version of the target application and the benchmark version of the target application.

[0112] For example, refer to Figure 4 As shown, Figure 4 A comparison chart of a certain performance indicator. Figure 4 The graph 41 of the performance index in the target application of the updated version and the graph 42 of the performance index in the target application of the benchmark version are included. Figure 4 The content shown can obtain detailed information about the performance indicator in the updated version of the target application and the baseline version of the target application.

[0113] Based on the same inventive concept, as an implementation of the above method, the embodiment of the present application also provides a server and a client device, which corresponds to the above method embodiment. For ease of reading, this embodiment will no longer repeat the details of the above method embodiment one by one, but it should be clear that the server and client device in this embodiment can correspond to all the contents of the above method embodiment.

[0114] The embodiment of the present application provides a server, Figure 5 The schematic diagram of the test device structure of this application is as follows: Figure 5 As shown, the test device 500 of the application comprises:

[0115] An acquisition unit 51 is used to acquire a target compiled file, where the target file is a file obtained by compiling the source code of the target functional module;

[0116] An updating unit 52, configured to update the target application of the base version according to the target compilation file to obtain the target application of the updated version;

[0117] A testing unit 53, configured to test the updated version of the target application to obtain a first performance indicator set;

[0118] The processing unit 54 is used to obtain the impact of the target functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set, wherein the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application.

[0119] As an optional implementation of the embodiment of the present application, the update unit 52 is specifically used to determine whether the target application of the baseline version includes the compilation file of the target functional module of the old version; if not, integrating the target compilation file into the target application of the baseline version to obtain the target application of the updated version; if so, replacing the compilation file of the target functional module of the old version in the target application of the baseline version with the target compilation file to obtain the target application of the updated version.

[0120] As an optional implementation of the embodiment of the present application, the test unit 53 is specifically used to create a test client in the cloud server and configure the operating environment of the test client as a test environment; run the updated version of the target application on the test client based on the test program and / or the test service, and record the performance tracking data reported by the performance tracking when the performance tracking in the updated version of the target application is triggered;

[0121] The first performance indicator set is obtained according to the buried data.

[0122] As an optional implementation of the embodiment of the present application, the processing unit 54 is specifically used to obtain the difference values ​​of each performance indicator; the difference value of any performance indicator is the difference between the value of the performance indicator in the first performance indicator set and the value of the performance indicator in the second performance indicator set; based on the difference values ​​of each performance indicator, the impact of the target functional module on the performance of the target application is obtained.

[0123] As an optional implementation of the embodiment of the present application, the processing unit 54 is also used to determine whether the difference value of each performance indicator is greater than the difference threshold corresponding to each performance indicator; when the difference value of one or more performance indicators is greater than the corresponding difference threshold, an alarm message is output.

[0124] As an optional implementation of the embodiment of the present application, the processing unit 54 is also used to update the target application of the baseline version to the target application of the updated version and save the first performance indicator set when the difference values ​​of each performance indicator are less than the corresponding difference threshold.

[0125] As an optional implementation of the embodiment of the present application, the processing unit 54 is also used to generate a comparison chart or comparison table of at least one performance indicator based on the first performance indicator set and the second performance indicator set; and output the comparison chart or comparison table of the at least one performance indicator.

[0126] The application testing device provided in the embodiment of the present application can execute the application testing method provided in any of the above embodiments. Its implementation principle and technical effect are similar and will not be repeated here.

[0127] Based on the same inventive concept, an embodiment of the present application also provides an electronic device. Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, such as Figure 6 As shown, the electronic device provided in this embodiment includes: a memory 601 and a processor 602, wherein the memory 601 is used to store a computer program, and the processor 602 is used to execute the test method of the application provided in the above embodiment when executing the computer program.

[0128] Based on the same inventive concept, an embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the computing device implements the test method of the application provided in the above embodiment.

[0129] Based on the same inventive concept, an embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computing device implements the application program testing method provided in the above embodiment.

[0130] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media that include computer-usable program code.

[0131] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0132] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0133] Computer readable media include permanent and non-permanent, removable and non-removable storage media. Storage media can be implemented by any method or technology to store information, and the information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0134] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein, and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for testing an application, characterized in that: include: Obtaining a target compiled file, wherein the target file is a file obtained by compiling the source code of the target functional module; updating the target application of the base version according to the target compilation file to obtain the target application of the updated version; Testing the updated version of the target application to obtain a first performance indicator set; According to the first performance indicator set and the second performance indicator set, the influence of the target functional module on the performance of the target application is obtained, wherein the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application.

2. The method according to claim 1, characterized in that The updating of the target application of the base version according to the target compilation file to obtain the target application of the updated version includes: Determine whether the target application of the base version includes a compiled file of the target functional module of the old version; If not, integrating the target compiled file into the target application of the base version to obtain the target application of the updated version; If so, the compilation file of the target function module of the old version in the target application of the base version is replaced with the target compilation file to obtain the target application of the updated version.

3. The method according to claim 1, characterized in that The step of testing the updated version of the target application to obtain a first performance indicator set includes: Creating a test client in the cloud server, and configuring the operating environment of the test client as a test environment; Running the updated version of the target application on the test client based on the test program and / or the test service, and recording the tracking data reported by the performance tracking point when the performance tracking point in the updated version of the target application is triggered; The first performance indicator set is obtained according to the buried data.

4. The method according to claim 1, characterized in that: The obtaining, according to the first performance indicator set and the second performance indicator set, the influence of the target functional module on the performance of the target application program includes: Obtaining difference values ​​of each performance indicator; the difference value of any performance indicator is the difference between the value of the performance indicator in the first performance indicator set and the value of the performance indicator in the second performance indicator set; According to the difference values ​​of various performance indicators, the influence of the target functional module on the performance of the target application is obtained.

5. The method according to claim 4, characterized in that The method further comprises: Determine whether the difference value of each performance indicator is greater than the difference threshold corresponding to each performance indicator; When the difference value of one or more performance indicators is greater than the corresponding difference threshold, an alarm message is output.

6. The method according to claim 5, characterized in that The method further comprises: When the difference values ​​of the various performance indicators are all smaller than the corresponding difference thresholds, the target application of the baseline version is updated to the target application of the updated version, and the first performance indicator set is saved.

7. The method according to claim 1, characterized in that The method further comprises: Generating a comparison chart or a comparison table of at least one performance indicator according to the first performance indicator set and the second performance indicator set; Output a comparison chart or a comparison table of the at least one performance indicator.

8. A testing device for an application, characterized in that: include: An acquisition unit, used to acquire a target compiled file, wherein the target file is a file obtained by compiling the source code of the target functional module; An updating unit, configured to update the target application of the base version according to the target compilation file to obtain the target application of the updated version; A testing unit, configured to test the updated version of the target application to obtain a first performance indicator set; The processing unit is used to obtain the impact of the target functional module on the performance of the target application according to the first performance indicator set and the second performance indicator set, wherein the second performance indicator set is a performance indicator set obtained by testing the benchmark version of the target application.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program and the processor is used to enable the electronic device to implement the test method for the application program described in any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the method for testing the application program according to any one of claims 1 to 7.

Images