Application compatibility test method and system, computer equipment and storage medium

Abstract

The invention discloses an application compatibility testing method. The method comprises the following steps: constructing a to-be-tested task queue for a to-be-tested application; obtaining to-be-tested tasks one by one from the to-be-tested task queue; according to historical test data, an automatic test script is adapted to the obtained to-be-tested task; matching test equipment for the acquired to-be-tested task; generating a test instruction according to the adaptive automated test script; the test instruction is sent to the matched test equipment for compatibility test of the corresponding to-be-tested application; and obtaining a test result, and counting and updating the historical test data according to the test result. The invention further discloses an application compatibility testing system, computer equipment and a storage medium. According to the application compatibility test method and system, the computer equipment and the storage medium provided by the invention, the application compatibility test efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an application compatibility testing method, system, computer equipment and storage medium. Background Art

[0002] Since the popularization of smart phones, there are thousands of applications on each terminal device to meet the various needs of customers. Each application uses different software and hardware resources of the terminal device. Therefore, before the terminal device is launched on the market, or before pushing a new version to the customer end user, the compatibility of the application needs to be tested to ensure that most applications can run stably on the terminal device or the new software version.

[0003] The traditional testing method process is as follows:

[0004] 1. The test initiator gets a list of third-party applications to be tested and assigns different parts of the test form to different testers based on human resources;

[0005] 2. After each tester gets the test sub-table, he / she finds a mobile device that meets the requirements and starts testing. After completing the compatibility test of each application, the results are filled back into the test sub-table.

[0006] 3. After all testers complete the test, the test initiator obtains all the test sub-tables, summarizes them into a third-party application test table file, and generates a test report.

[0007] It can be seen that the traditional testing method in the terminal equipment testing industry is to verify the compatibility of applications one by one through manual testing, including: downloading, installing, opening, uninstalling and checking version information of applications; at the same time, there is also the complicated work of filling out test results and summarizing reports. The traditional testing method is very labor-intensive and time-consuming, and prone to errors.

[0008] Based on this, there is an urgent need to propose an application compatibility testing method, system, computer device and storage medium to solve the above-mentioned problems. Summary of the invention

[0009] The purpose of the present invention is to provide an application compatibility testing method, system, computer equipment and storage medium to improve the efficiency of application testing.

[0010] In order to solve the above technical problems, the present invention provides an application compatibility testing method, comprising the following steps:

[0011] Build a task queue for the application to be tested;

[0012] Obtaining the tasks to be tested one by one from the task queue to be tested;

[0013] Adapting an automated test script for the acquired task to be tested according to historical test data;

[0014] Matching a test device for the acquired task to be tested;

[0015] Sending the acquired task to be tested and the adapted automated test script to the matching test device to perform compatibility testing of the corresponding application to be tested;

[0016] The test results are obtained and the historical test data are counted and updated according to the test results.

[0017] Furthermore, the specific steps of constructing the task queue to be tested are:

[0018] Enter the list of applications to be tested in a table format;

[0019] Automatically identify the data in the table to form multiple tasks to be tested that contain the core information of the application to be tested;

[0020] The plurality of tasks to be tested are sequentially arranged to form the task queue to be tested.

[0021] Furthermore, the application compatibility testing method further includes the following steps:

[0022] After the test of the application to be tested corresponding to the task to be tested is completed, the test result is filled back into the corresponding position of the list of applications to be tested, and a test report is generated;

[0023] After all the applications to be tested corresponding to the tasks to be tested in the task queue to be tested are tested, the list of applications to be tested and the test report are remotely and directedly sent together.

[0024] Furthermore, the specific method for adapting the automated test script to the task to be tested acquired according to the historical test data is:

[0025] If the task to be tested has corresponding historical test data, then the test script with a high success rate for the application to be tested in the historical test data is preferentially selected;

[0026] If the application to be tested corresponding to the task to be tested lacks historical test data, a test script with a high success rate in compatibility tests of other third-party applications is preferentially selected.

[0027] Furthermore, the method for adapting the automated test script to the acquired task to be tested also includes: adapting the automated test script to the task to be tested according to the inherent characteristics of the application to be tested corresponding to the task to be tested, specifically:

[0028] If the application to be tested corresponding to the task to be tested has specific test steps or test preferences, an automated test script including the specific test steps or matching the test preferences is selected.

[0029] Furthermore, the specific method for matching the test equipment for the acquired task to be tested is:

[0030] First, select the test equipment model, hardware configuration, and software version that meet the test requirements;

[0031] Secondly, a suitable test robot is selected according to the properties of the application to be tested corresponding to the task to be tested.

[0032] Furthermore, when the test device performs compatibility testing on the application to be tested, if the test fails, a new automated test script is re-adapted for the task to be tested corresponding to the application to be tested, and the process is repeated three times. If the test still fails, the test of the application to be tested is terminated.

[0033] The present invention also provides an application program compatibility testing system, comprising:

[0034] A database unit, used to store automated test scripts and historical test data generated by the tests;

[0035] An information input unit, used to input information of a list of applications to be tested;

[0036] An information processing unit, used for automatically identifying and processing the input list of applications to be tested, and generating a task queue to be tested including a plurality of tasks to be tested;

[0037] A request acquisition unit, used for acquiring the task to be tested from the task queue to be tested;

[0038] A script matching unit, used for adapting an automated test script to the acquired task to be tested;

[0039] A test equipment matching unit, used for matching the test equipment for the task to be tested;

[0040] An instruction sending unit, used for sending the task to be tested and the adapted automated test script to the matching test device;

[0041] A result statistics unit, used to obtain test results and to count and update historical test data according to the test results; and also used to fill the test results back into the list of applications to be tested;

[0042] Report statistics unit, used to generate test reports according to test conditions;

[0043] The remote sending unit is used to remotely send the list of applications to be tested filled with test results and the test report to a designated terminal.

[0044] The present invention also provides a computer device, which includes a memory and a processor connected to the memory; the memory is used to store computer programs; the processor is used to run the computer programs stored in the memory to execute the steps of the above-mentioned application compatibility testing method.

[0045] In addition, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the above-mentioned application compatibility testing method.

[0046] Compared with the prior art, the present invention has at least the following beneficial effects:

[0047] The present invention can realize the automated process of application compatibility testing, including automatic disassembly of application table files, automatic adaptation of automated test scripts, automatic matching of test equipment, and automatic generation and sending of test results and test reports, which effectively improves the efficiency of application compatibility testing;

[0048] Furthermore, in the present invention, the automated test scripts are mainly adapted based on historical test data. As historical experience increases, the adaptation accuracy of the automated test scripts will become higher and higher, thereby further improving the efficiency of application compatibility testing. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 This is an application environment diagram of the application program compatibility testing method in Embodiment 1 of the present invention;

[0050] Figure 2 The figure is a flowchart of the application compatibility testing method in the first embodiment of the present invention. DETAILED DESCRIPTION

[0051] The following will be described in more detail with reference to the schematic diagram of the application compatibility testing method, system, computer device and storage medium of the present invention, wherein the preferred embodiment of the present invention is shown, and it should be understood that those skilled in the art can modify the present invention described herein, while still achieving the advantageous effects of the present invention. Therefore, the following description should be understood as being widely known to those skilled in the art, and not as a limitation of the present invention.

[0052] The present invention is described in more detail in the following paragraphs by way of example with reference to the accompanying drawings. The advantages and features of the present invention will become more apparent from the following description. It should be noted that the accompanying drawings are in very simplified form and are not in exact proportions, and are only used to facilitate and clearly assist in illustrating the purpose of the embodiments of the present invention.

[0053] Embodiment 1

[0054] The application compatibility testing method provided in this embodiment can be applied to Figure 1 In the environment shown, the control terminal 01 is integrated with an application compatibility test system and is connected to multiple test devices 02 through a network. The multiple test devices 02 are not limited to various computers, laptops, smart phones, tablet computers, portable wearable devices, etc., and the operating system is not limited to Android, iOS, Windows, Linux, etc.

[0055] Specifically, in this embodiment, Figure 2 As shown in the figure, an application compatibility testing method is proposed, which is applied to Figure 1 Taking the control terminal 01 in the example as an example, the following steps are included:

[0056] S1. Build a task queue for the application to be tested;

[0057] Specifically, when conducting application compatibility testing, the operator inputs a list of applications to be tested in tabular form into the application compatibility testing system in the control terminal 01. The application compatibility testing system will automatically identify and process the data in the table to form multiple tasks to be tested that contain core information of the applications to be tested, and then arrange the multiple tasks to be tested in sequence to form the task queue to be tested.

[0058] S2, obtaining the tasks to be tested one by one from the task queue to be tested;

[0059] Specifically, the queue of tasks to be tested is essentially a list of test tasks arranged in a specific order or rule. It plays a role in overall planning, allowing the testing work to be carried out in an orderly manner, ensuring that all content that needs to be tested can be reasonably arranged and executed in a timely manner to avoid missing tasks. It also makes it convenient for the testing team to clearly grasp the testing progress and task allocation.

[0060] S3, adapting the automated test script for the acquired task to be tested according to the historical test data;

[0061] Specifically, the application compatibility testing system will retain the test results of the corresponding test script after each compatibility test, and will count the success rate to form historical test data. After the application compatibility testing system obtains a task to be tested, it will adapt the automated test script for the task to be tested in the system. The adaptation logic method is mainly based on historical test data. If the task to be tested has corresponding historical test data, the test script with a high success rate for the application to be tested in the historical test data will be given priority; if the application to be tested corresponding to the task to be tested lacks historical test data, the test script with a high success rate in other third-party application compatibility tests will be given priority.

[0062] Of course, the adaptation logic method of the automated test script also includes: adapting the automated test script for the task to be tested according to the inherent characteristics of the application to be tested corresponding to the task to be tested, specifically: if the application to be tested corresponding to the task to be tested has specific test steps or test preferences, then selecting an automated test script that contains specific test steps or matches the test preferences. For example, some applications appear less frequently in "application market a" but appear a lot in "application market b", then the automated test script of "application market b" is preferentially selected.

[0063] In this step, the automated test script is written by relevant technical personnel and uploaded to the application compatibility testing system. The automated test script mainly includes the steps and verification conditions for downloading, installing, opening, uninstalling and other operations of the application, as well as the specific content of the application function test.

[0064] S4, matching a test device for the acquired task to be tested;

[0065] Specifically, the application compatibility testing system searches for idle test devices that meet the test requirements among multiple test devices. The first is to meet the model, hardware configuration and software version of the test equipment in the test requirements, and the second is to select a suitable test robot based on the characteristics of the application to be tested.

[0066] It should be noted that the test robot is mainly constructed by a mechanical arm, an image acquisition device, etc., which belongs to the existing technology and will not be described in detail here. The introduction of the test robot meets more application testing needs, such as for some financial and security applications.

[0067] S5, sending the acquired task to be tested and the adapted automated test script to the matching test device to perform compatibility testing of the corresponding application to be tested;

[0068] Specifically, the test device runs the automated test script. After the test of an application to be tested is completed, the application compatibility test system obtains the test result, fills it back into the corresponding position of the list of applications to be tested, and generates a test report; after the test of all applications to be tested corresponding to all tasks to be tested in the task queue to be tested is completed, the application compatibility test system will remotely and directedly send the list of applications to be tested and the test report filled with the test results to the operator.

[0069] The following is an explanation of how to determine whether the application under test has been tested:

[0070] If the adapted automated test script of a test task corresponding to an application to be tested runs successfully, the test of the application to be tested is defined as ended; if the adapted automated test script of a test task corresponding to an application to be tested fails to run, the application compatibility testing system will re-adapt a new automated script for the test task according to the adaptation logic method of the automated test script described above for load testing. After repeating three times, the test of the application to be tested is defined as ended regardless of success or failure.

[0071] S6. Obtain test results and collect and update the historical test data according to the test results;

[0072] After the test device performs application compatibility testing, whether the test fails or succeeds, the application compatibility testing system obtains the results, updates the historical test data and counts the success rate, thereby accumulating test experience. In other words, in terms of application compatibility test scheduling, it has a certain degree of self-learning, that is, as more and more test data is collected, the adaptation of the automated test script can be more accurate, which further improves the test efficiency.

[0073] The application compatibility testing method proposed in this embodiment can realize automated compatibility testing of applications, improve the testing efficiency of applications, and further, automatically adapt automated test scripts based on historical test data, and the historical test data will be updated in real time as the test progresses. That is, as more and more testing experience is gained, automated test scripts with high success rates will be selected, that is, test scripts with higher quality and better methods will be selected, so that the testing efficiency will be further improved.

[0074] Embodiment 2

[0075] In the second embodiment, an application compatibility testing system is proposed, which is used to implement the application compatibility testing method as in the first embodiment. The testing system includes an information input unit, an information processing unit, a request acquisition unit, a script matching unit, a test device matching unit, an instruction sending unit, a report statistics unit, a database unit and a remote sending unit.

[0076] Specifically, the information input unit is used to input information of a list of applications to be tested. The list of applications to be tested is in Excel format, and multiple applications to be tested are sorted. The list mainly includes information such as application package names of the applications to be tested and search application names.

[0077] The information processing unit is used to automatically identify and process the list of applications to be tested input through the information input unit, and generate a task queue to be tested including a plurality of tasks to be tested.

[0078] The request acquisition unit is used to acquire the task to be tested from the task queue to be tested generated by the information processing unit.

[0079] The script matching unit is used to adapt the automated test script for the task to be tested obtained by the request acquisition unit. The automated test script is edited by relevant technical personnel and saved in the database unit, and mainly includes the steps and verification conditions for operations such as downloading, installing, opening, and uninstalling the application, as well as the specific content of the application function test.

[0080] The test device matching unit is used to match the test device for the task to be tested obtained by the request acquisition unit; the test device is not limited to various computers, laptops, smart phones, tablets and portable wearable devices, etc., and the operating system is not limited to Android, iOS, Windows, Linux, etc.

[0081] The instruction sending unit is used to send the task to be tested obtained by the request obtaining unit and the automated test script adapted by the script matching unit to the test device matched by the test device matching unit, and the test device runs the automated test script to implement application compatibility testing.

[0082] The result statistics unit is used to obtain the test results of the test equipment and to collect statistics and update the historical test data of the application according to the test results. The historical test data is stored in the database unit.

[0083] Furthermore, the result statistics unit is further used to fill the successful test results of the test device back into the list of applications to be tested input by the information input unit.

[0084] The report statistics unit is used to generate a test report according to the test situation, and the test report includes the test results, test time, abnormal conditions during the test process, etc.

[0085] The remote sending unit is used to remotely send the list of applications to be tested filled with test success results and the test report to a designated terminal; the designated terminal can be but is not limited to a personal computer, mobile phone, tablet or other device of the relevant technician.

[0086] For the specific definition of the application compatibility testing system, please refer to the definition of the application compatibility testing method above, which will not be repeated here. Each unit in the above-mentioned application compatibility testing system can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned units can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned units.

[0087] The application compatibility testing system proposed in this embodiment can realize the automated process of application compatibility testing, including automatic disassembly of application spreadsheet files, automatic adaptation of automated test scripts, automatic matching of test equipment, and automatic generation and sending of test results and test reports. Compared with manual testing, it effectively improves the efficiency of application compatibility testing.

[0088] Embodiment 3

[0089] In this third embodiment, a computer device is proposed, which includes a memory and a processor connected to the memory; the memory is used to store computer programs; the processor is used to run the computer programs stored in the memory to execute the steps of the application compatibility testing method described in the first embodiment.

[0090] Embodiment 4

[0091] In the fourth embodiment, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the application compatibility testing method described in the first embodiment.

[0092] Those skilled in the art can understand that all or part of the process of the method in the above-mentioned embodiment 1 can be realized by controlling the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the process of each method in the embodiment 1. Among them, any reference to memory, storage, database or other media provided in this embodiment 4 can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0093] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An application compatibility testing method, characterized in that: The steps include: Build a task queue for the application to be tested; Obtaining the tasks to be tested one by one from the task queue to be tested; Adapting an automated test script for the acquired task to be tested according to historical test data; Matching a test device for the acquired task to be tested; Sending the acquired task to be tested and the adapted automated test script to the matching test device to perform compatibility testing of the corresponding application to be tested; The test results are obtained and the historical test data are counted and updated according to the test results.

2. The application compatibility testing method according to claim 1, characterized in that: The specific steps of constructing the task queue to be tested are: Enter the list of applications to be tested in a table format; Automatically identify the data in the table to form multiple tasks to be tested that contain the core information of the application to be tested; The plurality of tasks to be tested are sequentially arranged to form the task queue to be tested.

3. The application compatibility testing method according to claim 2, characterized in that: The following steps are also included: After the test of the application to be tested corresponding to the task to be tested is completed, the test result is filled back into the corresponding position of the list of applications to be tested, and a test report is generated; After all the applications to be tested corresponding to the tasks to be tested in the task queue to be tested are tested, the list of applications to be tested and the test report are remotely and directedly sent together.

4. The application compatibility testing method according to claim 1, characterized in that: The specific method for adapting the automated test script to the task to be tested obtained according to the historical test data is: If the task to be tested has corresponding historical test data, then the test script with a high success rate for the application to be tested in the historical test data is preferentially selected; If the application to be tested corresponding to the task to be tested lacks historical test data, a test script with a high success rate in compatibility tests of other third-party applications is preferentially selected.

5. The application compatibility testing method according to claim 1, characterized in that; The method for adapting the automated test script to the acquired task to be tested also includes: adapting the automated test script to the task to be tested according to the characteristics of the application to be tested corresponding to the task to be tested, specifically: If the application to be tested corresponding to the task to be tested has specific test steps or test preferences, an automated test script including the specific test steps or matching the test preferences is selected.

6. The application compatibility testing method according to claim 1, characterized in that: The specific method for matching the test equipment to the acquired task to be tested is: First, select the test equipment model, hardware configuration, and software version that meet the test requirements; Secondly, a suitable test robot is selected according to the properties of the application to be tested corresponding to the task to be tested.

7. The application compatibility testing method according to claim 1, characterized in that: When the test device performs compatibility testing on the application to be tested, if the test fails, a new automated test script is re-adapted for the task to be tested corresponding to the application to be tested, and the process is repeated three times. If the test still fails, the test of the application to be tested is terminated.

8. An application compatibility testing system, characterized in that: include: A database unit, used to store automated test scripts and historical test data generated by the tests; An information input unit, used to input information of a list of applications to be tested; An information processing unit, used for automatically identifying and processing the input list of applications to be tested, and generating a task queue to be tested including a plurality of tasks to be tested; A request acquisition unit, used for acquiring the task to be tested from the task queue to be tested; A script matching unit, used for adapting an automated test script to the acquired task to be tested; A test equipment matching unit, used for matching the test equipment for the task to be tested; An instruction sending unit, used for sending the task to be tested and the adapted automated test script to the matching test device; A result statistics unit, used to obtain test results and perform statistics and update historical test data according to the test results; Also used to fill the test results back into the list of applications to be tested; Report statistics unit, used to generate test reports according to test conditions; The remote sending unit is used to remotely send the list of applications to be tested filled with test results and the test report to a designated terminal.

9. A computer device, characterized in that: The computer device includes a memory and a processor connected to the memory; the memory is used to store computer programs; the processor is used to run the computer programs stored in the memory to execute the steps of the application compatibility testing method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the application compatibility testing method according to any one of claims 1 to 7.

Images