User interface UI automated testing method, device, equipment and medium

Abstract

The present application relates to the field of interface testing, and specifically to a user interface (UI) automated testing method, apparatus, equipment, and medium, which are used to solve the problem of low efficiency in UI automated testing. The method includes: recording the user's operation process on the interface under test; during the recording process, if it is detected that the user's operation process on the interface under test requires the acquisition of dynamic data, the dynamic data is converted into fixed data through a baffle server; the fixed data is sent to the interface under test so that the user can obtain the fixed data; after the recording is completed, the recorded content is played back, and if the playback is successful, it is determined that the interface under test functions normally. Since a baffle server is used in this application, the baffle server can convert dynamic data into fixed data, which can improve the success rate of playback, thereby improving test efficiency.

Description

Technical Field

[0001] The present application relates to the field of interface testing, and specifically to a user interface (UI) automated testing method, device, equipment, and medium. Background Art

[0002] When performing functional testing or special testing on application software, due to the frequent iteration of mobile versions and the fact that there are usually multiple backend server environments for an application software, it is easy to encounter phenomena such as tight test data resources and unstable test environment.

[0003] During the testing process, some tests involve obtaining dynamically changing data (for example, dynamically obtaining verification codes, QR codes, etc., which will become invalid after 1 minute or 5 minutes). These dynamically changing data may cause playback failures during the user interface UI automated testing process; and, in the existing technology, during the automated testing process, due to the existence of some consumable test data, mutually exclusive data, data corruption, etc., automated testing cannot be performed on multiple devices at the same time. Sufficient test data must be prepared to complete the test, which seriously reduces the testing efficiency. Summary of the Invention

[0004] The embodiments of the present application provide a user interface (UI) automated testing method, apparatus, device, and medium for solving the problem of low efficiency of UI automated testing.

[0005] In a first aspect, an embodiment of the present application provides a user interface (UI) automated testing method, the method comprising:

[0006] Record the user's operation process on the tested interface;

[0007] During the recording process, if it is detected that the user's operation process on the measured interface needs to obtain dynamic data, the dynamic data is converted into fixed data through the baffle server;

[0008] Sending the fixed data to the tested interface so that the user can obtain the fixed data;

[0009] After the recording is completed, the recorded content is played back. If the playback is successful, it is determined that the function of the tested interface is normal.

[0010] In the user interface UI automated testing method provided in the embodiment of the present application, since a baffle server is used, the baffle server can convert dynamic data into fixed data, which can improve the success rate of playback and thus improve testing efficiency.

[0011] In a possible embodiment, before recording the user's operation process on the tested interface, the method further includes:

[0012] Data resource configuration is performed on the baffle server according to the attributes of the interface under test.

[0013] In a possible embodiment, recording the user's operation process on the tested interface includes:

[0014] Identifying the operation position and operation control corresponding to the operation performed by the user on the tested interface;

[0015] The identified operation position and the data of the operation control are recorded and saved.

[0016] In a possible embodiment, playing back the recorded content includes:

[0017] Locate the current operation position and operation controls to be played back based on the intelligent search algorithm;

[0018] Based on the located operation position and operation controls, the user's operation is determined and played back for display.

[0019] In one possible embodiment, whether the playback is successful is determined in the following manner:

[0020] If the operation positions and operation controls recorded and saved during the recording process are completely played back, it is determined that the playback is successful; otherwise, it is determined that the playback has failed.

[0021] In a possible embodiment, converting the dynamic data into fixed data by the baffle server includes:

[0022] Acquiring type information of the operation control through the baffle server;

[0023] Based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control.

[0024] In a possible embodiment, after playing back the recorded content, the method further includes:

[0025] If the playback fails, it is determined that the function of the tested interface is abnormal and an alarm is issued.

[0026] In a second aspect, the present application provides a user interface UI automated testing device, the device comprising:

[0027] A recording unit, used to record the user's operation process on the tested interface;

[0028] The conversion unit is configured to, during the recording process, if it is detected that the user's operation process on the measured interface requires acquisition of dynamic data, convert the dynamic data into fixed data through the baffle server; and send the fixed data to the measured interface so that the user acquires the fixed data;

[0029] The playback unit is used to play back the recorded content after the recording is completed. If the playback is successful, it is determined that the function of the tested interface is normal.

[0030] In a possible embodiment, the device further includes:

[0031] A configuration unit is used to configure data resources for the baffle server according to the attributes of the interface under test.

[0032] In a possible embodiment, the recording unit is specifically configured to:

[0033] Identifying the operation position and operation control corresponding to the operation performed by the user on the tested interface;

[0034] The identified operation position and the data of the operation control are recorded and saved.

[0035] In a possible embodiment, the playback unit is specifically configured to:

[0036] Locate the current operation position and operation controls to be played back based on the intelligent search algorithm;

[0037] Based on the located operation position and operation controls, the user's operation is determined and played back for display.

[0038] In one possible embodiment, whether the playback is successful is determined in the following manner:

[0039] If the operation positions and operation controls recorded and saved during the recording process are completely played back, it is determined that the playback is successful; otherwise, it is determined that the playback has failed.

[0040] In a possible embodiment, the conversion unit is specifically configured to:

[0041] Acquiring type information of the operation control through the baffle server;

[0042] Based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control.

[0043] In a possible embodiment, the playback unit is further configured to:

[0044] If the playback fails, it is determined that the function of the tested interface is abnormal and an alarm is issued.

[0045] In a third aspect, the present application provides an electronic device, comprising:

[0046] a memory for storing program instructions;

[0047] The processor is configured to call the program instructions stored in the memory and execute the steps included in any one of the methods of the first aspect according to the obtained program instructions.

[0048] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes any one of the methods according to the first aspect.

[0049] In a fifth aspect, the present application provides a computer program product, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any one of the methods described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A flowchart of a UI automation testing method provided in an embodiment of the present application;

[0051] Figure 2 A schematic diagram of a recording and playback process provided in an embodiment of the present application;

[0052] Figure 3a A schematic diagram of a specific application scenario provided in an embodiment of the present application;

[0053] Figure 3b A schematic diagram of another specific application scenario provided in an embodiment of the present application;

[0054] Figure 4 A structural diagram of a user interface UI automated testing device provided in an embodiment of the present application;

[0055] Figure 5 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. Unless there is a conflict, the embodiments in the present application and the features in the embodiments can be combined with each other in any way. In addition, although a logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that here.

[0057] The terms "first" and "second" in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of its variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in this application can mean at least two, for example, two, three or more, and the embodiments of this application are not limited thereto.

[0058] In the technical solution of this application, the collection, dissemination, and use of data comply with the requirements of relevant national laws and regulations.

[0059] Before introducing a user interface UI automated testing method provided by an embodiment of the present application, for ease of understanding, the technical background of the embodiment of the present application is first introduced in detail below.

[0060] Some application software projects have frequent iterations of mobile versions when conducting functional testing, compatibility testing and other special tests, and have multiple backend server environments and tight test data resources. When conducting regression testing, test cases will be repeatedly executed, and the unstable environment will lead to test blockage and delayed version release. When conducting special compatibility testing, due to insufficient test data and unstable environment, more manpower and time will be required to implement it.

[0061] More specifically, the prior art has the following two drawbacks:

[0062] (1) During the UI automation test, playback fails due to data changes. For example, dynamically obtaining verification codes or QR codes will become invalid after 1 or 5 minutes, causing script execution failure during playback.

[0063] (2) In the process of automated testing, the existing technology cannot perform automated testing on multiple devices at the same time because of the existence of some consumable test data, mutually exclusive data, and data corruption. Sufficient test data must be prepared to complete the test.

[0064] In response to this phenomenon, in order to improve the execution success rate of regression testing in project iterations, save time for manual regression, save time for pre-embedded test data, and improve work efficiency, this application implemented automated testing based on a baffle environment in the project to solve the above problems.

[0065] like Figure 1 As shown, a user interface UI automated testing method provided in an embodiment of the present application includes the following steps:

[0066] S101, recording the user's operation process on the tested interface;

[0067] S102, during the recording process, if it is detected that the user's operation process on the measured interface needs to obtain dynamic data, the dynamic data is converted into fixed data through the baffle server;

[0068] S103, sending the fixed data to the interface under test so that the user can obtain the fixed data;

[0069] S104: After the recording is completed, the recorded content is played back. If the playback is successful, it is determined that the function of the tested interface is normal.

[0070] The user interface (UI) automated testing method provided in an embodiment of the present application records the user's operations on the interface under test. During the recording process, if it is detected that the user's operations on the interface under test require the acquisition of dynamic data, the dynamic data is converted into fixed data via a baffle server. The fixed data is sent to the interface under test so that the user can obtain the fixed data. After the recording is completed, the recorded content is played back. If the playback is successful, it is determined that the interface under test is functioning normally. Since the baffle server is used to convert the dynamic data into fixed data, the playback success rate can be improved, thereby improving testing efficiency.

[0071] It is worth noting that what is played back here is not just a simple video, but corresponding operations based on the recorded content. If a certain operation during the recording process requires obtaining data such as a verification code, then the data still needs to be obtained during playback.

[0072] In some embodiments, before recording the user's operation process on the interface under test, the baffle server can also be configured with data resources according to the properties of the interface under test. The data configuration here refers to the configuration of various data required for the test. For example, when testing a certain application software, the user needs to have his or her own mobile phone number to log in. Once the user logs in, he or she cannot log in again on other devices. Since this application uses a baffle server, a large amount of test data can be directly configured in the baffle server, such as a large number of virtual mobile phone numbers, so that the test can be carried out on multiple devices at the same time, and batch automated testing can be carried out, thereby improving work efficiency.

[0073] The specific testing tool that can be used is Soloπ, which is a set of wireless, non-invasive, and root-free Android-specific tools for mobile devices. It can implement automated function, performance, and compatibility testing on mobile devices without being separated from the PC environment, reducing the testing costs of the majority of test developers and improving testing efficiency.

[0074] The baffle server used in this application means that the test is conducted in a baffle environment. A baffle refers to a type of system or service that simulates the services or functions of the called system in a development or test environment, and provides return values ​​when the corresponding interface is called, to assist the calling system in development and testing. The baffle data is fake data written to simulate real network requests. Although this data is written, it conforms to the data format in the real environment. This data is generally stored locally in the program, and then directly called from the local to see whether the display and related logic are normal. If normal, it means that it can still run normally when connected to a normal environment. The recording and playback function is mainly used in the test process. The recording and playback function can achieve accurate search based on three modes: AccessibilityService, ChromeDevToolsProtocol, and image recognition. It can be played back locally on the device, or converted into scripts of frameworks such as Appium / Macaca, and connected to the cloud testing platform. In addition, in order to reduce the cost of use case maintenance, use case editing and process control functions are also provided on the end.

[0075] like Figure 2 As shown, this is a schematic diagram of the recording and playback provided by an embodiment of the present application. During the recording process, Soloπ will intercept the user's operation, identify the location of the user's operation, highlight the control of the current operation, and record the type of operation the user is currently performing. After each step of the operation, the operation type and various information of the target control are recorded. The control information here includes basic information such as the control's ID and text, as well as relative layout, screenshot information, etc. During playback, Soloπ will parse the previously recorded data one by one, and through an intelligent search algorithm, it will integrate various attributes to locate the target control. After finding the control, it will perform the corresponding operation, such as clicking, sliding, etc. After all steps are executed, the results of this playback will be displayed, including logs, screenshots and other information, as a summary of this playback.

[0076] In some embodiments, the user's operation process on the tested interface is recorded, specifically identifying the operation position and operation control corresponding to the operation performed by the user on the tested interface; recording and saving the data of the identified operation position and operation control for subsequent playback.

[0077] In some embodiments, playback of recorded content can include: locating the current operation position and operation control to be replayed based on an intelligent search algorithm; determining the user's operation based on the located operation position and operation control, and replaying and displaying it. Specifically, the success of playback can be determined as follows: if the operation position and operation control recorded and saved during the recording process are fully played back, the playback is determined to be successful; otherwise, the playback is determined to have failed. If playback fails, the tested interface is determined to be malfunctioning, and an alarm is issued.

[0078] In some embodiments, dynamic data is converted into fixed data via a baffle server. Specifically, the baffle server may obtain type information of an operation control; based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control. For example, if the operation control type is to obtain a verification code, the dynamic verification code can be converted into a corresponding fixed verification code, such as 123456; or if the operation control type is to obtain a QR code, the dynamic QR code can be converted into a corresponding fixed QR code. This ensures successful verification during playback, thereby ensuring a smooth verification process.

[0079] like Figure 3a As shown in the figure, it is a schematic diagram of a specific application scenario. First, the APP side obtains the verification code, and then the baffle server sends the verification code. After the user enters the verification code on the APP side, it sends the verification code to the baffle server. Finally, the baffle server verifies the verification code and returns the verification result to the APP side. This application can modify the dynamic verification code to a fixed verification code to ensure that the process goes smoothly. Similarly, if Figure 3b As shown, this is a schematic diagram of another specific application scenario. The merchant requests the baffle server to generate a payment code, and then the payment App user scans the code and sends a payment code query request to the baffle server to obtain the QR code information and order information. This application can modify the dynamic QR code into a fixed QR code to ensure that this process proceeds smoothly.

[0080] This application uses the tested application package of the baffle environment for recording during recording. Specific scenarios such as the above-mentioned input verification code (using the data returned by the baffle server) and generation of QR code (using the baffle server to generate QR code) can solve the playback failure caused by data changes during playback of these dynamically changing data.

[0081] Based on the same inventive concept, the present application embodiment provides a user interface UI automatic testing device, please refer to Figure 4 , the device comprises:

[0082] The recording unit 401 is used to record the user's operation process on the tested interface;

[0083] The conversion unit 402 is configured to, during the recording process, if it is detected that the user's operation on the measured interface requires acquisition of dynamic data, convert the dynamic data into fixed data through the baffle server; and send the fixed data to the measured interface so that the user can acquire the fixed data;

[0084] The playback unit 403 is used to play back the recorded content after the recording is completed. If the playback is successful, it is determined that the function of the tested interface is normal.

[0085] In some embodiments, further comprising:

[0086] The configuration unit is used to configure data resources on the baffle server according to the properties of the interface under test.

[0087] In some embodiments, the recording unit 401 is specifically configured to:

[0088] Identify the operation positions and operation controls corresponding to the operations performed by the user on the tested interface;

[0089] The data of the identified operation position and operation control are recorded and saved.

[0090] In some embodiments, the playback unit 403 is specifically configured to:

[0091] Locate the current operation position and operation controls to be played back based on the intelligent search algorithm;

[0092] Based on the located operation position and operation controls, the user's operation is determined and played back for display.

[0093] In some embodiments, whether the playback is successful is determined by:

[0094] If the operation positions and operation controls recorded and saved during the recording process are completely played back, it is determined that the playback is successful; otherwise, it is determined that the playback has failed.

[0095] In some embodiments, the conversion unit 402 is specifically configured to:

[0096] Obtain the type information of the operation control through the baffle server;

[0097] Based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control.

[0098] In some embodiments, the playback unit 403 is further configured to:

[0099] If the playback fails, it is determined that the function of the tested interface is abnormal and an alarm is issued.

[0100] Based on the same inventive concept, the embodiment of the present application provides an electronic device that can realize the functions of the user interface UI automated testing device discussed above. Please refer to Figure 5 The device includes a processor 501 and a memory 502, the memory 502 is used to store program instructions; the processor 501 is used to call the program instructions stored in the memory 502, and execute the steps included in any of the above-mentioned user interface UI automation testing methods according to the obtained program instructions.

[0101] Based on the same inventive concept, embodiments of the present application provide a computer-readable storage medium, a computer program product comprising: computer program code. When the computer program code is executed on a computer, it causes the computer to execute any of the user interface (UI) automated testing methods discussed above. Because the principles underlying the problems solved by the computer-readable storage medium are similar to those of the user interface (UI) automated testing method, the implementation of the computer-readable storage medium can be referenced to the implementation of the method, and any repetitions will not be repeated.

[0102] Based on the same inventive concept, embodiments of the present application further provide a computer program product comprising: computer program code, which, when executed on a computer, causes the computer to execute any of the user interface (UI) automated testing methods discussed above. Because the principles underlying the problems solved by the aforementioned computer program products are similar to those of the user interface (UI) automated testing methods, the implementation of the aforementioned computer program products can be referenced to the implementation of the methods, and any repetitive details will not be repeated.

[0103] The present application provides a user interface (UI) automated testing method, apparatus, device, and medium. The method includes recording a user's operations on a tested interface; during the recording process, if it is detected that the user's operations on the tested interface require the acquisition of dynamic data, converting the dynamic data into fixed data via a baffle server; sending the fixed data to the tested interface so that the user can obtain the fixed data; and after the recording is completed, replaying the recorded content. If the playback is successful, it is determined that the tested interface functions normally. Since the baffle server is used to convert the dynamic data into fixed data, the playback success rate can be improved, thereby improving testing efficiency.

[0104] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0105] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0106] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0107] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of user-operated steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0108] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A user interface UI automated testing method, characterized in that: include: Use the application package under test in the baffle environment to record the user's operation process on the tested interface. The baffle environment refers to a type of system or service that simulates the services or functions of the called system in the development or test environment and provides the return value of the corresponding interface call to assist the calling system in development and testing; During the recording process, if it is detected that the user's operation process on the tested interface requires the acquisition of dynamic data, the dynamic data is converted into fixed data through the baffle server, wherein the type information of the current operation control is obtained through the baffle server, and based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control, when the type of the operation control is to obtain a dynamic verification code, the fixed data is a fixed verification code, and when the type of the operation control is to obtain a dynamic QR code, the fixed data is a fixed QR code; Sending the fixed data to the tested interface so that the user can obtain the fixed data; After the recording is completed, the recorded content is played back. If the playback is successful, it is determined that the function of the tested interface is normal.

2. The method according to claim 1, wherein Before recording the user's operation process on the tested interface, the method further includes: Data resource configuration is performed on the baffle server according to the attributes of the interface under test.

3. The method according to claim 1, wherein The recording of the user's operation process on the tested interface includes: Identifying the operation position and operation control corresponding to the operation performed by the user on the tested interface; The identified operation position and the data of the operation control are recorded and saved.

4. The method according to claim 3, wherein Playing back the recorded content includes: Locate the current operation position and operation controls to be played back based on the intelligent search algorithm; Based on the located operation position and operation controls, the user's operation is determined and played back for display.

5. The method according to claim 3, wherein Determine whether playback is successful by the following methods: If the operation positions and operation controls recorded and saved during the recording process are completely played back, it is determined that the playback is successful; otherwise, it is determined that the playback has failed.

6. The method according to any one of claims 1 to 5, characterized in that: After playing back the recorded content, the method further includes: If the playback fails, it is determined that the function of the tested interface is abnormal and an alarm is issued.

7. A user interface UI automated testing device, characterized in that: include: A recording unit, configured to record the user's operations on the interface under test using the application package under test in a baffle environment. The baffle environment refers to a system or service that simulates the services or functions of the called system in a development or test environment and provides return values ​​when the corresponding interface is called, thereby assisting the calling system in development and testing. a conversion unit configured to, during a recording process, convert the dynamic data into fixed data through a baffle server if it is detected that the user's operation process on the measured interface requires the acquisition of dynamic data; and send the fixed data to the measured interface so that the user acquires the fixed data, wherein type information of the current operation control is acquired through the baffle server, and based on the type information of the operation control, the dynamic data is converted into fixed data corresponding to the operation control; when the type of the operation control is to acquire a dynamic verification code, the fixed data is a fixed verification code; when the type of the operation control is to acquire a dynamic QR code, the fixed data is a fixed QR code; The playback unit is used to play back the recorded content after the recording is completed. If the playback is successful, it is determined that the function of the tested interface is normal.

8. The device according to claim 7, wherein Also includes: A configuration unit is used to configure data resources for the baffle server according to the attributes of the interface under test.

9. The device according to claim 7, wherein The recording unit is specifically configured to: Identifying the operation position and operation control corresponding to the operation performed by the user on the tested interface; The identified operation position and the data of the operation control are recorded and saved.

10. The device according to claim 9, wherein The playback unit is specifically configured to: Locate the current operation position and operation controls to be played back based on the intelligent search algorithm; Based on the located operation position and operation controls, the user's operation is determined and played back for display.

11. The device according to claim 9, wherein Determine whether playback is successful by the following methods: If the operation positions and operation controls recorded and saved during the recording process are completely played back, it is determined that the playback is successful; otherwise, it is determined that the playback has failed.

12. The device according to any one of claims 7 to 11, characterized in that: The playback unit is further configured to: If the playback fails, it is determined that the function of the tested interface is abnormal and an alarm is issued.

13. An electronic device, characterized in that: include: a memory for storing program instructions; A processor is configured to call the program instructions stored in the memory, and execute the steps included in the method according to any one of claims 1 to 6 according to the obtained program instructions.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a computer, the computer is caused to perform the method according to any one of claims 1 to 6.

15. A computer program product, characterized in that The computer program product comprises: a computer program code, and when the computer program code is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 6.

Images