Application test method and device, electronic equipment and storage medium

Abstract

The invention relates to an application testing method and device, electronic equipment and a storage medium, and relates to the technical field of computers.The application testing method comprises the steps that under the condition that an application testing instruction for a target testing application is detected, a current application display page of the target testing application is obtained, the first test attribute information comprises first identification indication information corresponding to the first test control and first operation indication information corresponding to the first test control; based on the first identification indication information and the current application display page, performing control region position analysis on the first test control to obtain first position indication information corresponding to the first test control; generating a first control operation instruction corresponding to the first test control based on the first position indication information and the first operation indication information; and based on the first control operation instruction, controlling the target test application to execute a first business operation corresponding to the first operation indication information. By utilizing the embodiment of the invention, the test of a complex scene can be realized, and the application test efficiency can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to an application testing method, apparatus, electronic device, and storage medium. Background Technology

[0002] In existing automated test case editing processes, testers can continuously refresh the editor with the latest screenshots of the mobile phone interface and determine the coordinates of the location to be clicked based on the screenshots displayed in the editor. Then, testers can edit the click instructions in the editor based on these coordinates to complete an operation test case. This operation test case can verify whether the effect after clicking meets expectations. However, this approach is only applicable to relatively simple scenarios and has low testing efficiency. Summary of the Invention

[0003] In view of the aforementioned technical problems, this disclosure proposes an application testing method, apparatus, electronic device, and storage medium.

[0004] According to one aspect of the embodiments of this disclosure, an application testing method is provided, the method comprising:

[0005] Upon detecting an application test instruction for the target test application, the current application display page of the target test application is obtained; the application test instruction includes first test attribute information corresponding to the first test control, and the first test attribute information includes first identifier indication information corresponding to the first test control and first operation indication information corresponding to the first test control;

[0006] Based on the first identifier indication information and the current application display page, the control area position analysis is performed on the first test control to obtain the first position indication information corresponding to the first test control; the first position indication information is used to indicate the position of the first test control in the current application display page.

[0007] Based on the first position indication information and the first operation indication information, generate the first control operation instruction corresponding to the first test control;

[0008] Based on the first control operation instruction, the target test application is controlled to execute the first business operation corresponding to the first operation instruction information.

[0009] According to another aspect of the embodiments of this disclosure, an application testing apparatus is provided, the apparatus comprising:

[0010] The current page acquisition module is used to acquire the current application display page of the target test application when an application test instruction for the target test application is detected; the application test instruction includes first test attribute information corresponding to the first test control, and the first test attribute information includes first identification indication information and first operation indication information corresponding to the first test control;

[0011] The control position analysis module is used to perform control area position analysis on the first test control based on the first identifier indication information and the current application display page, and obtain the first position indication information corresponding to the first test control; the first position indication information is used to indicate the position of the first test control in the current application display page.

[0012] The first instruction generation module is used to generate a first control operation instruction corresponding to the first test control based on the first position indication information and the first operation indication information.

[0013] The first execution module is used to control the target test application to perform the first business operation corresponding to the first operation instruction information based on the first control operation instruction.

[0014] Optionally, the first execution module includes:

[0015] The second execution module is used to send the first control operation instruction to the target terminal, so that the target terminal performs the first business operation corresponding to the first operation instruction in the first control operation instruction on the first test control based on the first position indication information in the first control operation instruction; the target test application runs on the target terminal.

[0016] Optionally, the current page acquisition module includes:

[0017] The interception instruction sending module is used to send an interception instruction for the current page corresponding to the target test application to the target terminal, so that the target terminal performs a page interception operation and obtains the page encoding information corresponding to the current application display page;

[0018] The page encoding receiving module is used to receive the page encoding information corresponding to the current application display page sent by the target terminal;

[0019] The decoding processing module is used to decode the page encoding information to obtain the page decoding information corresponding to the current application display page;

[0020] The transcoding module is used to transcode the page decoding information to obtain the current application display page.

[0021] Optionally, the device further includes:

[0022] The first thread creation module is used to create the page receiving thread and the instruction sending thread;

[0023] Accordingly, the page encoding receiving module includes:

[0024] The first thread execution module is used to receive the page encoding information sent by the target terminal based on the page receiving thread;

[0025] Accordingly, the second execution module includes:

[0026] The second thread execution module is used to send the first control operation instruction to the target terminal based on the instruction sending thread.

[0027] Optionally, the device further includes:

[0028] The second thread creation module is used to create page processing threads;

[0029] Accordingly, the decoding processing module includes:

[0030] The third thread execution module is used to decode the page encoding information based on the page processing thread to obtain the page decoding information.

[0031] Optionally, the transcoding module includes:

[0032] The hardware-accelerated transcoding module is used to transcode the page decoding information based on a preset hardware transcoding module to obtain the current application display page; the preset hardware transcoding module is used to perform parallel processing of multi-bit data on the page decoding information to achieve hardware-accelerated transcoding.

[0033] Optionally, the control position analysis module includes:

[0034] The text recognition module is used to perform text recognition on the current application display page to obtain the application page text information corresponding to the current application display page;

[0035] The matching processing module is used to match the application page text information and the control identifier text information to obtain the target matching result;

[0036] The control region recognition module is used to identify the first test control based on the control identifier text information and the current application display page when the target matching result indicates that the application page text information contains the control identifier text information, thereby obtaining the first test control region corresponding to the first test control.

[0037] The first position analysis module is used to perform regional position analysis on the first test control based on the current application display page and the first test control area to obtain the first position indication information.

[0038] Optionally, the device further includes:

[0039] The control region prediction module is used to perform control region prediction analysis on the first test control based on the control identifier text information, the current application display page, and a preset control recognition model when the target matching result indicates that the application page text information does not contain the control identifier text information, thereby obtaining the first position indication information.

[0040] Optionally, the device further includes:

[0041] The dataset acquisition module is used to acquire a preset sample dataset; the preset sample dataset includes at least one sample application display page, sample identifier text information corresponding to each sample application display page, and label position indication information corresponding to each sample application display page;

[0042] The sample region prediction module is used to input the sample identifier text information corresponding to each sample application display page and each sample application display page into a preset machine learning model to perform control region prediction analysis, and obtain the prediction position indication information of the predicted control region image corresponding to each sample identifier text information;

[0043] The loss determination module is used to determine the target loss information based on the prediction position indication information of the prediction control area image corresponding to each sample identification text information and the label position indication information corresponding to each sample identification text information;

[0044] The model training module is used to train the preset machine learning model based on the target loss information to obtain the preset control recognition model.

[0045] Optionally, the device further includes:

[0046] The second position analysis module is used to perform control area position analysis on the second test control based on the second identification indication information and the current application display page, and obtain the second position indication information corresponding to the second test control; the second position indication information is used to indicate the position of the second test control in the current application display page.

[0047] The second instruction generation module is used to generate a second control operation instruction corresponding to the second test control based on the second position indication information and the second operation indication information;

[0048] The third execution module is used to control the target test application to perform the second business operation corresponding to the second operation instruction information based on the second control operation instructions.

[0049] Optionally, the device further includes:

[0050] The current duration acquisition module is used to acquire the current position analysis duration corresponding to the first test control during the process of analyzing the control area position of the first test control; the current position analysis duration represents the duration from the start time of the control area position analysis of the first test control to the current time;

[0051] The third location analysis module is used to perform control area location analysis on the second test control based on the second identifier indication information and the current application display page when the current location analysis duration is detected to be greater than or equal to the preset location analysis duration and no first location indication information is detected, thereby obtaining the second location indication information corresponding to the second test control; the second location indication information is used to indicate the position of the second test control in the current application display page.

[0052] The third instruction generation module is used to generate a second control operation instruction corresponding to the second test control based on the second position indication information and the second operation indication information;

[0053] The fourth execution module is used to control the target test application to perform the second business operation corresponding to the second operation instruction information based on the second control operation instructions.

[0054] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects:

[0055] Upon detecting an application test instruction targeting the target application, the system retrieves the current application display page of the target application. The application test instruction includes first test attribute information corresponding to a first test control. This first test attribute information includes first identifier information and first operation instruction information corresponding to the first test control. This allows the retrieval of the current application display page. Combining the first identifier information and the current application display page, the system analyzes the control area position of the first test control to obtain its corresponding first position indication information. This allows for the analysis of the control area position of the first test control. Next, combining the first position indication information and the first operation indication information, the system generates a first control operation instruction corresponding to the first test control. This allows for the generation of operation instructions for the first test control. Finally, combining the first control operation instructions, the system controls the target application to execute the first business operation corresponding to the first operation instruction information. This enables targeted testing of the first test control, thereby enabling testing of complex scenarios and improving application testing efficiency.

[0056] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0057] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0058] Figure 1 This is a schematic diagram illustrating an application system according to an exemplary embodiment;

[0059] Figure 2 This is a flowchart illustrating an application testing method according to an exemplary embodiment;

[0060] Figure 3 This is an interactive schematic diagram illustrating an application testing method according to an exemplary embodiment;

[0061] Figure 4 This is a block diagram illustrating an application testing apparatus according to an exemplary embodiment;

[0062] Figure 5 This is a block diagram illustrating an electronic device for controlling a target test application to perform a first business operation, according to an exemplary embodiment.

[0063] Figure 6 This is a block diagram illustrating another electronic device for controlling a target test application to perform a first business operation, according to an exemplary embodiment. Detailed Implementation

[0064] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0065] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0066] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.

[0067] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating an application system according to an exemplary embodiment. The application system can be used in the application testing method of this application. The application system may include at least terminal 01 and terminal 02.

[0068] In this embodiment, terminal 01 can be a test terminal. The test terminal can be used to test the target application. Specifically, terminal 01 can include physical devices such as smartphones, desktop computers, tablets, laptops, smart speakers, in-vehicle terminals, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices, and can also include software running on the physical device, such as applications. The operating system running on terminal 01 in this embodiment can include, but is not limited to, Android, GNU / Linux, and Windows systems.

[0069] In this embodiment, terminal 02 can be a target terminal. The target terminal can be a terminal running a target test application. Terminal 02 can include physical devices such as smartphones, desktop computers, tablets, laptops, smart speakers, in-vehicle terminals, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices, and can also include software running on the physical device, such as applications. The operating system running on terminal 02 in this embodiment can include, but is not limited to, Android, GNU / Linux, and Windows systems.

[0070] In addition, it should be noted that, Figure 1 The example shown is merely one application environment provided by this disclosure. In practical applications, other application environments may also be included. For example, the process of analyzing the position of the control area can also be implemented on a server.

[0071] In the embodiments described in this specification, the terminals 01 and 02 described above can be directly or indirectly connected through wired or wireless communication methods, and this application does not limit this connection.

[0072] It should be noted that the following diagram shows one possible sequence of steps, and it is not strictly necessary to follow this order. Some steps can be executed in parallel without interdependence.

[0073] Specifically, Figure 2 This is a flowchart illustrating an application testing method according to an exemplary embodiment. For example... Figure 2 As shown, this application testing method can be used to test electronic devices such as terminals, and specifically includes the following steps:

[0074] S201: If an application test command is detected targeting the target test application, obtain the current application display page of the target test application.

[0075] In one specific embodiment, the target test application can refer to the application to be tested. Specifically, the target test application may include game applications, shopping applications, or music applications, etc.

[0076] In one specific embodiment, application test instructions can be used to instruct the execution of corresponding business operations on the target test application. Application test instructions may include first test attribute information corresponding to the first test control.

[0077] In a specific embodiment, the first test control can refer to the control to be tested in the target test application. The first test control may include a button or scroll bar, etc. The first test attribute information may include a first identifier indication information corresponding to the first test control and a first operation indication information corresponding to the first test control. The first identifier indication information can be used to indicate the identifier of the first test control that needs to be operated. The first operation indication information can be used to indicate the business operation of the first test control that needs to be operated. For example, taking a game application scenario as an example, assuming the first test control is a "Start Game" button, the first identifier indication information can be the text information "Start Game", and the first operation indication information can be "1, None, False"; further, the above-mentioned first operation indication information "1, None, False" can be used to indicate a single click operation on the above-mentioned first test control; or, the first operation indication information can also be "1, DRAG, False", which can be used to indicate a swipe-click operation on the first test control.

[0078] In one specific embodiment, the currently displayed application page may refer to the page currently displayed by the target test application. The currently displayed application page may include a first test control.

[0079] In one specific embodiment, the application tester can execute a command input operation on the test terminal to cause the test terminal to generate application test commands for the target test application. Specifically, the application tester can execute a command input operation on the test terminal to cause the test terminal to obtain test command information, and accordingly, the test terminal can generate application test commands based on the test command information. The test command information may include first test attribute information corresponding to the first test control. For example, the test command information is "iat.ocr_click(1,None,False,u“Start Game”)", which can be used to instruct a single click operation on the "Start Game" button.

[0080] In one specific embodiment, obtaining the current application display page of the target test application may include:

[0081] Send a current page capture command corresponding to the target test application to the target terminal so that the target terminal can perform a page capture operation and obtain the page encoding information corresponding to the current application display page;

[0082] Receive page encoding information corresponding to the currently displayed application page sent by the target terminal;

[0083] The page encoding information is decoded to obtain the page decoding information corresponding to the current application display page;

[0084] The page decoding information is transcoded to obtain the current application display page.

[0085] In one specific embodiment, the current page capture instruction can be used to instruct the target terminal to capture the currently displayed page.

[0086] In one specific embodiment, the page encoding information corresponding to the current application display page can be used to transmit the data corresponding to the current application display page.

[0087] In one specific embodiment, upon receiving a current page capture command from the test terminal, the target terminal can obtain an image of the current page corresponding to the currently displayed application page through screenshot processing. The target terminal can then encode the current page image to obtain page encoding information corresponding to the currently displayed application page. The target terminal can then send this page encoding information to the test terminal. Specifically, the target terminal can obtain the page encoding information by compressing the current page image.

[0088] In one specific embodiment, during the connection process between the test terminal and the target terminal, the test terminal may first attempt to receive one byte of data to confirm whether the connection is successful and avoid connection failure.

[0089] In one specific embodiment, the above method may further include:

[0090] Create a page receiving thread and an instruction sending thread;

[0091] Accordingly, the page encoding information corresponding to the current application display page sent by the target terminal may include:

[0092] Based on the page receiving thread, it receives page encoding information sent by the target terminal;

[0093] Accordingly, sending the first control operation instruction to the target terminal may include:

[0094] Based on the instruction sending thread, the first control operation instruction is sent to the target terminal.

[0095] In one specific embodiment, a page receiving thread and an instruction sending thread can be created based on the controller in the test terminal. The page receiving thread can be used to receive page encoding information sent by the target terminal. The instruction sending thread can be used to send instructions to the target terminal.

[0096] In one specific embodiment, the test terminal can receive page encoding information sent by the target terminal through a page receiving thread; correspondingly, the test terminal can send a first control operation instruction to the target terminal through an instruction sending thread. The first control operation instruction can be used to instruct the target terminal to perform a corresponding business operation.

[0097] In the above embodiments, the page receiving thread receives page encoding information sent by the target terminal, and the instruction sending thread sends a first control operation instruction to the target terminal. This allows for parallel processing of page encoding reception and operation instruction sending, avoiding interference between instruction sending and encoding reception. This improves the efficiency of current page retrieval, reduces page display latency, and increases operation execution speed, thereby enabling complex testing scenarios. It is understood that for some complex testing scenarios, high latency requirements necessitate identifying controls and performing business operations on them within a short timeframe. An exemplary scenario could be clicking a newly popped-up button within a specified time range.

[0098] In one specific embodiment, the page decoding information can be page information in a first preset format obtained through decoding processing. The first preset format can be YUV format.

[0099] In one specific embodiment, the above method may further include:

[0100] Create a page processing thread;

[0101] Accordingly, the above-mentioned decoding process of page encoding information to obtain the page decoding information corresponding to the currently displayed application page may include:

[0102] Based on the page processing thread, the page encoding information is decoded to obtain the page decoding information.

[0103] In one specific embodiment, a page processing thread can be created based on the controller in the test terminal. This page processing thread can be used to process the received page encoding information.

[0104] In one specific embodiment, the test terminal can decode the page encoding information through the page processing thread to obtain the aforementioned page decoding information.

[0105] In one specific embodiment, the above-mentioned transcoding of page decoding information to obtain the current application display page may include:

[0106] Based on a preset hardware transcoding module, the page decoding information is transcoded to obtain the current application display page.

[0107] In one specific embodiment, the aforementioned preset hardware transcoding module can be used to perform parallel processing of multi-bit data on page decoding information to achieve hardware-accelerated transcoding. Specifically, the preset hardware transcoding module may include a preset single-instruction multiple-data stream processor. The preset hardware transcoding module may be pre-configured on the test terminal.

[0108] In one specific embodiment, the page processing thread in the test terminal decodes the page encoding information to obtain page decoding information. The page processing thread can then input this decoding information to a preset hardware transcoding module. The preset hardware transcoding module transcodes the page decoding information to obtain page transcoding information corresponding to the currently displayed application page. Upon receiving the page transcoding information output by the preset hardware transcoding module, the page processing thread can send this transcoding information to the page display thread. Upon receiving the transcoding information, the page display thread can update the display area corresponding to the currently displayed application page on the test page displayed on the test terminal based on this information. The page transcoding information can be page information in a second preset format obtained after transcoding. Specifically, the second preset format can be the UI display format bgr24. The page display thread can be pre-built by the controller in the test terminal. The page display thread can be used to display the test page displayed on the test terminal. For example, in the processing of the preset hardware transcoding module, taking the calculation of g component data as an example, the 128-bit registers q0 and q10 are subtracted in 16-bit increments, and then all the final results are stored in the 128-bit register q13. Since the preset hardware transcoding module can perform 128-bit data processing simultaneously, it greatly improves the transcoding speed of image data formats. For transcoding a 1920*1080 image, the existing method (i.e., C version) takes 50ms, while the preset hardware transcoding module only takes 8ms.

[0109] In the above embodiments, by using a preset hardware transcoding module to transcode the page decoding information to obtain the current application display page, hardware-accelerated transcoding can be achieved, improving the page transcoding speed, thereby improving the current page acquisition efficiency, reducing page display latency, and enabling complex test scenarios.

[0110] S203: Based on the first identifier indication information and the current application display page, perform control area position analysis on the first test control to obtain the first position indication information corresponding to the first test control.

[0111] In one specific embodiment, the first position indication information can be used to indicate the position of the first test control on the current application display page. The first position indication information may include point position information, region position information, or an image of the control region corresponding to the first test control. Specifically, the point position information may refer to the position information of the center point of the first test control. The region position information can characterize the region position of the first test control on the current application display page. Specifically, the point position information may include coordinates. The region position information may include the coordinates corresponding to multiple region boundary points. The control region image may refer to the image of the first test control on the current application display page. For example, when the first test control is a rectangular control, the coordinates corresponding to the multiple region boundary points may be the coordinates of the four vertices of the rectangle corresponding to the first test control.

[0112] In one specific embodiment, the first identification indication information may include control identification text information.

[0113] In a specific embodiment, when the first identifier indication information is control identifier text information, step S203 may include:

[0114] Perform text recognition on the current application display page to obtain the application page text information corresponding to the current application display page;

[0115] The text information on the application page and the text information of the control identifiers are matched to obtain the target matching result;

[0116] When the target matching result indicates that the application page text information contains control identifier text information, the control area is identified based on the control identifier text information and the current application display page to obtain the first test control area corresponding to the first test control.

[0117] Based on the current application display page and the area of ​​the first test control, the area position of the first test control is analyzed to obtain the first position indication information.

[0118] In one specific embodiment, the application page text information can represent the text information contained in the current application display page. The application page text information may include text information corresponding to multiple preset areas within the current application display page. These multiple preset areas can be used to represent the layout of the current application display page.

[0119] In one specific embodiment, the current application display page is input into a preset text recognition model for text recognition, which yields the text information corresponding to each of the multiple preset regions of the current application display page. Specifically, text extraction processing can be performed on the current application display page to obtain multiple text units and the text unit position information corresponding to each text unit; based on the multiple text units and the text unit position information corresponding to each text unit, region analysis can be performed on the current application display page to obtain the text information corresponding to each of the multiple preset regions.

[0120] In one specific embodiment, the target matching result can be used to indicate whether the application page text information contains control identifier text information. The target matching result may include a first matching result or a second matching result. The first matching result can be used to indicate that the application page text information contains control identifier text information. The second matching result can be used to indicate that the application page text information does not contain control identifier text information.

[0121] In one specific embodiment, a target matching result can be obtained by matching the region text information corresponding to each preset region with the control identifier text information. Specifically, if the region text information corresponding to any preset region is found to be the same as the control identifier text information, the target matching result can be determined as the first matching result; if no region text information corresponding to any preset region is found to be the same as the control identifier text information, the target matching result can be determined as the second matching result.

[0122] In a specific embodiment, when the target matching result is the first matching result, the first test control can be identified based on the control identifier text information and the current application display page to obtain the first test control area corresponding to the first test control. Specifically, when the target matching result is the first matching result, the first test control can be detected based on the control identifier text information and the current application display page to obtain the control boundary information corresponding to the first test control. Accordingly, the first test control area corresponding to the first test control can be determined based on the control boundary information corresponding to the first test control. The control boundary information can be used to describe the position of the boundary of the control area corresponding to the first test control in the current application display page. The control boundary information can include the position information of each of the multiple area boundary points corresponding to the first test control.

[0123] In one specific embodiment, the target matching result may further include a target matching region. The target matching region can refer to a region among multiple preset regions that matches the control identifier text information. Specifically, if the text information corresponding to any preset region is identical to the control identifier text information, the target matching result may include a first matching result and the region identifier information corresponding to the target matching region. If the text information corresponding to no preset region is identical to the control identifier text information, the target matching region may be empty.

[0124] In one specific embodiment, the first position indication information corresponding to the first test control can be generated based on the control boundary information corresponding to the first test control. Specifically, based on the control boundary information corresponding to the first test control, vertex position analysis can be performed on the first test control to obtain the position information of each of the multiple region vertices corresponding to the first test control. Accordingly, the position information of each of the multiple region vertices corresponding to the first test control can be used as the first position indication information.

[0125] In a specific embodiment, the control area image of the first test control can be extracted based on the control boundary information corresponding to the first test control and the current application display page to obtain the control area image corresponding to the first test control. Accordingly, the control area image corresponding to the first test control can be used as the first position indication information.

[0126] In the above embodiments, text recognition is performed on the current application display page to obtain the application page text information corresponding to the current application display page. The application page text information and control identifier text information are matched to obtain the target matching result. When the target matching result indicates that the application page text information contains control identifier text information, the control region is identified based on the control identifier text information and the current application display page to obtain the first test control region corresponding to the first test control. Based on the current application display page and the first test control region, the region position analysis of the first test control is performed to obtain the first position indication information, which can improve the accuracy of control region position analysis.

[0127] In one specific embodiment, the above method may further include:

[0128] If the target matching result indicates that the application page text information does not contain control identifier text information, the control area prediction analysis is performed on the first test control based on the control identifier text information, the current application display page, and the preset control recognition model to obtain the first position indication information.

[0129] In one specific embodiment, a preset control recognition model can be used to perform control region prediction analysis on the first test control in the current application display page. Furthermore, if the application page text information does not contain control identifier text information, control region prediction analysis can be performed on the first test control using the control identifier text information and the preset control recognition model.

[0130] In a specific embodiment, the preset control recognition model may be obtained in the following ways:

[0131] Obtain the preset sample dataset;

[0132] The sample identification text information corresponding to each sample application display page and each sample application display page are input into a preset machine learning model to perform control area prediction analysis, and the predicted position indication information of the predicted control area image corresponding to each sample identification text information is obtained.

[0133] Based on the prediction position indication information of the prediction control region image corresponding to each sample identification text information and the label position indication information corresponding to each sample identification text information, the target loss information is determined;

[0134] Based on the target loss information, a preset machine learning model is trained to obtain a preset control recognition model.

[0135] In one specific embodiment, a preset sample dataset can be used to train a preset control recognition model. The preset sample dataset may include at least one sample application display page, sample identifier text information corresponding to each sample application display page, and label position indication information corresponding to each sample application display page. The at least one sample application display page and the sample identifier text information corresponding to each sample application display page can be used as samples for training the preset control recognition model. The label position indication information corresponding to at least one sample application display page can be used as a reference for training the preset control recognition model.

[0136] In one specific embodiment, the predicted location indication information corresponding to any sample identifier text information can be used to indicate the position of the predicted control area image corresponding to any of the sample identifier text information predicted by the preset machine learning model on the corresponding sample application display page. Specifically, the predicted location indication information may include point location information or region location information, etc.

[0137] In one specific embodiment, the target loss information can be used as a reference for training a preset control recognition model.

[0138] In one specific embodiment, positional difference analysis can be performed on the predicted position indication information of the predicted control region image corresponding to each sample identifier text information and the label position indication information corresponding to each sample identifier text information to obtain difference index data corresponding to each sample identifier text information; the difference index data corresponding to at least one sample identifier text information can be fused to obtain target loss information. Here, the difference index data corresponding to any sample identifier text information can characterize the degree of difference between the predicted position indication information of the predicted control region image corresponding to any sample identifier text information and the label position indication information corresponding to any sample identifier text information.

[0139] In one specific embodiment, an update gradient can be determined based on the target loss information; based on the aforementioned update gradient, a preset machine learning model can be trained to obtain a preset control recognition model. Specifically, the model parameters in the preset machine learning model can be updated using stochastic gradient descent.

[0140] In a specific embodiment, a preset machine learning model can be updated based on the target loss information to obtain an updated preset machine learning model. Based on the updated preset machine learning model, the model update steps described above—from obtaining a preset sample dataset to updating the preset machine learning model based on the target loss information—can be repeated until a preset convergence condition is met. The preset machine learning model that meets the preset convergence condition is then used as the preset control recognition model. Specifically, the preset convergence condition may include the number of model updates meeting a preset update count, or the target loss information being less than or equal to the preset loss information.

[0141] In one specific embodiment, if the target matching result indicates that the application page text information does not contain control identifier text information, the control identifier text information and the current application display page can be input into a preset control recognition model to perform control area prediction analysis to obtain the first position indication information.

[0142] In the above embodiments, when the target matching result indicates that the application page text information does not contain control identifier text information, the control identifier text information and the current application display page can be input into a preset control recognition model to perform control area prediction analysis to obtain the first position indication information. This can enable position prediction for controls that do not contain text information, thereby enabling the testing of various types of controls. It can also reduce the professional requirements for application testers, thereby improving the convenience of application testing, reducing the time cost of application testing, and improving the efficiency of application testing.

[0143] S205: Based on the first position indication information and the first operation indication information, generate the first control operation instruction corresponding to the first test control.

[0144] In one specific embodiment, the first control operation instruction can be used to control the target test application to perform business operations on the first test control. The first control operation instruction may include first position indication information and first operation indication information.

[0145] In a specific embodiment, a preset instruction template corresponding to the first operation instruction information can be obtained from preset instruction templates corresponding to multiple preset operation instruction information based on the first operation instruction information; correspondingly, a first control operation instruction corresponding to the first test control can be generated based on the first position instruction information, the first operation instruction information and the preset instruction template corresponding to the first operation instruction information.

[0146] S207: Based on the first control operation instruction, control the target test application to execute the first business operation corresponding to the first operation instruction information.

[0147] In one specific embodiment, the first business operation can refer to the business operation that needs to be performed on the first test control. The first business operation may include a single click operation or multiple consecutive click operations, etc.

[0148] In one specific embodiment, step S207 above may include:

[0149] Send a first control operation instruction to the target terminal so that the target terminal can perform a first business operation corresponding to the first operation instruction in the first control operation instruction on the first test control based on the first position indication information in the first control operation instruction.

[0150] In one specific embodiment, the application test instruction may further include second test attribute information corresponding to the second test control. The second test attribute information may include second identifier indication information and second operation indication information corresponding to the second test control. The second identifier indication information can be used to indicate the identifier of the second test control that needs to be operated. The second operation indication information can be used to indicate the business operation of the second test control that needs to be operated.

[0151] In the above embodiments, a first control operation instruction is sent to the target terminal, enabling the target terminal to execute a first business operation corresponding to the first operation instruction in the first control operation instruction on the first test control based on the first position indication information in the first control operation instruction. By utilizing the test terminal for control area position analysis and instruction generation, application testing efficiency can be improved even with the high computing power of the test terminal. It is understood that the performance and computing power of the test terminal are typically higher than those of the target terminal. By obtaining the current application display page on the target terminal, performing control area position analysis and instruction generation on the test terminal, and then sending the first control operation instruction to the target terminal, the overall processing speed can be significantly improved, testing process latency reduced, and thus testing of complex scenarios can be achieved.

[0152] In a specific embodiment, after controlling the target test application to execute the first business operation corresponding to the first operation instruction information based on the first control operation instruction, the above method may further include:

[0153] Based on the second identifier indication information and the current application display page, the control area position analysis is performed on the second test control to obtain the second position indication information corresponding to the second test control;

[0154] Based on the second position indication information and the second operation indication information, generate the second control operation instruction corresponding to the second test control;

[0155] Based on the second control operation instructions, the target test application is controlled to execute the second business operation corresponding to the second operation instruction information.

[0156] In one specific embodiment, the second location indication information can be used to indicate the position of the second test control in the current application display page.

[0157] In one specific embodiment, when the application test instruction also includes second test attribute information corresponding to the second test control, the current application display page of the target test application can be obtained in real time after the execution of the second business operation corresponding to the second operation instruction information of the target test application. Accordingly, based on the second identifier indication information and the obtained current application display page, the control area position analysis of the second test control can be performed to obtain the second position indication information corresponding to the second test control. Specifically, the process of performing control area position analysis on the second test control can refer to the control area position analysis process of the first test control described above, and will not be repeated here.

[0158] In one specific embodiment, the second control operation instruction can be used to instruct the target test application to perform a corresponding business operation on the second test control. The second business operation can refer to the business operation that needs to be performed on the second test control.

[0159] In one specific embodiment, a second control operation instruction can be sent to the target terminal so that the target terminal can perform a second business operation corresponding to the second operation instruction in the second control operation instruction on the second test control based on the second position indication information in the second control operation instruction.

[0160] In one specific embodiment, the application test instructions may include multiple attribute information arranged in sequence. The first test attribute information may be the attribute information that appears first among the multiple attribute information. The multiple attribute information may also include second test attribute information. The second test attribute information may include second identification indication information corresponding to a second test control and second operation indication information corresponding to a second test control. The first test attribute information may also include a preset position analysis duration. For example, the preset position analysis duration may be 10000µs.

[0161] In one specific embodiment, the above method may further include:

[0162] During the analysis of the control area position of the first test control, the current position analysis duration corresponding to the first test control is obtained;

[0163] If the current location analysis duration is greater than or equal to the preset location analysis duration and no first location indication information is detected, the second test control is analyzed for its control area position based on the second identifier indication information and the current application display page to obtain the second location indication information corresponding to the second test control.

[0164] Based on the second position indication information and the second operation indication information, generate the second control operation instruction corresponding to the second test control;

[0165] Based on the second control operation instructions, the target test application is controlled to execute the second business operation corresponding to the second operation instruction information.

[0166] In one specific embodiment, the current position analysis duration can characterize the duration from the start time of the position analysis of the control area of ​​the first test control to the current time.

[0167] In one specific embodiment, during the analysis of the control area position of the first test control, the current position analysis duration corresponding to the first test control can be obtained in real time.

[0168] In a specific embodiment, if the current location analysis duration is detected to be greater than or equal to the preset location analysis duration and no first location indication information is detected, it can be determined that the location of the first test control has not been identified even after the preset location analysis duration has been exceeded. Accordingly, the first test attribute information in the application test instruction can be filtered, that is, the first business operation for the first test control is not executed, and the test can be jumped to the test for the second test control.

[0169] In the above embodiments, when an application test instruction for the target test application is detected, the current application display page of the target test application is obtained. The application test instruction includes first test attribute information corresponding to a first test control. The first test attribute information includes first identifier indication information and first operation indication information corresponding to the first test control. This allows the current application display page to be obtained. Then, combining the first identifier indication information and the current application display page, the control area position of the first test control is analyzed to obtain the first position indication information corresponding to the first test control. This allows for the analysis of the control area position of the first test control. Next, combining the first position indication information and the first operation indication information, a first control operation instruction corresponding to the first test control is generated. This allows for the generation of operation instructions for the first test control. Finally, combining the first control operation instructions, the target test application is controlled to execute the first business operation corresponding to the first operation indication information. This allows for targeted testing of the first test control, thereby enabling testing of complex scenarios and improving application testing efficiency.

[0170] Figure 3 This is an interactive schematic diagram illustrating an application testing method according to an exemplary embodiment. Specifically, as shown below... Figure 3 As shown, when the test terminal detects an application test command for the target test application, it can obtain the current application display page of the target test application; the test terminal can perform control area position analysis on the first test control based on the first identifier indication information and the current application display page to obtain the first position indication information corresponding to the first test control; the test terminal can generate a first control operation command corresponding to the first test control based on the first position indication information and the first operation indication information; the test terminal can send the first control operation command to the target terminal; correspondingly, when the target terminal receives the first control operation command, it can execute the first business operation corresponding to the first operation indication information in the first control operation command on the first test control based on the first position indication information in the first control operation command.

[0171] Figure 4 This is a block diagram illustrating an application testing apparatus according to an exemplary embodiment. Figure 5 As shown, the device may include:

[0172] The current page acquisition module 410 can be used to acquire the current application display page of the target test application when an application test instruction for the target test application is detected; the application test instruction includes the first test attribute information corresponding to the first test control, and the first test attribute information includes the first identification indication information and the first operation indication information corresponding to the first test control;

[0173] The control position analysis module 420 can be used to perform control area position analysis on the first test control based on the first identifier indication information and the current application display page, and obtain the first position indication information corresponding to the first test control; the first position indication information is used to indicate the position of the first test control in the current application display page.

[0174] The first instruction generation module 430 can be used to generate a first control operation instruction corresponding to the first test control based on the first position indication information and the first operation indication information.

[0175] The first execution module 440 can be used to control the target test application to execute the first business operation corresponding to the first operation instruction information based on the first control operation instruction.

[0176] In one specific embodiment, the first execution module 440 described above may include:

[0177] The second execution module can be used to send a first control operation instruction to the target terminal, so that the target terminal can perform a first business operation corresponding to the first operation instruction in the first control operation instruction on the first test control based on the first position indication information in the first control operation instruction; the target test application runs on the target terminal.

[0178] In one specific embodiment, the current page acquisition module 410 described above may include:

[0179] The interception instruction sending module can be used to send the current page interception instruction corresponding to the target test application to the target terminal, so that the target terminal can perform the page interception operation and obtain the page encoding information corresponding to the current application display page;

[0180] The page encoding receiving module can be used to receive the page encoding information corresponding to the current application display page sent by the target terminal;

[0181] The decoding processing module can be used to decode the page encoding information to obtain the page decoding information corresponding to the currently displayed page of the application.

[0182] The transcoding module can be used to transcode the page decoding information to obtain the current application display page.

[0183] In one specific embodiment, the above-described apparatus may further include:

[0184] The first thread creation module can be used to create page receiving threads and instruction sending threads;

[0185] Accordingly, the aforementioned page encoding receiving module may include:

[0186] The first thread execution module can be used to receive page encoding information sent by the target terminal based on the page receiving thread;

[0187] Accordingly, the second execution module mentioned above may include:

[0188] The second thread execution module can be used to send first control operation instructions to the target terminal based on the instruction sending thread.

[0189] In one specific embodiment, the above-described apparatus may further include:

[0190] The second thread creation module can be used to create page processing threads;

[0191] Accordingly, the above decoding processing module may include:

[0192] The third thread execution module can be used to decode page encoding information based on the page processing thread to obtain page decoding information.

[0193] In one specific embodiment, the transcoding module described above may include:

[0194] The hardware-accelerated transcoding module can be used to transcode page decoding information based on a preset hardware transcoding module to obtain the current application display page; the preset hardware transcoding module is used to perform parallel processing of multi-bit data of page decoding information to achieve hardware-accelerated transcoding.

[0195] In one specific embodiment, the control position analysis module 420 described above may include:

[0196] The text recognition module can be used to recognize the text of the current application display page and obtain the application page text information corresponding to the current application display page;

[0197] The matching processing module can be used to match the text information of the application page and the text information of the control identifier to obtain the target matching result;

[0198] The control region recognition module can be used to identify the control region of the first test control based on the control identifier text information and the current application display page when the target matching result indicates that the application page text information contains control identifier text information, thereby obtaining the first test control region corresponding to the first test control.

[0199] The first position analysis module can be used to perform regional position analysis on the first test control based on the current application display page and the first test control area to obtain the first position indication information.

[0200] In one specific embodiment, the above-described apparatus may further include:

[0201] The control region prediction module can be used to perform control region prediction analysis on the first test control based on the control identifier text information, the current application display page, and a preset control recognition model when the target matching result indicates that the application page text information does not contain control identifier text information, in order to obtain the first position indication information.

[0202] In one specific embodiment, the above-described apparatus may further include:

[0203] The dataset acquisition module can be used to acquire a preset sample dataset; the preset sample dataset includes at least one sample application display page, sample identifier text information corresponding to each sample application display page, and label position indication information corresponding to each sample application display page;

[0204] The sample region prediction module can be used to input the sample identifier text information corresponding to each sample application display page and each sample application display page into a preset machine learning model for control region prediction analysis, and obtain the predicted position indication information of the predicted control region image corresponding to each sample identifier text information;

[0205] The loss determination module can be used to determine the target loss information based on the prediction position indication information of the prediction control area image corresponding to each sample identification text information and the label position indication information corresponding to each sample identification text information;

[0206] The model training module can be used to train a preset machine learning model based on the target loss information to obtain a preset control recognition model.

[0207] In one specific embodiment, the above-described apparatus may further include:

[0208] The second position analysis module can be used to perform control area position analysis on the second test control based on the second identifier indication information and the current application display page, and obtain the second position indication information corresponding to the second test control; the second position indication information is used to indicate the position of the second test control in the current application display page.

[0209] The second instruction generation module can be used to generate second control operation instructions corresponding to the second test control based on the second position indication information and the second operation indication information.

[0210] The third execution module can be used to control the target test application to execute the second business operation corresponding to the second operation instruction information based on the second control operation instructions.

[0211] In one specific embodiment, the above-described apparatus may further include:

[0212] The current duration acquisition module can be used to acquire the current position analysis duration of the first test control during the control area position analysis of the first test control; the current position analysis duration represents the duration from the start time of the control area position analysis of the first test control to the current time;

[0213] The third location analysis module can be used to perform control area location analysis on the second test control based on the second identifier indication information and the current application display page when the current location analysis duration is greater than or equal to the preset location analysis duration and no first location indication information is detected, so as to obtain the second location indication information corresponding to the second test control; the second location indication information is used to indicate the position of the second test control in the current application display page;

[0214] The third instruction generation module can be used to generate second control operation instructions corresponding to the second test control based on the second position indication information and the second operation indication information.

[0215] The fourth execution module can be used to control the target test application to execute the second business operation corresponding to the second operation instruction information based on the second control operation instructions.

[0216] Regarding the apparatus in the above embodiments, the specific manner in which each module and unit performs its operations has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0217] Figure 5 This is a block diagram illustrating an electronic device for controlling a target test application to perform a first business operation, according to an exemplary embodiment. The electronic device may be a server, and its internal structure diagram may be as follows: Figure 5 As shown, this electronic device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements an application testing method.

[0218] Figure 6This is a block diagram illustrating another electronic device for controlling a target test application to perform a first business operation, according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as follows: Figure 6 As shown, the electronic device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements an application testing method. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0219] Those skilled in the art will understand that Figure 5 or Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present disclosure and does not constitute a limitation on the electronic device to which the present disclosure is applied. A specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0220] In an exemplary embodiment, an electronic device is also provided, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the application testing method as described in the embodiments of this disclosure.

[0221] In an exemplary embodiment, a computer-readable storage medium is also provided, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the application testing method of the present disclosure embodiments.

[0222] In an exemplary embodiment, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the application testing method of the present disclosure embodiments.

[0223] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0224] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0225] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0226] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0227] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. An application testing method characterized by, The method is applied to a test terminal and comprises the following steps: In a case where an application test instruction for a target test application is detected, a current application display page of the target test application is acquired; the application test instruction comprises first test attribute information corresponding to a first test control, and the first test attribute information comprises first identification indication information corresponding to the first test control and first operation indication information corresponding to the first test control; Based on the first identification indication information and the current application display page, control region position analysis is performed on the first test control to obtain first position indication information corresponding to the first test control; the first position indication information is used to indicate a position of the first test control in the current application display page; Based on the first position indication information and the first operation indication information, a first control operation instruction corresponding to the first test control is generated; Based on the first control operation instruction, a first business operation corresponding to the first operation indication information is controlled to be performed on the target test application.

2. The method of claim 1, wherein, The step of controlling the first business operation corresponding to the first operation indication information to be performed on the target test application based on the first control operation instruction comprises the following steps: The first control operation instruction is sent to a target terminal, so that the target terminal performs a first business operation corresponding to the first operation indication information in the first control operation instruction on the first test control based on the first position indication information in the first control operation instruction; the target test application runs on the target terminal.

3. The method of claim 2, wherein, The step of acquiring the current application display page of the target test application comprises the following steps: A current page interception instruction corresponding to the target test application is sent to the target terminal, so that the target terminal performs a page interception operation to obtain page code information corresponding to the current application display page; Page code information corresponding to the current application display page sent by the target terminal is received; The page code information is decoded to obtain page decoding information corresponding to the current application display page; The page decoding information is transcoded to obtain the current application display page.

4. The method of claim 3, wherein, The method further comprises the following steps: A page receiving thread and an instruction sending thread are created; The step of receiving the page code information corresponding to the current application display page sent by the target terminal comprises the following steps: The page code information sent by the target terminal is received based on the page receiving thread; The step of sending the first control operation instruction to the target terminal comprises the following steps: The first control operation instruction is sent to the target terminal based on the instruction sending thread.

5. The method of claim 3, wherein, The method further comprises the following steps: A page processing thread is created; The step of decoding the page code information to obtain page decoding information corresponding to the current application display page comprises the following steps: The page code information is decoded to obtain the page decoding information based on the page processing thread.

6. The method of claim 5, wherein, The step of transcoding the page decoding information to obtain the current application display page comprises the following steps: The preset hardware transcoding module is used for parallel processing of multi-bit data of the page decoding information to realize hardware accelerated transcoding.

7. The method of claim 1, wherein, The first identification indication information includes control identification text information; the first test control is analyzed based on the first identification indication information and the current application display page to obtain first position indication information corresponding to the first test control, including: Text recognition is performed on the current application display page to obtain application page text information corresponding to the current application display page; The application page text information and the control identification text information are matched to obtain a target matching result; In a case where the target matching result indicates that the application page text information contains the control identification text information, control region identification is performed on the first test control based on the control identification text information and the current application display page to obtain a first test control region corresponding to the first test control. The first test control is analyzed based on the current application display page and the first test control region to obtain the first position indication information.

8. The method of claim 7, wherein, The method further includes: In a case where the target matching result indicates that the application page text information does not contain the control identification text information, control region prediction analysis is performed on the first test control based on the control identification text information, the current application display page, and a preset control identification model to obtain the first position indication information.

9. The method of claim 8, wherein, The preset control identification model includes the following acquisition method: A preset sample data set is acquired; the preset sample data set includes at least one sample application display page, sample identification text information corresponding to each sample application display page, and label position indication information corresponding to each sample application display page; The sample identification text information corresponding to each sample application display page and each sample application display page are input into a preset machine learning model for control region prediction analysis to obtain prediction position indication information of a predicted control region image corresponding to each sample identification text information; Based on the prediction position indication information of the predicted control region image corresponding to each sample identification text information and the label position indication information corresponding to each sample identification text information, target loss information is determined; The preset machine learning model is trained based on the target loss information to obtain the preset control identification model.

10. The method according to any one of claims 1 to 9, characterized in that, The application test instruction further includes second test attribute information corresponding to a second test control, and the second test attribute information includes second identification indication information corresponding to the second test control and second operation indication information corresponding to the second test control; After the target test application performs the first operation indication information corresponding first business operation based on the first control operation instruction, the method further includes: perform control region position analysis on the second test control based on the second identifier indication information and the current application display page to obtain second position indication information corresponding to the second test control; the second position indication information is used to indicate a position of the second test control in the current application display page; generate a second control operation instruction corresponding to the second test control based on the second position indication information and the second operation indication information; control the target test application to perform a second business operation corresponding to the second operation indication information based on the second control operation instruction.

11. The method of claim 1, wherein, The application test instruction includes a plurality of attribute information arranged in sequence, the first test attribute information is attribute information arranged first in the plurality of attribute information, the plurality of attribute information further includes second test attribute information, the second test attribute information includes second identifier indication information corresponding to a second test control and second operation indication information corresponding to the second test control, and the first test attribute information further includes a preset position analysis time length; the method further includes: In the process of performing control region position analysis on the first test control, a current position analysis time length corresponding to the first test control is acquired; the current position analysis time length represents a time length from a starting time of control region position analysis of the first test control to a current time; In a case where it is detected that the current position analysis time length is greater than or equal to the preset position analysis time length and the first position indication information is not detected, perform control region position analysis on the second test control based on the second identifier indication information and the current application display page to obtain second position indication information corresponding to the second test control; the second position indication information is used to indicate a position of the second test control in the current application display page; generate a second control operation instruction corresponding to the second test control based on the second position indication information and the second operation indication information; control the target test application to perform a second business operation corresponding to the second operation indication information based on the second control operation instruction.

12. An application testing apparatus characterized by comprising: The device is arranged in a test terminal, and the device includes: a current page acquisition module configured to acquire a current application display page of a target test application in a case where it is detected that an application test instruction for the target test application is acquired; the application test instruction includes first test attribute information corresponding to a first test control, and the first test attribute information includes first identifier indication information corresponding to the first test control and first operation indication information corresponding to the first test control; a control position analysis module configured to perform control region position analysis on the first test control based on the first identifier indication information and the current application display page to obtain first position indication information corresponding to the first test control; the first position indication information is used to indicate a position of the first test control in the current application display page; The first instruction generation module is configured to generate a first control operation instruction corresponding to the first test control based on the first position indication information and the first operation indication information. The first execution module is configured to control execution of a first business operation corresponding to the first operation indication information of the target test application based on the first control operation instruction.

13. An electronic device, comprising: The application comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions to implement the application test method of any one of claims 1 to 11.

14. A non-transitory computer readable storage medium having stored thereon computer program instructions, wherein, The computer program instructions, when executed by a processor, implement the application test method of any one of claims 1 to 11.

15. A computer program product comprising a computer program, characterized in that, The computer program, when executed by an electronic device, implements the application test method of any one of claims 1 to 11.

Images