Application testing method and related equipment
Through user interface analysis of the application to be tested and large-scale language model processing, reasonable test sequences are generated, which solves the problem of difficult processing of complex logical operation sequences in the existing technology, realizes an efficient and automated test process, and reduces labor costs.
Patent Information
- Application Number
- CN202411176028.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-12-20
AI Technical Summary
Existing test solutions are difficult to correctly handle the control operation sequence of complex logic, especially in scenarios such as login and privacy protocol analysis, which requires manual intervention, resulting in waste of resources and high labor costs.
Through the user interface of the application to be tested, the test sequence is generated, and a large language model is used to determine reasonable test sequences from these sequences to achieve automated testing.
It improves the logic and automation efficiency of the test, reduces the cost of manual intervention, can effectively handle control operations of complex logic, and improves the accuracy and efficiency of the test.
Smart Images
Figure CN119166499A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of software testing technology, and in particular to an application testing method and related equipment. Background Art
[0002] In the current prior art, when testing an application, the test cases generated by the existing test scheme lack the ability to handle complex logic, and it is difficult to correctly handle the correct operation content and reasonable operation sequence of controls such as the mobile phone number input box, password input box, and verification code button. Especially when facing test tasks in specific scenarios (such as login, privacy protocol analysis), it is often necessary to consume a lot of resources to process the jump logic. At this time, manual intervention is generally required, and the labor cost is high. Summary of the invention
[0003] In view of this, the purpose of this application is to propose an application testing method and related equipment.
[0004] Based on the above purpose, the present application provides an application testing method, including:
[0005] Performing graphic analysis and action analysis on the user interface of the application to be tested to obtain first information;
[0006] Based on the first information, matching is performed with a pre-built sequence library to obtain a first test sequence of the user interface;
[0007] Determine a second test sequence from the first test sequence using a large language model;
[0008] The application to be tested is tested using the second test sequence.
[0009] In a possible implementation, performing graphic analysis and action analysis on the user interface of the application to be tested to obtain the first information includes:
[0010] Performing a graphical analysis on the user interface of the application to be tested to obtain second information;
[0011] Based on the second information, an action analysis is performed on the user interface to obtain the first information.
[0012] In a possible implementation, performing a graphical analysis on the user interface of the application to be tested to obtain the second information includes:
[0013] Performing graphic analysis on the user interface to obtain a graphical user interface;
[0014] Analyze the graphical user interface to obtain control type, parent control type, child control text information and associated text information;
[0015] The control type, parent control type, child control text information and associated text information are used as the second information.
[0016] In a possible implementation manner, the performing action analysis on the user interface based on the second information to obtain the first information includes:
[0017] Analyze the action corresponding to each of the graphical user interfaces to obtain action information;
[0018] Based on the second information and in combination with the action information, determining and obtaining sequence position information of the graphical user interface in screen conversion;
[0019] The action information, the second information and the sequence position information are used as the first information.
[0020] In a possible implementation, matching the first information with a pre-built sequence library to obtain a first test sequence of the user interface includes:
[0021] Based on the sequence position information in the first information, matching is performed with the sequence library to obtain the first test sequence.
[0022] In a possible implementation manner, the determining the second test sequence from the first test sequence using the large language model includes:
[0023] Constructing test prompt information based on the first information, the first test sequence and the test target of the application to be tested;
[0024] Based on the test prompt information, a second test sequence is determined from the first test sequence using the large language model.
[0025] In a possible implementation, the method further includes:
[0026] In response to the screen of the application to be tested not changing after the test operation is performed, deleting the second test sequence from the first test sequence to obtain a third test sequence;
[0027] A new second test sequence is selected from the third test sequence using a large language model.
[0028] Based on the same inventive concept, the embodiment of the present application further provides an application testing device, including:
[0029] An analysis module, configured to perform graphic analysis and action analysis on the user interface of the application to be tested to obtain first information;
[0030] a matching module, configured to match the first information with a pre-built sequence library to obtain a first test sequence of the user interface;
[0031] A determination module, configured to determine a second test sequence from the first test sequence using a large language model;
[0032] The testing module is configured to test the application to be tested by using the second testing sequence.
[0033] Based on the same inventive concept, an embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, an application testing method as described in any one of the above is implemented.
[0034] Based on the same inventive concept, an embodiment of the present application also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute any of the above-mentioned application testing methods.
[0035] As can be seen from the above, the application testing method and related equipment provided by the present application perform graphic analysis and action analysis on the user interface of the application to be tested to obtain the first information; based on the first information, match with the pre-built sequence library to obtain the first test sequence of the user interface; determine the second test sequence from the first test sequence using a large language model; and test the application to be tested using the second test sequence. The embodiment of the present application divides the entire test process into two parts: in-screen testing and inter-screen jumps. In view of the logic of the in-screen test sequence (including whether the operation sequence of the test sequence is logical, such as entering the mobile phone number first and then clicking the verification code button, and whether the operation content is reasonable, such as entering the mobile phone number, entering the password or entering any other content), the present application proposes a test sequence generation scheme, and obtains the test sequence based on the matching results of the first information and the sequence library. In view of the logic of inter-screen jumps, the present application constructs a scenario test prompt information (Prompt) based on the test sequence and the test target, and selects the test sequence that best meets the test target with the help of the logical processing capability of the large language model (LLM). Through the combination of the first information and the LLM, a complete logical test case generation scheme is realized. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0037] Figure 1 A schematic diagram of the application test method flow of an embodiment of the present application;
[0038] Figure 2 This is a schematic diagram of the analysis process of an embodiment of the present application;
[0039] Figure 3 A schematic diagram of the sequence library abstraction process of an embodiment of the present application;
[0040] Figure 4 This is a schematic diagram of the analysis results of the screenshots of the embodiment of the present application;
[0041] Figure 5 This is a schematic diagram of the scenario test prompt information of an embodiment of the present application;
[0042] Figure 6 A schematic diagram of a scenario test example of an embodiment of the present application;
[0043] Figure 7 This is a schematic diagram of the structure of an application test device according to an embodiment of the present application;
[0044] Figure 8 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0045] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0046] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0047] It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.
[0048] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0049] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0050] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0051] As described in the background technology section, in the current prior art, when testing an application, the test cases generated by the existing test scheme lack the ability to handle complex logic, and it is difficult to correctly handle the correct operation content and reasonable operation sequence of controls such as the mobile phone number input box, password input box, and verification code button. Especially when facing test tasks in specific scenarios (such as login, privacy protocol analysis), it is often necessary to consume a lot of resources to process the jump logic. At this time, manual intervention is generally required, and the labor cost is high.
[0052] Based on the above considerations, the embodiment of the present application proposes an application testing method, which performs graphic analysis and action analysis on the user interface of the application to be tested to obtain the first information; based on the first information, it is matched with the pre-built sequence library to obtain the first test sequence of the user interface; a large language model is used to determine the second test sequence from the first test sequence; and the application to be tested is tested using the second test sequence. The embodiment of the present application divides the entire test process into two parts: in-screen testing and inter-screen jumps. In view of the logic of the in-screen test sequence (including whether the operation sequence of the test sequence is logical, such as entering the mobile phone number first and then clicking the verification code button, and whether the operation content is reasonable, such as entering the mobile phone number, entering the password or entering any other content), the present application proposes a test sequence generation scheme, and obtains the test sequence based on the matching results of the first information and the sequence library. In view of the logic of inter-screen jumps, the present application constructs scenario test prompt information based on the test sequence and test target, and selects the test sequence that best meets the test target with the help of the logical processing capability of the large language model. Through the combination of the first information and LLM, a complete logical test case generation scheme is realized.
[0053] The technical solutions of the embodiments of the present application are described in detail below through specific examples.
[0054] refer to Figure 1 The application testing method of the embodiment of the present application comprises the following steps:
[0055] Step S101, performing graphic analysis and action analysis on the user interface of the application to be tested to obtain first information;
[0056] Step S102, matching the first information with a pre-built sequence library to obtain a first test sequence of the user interface;
[0057] Step S103, using a large language model to determine a second test sequence from the first test sequence;
[0058] Step S104: testing the application to be tested by using the second test sequence.
[0059] With respect to step S101 , a graphic analysis and a motion analysis are performed on the user interface of the application to be tested to obtain first information.
[0060] First, when obtaining the application to be tested, it is necessary to analyze the user interface of the application to be tested, which is divided into graphic analysis and action analysis.
[0061] In some embodiments, performing graphic analysis and action analysis on the user interface of the application to be tested to obtain the first information includes: performing graphic analysis on the user interface of the application to be tested to obtain the second information; and performing action analysis on the user interface based on the second information to obtain the first information.
[0062] refer to Figure 2 , which is a schematic diagram of the analysis process of an embodiment of the present application.
[0063] In the specific analysis process, we first need to conduct a graphical analysis of the user interface.
[0064] In some embodiments, the performing graphical analysis on the user interface of the application to be tested to obtain the second information includes: performing graphical analysis on the user interface to obtain a graphical user interface; analyzing the graphical user interface to obtain a control type, a parent control type, child control text information, and associated text information; and using the control type, parent control type, child control text information, and associated text information as the second information.
[0065] In this embodiment, if Figure 2 As shown, the user interface of the application to be tested is Figure 2 The content on the left part includes many elements. After performing graphical analysis of the user interface (UI) of the screen of the application under test, we can collect information including graphical user interface (GUI) information (such as Figure 2 cls, parent, content fields in the .
[0066] Specifically, Figure 2 The right side shows the recognition results, including "Login to unlock the seal", "One-click login with local number", "Login with mobile verification code", radio button, "Read and agree to the privacy terms and service agreement", WeChat icon and QQ icon. There are some typos, because the recognition cannot be guaranteed to be completely accurate, so there will be recognition errors, which is normal.
[0067] After performing graphic analysis on the user interface, perform action analysis on the user interface.
[0068] In some embodiments, based on the second information, the user interface is action analyzed to obtain the first information, including: analyzing the action corresponding to each of the graphical user interfaces to obtain action information; based on the second information, in combination with the action information, determining the serial position information of the graphical user interface in the screen conversion; and using the action information, the second information and the serial position information as the first information.
[0069] In this embodiment, the action may include input and click, for example, inputting a password, user name or mobile phone number in a box to be input, or clicking a button.
[0070] It should be noted that although it is possible to identify individual controls and their corresponding actions (e.g., enter a mobile phone number, enter an email address, perform a click operation, etc.) and understand their functional area features, this is not enough to reveal the logical relationship between controls. For example, before clicking the Send verification code button, the user needs to enter the mobile phone number first; after clicking the Send button, the user needs to enter the received verification code. In order to build a test sequence with logical processing capabilities, it is necessary to further extract sequence features based on UI classification information.
[0071] To this end, we first abstracted the functional area experience library (pre-built sequence library) and converted it into a series of abstract test sequences according to the UI classification rules. By analyzing the correspondence between the abstract sequence features and the set {GUI information, UI classification information}, we mapped and generated the functional area test sequence. This process not only enhances the logic of the test sequence, but also improves the efficiency and accuracy of automated testing, providing a systematic and standardized method for multi-scenario testing. This method can ensure that the test sequence can fully cover the functional areas of the application and execute in a predefined logical order, so as to more effectively identify potential problems and defects.
[0072] exist Figure 2 In the embodiment of FIG. 1 , after analyzing the left image, the UI analysis result (such as Figure 2 The Label field here can represent the logical relationship of the corresponding control to a certain extent. When the field includes single, it means that it is located at the starting point of the control logic. When the field includes None_last, it means that it is located in the middle of the control logic. When the field includes last, it means that it is located at the end of the control logic.
[0073] Further, with respect to step S102, based on the first information, matching is performed with a pre-built sequence library to obtain a first test sequence of the user interface.
[0074] After the first information is obtained, although the logic of the controls is roughly divided in the first information, the specific logic is not clear. At this time, a method is needed to clarify the detailed logic between the various controls.
[0075] In some embodiments, matching with a pre-built sequence library based on the first information to obtain the first test sequence of the user interface includes: matching with the sequence library based on the sequence position information in the first information to obtain the first test sequence.
[0076] refer to Figure 3 , which is a schematic diagram of the sequence library abstraction process of an embodiment of the present application.
[0077] In this embodiment, the UI analysis method is firstly followed to implement abstract processing on the functional area experience library (sequence library) to generate sequence references that can be used for subsequent model mapping. Figure 3 The original data of the functional area experience library in the middle left figure shows a three-step complete test sequence of an APP: (1) Click the "My" tab in the navigation bar; (2) Click the Login / Register button; (3) Enter the user name --> Enter the password --> Confirm the password --> Enter the email address --> Click the radio button --> Click the Register button.
[0078] These three steps are abstracted as Figure 3 Data in the abstract results of the functional area experience library. For example, the "My" in the navigation bar is abstracted as TextView(text)_CLICK_Navigation(navigation bar)_single, and the "Home", "Mall" and "My" in the navigation bar all belong to the TextView(text)_CLICK_Navigation(navigation bar)_single category, which means that this type of control belongs to the type of control that will jump directly after clicking (at the same time, the "Home", "Mall" and "My" in the navigation bar also represent different function pages, and the subsequent specific context understanding and execution will be handed over to LLM).
[0079] Furthermore, based on the UI analysis results, the abstract results in the functional area experience library are retrieved. The goal of the retrieval is to identify the items in the current functional area that match the screen control UI classification results. It is crucial that the matching UI classification results should cover the two functional area features "last" and "single", which identify the key controls that can trigger screen transitions. Once these features are identified, we will extract the corresponding functional area matching results.
[0080] refer to Figure 4 , which is a schematic diagram of the screenshot analysis results of an embodiment of the present application.
[0081] The radio button and the one-click login button of the local number match some entries in the second item of the abstract result of the functional area experience library, and the operation sequence is obtained: click RadioButton (radio button) --> click Button (button): one-click login of the local number. The complete test sequence matching results are as follows: Figure 4 The functional area analysis results column represents:
[0082] (1) Click the RadioButton --> Click the Button: Log in with your phone number.
[0083] (2) Click RadioButton --> Click Button: Log in using mobile verification code.
[0084] (3) Click the RadioButton-->Click the QQ Icon.
[0085] (4) Click the RadioButton --> click the WeChat Icon.
[0086] (5) Simply click the button to log in using your phone number (a dialog box will pop up to confirm the privacy agreement).
[0087] (6) Simply click the Button to log in using the mobile verification code (a dialog box will pop up to confirm the privacy agreement).
[0088] (7) Click the TextView (text) to log in and unlock the seal.
[0089] Further, after obtaining the above-mentioned first test sequence, for step S103 and step S104, a second test sequence is determined from the first test sequence using a large language model, and the application to be tested is tested using the second test sequence.
[0090] In some embodiments, the use of a large language model to determine a second test sequence from the first test sequence includes: constructing test prompt information based on the first information, the first test sequence and the test target of the application to be tested; and based on the test prompt information, determining a second test sequence from the first test sequence using the large language model.
[0091] In this embodiment, the present application divides the entire test process into two test loops: a screen test loop and an application test loop (jumping between screens), wherein the logic of the test loop within the screen is mainly controlled by the functional area, while the application test loop adopts LLM control.
[0092] In order to improve the reasoning and decision-making capabilities of LLM, this application reordered the controls from top to bottom based on the previously sorted UI information, and constructed an ordered representation similar to the original XML layout structure. Among many LLMs, Wenxin Model 4.0 was selected as the main tool. Compared with other models, Wenxin Model 4.0 performs better in logical reasoning, especially in the processing capabilities in the Chinese context and the sensitivity to third-party login options (such as WeChat, QQ).
[0093] refer to Figure 5 , which is a schematic diagram of the scene test prompt information of an embodiment of the present application.
[0094] like Figure 5 In order to effectively guide LLM in selecting and executing test sequences, we carefully designed the test prompt, which contains three key parts that need to be dynamically filled according to the specific test scenario:
[0095] (1){{GUI information}}: This part of the data contains detailed information about the interface elements.
[0096] (2) {{Functional area test sequence}}: A test sequence obtained based on model mapping, which is used to guide LLM to make specific operation selections and is the second test sequence.
[0097] (3) {{target}}: defines the target of the test, which is the login operation in this embodiment.
[0098] For further reference, Figure 6 , which is a schematic diagram of a scenario test example of an embodiment of the present application.
[0099] like Figure 6 As shown in the figure, taking the model mapping of the login screen as an example, the prompt we built allows LLM to select the most appropriate test sequence based on understanding the current UI layout and test goals. The return result of Wenxinyiyan provides the sequence number and the reason for selecting the sequence in the form of a JSON string. Since I required the return format to be a json string in the prompt, the returned json string will be extracted in my code and the first matching json data will be selected.
[0100] In some embodiments, the method further includes: in response to the screen of the application to be tested not changing after executing the test operation, deleting the second test sequence from the first test sequence to obtain a third test sequence; and selecting a new second test sequence from the third test sequence using a large language model.
[0101] In the subsequent on-screen test loop, screen changes will be detected and the next step will be performed based on the screen changes:
[0102] (1) After the operation is performed, the screen changes and enters the application loop, performing UI analysis and model analysis on the new page.
[0103] (2) After the operation is executed, the screen does not change, an unknown error occurs in the strategy, and the currently executing screen function area test sequence is deleted and resent to the large language model for it to reselect and execute.
[0104] (3) If all functional area test sequences have been executed, it means that the page does not meet the task requirements and the Back operation is executed.
[0105] It can be seen from the above embodiments that the application testing method described in the embodiment of the present application performs graphic analysis and action analysis on the user interface of the application to be tested to obtain the first information; based on the first information, it is matched with the pre-built sequence library to obtain the first test sequence of the user interface; a large language model is used to determine the second test sequence from the first test sequence; and the application to be tested is tested using the second test sequence. The embodiment of the present application divides the entire test process into two parts: in-screen testing and inter-screen jumps. In view of the logic of the in-screen test sequence (including whether the operation sequence of the test sequence is logical, such as entering the mobile phone number first and then clicking the verification code button, and whether the operation content is reasonable, such as entering the mobile phone number, entering the password or entering any other content), the present application proposes a test sequence generation scheme, and obtains the test sequence based on the matching results of the first information and the sequence library. In view of the logic of inter-screen jumps, the present application constructs scenario test prompt information based on the test sequence and test target, and selects the test sequence that best meets the test target with the help of the logical processing capability of the large language model. Through the combination of the first information and LLM, a complete logical test case generation scheme is realized.
[0106] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.
[0107] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0108] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides an application testing device.
[0109] refer to Figure 7 , the application testing device comprises:
[0110] An analysis module 71 is configured to perform graphic analysis and action analysis on the user interface of the application to be tested to obtain first information;
[0111] A matching module 72 is configured to match the first information with a pre-built sequence library to obtain a first test sequence of the user interface;
[0112] A determination module 73 is configured to determine a second test sequence from the first test sequence using a large language model;
[0113] The testing module 74 is configured to test the application to be tested by using the second test sequence.
[0114] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0115] The device of the above embodiment is used to implement the corresponding application test method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0116] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the application testing method described in any of the above embodiments is implemented.
[0117] Figure 8A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0118] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0119] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0120] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0121] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0122] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0123] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0124] The electronic device of the above embodiment is used to implement the corresponding application test method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0125] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the application testing method described in any of the above embodiments.
[0126] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0127] The computer instructions stored in the storage medium of the above embodiments are used to enable the computer to execute the application testing method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0128] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0129] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.
[0130] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0131] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.
Claims
1. An application testing method, characterized in that: include: Performing graphic analysis and action analysis on the user interface of the application to be tested to obtain first information; Based on the first information, matching is performed with a pre-built sequence library to obtain a first test sequence of the user interface; Determine a second test sequence from the first test sequence using a large language model; The application to be tested is tested using the second test sequence.
2. The method according to claim 1, characterized in that: The step of performing graphic analysis and action analysis on the user interface of the application to be tested to obtain first information includes: Performing a graphical analysis on the user interface of the application to be tested to obtain second information; Based on the second information, an action analysis is performed on the user interface to obtain the first information.
3. The method according to claim 2, characterized in that The step of performing a graphical analysis on the user interface of the application to be tested to obtain the second information includes: Performing graphic analysis on the user interface to obtain a graphical user interface; Analyze the graphical user interface to obtain control type, parent control type, child control text information and associated text information; The control type, parent control type, child control text information and associated text information are used as the second information.
4. The method according to claim 3, characterized in that The performing action analysis on the user interface based on the second information to obtain the first information includes: Analyze the action corresponding to each of the graphical user interfaces to obtain action information; Based on the second information and in combination with the action information, determining and obtaining sequence position information of the graphical user interface in screen conversion; The action information, the second information and the sequence position information are used as the first information.
5. The method according to claim 4, characterized in that The step of matching the first information with a pre-built sequence library to obtain a first test sequence of the user interface includes: Based on the sequence position information in the first information, matching is performed with the sequence library to obtain the first test sequence.
6. The method according to claim 1, characterized in that The determining a second test sequence from the first test sequence using a large language model includes: Constructing test prompt information based on the first information, the first test sequence and the test target of the application to be tested; Based on the test prompt information, a second test sequence is determined from the first test sequence using the large language model.
7. The method according to claim 1, characterized in that The method further comprises: In response to the screen of the application to be tested not changing after the test operation is performed, deleting the second test sequence from the first test sequence to obtain a third test sequence; A new second test sequence is selected from the third test sequence using a large language model.
8. An application testing device, characterized in that: include: An analysis module, configured to perform graphic analysis and action analysis on the user interface of the application to be tested to obtain first information; a matching module, configured to match the first information with a pre-built sequence library to obtain a first test sequence of the user interface; A determination module, configured to determine a second test sequence from the first test sequence using a large language model; The testing module is configured to test the application to be tested by using the second testing sequence.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 7 is implemented.
10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.