Automated test method and related apparatus
By using a log analysis device between the client and server to relay and analyze data, the high-cost test analysis problem caused by Selenium's reliance on testers' experience is solved, and efficient and accurate analysis of automated tests is achieved.
Patent Information
- Application Number
- CN202111508861.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-10
- Publication Date
- 2025-12-30
- Estimated Expiration
- 2041-12-10
AI Technical Summary
The existing automated testing tool Selenium relies on the experience of testers for test analysis, resulting in high test analysis costs.
An automated testing method and related equipment are provided. The method uses a log analysis device to transfer data between the client and the server, extract and analyze log information, generate test analysis information, and reduce the analysis burden on testers.
Automated testing methods and equipment can accurately generate test analysis information, reducing the analysis costs for testers and improving testing efficiency and accuracy.
Smart Images
Figure CN114168426B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of software testing, in particular to an automatic testing method and related equipment. BACKGROUND
[0002] Selenium is an open source and free tool for web application automatic testing. Selenium supports multiple browsers and multiple operating system programming languages. Selenium directly runs in the browser, simulates real user operation of the webpage. The main functions of Selenium include testing compatibility with browsers and web system functions. Selenium is the most widely used web application automatic testing tool at present.
[0003] When Selenium performs testing, test cases are submitted to the background of the browser, and the background returns the running results to the client where the browser is located. The tester analyzes the test according to the running results.
[0004] The test analysis of the tester based on the running results relies on the experience of the tester. If the test analysis result needs to be accurate, experienced testers need to be used for testing, and the test analysis cost of automatic testing is high. SUMMARY
[0005] The present application provides an automatic testing method and related equipment to solve the problem of high test analysis cost of automatic testing.
[0006] In one aspect, the present application provides an automatic testing method applied to a log analysis device, comprising:
[0007] When receiving execution data sent by a server, the execution data is sent to a client, and log information is extracted from the execution data, wherein the execution data is obtained by executing commands submitted by the client by the server;
[0008] When receiving test termination information sent by the client or the server, log corresponding to a target command is extracted from the log information, wherein the target command is a command meeting a set condition;
[0009] According to the log corresponding to the target command, a first command chain corresponding to the target command and command response content are determined;
[0010] According to the first command chain corresponding to the target command and the command response content, test analysis information is determined;
[0011] The test analysis information is sent to the client.
[0012] In an embodiment, the step of determining the first command chain corresponding to the target command according to the log corresponding to the target command comprises:
[0013] constructing a source parameter ID and a response ID according to the log corresponding to the target command;
[0014] constructing the first command chain corresponding to the target command according to the source parameter ID and the response ID.
[0015] In an embodiment, the step of determining the test analysis information according to the first command chain corresponding to the target command and the command response content comprises:
[0016] determining whether the target command is successfully run by the server;
[0017] when the target command is successfully run by the server, determining the test analysis information according to the first command chain corresponding to the target command and the command response content.
[0018] In an embodiment, the step of determining whether the target command is successfully run by the server according to the log of the target command comprises:
[0019] when the target command is not successfully run by the server, obtaining a second command chain corresponding to the target command when the target command is last successfully run;
[0020] determining a third command chain missing for successfully running the target command according to the second command chain and the first command chain;
[0021] determining the test analysis information according to the first command chain, the third command chain and the command response content.
[0022] In an embodiment, the step of determining the command response content corresponding to the target command according to the log corresponding to the target command comprises:
[0023] obtaining response information in the log corresponding to the target command;
[0024] querying text content contained in a preset element in the response information as the command response content corresponding to the target command, the preset element being an element in a file associated with the target command.
[0025] In an embodiment, the test termination information comprises a test stop instruction sent by the client or a running error prompt information sent by the server.
[0026] On the other hand, the application further provides a log analysis device, comprising:
[0027] The sending module is configured to send the execution data to the client when the execution data is received, and extract log information from the execution data, wherein the execution data is obtained by executing the command submitted by the client by the server;
[0028] The extraction module is configured to extract log corresponding to the target command from the log information when the test termination information sent by the client or the server is received, wherein the target command is a command meeting a set condition;
[0029] The determination module is configured to determine a first command chain and a command response content corresponding to the target command according to the log corresponding to the target command;
[0030] The determination module is configured to determine test analysis information according to the first command chain and the command response content corresponding to the target command;
[0031] The sending module is further configured to send the test analysis information to the client.
[0032] In another aspect, the present application further provides a log analysis device, comprising a memory and a processor;
[0033] The memory stores computer execution instructions;
[0034] The processor executes the computer execution instructions stored in the memory, so that the processor executes the automatic test method as described above.
[0035] In another aspect, the present application further provides a computer readable storage medium, wherein the computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by the processor to implement the automatic test method as described above.
[0036] In another aspect, the present application further provides a computer program product, comprising a computer program, wherein the computer program is executed by the processor to implement the automatic test method as described above.
[0037] The automatic test method and related device provided by the application send running data fed back by a server running a test case to a client when the running data is received, extract log information from the running data, extract log of a target command from the log information if test termination information is received, determine command chain corresponding to the target command and command response content according to the log, determine test analysis information based on the command chain and the command response content, and send the test analysis information to the client. In the application, the log analysis device is responsible for the transfer of interactive data between the client and the server, and stores log information in the interactive data. If the test is terminated, the log analysis device analyzes the log information to obtain the command chain and the command response content, so that the tester can accurately locate the problems existing in the automatic test based on the command chain and the command response content, that is, the test analysis is performed by the log analysis device, and the tester does not need to perform analysis, thereby reducing the test analysis cost of the automatic test. BRIEF DESCRIPTION OF DRAWINGS
[0038] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the description, further serve to explain the principles of the present disclosure.
[0039] Figure 1 A system architecture diagram for implementing the automatic test method of the application;
[0040] Figure 2 A flowchart of the first embodiment of the automatic test method of the application;
[0041] Figure 3 A detailed flowchart of step S30 in the second embodiment of the automatic test method of the application;
[0042] Figure 4 A detailed flowchart of step S40 in the third embodiment of the automatic test method of the application;
[0043] Figure 5 A detailed flowchart of step S30 in the fourth embodiment of the automatic test method of the application;
[0044] Figure 6 A module diagram of the log analysis device of the application;
[0045] Figure 7 A hardware structure diagram of the log analysis device of the application.
[0046] The above-described drawings have shown the specific embodiments of the present disclosure, and the following will have a more detailed description. These drawings and textual descriptions are not intended to limit the scope of the concept of the present disclosure by any means, but to illustrate the concept of the present disclosure to those skilled in the art by referring to specific embodiments. Detailed Implementation
[0047] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0048] This invention provides an automated testing method that can... Figure 1 The system architecture diagram shown is implemented. (See example.) Figure 1 As shown, client 100 communicates with server 300 through log analysis device 200. Client 100 has an automated testing application installed, such as Selenium. The application submits test cases to the browser's background for execution, i.e., to server 300, allowing server 300 to run the test cases. Log analysis device 200 acts as a data relay between client 100 and server 300; all data between the two is forwarded through log analysis device 200. Log analysis device 200 has data acquisition and log analysis functions. Specifically, log analysis device 200 acquires log information from the data exchanged between client 100 and server 300 through its data acquisition function. When the test terminates, log analysis device 200 activates its log analysis function, analyzes the acquired log information to obtain test analysis information, and then returns the test analysis information to client 100.
[0049] The technical solutions of the present invention and how they solve the above-mentioned technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will now be described with reference to the accompanying drawings.
[0050] Reference Figure 2 , Figure 2 This is a first embodiment of the automated testing method of the present invention. The automated testing method includes the following steps:
[0051] Step S10: Upon receiving the execution data sent by the server, the execution data is sent to the client, and log information is extracted from the execution data. The execution data is obtained by the server executing the commands submitted by the client.
[0052] In the embodiment, the execution subject is a log analysis device, and for ease of description, the device is used to represent the log analysis device in the following. The client is connected to the server through the device, an automated test tool in the client submits data to the device, the device forwards the submitted data to the server, the server performs testing through the data, and test logs are returned to the client through the device. The data submitted by the client can be a command issued by an automated test tool Selenium, that is, the log is a log of the server executing the command. That is, when the server executes the command submitted by the client, execution data is fed back to the device. The device has a data collection function, and when the device sends the execution data to the client, log information is extracted from the execution data.
[0053] Specifically, the log information includes information of a current step of the server executing a test case and html information of a current page. The information of the current step includes a current command sequence number, a command name, a command parameter, response content, and a return result. The command parameter can be a parameter ID and a parameter value.
[0054] The response content includes a response ID, a command name, a running state, a return result, a page html file, a page html file name, and other related information. It should be noted that the server executes a query page element command, and the return result of the query needs to be recorded. The return result includes a locator used for positioning an element and an uploaded html tag of a queried page. The other related information is, for example, a page screenshot file, a running start time point, and a running end time point. The html information of the current page includes page source code saved as a file. The log information extracted by the device can be saved in a json format.
[0055] In step S20, when receiving test termination information sent by the client or the server, log information corresponding to a target command that meets a set condition is extracted from the log information. The target command is a command that meets a set condition.
[0056] When receiving test termination information sent by the client or the server, the device starts a log analysis function and begins to analyze logs of a current run of the server. The test termination information includes a test stop instruction sent by the client, and the test stop instruction is an end program running command sent by an automated test tool in the client to the server. The test termination information can also be prompt information of a running error sent by the server, that is, an error occurs in a test program running process of the server, and the server sends prompt information to the client.
[0057] The device extracts the log corresponding to the target command from the log information. The target command is a command that meets the set condition. That is, the device performs screening of the commands to obtain the log corresponding to the target command. Specifically, the device first filters out the command logs that are useless and do not want to be processed, for example, the selenium preparation commands before the first get command. The device then selects the target command, which is a command that meets the set condition, i.e., a command that contains an html page file, a command that starts with find / click / send / mouse, or a command that has a non-empty id or actual value of the parameter.
[0058] After determining the target command, the device obtains the log corresponding to the target command.
[0059] In step S30, the first command chain corresponding to the target command and the command response content are determined according to the log corresponding to the target command.
[0060] The command chain refers to a command chain composed of each target command in time sequence. The command response content refers to the text content corresponding to the page element after the server executes the target command. The command chain can represent the combination of the key commands of the test case during testing. The first command chain is basic information of the automated interface test, which can be used for analysis by the downstream.
[0061] The device determines the first command chain corresponding to the target command and the command response content based on the log corresponding to the target command.
[0062] In step S40, the test analysis information is determined according to the first command chain corresponding to the target command and the command response content.
[0063] In step S50, the test analysis information is sent to the client.
[0064] The device can determine the test analysis information based on the first command chain and the command response content. The test analysis information at least includes the first command chain and the command response content. The device then sends the test analysis information to the client, so that the tester determines the result after the test case is executed. If the test case has an error operation, the tester can quickly analyze the error time through the first command chain and the command response content, thereby reducing the development time of the system and speeding up the development process under the premise of ensuring the quality.
[0065] Furthermore, the data acquisition and log analysis functions are integrated into the device, making them invisible to testers and not affecting the execution of test cases. The collection and analysis of log information allows the client to obtain the key command chain for each test case execution, enabling testers to compare and analyze failed cases and accurately pinpoint the source of errors. This facilitates problem identification and saves time in reproducing the errors.
[0066] In the technical solution provided in this embodiment, upon receiving the running data from the server running test cases, the running data is sent to the client, and log information is extracted from the computational data. If test termination information is received, the log of the target command is extracted from the log information, and the command chain and command response content corresponding to the target command are determined based on the log. Test analysis information is then determined based on the command chain and command response content, and the test analysis information is sent to the client. In this invention, the log analysis device is responsible for relaying the interactive data between the client and the server, and stores the log information in the interactive data. If the test terminates, the log analysis device analyzes the log information to obtain the command chain and command response content, thereby enabling testers to accurately locate the problems existing in the automated test based on the command chain and command response content. That is, test analysis is performed through the log analysis device, eliminating the need for testers to perform analysis, thus reducing the test analysis cost of automated testing.
[0067] Reference Figure 3 , Figure 3 This is a second embodiment of the automated testing method of the present invention. Based on the first embodiment, step S30 includes:
[0068] Step S31: Construct the source parameter ID and response ID based on the log corresponding to the target command.
[0069] In this embodiment, after obtaining the log corresponding to the target command, a source parameter ID and a response ID are constructed based on the log. For example, the constructed source parameter ID is sourceId, and the constructed response ID is responseId. It should be noted that if the log contains a parameter ID, then sourceId is the source parameter ID; if the log does not contain a parameter ID, then the source parameter ID is empty. Furthermore, if the log contains a response element, then the response ID is related to the response element; if the log does not contain a response element, then the response ID is empty.
[0070] Step S32: Construct the first command chain corresponding to the target command based on the source parameter ID and the response ID.
[0071] The device needs to remove response IDs with empty response IDs, and then construct the first command chain of the target command based on the source parameter ID and the response ID. Specifically, the device can construct the first command chain based on the source parameter ID = response ID. For example, if the response ID of target command A = the source parameter ID of target command B, then target command A is the parent command of target command B: the first command chain corresponding to the target command is: A→B.
[0072] In the technical solution provided in this embodiment, the device constructs a source parameter ID and a response ID based on the log corresponding to the target command, thereby accurately constructing the first command chain corresponding to the target based on the source parameter ID and the response ID.
[0073] Reference Figure 4 , Figure 4 In the third embodiment of the automated testing method of the present invention, based on the first or second embodiment, step S40 includes:
[0074] Step S41: Determine whether the server has successfully run the target command.
[0075] In this embodiment, the device needs to determine whether the first command chain corresponding to the target command is complete. If the server fails to execute the target command this time, the first command chain is incomplete; if the server successfully executes the target command this time, the first command chain is complete.
[0076] To determine whether the server successfully executed the target command, the device needs to ascertain whether it has. This can be done based on the test termination information. If the test termination information is sent by the client, it indicates that the client completed the test, meaning the server executed the target command without error, and thus the server successfully ran the target command. If the test termination information is sent by the server, it indicates that the test termination information represents an error message from the server's execution of the target command, and the device can determine that the server failed to successfully execute the target command.
[0077] Step S42: When the target command is successfully executed on the server, determine the test analysis information based on the first command chain corresponding to the target command and the command response content.
[0078] When the device determines that the target command has been successfully executed on the server, it can determine that the first command chain is complete. The device can then generate test analysis information based on the first command chain and the command response content.
[0079] If the server fails to execute the target command, it can be determined that the first command chain is incomplete. The device retrieves the second command chain corresponding to the last successful execution of the target command from historical log information. Based on the first and second command chains, it determines the missing third command chain for the successful execution of the target command. The device can determine the test analysis information based on the first and third command chains and the command response; that is, the test analysis information includes the first and third command chains and the command response information.
[0080] In the technical solution provided in this embodiment, the device determines whether the server has successfully run the target command. If the server has successfully run the target command, the device determines the test analysis information based on the first command chain corresponding to the target command and the command response content, thereby accurately generating the test analysis information.
[0081] Reference Figure 5 , Figure 5 In the fourth embodiment of the automated testing method of the present invention, based on any one of the first to fourth embodiments, step S30 includes:
[0082] Step S33: Obtain the response information from the log corresponding to the target command.
[0083] In this embodiment, the device obtains response information from the log corresponding to the target command, that is, the device obtains the server's response to the target command, and this response is the response information.
[0084] Step S34: Query the text content contained in the preset element in the response information, which serves as the command response content corresponding to the target command. The preset element is an element in the file associated with the target command.
[0085] The device retrieves the text content contained in a preset element from the response information as the command response content corresponding to the target command. The preset element is an element in the file associated with the target command. Specifically, the device has different query methods. Based on the different query methods, the device retrieves the corresponding HTML element in the HTML source file associated with the target command, and then retrieves the text contained in the HTML element. This text is the command response content.
[0086] In the technical solution provided in this embodiment, the device obtains response information from the log corresponding to the target command, and then accurately queries the text content contained in the preset element from the response information as the command response content corresponding to the target command.
[0087] The present invention also provides a log analysis device, with reference to Figure 6 The log analysis device 600 includes:
[0088] The sending module 610 is used to send the execution data to the client when it receives the execution data sent by the server, and to extract log information from the execution data. The execution data is obtained by the server executing the command submitted by the client.
[0089] The extraction module 620 is used to extract the log corresponding to the target command from the log information when a test termination message is received from the client or server. The target command is a command that meets the set conditions.
[0090] The determination module 630 is used to determine the first command chain and command response content corresponding to the target command based on the log corresponding to the target command.
[0091] The determination module 630 is used to determine test analysis information based on the first command chain corresponding to the target command and the command response content;
[0092] Send test analysis information to the client.
[0093] In one embodiment, the log analysis device 600 includes:
[0094] The construction module is used to construct the source parameter ID and response ID based on the logs corresponding to the target command.
[0095] The constructor module is used to construct the first command chain corresponding to the target command based on the source parameter ID and the response ID.
[0096] In one embodiment, the log analysis device 600 includes:
[0097] Module 630 is used to determine whether the server has successfully run the target command.
[0098] The determination module 630 is used to determine test analysis information based on the first command chain corresponding to the target command and the command response content when the target command is successfully executed on the server.
[0099] In one embodiment, the log analysis device 600 includes:
[0100] The acquisition module is used to acquire the second command chain corresponding to the last successful execution of the target command when the target command fails to run on the server.
[0101] The determination module 630 is used to determine the missing third command chain for the successful execution of the target command based on the second command chain and the first command chain;
[0102] The determination module 630 is used to determine test analysis information based on the first command chain, the third command chain, and the command response content.
[0103] In one embodiment, the log analysis device 600 includes:
[0104] The acquisition module is used to retrieve response information from the logs corresponding to the target command;
[0105] The query module is used to search for the text content contained in a preset element in the response information, which serves as the command response content corresponding to the target command. The preset element is an element in the file associated with the target command.
[0106] Figure 7 This is a hardware structure diagram of a log analysis device according to an exemplary embodiment.
[0107] The log analysis device 700 may include: a processor 701, such as a CPU, a memory 702, and a transceiver 703. Those skilled in the art will understand that... Figure 7 The structure shown does not constitute a limitation on the log analysis device and may include more or fewer components than illustrated, or combine certain components, or have different component arrangements. Memory 702 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0108] The processor 701 can call the computer program stored in the memory 702 to complete all or part of the steps of the above-described automated testing method.
[0109] Transceiver 703 is used to receive information sent by external devices and to send information to external devices.
[0110] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a log analysis device, enables the log analysis device to perform the aforementioned automated testing method.
[0111] A computer program product includes a computer program that, when executed by the processor of a log analysis device, enables the log analysis device to perform the aforementioned automated testing method.
[0112] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0113] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. An automated testing method, characterized by, The application is applied to a log analysis device, comprising: when receiving execution data sent by a server, sending the execution data to a client and extracting log information from the execution data, the execution data being obtained by the server executing a command submitted by the client; when receiving test termination information sent by the client or the server, extracting log corresponding to a target command from the log information, the target command being a command meeting a set condition; determining a first command chain and command response content corresponding to the target command according to the log corresponding to the target command; determining test analysis information according to the first command chain and the command response content corresponding to the target command; sending the test analysis information to the client; the step of determining test analysis information according to the first command chain and the command response content corresponding to the target command comprises: determining whether the server successfully runs the target command; when the server successfully runs the target command, determining the test analysis information according to the first command chain and the command response content corresponding to the target command; the step of determining whether the server successfully runs the target command according to the log of the target command comprises: when the server does not successfully run the target command, obtaining a second command chain corresponding to the target command in the last successful running; determining a third command chain missing in the successful running of the target command according to the second command chain and the first command chain; determining the test analysis information according to the first command chain, the third command chain and the command response content.
2. The automated testing method of claim 1, wherein, the step of determining the first command chain corresponding to the target command according to the log corresponding to the target command comprises: constructing a source parameter ID and a response ID according to the log corresponding to the target command; constructing the first command chain corresponding to the target command according to the source parameter ID and the response ID.
3. The automated testing method of claim 1, wherein, the step of determining the command response content corresponding to the target command according to the log corresponding to the target command comprises: obtaining response information in the log corresponding to the target command; querying text content contained in a preset element in the response information as the command response content corresponding to the target command, the preset element being an element in a file associated with the target command.
4. The automated testing method according to any one of claims 1-3, wherein, The test termination information comprises a test stop instruction sent by the client or a running error prompt information sent by the server.
5. A log analysis apparatus characterized by comprising: comprising: a sending module configured to, when receiving execution data sent by a server, send the execution data to a client and extract log information from the execution data, the execution data being obtained by the server executing a command submitted by the client; an extracting module configured to, when receiving test termination information sent by the client or the server, extract log corresponding to a target command from the log information, the target command being a command meeting a set condition; a determining module configured to determine a first command chain and command response content corresponding to the target command according to the log corresponding to the target command; The determining module is configured to determine test analysis information according to the first command chain corresponding to the target command and the command response content; The sending module is further configured to send the test analysis information to the client; The determining module is specifically configured to determine whether the target command is successfully run on the server, and determine the test analysis information according to the first command chain corresponding to the target command and the command response content when the target command is successfully run on the server. The determining module is specifically configured to acquire a second command chain corresponding to the target command when the target command is successfully run last time when the target command is not successfully run on the server, determine a third command chain missing for successful running of the target command according to the second command chain and the first command chain, and determine the test analysis information according to the first command chain, the third command chain and the command response content.
6. A log analysis device characterized by comprising: Comprise: a memory and a processor; The memory stores computer execution instructions; The processor executes the computer execution instructions stored in the memory, so that the processor executes the automatic test method in any one of claims 1 to 4.
7. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by the processor to implement the automatic test method in any one of claims 1 to 4.
8. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the automatic test method in any one of claims 1 to 4.
Citation Information
Patent Citations
Application testing method and system
CN107092555A
Log analysis device and method
CN107894940A