Automated testing method, device, equipment and readable storage medium

Abstract

The embodiment of the present application provides an automated testing method, apparatus, device and readable storage medium, which obtains an expression to be tested and verification data, obtains the execution result of the test case executed by the test object, and the execution result includes the correspondence between the solution set and the running result. According to the target result and the running result corresponding to each solution set, the test result of the test case is obtained. The verification data includes the correspondence between the solution set and the target result. The solution set corresponding to the target result indicates the value of the variable of the expression to be tested when the target result is the result of the expression to be tested. The running result corresponding to the solution set indicates the result of the expression to be tested after the test object uses the solution set as the value of the variable of the expression to be tested and executes the expression to be tested. By comparing the target result and the running result corresponding to the same solution set, it is possible to obtain whether the test object executes the expression to be tested correctly, thereby obtaining the test result, which improves the execution efficiency and timeliness of software functional testing.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to an automated testing method, device, equipment and readable storage medium. Background Art

[0002] With the continuous development of the industrial Internet, the informationization of the industrial control industry is getting higher and higher, and the number of software iterations is becoming more and more frequent, which requires higher frequency response of expression function testing and regression testing. Obviously, the execution efficiency and timeliness of traditional manual testing solutions need to be improved. Summary of the invention

[0003] The present application provides an automated testing method, apparatus, device, and readable storage medium, the purpose of which is to improve the execution efficiency and timeliness of expression testing, as follows:

[0004] An automated testing method, comprising:

[0005] Obtain a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, wherein the expression to be tested includes a variable to be tested and a fixed quantity to be tested, wherein the verification data includes a correspondence between a solution set and a target result, wherein the solution set corresponding to the target result includes values ​​of each variable to be tested under the condition of the target result, and wherein the target result includes whether the expression to be tested is true or false;

[0006] Obtaining the execution result of the test case executed by the test object, the execution result including the correspondence between the solution set and the running result, the running result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the running result including whether the expression to be tested is established or not established;

[0007] The test results of the test cases are obtained according to the target results and the running results corresponding to each of the solution sets.

[0008] Optionally, before obtaining the test case, the method further includes: obtaining a first test document according to a preset test document template, wherein the first test document includes a preset first-category field, wherein the first-category field includes an identifier, an original expression, and data source information; the data source information includes a correspondence between a variable to be measured and a variable type, wherein the variable type of the variable to be measured indicates a value range of the variable to be measured;

[0009] The obtaining of test cases comprises:

[0010] Taking the original expression as the expression to be tested;

[0011] Convert the expression to be tested into a readable expression;

[0012] With the readable expression and the data source information as script parameters, the first preset script is called to obtain the verification data of the expression to be tested; the first preset script is used to obtain the values ​​of each variable to be tested with the target result as the condition, as the solution set corresponding to the target result.

[0013] Optionally, converting the expression to be tested into a readable expression includes:

[0014] From the expression to be tested, identifying the character string of each variable to be tested and the character string of each fixed quantity to be tested;

[0015] According to the character string of each variable to be measured, the script character string of each variable to be measured and the order of the script character string are obtained; the script character string of the variable to be measured is an expression form applied to the first preset script;

[0016] According to the character string of each fixed quantity to be measured, a script character string of each fixed quantity to be measured is obtained; the script character string of the fixed quantity to be measured is an expression form applied to the first preset script;

[0017] A readable expression of the expression to be tested is generated according to the script character string of each of the variables to be tested and the script character string of each of the fixed quantities to be tested.

[0018] Optionally, according to the character string of the target variable to be measured, the script character string of the target variable to be measured and the order of the script character string are obtained, and the target variable to be measured is any variable to be measured, including:

[0019] Using a regular expression to match the target variable to be measured to obtain a script string that matches the target variable to be measured;

[0020] Performing generalization processing on the script character string that matches the target variable to be measured, and using the generalization processing result as the script character string of the target variable to be measured;

[0021] The sequence of the target variable to be tested in a variable sequence is obtained as the sequence of the script character string of the target variable to be tested, wherein the variable sequence includes the variables to be tested in the expression to be tested arranged in a front-to-back order.

[0022] Optionally, according to a character string of a target fixed quantity to be measured, a script character string of the target fixed quantity to be measured is obtained, wherein the target fixed quantity to be measured is any fixed quantity to be measured, including:

[0023] If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the preset conversion dictionary is used as the script string of the target fixed quantity to be measured; the conversion dictionary includes a mapping relationship between the string of each fixed quantity to be measured and the script string;

[0024] If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is used as the script character string of the target fixed quantity to be measured.

[0025] Optionally, obtaining the test result of the test case according to the target result and the running result corresponding to each of the solution sets includes:

[0026] If there is at least one set of solution sets whose corresponding target results and running results are inconsistent, the test result of the test case is failure;

[0027] If the target results and running results corresponding to all solution sets are consistent, the test result of the test case is passed.

[0028] Optionally, after the first preset script is called with the readable expression and the data source information as script parameters to obtain verification data of the expression to be tested, the method further includes:

[0029] Record the verification data of the expression to be tested as a second type of field into the first test document to generate a second test document;

[0030] After obtaining the test result of the test case according to the target result and the running result corresponding to each solution set, the method further includes:

[0031] The test results and log information are recorded as the third type of fields in the second test document to generate a result test document.

[0032] An automated testing device, comprising:

[0033] A test case acquisition unit, used to acquire a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, the expression to be tested includes a variable to be tested and a fixed quantity to be tested, the verification data includes a correspondence between a solution set and a target result, the solution set corresponding to the target result includes the values ​​of each variable to be tested under the condition of the target result, and the target result includes the establishment of the expression to be tested and the failure of the expression to be tested;

[0034] an execution result acquisition unit, used to acquire the execution result of the test object executing the test case, the execution result including the correspondence between the solution set and the operation result, the operation result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the operation result including whether the expression to be tested is established or not established;

[0035] The test result acquisition unit is used to acquire the test result of the test case according to the target result and the running result corresponding to each solution set.

[0036] An automated testing device, comprising: a memory and a processor;

[0037] The memory is used to store programs;

[0038] The processor is used to execute the program to implement each step of the automated testing method.

[0039] A readable storage medium stores a computer program, which, when executed by a processor, implements various steps of an automated testing method.

[0040] It can be seen from the above technical scheme that the automated testing method, device, equipment and readable storage medium provided by the embodiment of the present application obtain the expression to be tested and the verification data, obtain the execution result of the test case executed by the test object, the execution result includes the corresponding relationship between the solution set and the running result, and obtains the test result of the test case according to the target result and the running result corresponding to each solution set. Among them, the verification data includes the corresponding relationship between the solution set and the target result, because the solution set corresponding to the target result indicates the value of the variable of the expression to be tested when the target result is the result of the expression to be tested, and the target result includes the establishment of the expression to be tested and the failure of the expression to be tested. The running result corresponding to the solution set indicates the result of the expression to be tested after the test object takes the solution set as the value of the variable of the expression to be tested and executes the expression to be tested, and the running result includes the establishment of the expression to be tested and the failure of the expression to be tested. Therefore, by comparing the target result and the running result corresponding to the unified solution set, it is possible to obtain whether the test object executes the expression to be tested correctly, thereby obtaining the test result. Obviously, compared with the traditional manual testing scheme, the execution efficiency and timeliness of software functional testing are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0042] Figure 1 A flowchart of a specific implementation method of an automated testing method provided in an embodiment of the present application;

[0043] Figure 2 A schematic diagram of a test document provided in an embodiment of the present application;

[0044] Figure 3 A flowchart of a readable expression conversion method provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of a flow chart of an automated testing method provided in an embodiment of the present application;

[0046] Figure 5 A schematic diagram of the structure of an automated testing device provided in an embodiment of the present application;

[0047] Figure 6 A schematic diagram of the structure of an automated testing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0049] An automated testing method provided in an embodiment of the present application is applied to, but not limited to, the testing process of the test points of industrial control software, wherein the test points include, but are not limited to, operators, variable types, and functions. It can be seen that the test points include the smallest operation unit that implements the software function. Specifically, the method is applied to a software testing tool, which is connected to the industrial control software to be tested, can control the operation of the industrial control software, and can obtain the operation results of the industrial control software.

[0050] Figure 1 An automated testing method is provided in the embodiment of the present application, such as Figure 1 As shown, the method includes:

[0051] S101. Obtain a test document according to a test document template.

[0052] In this embodiment, the test document template is a preset Excel document, and the header of the test document template indicates various preset fields corresponding to the same test case, and the fields include but are not limited to: identification, original expression, data source information (including data source address and data source type), first solution set, second solution set, and test results. It should be noted that the fields are obtained by parameter extraction, and the details can be referred to the prior art.

[0053] like Figure 2 As shown in the figure, in the scenario of alarm function testing, the fields in the header of the test document template include: alarm name (AlarmName), alarm ID (AlarmID), expression (Expression), data source (TagName i), data source type (TagType i), first solution set (TagValue i_generate), and second solution set (TagValue i_ingenerate). It also includes: test result result and failed case error reason note.

[0054] The original expression can be composed of operators, constants, variables and functions, where the operators at least include relational operators, and the expression has true and false solution sets. For example, Figure 2 In the expression 1 shown in (the expression in the test case in the first row below the table header), "EXP_INT51" and "EXP_INT52" are variables, "INT" indicates the variable type, "TAG("var: / / [variable name]")" is a preset custom function, "+" is the addition operator, and ">" is the greater than relational operator. The alarm name and alarm ID are both preset field values, please refer to the prior art for details.

[0055] Where i is less than or equal to n, n is the number of variables in the expression, TagName i represents the data source of the i-th variable in the original expression, and TagType i represents the type of the data source of the i-th variable in the original expression. The first solution set (TagValue i_generate) is the value of the i-th variable in expression 1 when expression 1 is true, and the second solution set (TagValue i_ingenerate) is the value of the i-th variable in the original expression when expression 1 is false.

[0056] It should be noted that Figure 2 Only the original expression with 2 variables is taken as an example. In this embodiment, when the number of variables in the original expression is greater than 2, i is correspondingly greater than 2, which will not be described in detail.

[0057] In this embodiment, obtaining a test document according to a test document template includes:

[0058] The identification, original expression, and data source information of the test case are obtained, and recorded accordingly in the test document template to obtain a first test document.

[0059] It should be noted that the first test document includes the identification of the test case, the original expression, and the data source information, wherein the expression form of the original expression is the first grammatical expression, and the first grammatical expression is the preset expression form of the object under test (software).

[0060] Optionally, the original expression is obtained by orthogonal combination of preset test points. In this embodiment, a number of original expressions are obtained by covering all test points through an orthogonal combination method, and syntax coverage is performed by using operators, functions and different variable permutations and combinations, thereby improving the coverage of the test points by the original expression, that is, improving the coverage of the functional points of the functional test. It should be noted that the specific orthogonal combination method can be referred to in the prior art.

[0061] It should be noted that the number of solution sets can be one or more. This embodiment only takes the solution set including the first solution set and the second solution set as an example. Optionally, the first solution set is the solution set that makes the original expression valid (that is, the true solution set of the original expression), and the second solution set is the solution set that makes the original expression invalid (that is, the false solution set of the original expression).

[0062] S102. Use the original expression as the expression to be tested.

[0063] In the test process, test cases are obtained one by one according to the column number, and the expression to be tested in each test case is extracted from the first test document according to the first category of fields. For details, please refer to the prior art.

[0064] S103: Convert the expression to be tested into a readable expression.

[0065] For a specific method of converting the expression to be tested into a readable expression, see the following embodiment.

[0066] S104: Using the readable expression and data source information as script parameters, calling the first preset script to obtain verification data of the expression to be tested.

[0067] In this embodiment, the first preset script is used to obtain the values ​​of each variable to be measured with the target result as a condition, as a solution set corresponding to the target result.

[0068] In this embodiment, the data source information at least includes the correspondence between the order of the variable to be measured and the variable type, and the variable type is used to constrain the value range of the variable to be measured. The constraint rules are determined according to the preset data dictionary, and the details are referred to the prior art, which will not be described in detail in this embodiment.

[0069] In this embodiment, the verification data of the expression to be tested includes: a first solution set corresponding to the establishment of the expression to be tested, and a second solution set corresponding to the failure of the expression to be tested.

[0070] The method for obtaining the first solution set and the second solution set by the first preset script includes: taking the test expression as a condition, obtaining the value of each variable to be tested according to the variable type corresponding to the sequence of each variable to be tested, obtaining the true solution set of the test expression, and randomly obtaining the first solution set from the true solution set and outputting it. Taking the test expression as a condition that it is not established, obtaining the value of each variable to be tested according to the variable type corresponding to the sequence of each variable to be tested, obtaining the false solution set of the test expression, and randomly obtaining the second solution set from the false solution set and outputting it.

[0071] It should be noted that the readable expression of the expression to be tested is only a grammatical form of the expression to be tested. Therefore, the establishment of the expression to be tested is equivalent to the establishment of the readable expression, and the failure of the expression to be tested is equivalent to the failure of the readable expression.

[0072] It should be noted that, for any expression to be tested, if it is not the first time to obtain the verification data of the expression to be tested, a set of values ​​of the variables to be tested is randomly obtained again from the true solution set of the expression to be tested obtained for the first time, as the first solution set of the expression to be tested, and a set of values ​​of the variables to be tested is randomly obtained again from the false solution set of the expression to be tested obtained for the first time, as the second solution set of the expression to be tested. It can be seen that this method adopts a variable random value strategy to obtain the first solution set and / or the second solution set in the verification data, which, on the one hand, reduces the computational resource consumption of calculating the true solution set or the false solution set each time, and on the other hand, reduces the risk of missing defects due to test design, and improves the coverage and randomness of test data.

[0073] S105. Record the verification data of the expression to be tested into the first test document to obtain a second test document.

[0074] like Figure 2 As shown, the original expression is Expression 1, and the values ​​of each variable included in the first solution set are recorded in the first solution set field corresponding to Expression 1, and the values ​​of each variable included in the second solution set are recorded in the second solution set field corresponding to Expression 1.

[0075] It should be noted that if the verification data of the original expression is obtained for the nth time (n is greater than 1), it is only necessary to randomly select a group of values ​​from the several groups of values ​​obtained for the first time (with the target result as the result of the expression to be tested and the variables of the expression to be tested) as the solution set corresponding to the target result in the verification data process of obtaining the original expression this time.

[0076] S106: Obtain the execution result of the test case executed by the test object.

[0077] In this embodiment, the execution result includes a correspondence between a solution set and an operation result, and the operation result corresponding to the solution set indicates the result of the expression to be tested after the test object uses the solution set as the value of the variable of the expression to be tested and executes the expression to be tested. The test object executes the test case, specifically including: the test object uses the solution set as the value of the variable of the expression to be tested, runs the expression to be tested, and uses whether the expression to be tested is established as the operation result corresponding to the solution set. Among them, the operation result includes whether the expression to be tested is established and whether the expression to be tested is not established.

[0078] In this embodiment, the execution result of the test case executed by the test object is obtained through a preset interface, and the details can be referred to the prior art.

[0079] S107. Obtain the test result of the test case according to the target result and the running result corresponding to each solution set.

[0080] Specifically, if the target result and the running result corresponding to the first solution set are consistent, and the target result and the running result corresponding to the second solution set are consistent, the test result is passed.

[0081] If the target result and the running result corresponding to the first solution set are inconsistent, or the target result and the running result corresponding to the second solution set are inconsistent, the test result is failed.

[0082] It should be noted that

[0083] S108. Record the test results and log information into a second test document to obtain a result test document.

[0084] Specifically, Figure 2 As shown, the expression to be tested is expression 1. If the test result is passed, the pass mark (pass) is recorded in the test result field corresponding to expression 1. If the test result is not passed, the fail mark (fail) is recorded in the test result field corresponding to expression 1.

[0085] It should be noted that if the test result is failed, log information is obtained and recorded in the note field of the failed case error reason corresponding to Expression 1. It should be noted that the method of obtaining log information can be found in the prior art.

[0086] It can be seen from the above technical scheme that the method of automated testing provided by the embodiment of the present application obtains the expression to be tested and the verification data, obtains the execution result of the test case executed by the test object, and the execution result includes the corresponding relationship between the solution set and the running result. According to the target result and the running result corresponding to each solution set, the test result of the test case is obtained. Among them, the verification data includes the corresponding relationship between the solution set and the target result. Since the solution set corresponding to the target result indicates the value of the variable of the expression to be tested when the target result is the result of the expression to be tested, the target result includes the establishment of the expression to be tested and the failure of the expression to be tested. The running result corresponding to the solution set indicates the result of the expression to be tested after the test object uses the solution set as the value of the variable of the expression to be tested and executes the expression to be tested. The running result includes the establishment of the expression to be tested and the failure of the expression to be tested. Therefore, by comparing the target result and the running result corresponding to the same solution set, it is possible to obtain whether the test object executes the expression to be tested correctly, thereby obtaining the test result. Obviously, compared with the traditional manual testing scheme, the execution efficiency and timeliness of software functional testing are improved.

[0087] It should be noted that the automated testing method provided in the embodiments of the present application can also achieve the following beneficial effects:

[0088] 1. Convert the expression to be tested into a readable expression, and use the first preset script to automatically obtain the verification data of the expression to be tested. That is, this method provides a method for automatically obtaining verification data using a script, thereby improving the efficiency and accuracy of obtaining verification data.

[0089] 2. This method is applied to software testing tools. When the software testing tools automatically execute the automated testing method provided in the embodiments of this application, no human involvement is required and no additional test environment needs to be installed, thereby reducing the investment in testing resources and improving the efficiency of software automated testing implementation.

[0090] 3. Describe the expression test object and test action, and make the test action streamlined and standardized through parameter feature extraction.

[0091] 4. Set constraints on the expected test data, that is, through the data source information field, constrain the data range of the variable, and obtain the test input data solution set in a random manner. This can reduce the coupling between the test object, test action (the action of the test object executing the test case), and test case, reduce the modification cost and maintenance cost of the test program, and improve the operability and maintainability of the test.

[0092] 5. Use the preset test document template to obtain various test documents, and use readable and standardized language and format to describe and store test cases to ensure the readability and maintainability of test data.

[0093] Figure 3 This example shows a specific method for converting the expression to be tested into a readable expression. Figure 3 As shown, the method includes:

[0094] S301 . Identify, from an expression to be tested, a character string of a variable to be tested and a character string of a fixed quantity to be tested.

[0095] In this embodiment, the measured quantity includes the measured variable and the measured fixed quantity. The expression to be tested is recorded in the test document in the form of a first grammatical expression, wherein the first grammatical expression is a preset grammar of the software to be tested. That is, the character string of each variable to be tested is in the first expression form.

[0096] It should be noted that the method for identifying and obtaining the character string of the variable to be tested can refer to the prior art.

[0097] S302 : According to the character string of each variable to be measured, obtain the script character string of each variable to be measured and the sequence of the script character string.

[0098] In this embodiment, the script character strings are all second grammatical expressions, and the second grammatical expressions are programmable readable expressions, that is, expressions applied to the first preset script. The order of the script character string of the variable to be tested indicates the order of the variable to be tested in the variable sequence of the expression to be tested, and the variable sequence includes the variables to be tested arranged in a front-to-back order.

[0099] In this embodiment, the specific method of obtaining the script string of any variable to be measured includes:

[0100] A1. Use a regular expression to match the variable to be tested, and obtain a script string that matches the variable to be tested.

[0101] A2. Generalize the script string that matches the variable to be measured, and use the generalized script string as the script string of the variable to be measured.

[0102] It should be noted that, for all variables to be measured, the method further includes removing duplicate script strings of the variables to be measured to obtain the script strings of the variables to be measured and the order of the script strings of the variables to be measured.

[0103] It should be noted that this method uses the method of removing duplicates of the variables to be tested to retain the order of the original list elements. This is to ensure the validity of the verification data obtained when the variables are referenced multiple times in the same expression. And through generalization, the variables to be tested with the same mathematical meaning are standardized, so that the variables to be tested are not limited to specific variable names.

[0104] S303 , obtaining a script character string for each fixed quantity to be measured according to the character string for each fixed quantity to be measured.

[0105] In this embodiment, the specific method for obtaining the script string of any fixed quantity to be measured (recorded as the target fixed quantity to be measured) includes:

[0106] B1. Obtain a conversion dictionary, where the conversion dictionary includes a mapping relationship between a string of a fixed quantity to be measured and a script string.

[0107] In this embodiment, script strings are all recorded in the form of programming readable expressions (ie, second language expressions), and the conversion dictionary includes: a temporary replacement dictionary, a universal replacement dictionary, and a specific language replacement script dictionary.

[0108] The temporary replacement dictionary stores the mapping relationship between the first type of fixed variables and the script string. The first type of fixed variables includes operators or functions that are easily confused. For example, negation "!" and not equal to "!=" are to replace easily confused strings.

[0109] The general replacement dictionary stores the mapping relationship between the second type of fixed variables and the script string. The second type of fixed variables includes general operators and functions. For example, logical operators are represented in the same form in all function libraries of a programming language.

[0110] The specific language replacement script dictionary stores the mapping relationship between the third type of fixed quantities and the script string. The third type of fixed quantities includes operators and functions of the programming language function library, as well as temporarily matched functions or operators.

[0111] B2. If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the conversion dictionary is used as the script string of the fixed quantity to be measured.

[0112] B3. If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is directly used as the script character string of the target fixed quantity to be measured.

[0113] S304 , generating a readable expression of the expression to be tested according to the script character string of the variable to be tested and the script character string of the fixed quantity to be tested.

[0114] Figure 3The example of the present application embodiment provides a method for obtaining a readable expression of an expression to be tested, obtains the readable expression of the expression to be tested, takes the readable expression and the data source information as the script parameters, calls the first preset script, and obtains the verification data of the expression to be tested, wherein the verification data includes the target result and the solution set corresponding to the target result, and the target result includes the readable expression being established and / or not established. Since the variable to be tested and the fixed quantity to be tested in the expression to be tested, the data source information includes the corresponding relationship between the variable to be tested and the variable type, and the variable type indicates the value range, the first preset script is used to obtain the value of each variable to be tested with the target result as the condition, as the solution set corresponding to the target result, therefore, the method can automatically obtain the verification data of the expression to be tested by converting the expression to be tested into a readable expression and using the first preset script. Further, the mapping relationship between the fixed quantity to be tested (operator and function) and the script string (second expression form) is pre-stored in a classified dictionary manner, which improves the efficiency of obtaining the script string of the fixed quantity to be tested. The data value range of the variable type is stored in a dictionary manner, and the value of the variable to be tested is constrained to ensure the correctness of the value of the variable to be tested.

[0115] It should be noted that Figure 1 The process shown is only a specific implementation of an optional automated testing method provided in the embodiment of the present application. The present application also includes other specific implementation methods, for example, Figure 3 This is only an optional method for obtaining a readable expression of an expression to be tested. In other implementation methods, other methods for obtaining the expression are also included. For details, please refer to the prior art. For another example, S108 is an optional step.

[0116] In summary, the method of automated testing provided in the embodiment of the present application is summarized as follows: Figure 4 The process shown is as follows Figure 4 As shown, the method includes:

[0117] S401. Obtain test cases.

[0118] In this embodiment, the test case includes an expression to be tested and verification data of the expression to be tested. The expression to be tested includes variables to be tested and fixed quantities to be tested. The verification data includes the correspondence between a solution set and a target result. The solution set corresponding to the target result includes the values ​​of each variable to be tested under the condition of the target result. The target result includes whether the expression to be tested is true or false.

[0119] It should be noted that the expression to be tested includes fixed values ​​and variables, representing at least one functional test point. There are multiple methods for obtaining the expression to be tested. An optional method for obtaining the expression to be tested and its verification data is shown in the above embodiment. Another optional method for obtaining the expression to be tested and its verification data is to use the expression to be tested and its verification data in the historical test data as the expression to be tested and its verification data of the test method provided in this application.

[0120] S402: Obtain the execution result of the test case executed by the test object.

[0121] In this embodiment, the execution result includes the correspondence between the solution set and the running result. The running result corresponding to the solution set indicates that the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested. The running result includes whether the expression to be tested is true or false.

[0122] S403: Obtain the test result of the test case according to the target result and the running result corresponding to each solution set.

[0123] In this embodiment, the test result of the test case indicates whether the test object passes the test case, that is, whether the test object correctly implements each function indicated by the expression to be tested in the test case.

[0124] It can be seen from the above technical scheme that the method of automated testing provided by the embodiment of the present application obtains the expression to be tested and the verification data, obtains the execution result of the test case executed by the test object, and the execution result includes the corresponding relationship between the solution set and the running result. According to the target result and the running result corresponding to each solution set, the test result of the test case is obtained. Among them, the verification data includes the corresponding relationship between the solution set and the target result. Since the solution set corresponding to the target result indicates the value of the variable of the expression to be tested when the target result is the result of the expression to be tested, the target result includes the establishment of the expression to be tested and the failure of the expression to be tested. The running result corresponding to the solution set indicates the result of the expression to be tested after the test object uses the solution set as the value of the variable of the expression to be tested and executes the expression to be tested. The running result includes the establishment of the expression to be tested and the failure of the expression to be tested. Therefore, by comparing the target result and the running result corresponding to the same solution set, it is possible to obtain whether the test object executes the expression to be tested correctly, thereby obtaining the test result. Obviously, compared with the traditional manual testing scheme, the execution efficiency and timeliness of software functional testing are improved.

[0125] Figure 5 A schematic diagram of the structure of an automated testing device provided in an embodiment of the present application is shown. Figure 5 As shown, the device may include:

[0126] A test case acquisition unit 501 is used to acquire a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, wherein the expression to be tested includes a variable to be tested and a fixed quantity to be tested, wherein the verification data includes a correspondence between a solution set and a target result, wherein the solution set corresponding to the target result includes the values ​​of each variable to be tested under the condition of the target result, and wherein the target result includes the establishment of the expression to be tested and the failure of the expression to be tested;

[0127] An execution result acquisition unit 502 is used to acquire the execution result of the test object executing the test case, wherein the execution result includes a correspondence between a solution set and an operation result, wherein the operation result corresponding to the solution set indicates the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, and the operation result includes whether the expression to be tested is established or not established;

[0128] The test result acquisition unit 503 is used to acquire the test result of the test case according to the target result and the running result corresponding to each solution set.

[0129] Optionally, the method further comprises a document generation unit, which is used for, before obtaining the test case, obtaining a first test document according to a preset test document template, wherein the first test document comprises a preset first-category field, wherein the first-category field comprises an identifier, an original expression, and data source information; the data source information comprises a correspondence between a variable to be measured and a variable type, wherein the variable type of the variable to be measured indicates a value range of the variable to be measured;

[0130] Optionally, a test case acquisition unit is used to acquire test cases, including: the test case acquisition unit is specifically used to: use the original expression as the expression to be tested; convert the expression to be tested into a readable expression; use the readable expression and the data source information as script parameters, call a first preset script, and obtain verification data of the expression to be tested; the first preset script is used to obtain the values ​​of each of the variables to be tested with the target result as a condition, as a solution set corresponding to the target result.

[0131] Optionally, the test case acquisition unit is used to convert the expression to be tested into a readable expression, including: the test case acquisition unit is specifically used to:

[0132] From the expression to be tested, identifying the character string of each variable to be tested and the character string of each fixed quantity to be tested;

[0133] According to the character string of each variable to be measured, the script character string of each variable to be measured and the order of the script character string are obtained; the script character string of the variable to be measured is an expression form applied to the first preset script;

[0134] According to the character string of each fixed quantity to be measured, a script character string of each fixed quantity to be measured is obtained; the script character string of the fixed quantity to be measured is an expression form applied to the first preset script;

[0135] A readable expression of the expression to be tested is generated according to the script character string of each of the variables to be tested and the script character string of each of the fixed quantities to be tested.

[0136] Optionally, the test case acquisition unit is used to acquire the script string of the target variable to be tested and the order of the script string according to the string of the target variable to be tested, wherein the target variable to be tested is any variable to be tested, including: the test case acquisition unit is specifically used to:

[0137] Using a regular expression to match the target variable to be measured to obtain a script string that matches the target variable to be measured;

[0138] Performing generalization processing on the script character string that matches the target variable to be measured, and using the generalization processing result as the script character string of the target variable to be measured;

[0139] The sequence of the target variable to be tested in a variable sequence is obtained as the sequence of the script character string of the target variable to be tested, wherein the variable sequence includes the variables to be tested in the expression to be tested arranged in a front-to-back order.

[0140] Optionally, the test case acquisition unit is used to acquire a script string of the target fixed quantity to be tested according to the string of the target fixed quantity to be tested, wherein the target fixed quantity to be tested is any fixed quantity to be tested, including: the test case acquisition unit is specifically used to:

[0141] If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the preset conversion dictionary is used as the script string of the target fixed quantity to be measured; the conversion dictionary includes a mapping relationship between the string of each fixed quantity to be measured and the script string;

[0142] If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is used as the script character string of the target fixed quantity to be measured.

[0143] Optionally, a test result acquisition unit is used to acquire the test result of the test case according to the target result and the running result corresponding to each solution set, including: the test result acquisition unit is specifically used to:

[0144] If there is at least one set of solution sets whose corresponding target results and running results are inconsistent, the test result of the test case is failure;

[0145] If the target results and running results corresponding to all solution sets are consistent, the test result of the test case is passed.

[0146] Optionally, the document generation unit is further used for: after calling the first preset script with the readable expression and the data source information as script parameters to obtain the verification data of the expression to be tested, recording the verification data of the expression to be tested as the second type of field into the first test document to generate a second test document;

[0147] Optionally, the document generation unit is also used to: after obtaining the test results of the test case based on the target results and running results corresponding to each solution set, record the test results and log information as the third type of field in the second test document to generate a result test document.

[0148] Figure 6 The schematic diagram of the structure of the automated testing device is shown, and the device may include: at least one processor 601, at least one communication interface 602, at least one memory 603 and at least one communication bus 604;

[0149] In the embodiment of the present application, the number of the processor 601, the communication interface 602, the memory 603, and the communication bus 604 is at least one, and the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604;

[0150] The processor 601 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention;

[0151] The memory 603 may include a high-speed RAM memory, and may also include a non-volatile memory, such as at least one disk memory;

[0152] The memory stores a program, and the processor can execute the program stored in the memory to implement various steps of an automated testing method provided in an embodiment of the present application, as follows:

[0153] Obtain a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, wherein the expression to be tested includes a variable to be tested and a fixed quantity to be tested, wherein the verification data includes a correspondence between a solution set and a target result, wherein the solution set corresponding to the target result includes values ​​of each variable to be tested under the condition of the target result, and wherein the target result includes whether the expression to be tested is true or false;

[0154] Obtaining the execution result of the test case executed by the test object, the execution result including the correspondence between the solution set and the running result, the running result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the running result including whether the expression to be tested is established or not established;

[0155] The test results of the test cases are obtained according to the target results and the running results corresponding to each of the solution sets.

[0156] Optionally, before obtaining the test case, the method further includes: obtaining a first test document according to a preset test document template, wherein the first test document includes a preset first-category field, wherein the first-category field includes an identifier, an original expression, and data source information; the data source information includes a correspondence between a variable to be measured and a variable type, wherein the variable type of the variable to be measured indicates a value range of the variable to be measured;

[0157] The obtaining of test cases comprises:

[0158] Taking the original expression as the expression to be tested;

[0159] Convert the expression to be tested into a readable expression;

[0160] With the readable expression and the data source information as script parameters, the first preset script is called to obtain the verification data of the expression to be tested; the first preset script is used to obtain the values ​​of each variable to be tested with the target result as the condition, as the solution set corresponding to the target result.

[0161] Optionally, converting the expression to be tested into a readable expression includes:

[0162] From the expression to be tested, identifying the character string of each variable to be tested and the character string of each fixed quantity to be tested;

[0163] According to the character string of each variable to be measured, the script character string of each variable to be measured and the order of the script character string are obtained; the script character string of the variable to be measured is an expression form applied to the first preset script;

[0164] According to the character string of each fixed quantity to be measured, a script character string of each fixed quantity to be measured is obtained; the script character string of the fixed quantity to be measured is an expression form applied to the first preset script;

[0165] A readable expression of the expression to be tested is generated according to the script character string of each of the variables to be tested and the script character string of each of the fixed quantities to be tested.

[0166] Optionally, according to the character string of the target variable to be measured, the script character string of the target variable to be measured and the order of the script character string are obtained, and the target variable to be measured is any variable to be measured, including:

[0167] Using a regular expression to match the target variable to be measured to obtain a script string that matches the target variable to be measured;

[0168] Performing generalization processing on the script character string that matches the target variable to be measured, and using the generalization processing result as the script character string of the target variable to be measured;

[0169] The sequence of the target variable to be tested in a variable sequence is obtained as the sequence of the script character string of the target variable to be tested, wherein the variable sequence includes the variables to be tested in the expression to be tested arranged in a front-to-back order.

[0170] Optionally, according to a character string of a target fixed quantity to be measured, a script character string of the target fixed quantity to be measured is obtained, wherein the target fixed quantity to be measured is any fixed quantity to be measured, including:

[0171] If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the preset conversion dictionary is used as the script string of the target fixed quantity to be measured; the conversion dictionary includes a mapping relationship between the string of each fixed quantity to be measured and the script string;

[0172] If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is used as the script character string of the target fixed quantity to be measured.

[0173] Optionally, obtaining the test result of the test case according to the target result and the running result corresponding to each of the solution sets includes:

[0174] If there is at least one set of solution sets whose corresponding target results and running results are inconsistent, the test result of the test case is failure;

[0175] If the target results and running results corresponding to all solution sets are consistent, the test result of the test case is passed.

[0176] Optionally, after the first preset script is called with the readable expression and the data source information as script parameters to obtain verification data of the expression to be tested, the method further includes:

[0177] Record the verification data of the expression to be tested as a second type of field into the first test document to generate a second test document;

[0178] After obtaining the test result of the test case according to the target result and the running result corresponding to each solution set, the method further includes:

[0179] The test results and log information are recorded as the third type of fields in the second test document to generate a result test document.

[0180] The embodiment of the present application further provides a readable storage medium, which can store a computer program suitable for execution by a processor. When the computer program is executed by the processor, the steps of an automated testing method provided in the embodiment of the present application are implemented as follows:

[0181] Obtain a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, wherein the expression to be tested includes a variable to be tested and a fixed quantity to be tested, wherein the verification data includes a correspondence between a solution set and a target result, wherein the solution set corresponding to the target result includes values ​​of each variable to be tested under the condition of the target result, and wherein the target result includes whether the expression to be tested is true or false;

[0182] Obtaining the execution result of the test case executed by the test object, the execution result including the correspondence between the solution set and the running result, the running result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the running result including whether the expression to be tested is established or not established;

[0183] The test results of the test cases are obtained according to the target results and the running results corresponding to each of the solution sets.

[0184] Optionally, before obtaining the test case, the method further includes: obtaining a first test document according to a preset test document template, wherein the first test document includes a preset first-category field, wherein the first-category field includes an identifier, an original expression, and data source information; the data source information includes a correspondence between a variable to be measured and a variable type, wherein the variable type of the variable to be measured indicates a value range of the variable to be measured;

[0185] The obtaining of test cases comprises:

[0186] Taking the original expression as the expression to be tested;

[0187] Convert the expression to be tested into a readable expression;

[0188] With the readable expression and the data source information as script parameters, the first preset script is called to obtain the verification data of the expression to be tested; the first preset script is used to obtain the values ​​of each variable to be tested with the target result as the condition, as the solution set corresponding to the target result.

[0189] Optionally, converting the expression to be tested into a readable expression includes:

[0190] From the expression to be tested, identifying the character string of each variable to be tested and the character string of each fixed quantity to be tested;

[0191] According to the character string of each variable to be measured, the script character string of each variable to be measured and the order of the script character string are obtained; the script character string of the variable to be measured is an expression form applied to the first preset script;

[0192] According to the character string of each fixed quantity to be measured, a script character string of each fixed quantity to be measured is obtained; the script character string of the fixed quantity to be measured is an expression form applied to the first preset script;

[0193] A readable expression of the expression to be tested is generated according to the script character string of each of the variables to be tested and the script character string of each of the fixed quantities to be tested.

[0194] Optionally, according to the character string of the target variable to be measured, the script character string of the target variable to be measured and the order of the script character string are obtained, and the target variable to be measured is any variable to be measured, including:

[0195] Using a regular expression to match the target variable to be measured to obtain a script string that matches the target variable to be measured;

[0196] Performing generalization processing on the script character string that matches the target variable to be measured, and using the generalization processing result as the script character string of the target variable to be measured;

[0197] The sequence of the target variable to be tested in a variable sequence is obtained as the sequence of the script character string of the target variable to be tested, wherein the variable sequence includes the variables to be tested in the expression to be tested arranged in a front-to-back order.

[0198] Optionally, according to a character string of a target fixed quantity to be measured, a script character string of the target fixed quantity to be measured is obtained, wherein the target fixed quantity to be measured is any fixed quantity to be measured, including:

[0199] If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the preset conversion dictionary is used as the script string of the target fixed quantity to be measured; the conversion dictionary includes a mapping relationship between the string of each fixed quantity to be measured and the script string;

[0200] If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is used as the script character string of the target fixed quantity to be measured.

[0201] Optionally, obtaining the test result of the test case according to the target result and the running result corresponding to each of the solution sets includes:

[0202] If there is at least one set of solution sets whose corresponding target results and running results are inconsistent, the test result of the test case is failure;

[0203] If the target results and running results corresponding to all solution sets are consistent, the test result of the test case is passed.

[0204] Optionally, after the first preset script is called with the readable expression and the data source information as script parameters to obtain verification data of the expression to be tested, the method further includes:

[0205] Record the verification data of the expression to be tested as a second type of field into the first test document to generate a second test document;

[0206] After obtaining the test result of the test case according to the target result and the running result corresponding to each solution set, the method further includes:

[0207] The test results and log information are recorded as the third type of fields in the second test document to generate a result test document.

[0208] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0209] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0210] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An automated testing method, characterized in that: include: Obtain a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, wherein the expression to be tested includes a variable to be tested and a fixed quantity to be tested, wherein the verification data includes a correspondence between a solution set and a target result, wherein the solution set corresponding to the target result includes values ​​of each variable to be tested under the condition of the target result, and wherein the target result includes whether the expression to be tested is true or false; Obtaining the execution result of the test case executed by the test object, the execution result including the correspondence between the solution set and the running result, the running result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the running result including whether the expression to be tested is established or not established; Obtaining the test results of the test cases according to the target results and the running results corresponding to each of the solution sets; The verification data of the expression to be tested includes: a first solution set corresponding to the establishment of the expression to be tested, and a second solution set corresponding to the failure of the expression to be tested. Obtaining the first solution set and the second solution set includes: Taking the establishment of the expression to be tested as a condition, obtaining the value of each variable to be tested according to the variable type corresponding to the order of each variable to be tested, obtaining the true solution set of the expression to be tested, and randomly obtaining the first solution set from the true solution set and outputting it; the variable type of the variable to be tested indicates the value range of the variable to be tested; On the condition that the expression to be tested is not true, the value of each variable to be tested is obtained according to the variable type corresponding to the order of each variable to be tested, and a false solution set of the expression to be tested is obtained. From the false solution set, a second solution set is randomly obtained and output.

2. The method according to claim 1, characterized in that: Before obtaining the test case, the method further includes: obtaining a first test document according to a preset test document template, wherein the first test document includes a preset first type of field, wherein the first type of field includes an identifier, an original expression, and data source information; the data source information includes a correspondence between each of the variables to be tested and a variable type, wherein the variable type of the variable to be tested indicates a value range of the variable to be tested; The obtaining of test cases comprises: Taking the original expression as the expression to be tested; Convert the expression to be tested into a readable expression; With the readable expression and the data source information as script parameters, the first preset script is called to obtain the verification data of the expression to be tested; the first preset script is used to obtain the values ​​of each variable to be tested with the target result as the condition, as the solution set corresponding to the target result.

3. The method according to claim 2, characterized in that The converting the expression to be tested into a readable expression comprises: From the expression to be tested, identifying the character string of each variable to be tested and the character string of each fixed quantity to be tested; According to the character string of each variable to be measured, the script character string of each variable to be measured and the order of the script character string are obtained; the script character string of the variable to be measured is an expression form applied to the first preset script; According to the character string of each fixed quantity to be measured, a script character string of each fixed quantity to be measured is obtained; the script character string of the fixed quantity to be measured is an expression form applied to the first preset script; A readable expression of the expression to be tested is generated according to the script character string of each of the variables to be tested and the script character string of each of the fixed quantities to be tested.

4. The method according to claim 3, characterized in that According to the character string of the target variable to be measured, the script character string of the target variable to be measured and the order of the script character string are obtained, wherein the target variable to be measured is any variable to be measured, including: Using a regular expression to match the target variable to be measured to obtain a script string that matches the target variable to be measured; Performing generalization processing on the script character string that matches the target variable to be measured, and using the generalization processing result as the script character string of the target variable to be measured; The sequence of the target variable to be tested in a variable sequence is obtained as the sequence of the script character string of the target variable to be tested, wherein the variable sequence includes the variables to be tested in the expression to be tested arranged in a front-to-back order.

5. The method according to claim 3, characterized in that: According to the character string of the target fixed quantity to be measured, a script character string of the target fixed quantity to be measured is obtained, where the target fixed quantity to be measured is any fixed quantity to be measured, including: If the target fixed quantity to be measured is a function or an operator, the script string corresponding to the target fixed quantity to be measured in the preset conversion dictionary is used as the script string of the target fixed quantity to be measured; the conversion dictionary includes a mapping relationship between the string of each fixed quantity to be measured and the script string; If the target fixed quantity to be measured is a constant, the character string of the target fixed quantity to be measured is used as the script character string of the target fixed quantity to be measured.

6. The method according to claim 1, characterized in that The step of obtaining the test result of the test case according to the target result and the running result corresponding to each solution set includes: If there is at least one set of solution sets whose corresponding target results and running results are inconsistent, the test result of the test case is failure; If the target results and running results corresponding to all solution sets are consistent, the test result of the test case is passed.

7. The method according to claim 2, characterized in that: After the first preset script is called with the readable expression and the data source information as script parameters to obtain the verification data of the expression to be tested, the method further includes: Record the verification data of the expression to be tested as a second type of field into the first test document to generate a second test document; After obtaining the test result of the test case according to the target result and the running result corresponding to each solution set, the method further includes: The test results and log information are recorded as the third type of fields in the second test document to generate a result test document.

8. An automated testing device, characterized in that: include: A test case acquisition unit, used to acquire a test case, wherein the test case includes an expression to be tested and verification data of the expression to be tested, the expression to be tested includes a variable to be tested and a fixed quantity to be tested, the verification data includes a correspondence between a solution set and a target result, the solution set corresponding to the target result includes the values ​​of each variable to be tested under the condition of the target result, and the target result includes the establishment of the expression to be tested and the failure of the expression to be tested; an execution result acquisition unit, used to acquire the execution result of the test object executing the test case, the execution result including the correspondence between the solution set and the operation result, the operation result corresponding to the solution set indicating the result after the test object uses the solution set as the value of the variable to be tested and executes the expression to be tested, the operation result including whether the expression to be tested is established or not established; A test result acquisition unit, used to acquire the test result of the test case according to the target result and the running result corresponding to each solution set; The verification data of the expression to be tested includes: a first solution set corresponding to the establishment of the expression to be tested, and a second solution set corresponding to the failure of the expression to be tested. Obtaining the first solution set and the second solution set includes: Taking the establishment of the expression to be tested as a condition, obtaining the value of each variable to be tested according to the variable type corresponding to the order of each variable to be tested, obtaining the true solution set of the expression to be tested, and randomly obtaining the first solution set from the true solution set and outputting it; the variable type of the variable to be tested indicates the value range of the variable to be tested; On the condition that the expression to be tested is not true, the value of each variable to be tested is obtained according to the variable type corresponding to the order of each variable to be tested, a false solution set of the expression to be tested is obtained, and a second solution set is randomly obtained from the false solution set and output.

9. An automated testing device, characterized in that: include: Memory and processor; The memory is used to store programs; The processor is used to execute the program to implement each step of the automated testing method according to any one of claims 1 to 7.

10. A readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, each step of the automated testing method according to any one of claims 1 to 7 is implemented.

Images