Software testing method, device and electronic equipment

Abstract

The present invention provides a software testing method, device and electronic device, which can be applied to software testing, database and computer technology fields. The method comprises: based on the function to be tested of the target software, checking the environment dependency required for the test environment to execute the function to be tested, wherein the environment dependency includes the environment configuration when the expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes the software dependency; when it is determined that the test environment does not meet the software dependency, creating a virtual environment in the test environment; based on the environment dependency, configuring a virtual data table and character set category for executing the function to be tested in the virtual environment; executing the function to be tested of the target software in the virtual environment to obtain the execution result; determining the test result based on the execution result and the expected result.

Description

Technical Field

[0001] The present invention relates to the fields of software testing, database and computer technology, and in particular to a software testing method, device and electronic equipment. Background Art

[0002] During the software life cycle, after developers modify the software code to update the software or fix existing vulnerabilities, testers are required to perform regression testing on the updated software to analyze whether the original functions of the software can run normally and determine whether the modification has introduced new errors. This ensures that the software can maintain its original functions and performance after the update and keep the software running normally.

[0003] In the process of implementing the present invention, it is found that there are at least the following problems in the prior art: when determining the results of existing regression tests, the actual test results are usually compared with the expected results of the function, and whether the test is passed is determined by comparing the results. However, in the actual testing process, the version difference of the object under test, the difference between the test environment for executing the test and the environment when the expected results are obtained, and other reasons may lead to different results when executing the same use case. Determining the regression test results only by the actual test results and the expected results can easily lead to misjudgment of the software function, and it is necessary to eliminate the misjudgment through manual analysis, resulting in high labor costs, low test efficiency, and difficulty in ensuring test accuracy. Summary of the invention

[0004] In view of the above problems, the present invention provides a software testing method, device and electronic device.

[0005] According to a first aspect of the present invention, a software testing method is provided, comprising: based on a function to be tested of a target software, checking environmental dependencies required for a test environment to execute the function to be tested, wherein the environmental dependencies include an environment configuration when an expected result is obtained, the expected result is a result obtained by executing the function to be tested before the target software is updated, and the environmental dependencies include software dependencies; in the case where it is determined that the test environment does not satisfy the software dependencies, creating a virtual environment in the test environment; based on the environmental dependencies, configuring a virtual data table and a character set category for executing the function to be tested in the virtual environment, wherein the virtual data table includes one or more data columns, the data in the one or more data columns is obtained from a source database table, the source database is determined according to the execution logic of the function to be tested, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result; executing the function to be tested of the target software in the virtual environment to obtain an execution result; and determining the test result based on the execution result and the expected result.

[0006] According to an embodiment of the present invention, based on environment dependencies, virtual data tables and character set categories for executing functions to be tested are configured in a virtual environment, including: when the test environment does not meet the software dependencies, determining the source database tables and character set categories included in the software dependencies; based on the source data in the source database tables, creating a virtual data table in the test environment and filling the source data into the virtual data table; based on the character set category, setting the character set of the virtual environment; and determining the virtual environment based on the virtual data table and the character set of the test environment.

[0007] According to an embodiment of the present invention, based on source data in a source database table, a virtual data table is created in a test environment and the source data is filled into the virtual data table, including: based on a function to be tested, determining one or more data table columns in the source database table that need to be called when executing the function to be tested; determining a database server where the source database table is located; determining an available server for connecting to the database server; controlling the available server to connect to the database server and obtain data of one or more data table columns from the source data table; and creating a virtual data table based on the data of the one or more data table columns and filling the source data into the virtual data table.

[0008] According to an embodiment of the present invention, a function to be tested of a target software is executed in a virtual environment to obtain an execution result, including: updating the function to be tested based on a source database table and a virtual data table to obtain an updated function to be tested; and executing the updated function to be tested in the virtual environment to obtain an execution result.

[0009] According to an embodiment of the present invention, based on the source database table and the virtual data table, the function to be tested is updated to obtain an updated function to be tested, including: parsing the function to be tested based on the source database table to determine a first keyword used to characterize the call relationship; generating a second keyword based on the virtual data table; and replacing the first keyword in the function to be tested with the second keyword to obtain an updated function to be tested.

[0010] According to an embodiment of the present invention, environmental dependency also includes hardware dependency, wherein the hardware dependency includes hardware performance requirements of respective multiple hardware categories required for executing the function to be tested; based on the function to be tested of the target software, checking the environmental dependency required for the test environment to execute the function to be tested, including: determining the source database table and one or more data table columns in the source database table based on the operation log of executing the function to be tested before the target software is updated; determining the character set category of the expected result application; determining the hardware dependency for executing the function to be tested based on the operation log; and determining the environmental dependency based on the source database table, one or more data table columns in the source database table, the character set category and the hardware dependency.

[0011] According to an embodiment of the present invention, the software testing method also includes: when it is determined that the test environment does not meet the hardware dependencies, determining the hardware to be upgraded that does not meet the hardware performance requirements from multiple hardware categories included in the hardware dependencies; and sending the hardware to be upgraded and the hardware performance requirements corresponding to the hardware to be upgraded to the operation and maintenance personnel.

[0012] According to an embodiment of the present invention, a test result is determined based on the execution result and the expected result, including: comparing the execution result and the expected result to determine the comparison result; when the comparison result indicates that the execution result and the expected result are consistent, it indicates that the function to be tested has passed the test; and when the comparison result indicates that the execution result and the expected result are inconsistent, it indicates that the function to be tested has failed the test.

[0013] A second aspect of the present invention provides a software testing device, comprising:

[0014] An environment check module is used to check the environment dependency required for the test environment to execute the function to be tested based on the function to be tested of the target software, wherein the environment dependency includes the environment configuration when the expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes the software dependency;

[0015] An environment creation module, used to create a virtual environment in the test environment when it is determined that the test environment does not satisfy the software dependency;

[0016] An environment configuration module is used to configure a virtual data table and a character set category for executing the function to be tested in a virtual environment based on the environment dependency, wherein the virtual data table includes one or more data columns, the data in the one or more data columns is obtained from a source database, the source database is determined according to the execution logic of the function to be tested, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result;

[0017] Functional testing module, used to execute the function to be tested of the target software in a virtual environment and obtain the execution result;

[0018] The result determination module is used to determine the test result based on the execution result and the expected result.

[0019] A third aspect of the present invention provides an electronic device, comprising: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0020] The fourth aspect of the present invention further provides a computer-readable storage medium on which a computer program or instruction is stored, and the steps of the above method are implemented when the above computer program or instruction is executed by a processor.

[0021] The fifth aspect of the present invention also provides a computer program product, including a computer program or instructions, which implement the steps of the above method when executed by a processor.

[0022] According to an embodiment of the present invention, the test environment is detected based on the function to be tested. When the test environment does not meet the environmental dependency of the function to be tested, a virtual environment is created and configured to meet the environmental dependency, thereby reducing the high requirements for the test environment during the software testing process and reducing the impact of the test environment on the software testing results, thereby ensuring that the test results can normally reflect the functional status of the target software after the update, improving the accuracy of the software testing, and improving the feasibility and testing efficiency of the software testing. In addition, by creating and configuring a virtual environment, the problem of the test environment not meeting the software dependency is eliminated, and the labor cost of analyzing the test environment when the software test fails can also be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above contents and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0024] Figure 1 An application scenario diagram of a software testing method, device, and electronic device according to an embodiment of the present invention is shown.

[0025] Figure 2 A flow chart of a software testing method according to an embodiment of the present invention is shown.

[0026] Figure 3 A flowchart of a software testing method according to another embodiment of the present invention is shown.

[0027] Figure 4 A structural block diagram of a software testing device according to an embodiment of the present invention is shown.

[0028] Figure 5 A block diagram of an electronic device suitable for implementing a software testing method according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0029] Below, embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present invention. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of embodiments of the present invention. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of concepts of the present invention.

[0030] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0031] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0032] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0033] In the technical solution of the present invention, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0034] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present invention provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating an individual's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0035] An embodiment of the present invention provides a software testing method, comprising: based on a function to be tested of a target software, checking the environment dependency required for a test environment to execute the function to be tested, wherein the environment dependency includes the environment configuration when an expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes software dependency; when it is determined that the test environment does not meet the software dependency, creating a virtual environment in the test environment; based on the environment dependency, configuring a virtual data table and a character set category for executing the function to be tested in the virtual environment, wherein the virtual data table includes one or more data columns, the data in the one or more data columns is obtained from a source database table, the source database is determined according to the execution logic of the function to be tested, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result; executing the function to be tested of the target software in the virtual environment to obtain an execution result; and determining the test result based on the execution result and the expected result.

[0036] Figure 1 An application scenario diagram of a software testing method, device, and electronic device according to an embodiment of the present invention is shown.

[0037] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0038] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0039] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0040] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0041] It should be noted that the software testing method provided in the embodiment of the present invention can generally be executed by the server 105. Accordingly, the software testing device provided in the embodiment of the present invention can generally be set in the server 105. The software testing method provided in the embodiment of the present invention can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the software testing device provided in the embodiment of the present invention can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0042] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0043] The following will be based on Figure 1 The scene described by Figure 2~Figure 3 The software testing method according to the embodiment of the present invention is described in detail.

[0044] Figure 2 A flow chart of a software testing method according to an embodiment of the present invention is shown.

[0045] like Figure 2 As shown, the software testing method of this embodiment includes operations S210 to S250.

[0046] In operation S210 , based on the function to be tested of the target software, the environment dependency required for the test environment to execute the function to be tested is checked.

[0047] According to an embodiment of the present invention, the target software is software that has undergone version update and needs to undergo regression testing, and the target software includes one or more functions. The function to be tested is a function that has undergone version update among the one or more functions of the target software.

[0048] According to an embodiment of the present invention, the test environment and the target software can be configured on the same server for regression testing of the function to be tested. The environment dependency includes the environment configuration when the expected result is obtained. The expected result is the result obtained by executing the function to be tested before the target software is updated. The environment dependency includes software dependency, such as interface connection status, database link status, etc.

[0049] In operation S220 , if it is determined that the test environment does not satisfy the software dependency, a virtual environment is created in the test environment.

[0050] According to an embodiment of the present invention, it can be determined that the test environment does not meet the software dependency when the server where the test environment is located has not established a connection with the server where the database to be called by the function to be tested is located, the server where the test environment is located has not been configured with the interface required to execute the function to be tested, etc. In the case where it is determined that the test environment does not meet the software dependency, if the function to be tested is directly executed in the current test environment, the result obtained will be affected by the software dependency and may not correctly reflect the actual situation of the function to be tested.

[0051] According to an embodiment of the present invention, a virtual environment can be created in a test environment and configured according to environment dependencies so that the virtual environment satisfies the environment dependencies and the function to be tested is executed in the virtual environment to avoid the influence of the environment on the test results.

[0052] In operation S230 , based on the environment dependency, a virtual data table and a character set category for executing the function to be tested are configured in the virtual environment.

[0053] According to an embodiment of the present invention, the virtual data table includes one or more data columns, the data in the one or more data columns are obtained from a source database table, the source database is determined according to the execution logic of the function to be tested, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result.

[0054] According to an embodiment of the present invention, based on the environment dependency, a virtual data table is configured in the virtual environment, and data in a data column obtained from a source database table is imported into the virtual data table. The character set category of the virtual environment is configured to be the same as the environment dependency.

[0055] In operation S240 , the function to be tested of the target software is executed in the virtual environment to obtain an execution result.

[0056] In operation S250 , a test result is determined based on the execution result and the expected result.

[0057] According to an embodiment of the present invention, the execution result is compared with the expected result, and based on the comparison result, the test result of the regression test can be determined.

[0058] According to an embodiment of the present invention, the test environment is detected based on the function to be tested. When the test environment does not meet the environmental dependency of the function to be tested, a virtual environment is created and configured to meet the environmental dependency, thereby reducing the high requirements for the test environment during the software testing process and reducing the impact of the test environment on the software testing results, thereby ensuring that the test results can normally reflect the functional status of the target software after the update, improving the accuracy of the software testing, and improving the feasibility and testing efficiency of the software testing. In addition, by creating and configuring a virtual environment, the problem of the test environment not meeting the software dependency is eliminated, and the labor cost of analyzing the test environment when the software test fails can also be reduced.

[0059] According to an embodiment of the present invention, based on environment dependencies, virtual data tables and character set categories for executing functions to be tested are configured in a virtual environment, including: when the test environment does not meet the software dependencies, determining the source database tables and character set categories included in the software dependencies; based on the source data in the source database tables, creating a virtual data table in the test environment and filling the source data into the virtual data table; based on the character set category, setting the character set of the virtual environment; and determining the virtual environment based on the virtual data table and the character set of the test environment.

[0060] According to an embodiment of the present invention, when the test environment does not satisfy the software dependency, a source database table is determined based on the software dependency, wherein the source database table can be determined according to the Structured Query Language (SQL) included in the function to be tested before the update.

[0061] According to an embodiment of the present invention, based on source data in a source database table, source data is filled into a virtual data table in a test environment, wherein the source data includes data in one or more data columns in the source database table.

[0062] According to an embodiment of the present invention, the character set category can be determined by analyzing the input data and output data of the function to be tested before updating, wherein the character set category can include UTF-8, GB2312, GBK, Unicode, etc.

[0063] According to an embodiment of the present invention, when the test environment does not meet the software dependencies, a virtual environment is created in the test environment and configured to meet the software dependencies, which can improve the feasibility of software testing, thereby reducing the dependence of software testing on the test environment and improving the efficiency of software testing.

[0064] According to an embodiment of the present invention, based on source data in a source database table, a virtual data table is created in a test environment and the source data is filled into the virtual data table, including: based on a function to be tested, determining one or more data table columns in the source database table that need to be called when executing the function to be tested; determining a database server where the source database table is located; determining an available server for connecting to the database server; controlling the available server to connect to the database server and obtain data of one or more data table columns from the source data table; and creating a virtual data table based on the data of the one or more data table columns and filling the source data into the virtual data table.

[0065] According to an embodiment of the present invention, one or more data columns can be determined according to SQL. For example, the structured query language included in the function to be tested before the update includes "SELECT a, b FROM AA.aa WHERE a!=1", then the source database table is the data table "aa" in the server "AA", and the data in the data column "a" and the data in the data column "b" in the data table are determined as the source data.

[0066] According to an embodiment of the present invention, after determining the source data that needs to be obtained, a server that can establish connections with both a server configured with the target software and a database server can be determined as an available server, and the available server can be controlled to connect to the database server, and the source data can be fully obtained through SQL statements, and a virtual data table can be created in a virtual environment, and the source data can be filled into the virtual data table.

[0067] According to an embodiment of the present invention, the function to be tested is parsed, the source database table and one or more data table columns in the source data table that need to be called when executing the function are determined, the database server where the source database table is located is connected through an available server, and the data of one or more data table columns are obtained, and the data of one or more data table columns are sent to the server configuring the target software through the available server, and the data is filled into the virtual data table. When the test environment does not meet the software dependency, the data structure and specific data required for executing the function to be tested can be obtained through the available server, and filled into the virtual data table, and an environment that meets the software dependency is constructed to test the function to be tested, thereby improving the feasibility of software testing. In addition, only the data of one or more data table columns are filled into the virtual data table, rather than filling all the data of the source database table into the virtual data table, which can reduce the amount of data operations, improve operation efficiency, and reduce the occupancy of the server's storage space.

[0068] According to an embodiment of the present invention, a function to be tested of a target software is executed in a virtual environment to obtain an execution result, including: updating the function to be tested based on a source database table and a virtual data table to obtain an updated function to be tested; and executing the updated function to be tested in the virtual environment to obtain an execution result.

[0069] According to an embodiment of the present invention, based on the source database table and the virtual data table, the SQL statement in the function to be tested is updated to obtain an updated function to be tested, so that the updated SQL statement can perform corresponding data operations on the virtual data table. After the function to be tested is updated, the updated function to be tested is executed in the virtual environment to obtain an execution result.

[0070] According to an embodiment of the present invention, by updating the function to be tested, the virtual environment can be correctly called when the function to be tested is executed, thereby avoiding the impact of environmental problems on the test results and further ensuring the accuracy of software testing.

[0071] According to an embodiment of the present invention, based on the source database table and the virtual data table, the function to be tested is updated to obtain an updated function to be tested, including: parsing the function to be tested based on the source database table to determine a first keyword used to characterize the call relationship; generating a second keyword based on the virtual data table; and replacing the first keyword in the function to be tested with the second keyword to obtain an updated function to be tested.

[0072] According to an embodiment of the present invention, the function to be tested is parsed based on the source database table to determine the first keyword used to characterize the call relationship. For example, when the SQL of the function to be tested is "SELECT a, b FROM AA.aa WHERE a!=1", it can be determined that the SQL statement needs to call the AA.aa database table for data query or data operation, so the first keyword is "AA.aa".

[0073] According to an embodiment of the present invention, a second keyword is generated based on a virtual data table, wherein the second keyword can be determined according to the table name of the virtual data table. For example, when the table "aa" does not exist in the server where the virtual data table is located, the virtual data table can be named "aa", and the second keyword can be determined as "aa".

[0074] According to an embodiment of the present invention, the first keyword in the function to be tested is replaced by the second keyword to obtain an updated function to be tested, wherein the SQL of the updated function to be tested may be "SELECT a, b FROM aaWHERE a!=1", so that when the updated function to be tested is executed, data query or data operation can be performed from the local "aa" data table.

[0075] According to an embodiment of the present invention, the first keyword may also be the IP address of the server where the source database table is located, and the corresponding second keyword is the IP address of the server configured with the target software.

[0076] According to an embodiment of the present invention, when it is necessary to create a virtual environment, when the function to be tested is executed in the virtual environment, the function cannot be executed because the configured IP address, database table name, etc. are different from those of the virtual environment. Therefore, before executing the function to be tested, the IP address, database table name and other information in the function to be tested is located and reset to the relevant information in the virtual environment, thereby ensuring that the virtual environment can be correctly used for software testing based on the modified function to be tested.

[0077] According to an embodiment of the present invention, environmental dependency also includes hardware dependency, wherein the hardware dependency includes hardware performance requirements of respective multiple hardware categories required for executing the function to be tested; based on the function to be tested of the target software, checking the environmental dependency required for the test environment to execute the function to be tested, including: determining the source database table and one or more data table columns in the source database table based on the operation log of executing the function to be tested before the target software is updated; determining the character set category of the expected result application; determining the hardware dependency for executing the function to be tested based on the operation log; and determining the environmental dependency based on the source database table, one or more data table columns in the source database table, the character set category and the hardware dependency.

[0078] According to an embodiment of the present invention, before the target software is updated, an operation log will be saved after the function to be tested is executed. The operation log includes the operations performed by the function to be tested, the time of executing the operations, the data range involved in the execution of the operations, and the occupancy of hardware performance such as memory when executing the operations.

[0079] According to an embodiment of the present invention, based on the operation log of executing the function to be tested before the target software is updated, the data range involved in the operation can be determined, that is, which data table columns of the data table are operated by the function to be tested, so that one or more data table columns in the source database table can be determined. Based on the operation log, the character set category of the expected result obtained after execution can also be determined. Based on the operation log, the occupation of hardware performance such as memory by the function to be tested during the execution of the operation can be determined, so as to determine the hardware dependence of executing the function to be tested.

[0080] According to an embodiment of the present invention, software dependency can be determined based on a source database table, one or more data table columns in an original data table, and a character set category. Environment dependency can be determined based on software dependency and hardware dependency.

[0081] According to an embodiment of the present invention, based on the running log of executing the function to be tested before the target software is updated, the data table columns that need to be called by the function to be tested, the character set categories and hardware dependencies applied when the function to be tested outputs the results are determined, so that based on the above-mentioned environment dependencies, the test environment is detected and if the test environment does not meet the environment dependencies, the virtual environment in the test environment is configured to meet the environment dependencies, ensuring that the environment for executing the function to be tested meets the environment dependencies, thereby ensuring that the test results can correctly reflect the situation of the function to be tested itself, thereby improving the accuracy of software testing.

[0082] According to an embodiment of the present invention, the software testing method also includes: when it is determined that the test environment does not meet the hardware dependencies, determining the hardware to be upgraded that does not meet the hardware performance requirements from multiple hardware categories included in the hardware dependencies; and sending the hardware to be upgraded and the hardware performance requirements corresponding to the hardware to be upgraded to the operation and maintenance personnel.

[0083] According to an embodiment of the present invention, when it is determined that the test environment does not meet the hardware dependency, multiple hardware categories included in the hardware dependency and their respective dependency conditions are determined, wherein the dependency conditions are used to characterize the hardware performance requirements of the hardware of the hardware category when executing the function to be tested.

[0084] According to an embodiment of the present invention, the available performance of multiple hardware corresponding to multiple hardware categories included in the hardware dependency in the server is determined. The dependency conditions of the multiple hardware categories and the available performance of the multiple hardware are then compared. When the available performance of the hardware corresponding to a certain hardware category is lower than the dependency condition of the hardware category, it can be determined that the hardware does not meet the hardware performance requirements and is hardware to be improved.

[0085] According to an embodiment of the present invention, the hardware to be upgraded, the hardware performance requirements corresponding to the hardware to be upgraded, and the available performance of the hardware in the server are sent to the operation and maintenance personnel, who then deploy the hardware and then perform software testing.

[0086] According to an embodiment of the present invention, since the problem of hardware dependency cannot be solved by automated adjustment of configuration, the hardware to be upgraded that needs to be optimized is determined based on the hardware dependency and the respective available performance of multiple hardware in the server, and the hardware to be upgraded and the hardware performance requirements of the hardware are sent to the operation and maintenance personnel so that the operation and maintenance personnel can optimize the hardware to be upgraded in a timely manner, thereby reducing the process of the operation and maintenance personnel analyzing multiple hardware one by one and improving the efficiency of software testing.

[0087] According to an embodiment of the present invention, a test result is determined based on the execution result and the expected result, including: comparing the execution result and the expected result to determine the comparison result; when the comparison result indicates that the execution result and the expected result are consistent, it indicates that the function to be tested has passed the test; and when the comparison result indicates that the execution result and the expected result are inconsistent, it indicates that the function to be tested has failed the test.

[0088] According to an embodiment of the present invention, the execution result is compared with the expected result to determine the comparison result, wherein both the execution result and the expected result include an error situation and a detailed description, the error situation characterizes whether the function to be tested reports an error, and the detailed description can be obtained from the console after the test, including detailed information such as the cause of the error and stack trace.

[0089] According to an embodiment of the present invention, when the comparison result indicates that the execution result is consistent with the expected result in both the error condition and the detailed description, it indicates that the function to be tested has passed the test.

[0090] According to an embodiment of the present invention, when the comparison result indicates that the execution result is inconsistent with the expected result in terms of error status and detailed description, it indicates that the function to be tested has failed the test.

[0091] According to an embodiment of the present invention, when the execution result is inconsistent with the expected result in terms of error reporting, the detailed description in the execution result can be captured, and the error keywords can be determined based on the detailed description, and the error keywords can be retrieved in the part related to the function to be tested in the software manual of the target software. If the retrieval is successful, it is characterized that the function to be tested has a fault during the update process, and a test report is generated based on the error keywords, and the test report is sent to the operation and maintenance personnel, who will perform maintenance and updates. If the retrieval fails, it is characterized that the function to be tested has not had the same error in the version before the update, and a test report is generated based on the detailed description, and the test report is sent to the operation and maintenance personnel, who will determine the cause of the error.

[0092] According to an embodiment of the present invention, when the execution result is consistent with the expected result in terms of error reporting, that is, both errors occur, but the detailed descriptions are different, a test report is generated based on the detailed descriptions and sent to the operation and maintenance personnel, who then determine the cause of the error.

[0093] According to an embodiment of the present invention, when the execution result is consistent with the expected result in terms of error reporting, i.e., no error is reported, but the detailed description is different, it indicates that the current function to be tested is not completely the same as the function to be tested before the update, i.e., the target software has a new function. Based on the function to be tested and the detailed description, a test report is generated, and the test report is sent to the operation and maintenance personnel, so that the operation and maintenance personnel can update the version branch of the target software based on the test report, so that the updated version branch includes the function to be tested.

[0094] According to an embodiment of the present invention, by comparing the expected results and the execution results, the test results of the function to be tested are determined, and a test report is determined based on the specific comparison results, so that the operation and maintenance personnel can determine the specific situation of the function to be tested according to the test report, thereby reducing the process of manual detailed analysis of the execution results by the operation and maintenance personnel, reducing labor costs, and improving software testing efficiency.

[0095] Figure 3 A flowchart of a software testing method according to another embodiment of the present invention is shown.

[0096] like Figure 3 As shown, the software testing process includes operations S301 to S312.

[0097] In operation S301, determine the environmental dependency of the function to be tested. In operation S302, check the test environment. In operation S303, determine whether the test environment meets the dependency. If yes, perform operation S304; if not, perform operation S305. In operation S304, execute the function to be tested in the test environment, and perform operation S310. In operation S305, determine the items that do not meet the environmental dependency. Environmental dependency includes software dependency and hardware dependency. In operation S306, determine whether the test environment meets the software dependency. If not, perform operation S307; if yes, perform operation S311. In operation S307, if it is determined that the test environment does not meet the software dependency, create a virtual environment in the test environment. In operation S308, configure the virtual environment according to the software dependency so that the virtual environment meets the software dependency. In operation S309, execute the function to be tested in the virtual environment. In operation S310, generate a test report based on the execution results and expected results, and perform operation S312. In operation S311, when it is determined that the test environment meets the software dependency, it can be determined that the test environment does not meet the hardware dependency, and the hardware to be upgraded is determined based on the hardware dependency and the available performance of each of the multiple hardware, and a report is generated. In operation S312, when the test environment does not meet the hardware dependency, the report of the hardware to be upgraded is sent to the operation and maintenance personnel. When the test environment meets the environment dependency, or the test environment does not meet the software dependency, the test report is sent to the operation and maintenance personnel. So that the operation and maintenance personnel can locate the hardware to be upgraded in time based on the report of the hardware to be upgraded, and make adjustments, or determine the test results of the function to be tested based on the test report.

[0098] Based on the above software testing method, the present invention also provides a software testing device. Figure 4 The device is described in detail.

[0099] Figure 4 A structural block diagram of a software testing device according to an embodiment of the present invention is shown.

[0100] like Figure 4 As shown, the software testing device 400 of this embodiment includes an environment checking module 410 , an environment creating module 420 , an environment configuring module 430 , a function testing module 440 and a result determining module 450 .

[0101] The environment checking module 410 is used to check the environment dependency required for the test environment to execute the function to be tested based on the function to be tested of the target software, wherein the environment dependency includes the environment configuration when the expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes the software dependency. In one embodiment, the environment checking module 410 can be used to execute the operation S210 described above, which will not be repeated here.

[0102] The environment creation module 420 is used to create a virtual environment in the test environment when it is determined that the test environment does not meet the software dependency. In one embodiment, the environment creation module 420 can be used to perform the operation S220 described above, which will not be repeated here.

[0103] The environment configuration module 430 is used to configure a virtual data table and a character set category for executing the function to be tested in a virtual environment based on the environment dependency, wherein the virtual data table includes one or more data columns, the data in the one or more data columns is obtained from a source database, the source database is determined according to the execution logic of the function to be tested, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result. In one embodiment, the environment configuration module 430 can be used to perform the operation S230 described above, which will not be repeated here.

[0104] The function test module 440 is used to execute the function to be tested of the target software in the virtual environment to obtain the execution result. In one embodiment, the function test module 440 can be used to execute the operation S240 described above, which will not be described in detail here.

[0105] The result determination module 450 is used to determine the test result based on the execution result and the expected result. In one embodiment, the result determination module 450 can be used to perform the operation S250 described above, which will not be described in detail here.

[0106] According to an embodiment of the present invention, the environment configuration module 430 includes an environment determination submodule, a data filling submodule, a character set setting submodule and an environment determination submodule.

[0107] The environment determination submodule is used to determine the source database tables and character set categories included in the software dependencies when the test environment does not meet the software dependencies.

[0108] The data filling submodule is used to create a virtual data table in the test environment based on the source data in the source database table and fill the source data into the virtual data table.

[0109] The character set setting submodule is used to set the character set of the virtual environment based on the character set category.

[0110] The environment determination submodule is used to determine the virtual environment based on the virtual data table and the character set of the test environment.

[0111] According to an embodiment of the present invention, the data filling submodule includes a data table column determination unit, a first server determination unit, a second server determination unit, a data acquisition unit and a data filling unit.

[0112] The data table column determination unit is used to determine, based on the function to be tested, one or more data table columns in the source database table that need to be called when executing the function to be tested.

[0113] The first server determination unit is used to determine the database server where the source database table is located.

[0114] The second server determination unit is used to determine an available server for connecting to the database server.

[0115] The data acquisition unit is used to control the available server to connect to the database server and acquire the data of one or more data table columns from the source data table.

[0116] The data filling unit is used to create a virtual data table based on the data in one or more data table columns and fill the source data into the virtual data table.

[0117] According to an embodiment of the present invention, the function test module 440 includes a function update submodule and a function test submodule.

[0118] The function update submodule is used to update the function to be tested based on the source database table and the virtual data table to obtain the updated function to be tested.

[0119] The functional testing submodule is used to execute the updated function to be tested in the virtual environment and obtain the execution result.

[0120] According to an embodiment of the present invention, the function updating submodule includes a first keyword determining unit, a second keyword determining unit and a keyword replacing unit.

[0121] The first keyword determining unit is used to parse the function to be tested based on the source database table to determine a first keyword used to characterize the call relationship.

[0122] The second keyword determination unit is used to generate a second keyword based on the virtual data table.

[0123] The keyword replacement unit is used to replace the first keyword in the function to be tested with the second keyword to obtain an updated function to be tested.

[0124] According to an embodiment of the present invention, the environment checking module 410 includes a data table column determination submodule, a character set category determination submodule, a hardware dependency determination submodule and an environment dependency determination submodule.

[0125] The data table column determination submodule is used to determine the source database table and one or more data table columns in the source database table based on the operation log of executing the function to be tested before the target software is updated.

[0126] The character set category determination submodule is used to determine the character set category of the expected result application.

[0127] The hardware dependency determination submodule is used to determine the hardware dependency for executing the function to be tested based on the operation log.

[0128] The environment dependency determination submodule is used to determine the environment dependency based on the source database table, one or more data table columns in the source database table, the character set category and the hardware dependency.

[0129] According to an embodiment of the present invention, the software testing device 400 further includes a hardware determination module and an information transmission module.

[0130] The hardware determination module is used to determine the hardware to be upgraded that does not meet the hardware performance requirements from multiple hardware categories included in the hardware dependencies when it is determined that the test environment does not meet the hardware dependencies.

[0131] The information transmission module is used to send the hardware to be upgraded and the hardware performance requirements corresponding to the hardware to be upgraded to the operation and maintenance personnel.

[0132] According to an embodiment of the present invention, the result determination module 450 includes a result comparison submodule, a first result determination submodule and a second result determination submodule.

[0133] The result comparison submodule is used to compare the execution result with the expected result and determine the comparison result.

[0134] The first result determination submodule is used to indicate that the function to be tested has passed the test when the comparison result indicates that the execution result is consistent with the expected result.

[0135] The second result determination submodule is used to indicate that the function to be tested has failed the test when the comparison result indicates that the execution result is inconsistent with the expected result.

[0136] According to an embodiment of the present invention, any multiple modules of the environment check module 410, the environment creation module 420, the environment configuration module 430, the function test module 440 and the result determination module 450 can be combined in one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present invention, at least one of the environment check module 410, the environment creation module 420, the environment configuration module 430, the function test module 440 and the result determination module 450 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in any appropriate combination of any of them. Alternatively, at least one of the environment checking module 410, the environment creating module 420, the environment configuring module 430, the function testing module 440 and the result determining module 450 may be at least partially implemented as a computer program module, which may perform a corresponding function when executed.

[0137] Figure 5 A block diagram of an electronic device suitable for implementing a software testing method according to an embodiment of the present invention is shown.

[0138] like Figure 5 As shown, the electronic device 500 according to an embodiment of the present invention includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage part 508 to a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include an onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present invention.

[0139] In RAM 503, various programs and data required for the operation of electronic device 500 are stored. Processor 501, ROM 502 and RAM 503 are connected to each other via bus 504. Processor 501 performs various operations of the method flow according to the embodiment of the present invention by executing the program in ROM 502 and / or RAM 503. It should be noted that the program can also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 can also perform various operations of the method flow according to the embodiment of the present invention by executing the program stored in the one or more memories.

[0140] According to an embodiment of the present invention, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to the bus 504. The electronic device 500 may further include one or more of the following components connected to the input / output (I / O) interface 505: an input portion 506 including a keyboard, a mouse, etc.; an output portion 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 508 including a hard disk, etc.; and a communication portion 509 including a network interface card such as a LAN card, a modem, etc. The communication portion 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the input / output (I / O) interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that the computer program read therefrom is installed into the storage portion 508 as needed.

[0141] The present invention also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiment; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present invention is implemented.

[0142] According to an embodiment of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present invention, the computer-readable storage medium may include the ROM 502 and / or RAM 503 described above and / or one or more memories other than ROM 502 and RAM 503.

[0143] The embodiment of the present invention also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the method provided by the embodiment of the present invention.

[0144] The computer program executes the above functions defined in the system / device of the embodiment of the present invention when it is executed by the processor 501. According to the embodiment of the present invention, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0145] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 509, and / or installed from the removable medium 511. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0146] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 509, and / or installed from the removable medium 511. When the computer program is executed by the processor 501, the above functions defined in the system of the embodiment of the present invention are performed. According to the embodiment of the present invention, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0147] According to an embodiment of the present invention, the program code for executing the computer program provided by the embodiment of the present invention can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0148] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0149] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present invention may be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present invention. In particular, without departing from the spirit and teachings of the present invention, the features described in the various embodiments of the present invention may be combined and / or combined in various ways. All of these combinations and / or combinations fall within the scope of the present invention.

[0150] The embodiments of the present invention are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present invention. Although each embodiment is described above, it does not mean that the measures in each embodiment cannot be used in combination advantageously. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A software testing method, characterized in that: The method comprises: Based on the function to be tested of the target software, checking the environment dependency required for the test environment to execute the function to be tested, wherein the environment dependency includes the environment configuration when the expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes software dependency; In a case where it is determined that the test environment does not satisfy the software dependency, creating a virtual environment in the test environment; Based on the environment dependency, a virtual data table and a character set category for executing the function to be tested are configured in the virtual environment, wherein the virtual data table includes one or more data table columns, data in the one or more data table columns are obtained from a source database, the one or more data table columns and the source database are determined by parsing the function to be tested and based on the call requirements when executing the function to be tested determined after the parsing, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result; Execute the function to be tested of the target software in the virtual environment to obtain an execution result; and A test result is determined based on the execution result and the expected result.

2. The method according to claim 1, characterized in that The configuring, in the virtual environment based on the environment dependency, a virtual data table and a character set category for executing the function to be tested includes: In a case where the test environment does not satisfy the software dependency, determining the source database table and the character set category included in the software dependency; Based on the source data in the source database table, creating a virtual data table in the test environment and filling the source data into the virtual data table; Based on the character set category, setting the character set of the virtual environment; and The virtual environment is determined based on the virtual data table and the character set of the test environment.

3. The method according to claim 2, characterized in that The step of creating a virtual data table in the test environment based on the source data in the source database table and filling the source data into the virtual data table includes: Based on the function to be tested, determining one or more data table columns in the source database table that need to be called when executing the function to be tested; Determine the database server where the source database table is located; determining an available server for connecting to the database server; Controlling the available server to connect to the database server and obtaining the data of the one or more data table columns from the source database table; and Based on the data of the one or more data table columns, the virtual data table is created and the source data is filled into the virtual data table.

4. The method according to claim 2, characterized in that: The step of executing the function to be tested of the target software in the virtual environment to obtain an execution result includes: Based on the source database table and the virtual data table, the function to be tested is updated to obtain an updated function to be tested; and The updated function to be tested is executed in the virtual environment to obtain the execution result.

5. The method according to claim 4, characterized in that The updating of the function to be tested based on the source database table and the virtual data table to obtain an updated function to be tested includes: Parsing the function to be tested based on the source database table to determine a first keyword for characterizing a call relationship; Based on the virtual data table, generating a second keyword; and The first keyword in the function to be tested is replaced with the second keyword to obtain an updated function to be tested.

6. The method according to claim 2, characterized in that The environment dependency also includes hardware dependency, wherein the hardware dependency includes hardware performance requirements of each of a plurality of hardware categories required to execute the function to be tested; The step of checking the environment dependency required for the test environment to execute the function to be tested based on the function to be tested of the target software includes: Determine the source database table and one or more data table columns in the source database table based on the operation log of executing the function to be tested before the target software is updated; Determining the character set category to which the expected result applies; Based on the operation log, determining the hardware dependency for executing the function to be tested; and The environment dependency is determined based on the source database table, one or more data table columns in the source database table, the character set category, and the hardware dependency.

7. The method according to claim 6, characterized in that The method further comprises: In the case where it is determined that the test environment does not meet the hardware dependency, determining hardware to be upgraded that does not meet the hardware performance requirement from a plurality of hardware categories included in the hardware dependency; and The hardware to be upgraded and the hardware performance requirements corresponding to the hardware to be upgraded are sent to operation and maintenance personnel.

8. The method according to claim 1, characterized in that The determining of the test result based on the execution result and the expected result includes: Comparing the execution result with the expected result to determine a comparison result; If the comparison result indicates that the execution result is consistent with the expected result, it indicates that the function to be tested has passed the test; and When the comparison result indicates that the execution result is inconsistent with the expected result, it indicates that the function to be tested has failed the test.

9. A software testing device, characterized in that: The device comprises: An environment checking module, used for checking the environment dependency required for the test environment to execute the function to be tested based on the function to be tested of the target software, wherein the environment dependency includes the environment configuration when the expected result is obtained, the expected result is the result obtained by executing the function to be tested before the target software is updated, and the environment dependency includes software dependency; An environment creation module, configured to create a virtual environment in the test environment if it is determined that the test environment does not satisfy the software dependency; An environment configuration module, configured to configure a virtual data table and a character set category for executing the function to be tested in the virtual environment based on the environment dependency, wherein the virtual data table includes one or more data table columns, the data in the one or more data table columns is obtained from a source database, the one or more data table columns and the source database are determined by parsing the function to be tested and based on the call requirements when executing the function to be tested determined after the parsing, the source database and the target software are installed on different servers, and the character set category is determined according to the encoding method of the expected result; A functional testing module, used to execute the function to be tested of the target software in the virtual environment to obtain an execution result; and The result determination module is used to determine the test result based on the execution result and the expected result.

10. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 8.

Images