Automatic execution method and device for test cases

Abstract

The invention provides a test case automatic execution method and device. The test case automatic execution method comprises the steps of pre-constructing and storing a plurality of test cases and test data thereof; obtaining a test object, selecting a corresponding test case from the database, and executing a test task; sending the test task to a message queue based on a scheduling mechanism; the idle working process takes out the test task from the message queue, and executes single test cases in sequence according to the test case IDs in the test task to obtain an actual test result; when a single test case is executed, selecting a test data assembly service message from the test data according to the type of the test case, and initiating a service test; monitoring the data state of the test object in real time, and automatically executing the next test action according to the state value and the test steps until the execution is finished; and comparing the actual test result with the expected test result to obtain a final test result, and generating a test report. According to the method provided by the invention, test case execution automation is realized, and the test efficiency is greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of new generation information technology, and in particular to a method and device for automatically executing a test case. Background Art

[0002] With the continuous development of Internet technology, various software are developed and used by users. In order to ensure that the software meets the requirements when actually used by users, the software needs to pass precise testing before release or delivery, and test cases come into being.

[0003] A test case, also known as a test procedure, is a description of a test task for a specific software product, reflecting the test plan, method, technology and strategy. Its content includes test objectives, test environment, input data, test steps, expected results, test scripts, etc., and finally forms a document. Simply put, a test case is a set of test inputs, execution conditions and expected results compiled for a special goal, used to verify whether a specific software requirement is met.

[0004] For the financial industry, such as the China Enterprise Cloud Chain Supply Chain Financial Service Platform, it is a complex system involving supply chain financial business, which includes multiple business modules and interactions. When testing this system, it is necessary to verify whether various business logics and processes work as expected. The existing technical solution is to manually execute test cases, that is, the tester manually operates the system according to the predefined test cases and manually compares the actual test results with the expected results.

[0005] The existing technical solutions have the following defects:

[0006] (1) The testing process is cumbersome and requires manual query of system status and step-by-step execution of operations, which is time-consuming and laborious.

[0007] (2) The actual results and expected results need to be compared manually field by field, which is labor-intensive, inefficient and error-prone.

[0008] (3) Test cases can only be executed one by one, and multiple test cases cannot be processed in parallel, resulting in low testing efficiency.

[0009] Therefore, there is an urgent need for a test case automation execution method to improve test efficiency and test accuracy. Summary of the invention

[0010] In view of this, an embodiment of the present invention provides a method and device for automatically executing test cases to eliminate or improve one or more defects existing in the prior art, and solve the problems existing in the prior art solution that the testing process is cumbersome, the system status needs to be manually queried and operations need to be executed step by step, the testing process is time-consuming and labor-intensive, the actual results and expected results need to be manually compared field by field, the comparison workload is large, the comparison efficiency is low and prone to errors, the test cases can only be executed one by one, multiple test cases cannot be processed in parallel, and the testing efficiency is low.

[0011] In one aspect, the present invention provides a method for automatically executing test cases, which constructs and maintains a plurality of test cases and test data thereof in advance according to the fields to which the test objects belong, and stores the test cases and test data thereof in a database, the method comprising the following steps:

[0012] Acquire the test object and select the corresponding test case from the database to execute the test task; the test case at least includes a test case ID, test steps and expected test results;

[0013] Based on a preset scheduling mechanism, the test task is sent to a message queue;

[0014] The idle working process takes out the test task from the message queue, executes the single test case in sequence according to the test case ID in the test task, and obtains the actual test result;

[0015] Among them, when executing a single test case, according to the test case type, a test data is randomly selected from the corresponding test data, the selected test data is assembled into a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the last step is completed;

[0016] Compare the actual test results with the expected test results to obtain final test results and generate a test report.

[0017] In some embodiments of the present invention, sending the test task to a message queue based on a preset scheduling mechanism includes:

[0018] The test task is asynchronously distributed to multiple worker processes for processing using the Celery asynchronous task queue.

[0019] In some embodiments of the present invention, randomly selecting a piece of test data from the corresponding test data, assembling the selected test data into a service message, and initiating a service test, further comprising:

[0020] According to the test case type, pre-associating and specifying a piece of test data for the test case;

[0021] Assemble the business message through Requests and initiate business testing.

[0022] In some embodiments of the present invention, the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the last step is completed, and further includes:

[0023] During the execution of the test case, the test step node data and the test results are saved to a preset database for subsequent review and display of the test results.

[0024] In some embodiments of the present invention, a single test case is executed in sequence according to the test case ID in the test task to obtain an actual test result, and the actual test result is in XML and JSON formats. It also includes: when the actual test result is in XML format, the fromstring method is used to parse the XML string into an XML element tree, the root element is obtained, all sub-element tags and attributes under the root element are looped through, and all tags and attributes are serialized into JSON format.

[0025] In some embodiments of the present invention, the actual test result and the expected test result are compared to obtain a final test result, and both the actual test result and the expected test result are in JSON format. The method includes:

[0026] Loop through each attribute and its expected attribute value in the expected test result, and according to each attribute in the expected test result, use the jsonpath method to retrieve the corresponding attribute and its test attribute value in the actual test result. If the expected attribute value and the test attribute value of each attribute are consistent, the test case result is passed, otherwise it fails.

[0027] In some embodiments of the present invention, generating a test report includes: displaying the test report in the form of an HTML page.

[0028] On the other hand, the present invention provides a test case automatic execution device, which, when executed, is used to implement the steps of any one of the test case automatic execution methods mentioned above, and the device includes:

[0029] The test data management module is used to build and maintain multiple test data according to the fields to which the test objects belong, and store them in the database;

[0030] A test case management module is used to construct and maintain multiple test cases according to the fields to which the test objects belong, and store them in a database; the test cases at least include a test case ID, test steps, and expected test results;

[0031] The test case execution module is used to send the test task to the message queue based on the preset scheduling mechanism; the idle working process takes the test task from the message queue, and executes the single test case in sequence according to the test case ID in the test task; wherein, when executing a single test case, according to the test case type, a test data is randomly selected from the corresponding test data, the selected test data is assembled into a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the last step is executed;

[0032] A test result checking module is used to compare the actual test result obtained by the test case execution module with the expected test result to obtain a final test result;

[0033] The test report generating module is used to generate a test report according to the final test result.

[0034] On the other hand, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any one of the methods mentioned above.

[0035] On the other hand, the present invention further provides a computer program product, comprising a computer program / instruction, characterized in that when the computer program / instruction is executed by a processor, the steps of any one of the methods mentioned above are implemented.

[0036] The beneficial effects of the present invention are at least:

[0037] The present invention provides a method and device for automatic execution of test cases, including: constructing and storing multiple test cases and test data thereof in advance according to the fields described by the test object; obtaining the test object and selecting the corresponding test case from the database to execute the test task; sending the test task to the message queue based on the scheduling mechanism; the idle working process takes out the test task from the message queue, and executes the single test case in sequence according to the test case ID in the test task to obtain the actual test result; when executing a single test case, a test data is selected from the test data according to the test case type to assemble a business message, and a business test is initiated; the data state of the test object is monitored in real time, and the next test action is automatically executed according to the state value and the test step until the execution is completed; the actual test result is compared with the expected test result to obtain the final test result, and a test report is generated. The method provided by the present invention realizes the automation of test case execution by real-time monitoring of the data state of the test object, and timely performs the next operation, without manual intervention, and greatly improves the test accuracy. Further, the method provided by the present invention can realize the simultaneous execution of multiple test cases, which greatly improves the test efficiency.

[0038] Additional advantages, purposes, and features of the present invention will be described in part in the following description, and will become apparent to those skilled in the art after studying the following, or may be learned from the practice of the present invention. The purposes and other advantages of the present invention may be achieved and obtained by the structures specifically indicated in the specification and the accompanying drawings.

[0039] Those skilled in the art will appreciate that the objectives and advantages that can be achieved with the present invention are not limited to the above specific description, and the above and other objectives that can be achieved by the present invention will be more clearly understood from the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The drawings described herein are used to provide a further understanding of the present invention, constitute a part of the present application, and do not constitute a limitation of the present invention. In the drawings:

[0041] Figure 1 The figure is a schematic diagram of the steps of a method for automatically executing test cases in one embodiment of the present invention.

[0042] Figure 2 The present invention is a flowchart of a method for automatically executing test cases in one embodiment of the present invention.

[0043] Figure 3 The figure is a flowchart of a method for executing a single test case in one embodiment of the present invention. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments and the accompanying drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0045] It should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, only structures and / or processing steps closely related to the solutions according to the present invention are shown in the accompanying drawings, while other details that are not closely related to the present invention are omitted.

[0046] It should be emphasized that the term “include / comprises” when used herein refers to the presence of features, elements, steps or components, but does not exclude the presence or addition of one or more other features, elements, steps or components.

[0047] It should also be noted that, unless otherwise specified, the term “connection” herein may refer not only to a direct connection but also to an indirect connection involving an intermediate.

[0048] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the accompanying drawings, the same reference numerals represent the same or similar components, or the same or similar steps.

[0049] It should be emphasized here that the step marks mentioned below are not intended to limit the order of the steps, but it should be understood that the steps can be executed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be executed simultaneously.

[0050] In order to solve the problems of the prior art solutions, such as the cumbersome testing process, the need to manually query the system status and perform operations step by step, the time-consuming and labor-intensive testing process, the need to manually compare the actual results with the expected results field by field, the large workload of the comparison, the low efficiency and the error-proneness of the comparison, the test cases can only be executed one by one, and multiple test cases cannot be processed in parallel, and the low testing efficiency, the present invention proposes a test case automatic execution method, which constructs and maintains multiple test cases and their test data in advance according to the field to which the test object belongs, and stores the test cases and their test data in a database, such as Figure 1 As shown, the method includes the following steps S101 to S104:

[0051] Step S101: Acquire a test object and select a corresponding test case from a database to execute a test task, wherein the test case at least includes a test case ID, test steps and expected test results.

[0052] Step S102: Based on a preset scheduling mechanism, the test task is sent to a message queue.

[0053] Step S103: The idle working process takes out the test task from the message queue, and executes the single test case in sequence according to the test case ID in the test task to obtain the actual test result.

[0054] Among them, when executing a single test case, a test data is randomly selected from the corresponding test data according to the test case type, the selected test data is assembled into a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and test steps until the last step is completed.

[0055] Step S104: Compare the actual test results with the expected test results, obtain the final test results, and generate a test report.

[0056] like Figure 2 The figure shows a flowchart of the test case automation execution method.

[0057] In step S101, after a plurality of test cases and their test data are pre-built and stored, a test object is obtained, and a corresponding test case set is selected from a database to start executing a test task.

[0058] In step S102, the test task is sent to a message queue based on a preset scheduling mechanism.

[0059] In some embodiments, the test task is sent to the message queue rabbitMQ through Celery. Celery is an asynchronous task queue / job queue used to process tasks in a distributed system, and can asynchronously distribute tasks to multiple worker processes (such as Celery-Worker) for processing.

[0060] In step S103, the idle working process, namely the Celery-Worker mentioned above, takes out the test task from the message queue, and executes the single test case in sequence according to the test case ID in the test task, so as to realize the automated asynchronous execution of the test case.

[0061] When executing a single test case, a piece of test data is randomly selected from the corresponding test data according to the test case type, the selected test data is assembled into a business message, and a business test is initiated. The data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and test steps until the last step is completed.

[0062] In some embodiments, not only can a piece of test data be randomly selected from the test data corresponding to the test case to be assembled into a business message, but a piece of test data can also be pre-associated with the test case according to the test case type and assembled into a business message.

[0063] In some embodiments, the service message is assembled by Requests, which is a Python library for simplifying the sending of HTTP requests and providing a friendly application programming interface (API), making it simple and fast to send requests such as GET and POST.

[0064] In some embodiments, during the execution of the test case, the test step node data and the test results of each step are saved to a preset database for subsequent review and display of the test results.

[0065] In some embodiments, a single test case is executed in sequence according to the test case ID in the test task, and the actual test results obtained are in two formats, XML and JSON. When the actual test result is in XML format, the XML string is parsed into an XML element tree through the fromstring method in xml.etree.ElementTree, the root element is obtained, all child element tags and attributes under the root element are looped through, and all tags and attributes are serialized into JSON format; when the actual test result is in JSON format, it is not processed.

[0066] Taking the business system of the China Enterprise Cloud Chain Supply Chain Financial Service Platform as an example of the test object, the steps of the execution method of a single test case are further explained, such as Figure 3 The figure shows a schematic diagram of the execution process of a single test case.

[0067] Assemble business messages according to the selected test data and initiate business.

[0068] Query the data status of the business system of the test object in real time. When the status field of the business system database table is 25, it indicates that the business has been successfully initiated and the next step is to be performed.

[0069] Get the expected test results based on the selected test case and serialize them into JSON format.

[0070] Query the data status of the business system of the test object in real time. When the status field of the business system database table is 35, it indicates that the business data has been adapted to the business system service and the next step is to be performed.

[0071] Use logld and channelCode to query the actual test results in the business system log table. If the actual test results are in XML format, serialize them into JSON format.

[0072] Compare the expected test results and the actual test results field by field to obtain the judgment result.

[0073] If the notification type of the judgment result is real-time response, no other processing is performed; if the notification type of the judgment result is manual push, the serial number in the baffle template is automatically replaced to simulate the third-party bank system to send the judgment result; if the notification type of the judgment result is automatic push, the corresponding scheduled task is called to send it.

[0074] Query the data status of the business system of the test object in real time. When the status field of the business system database table is 55 / 15, it indicates that the business process has been completed and the next step is to be performed.

[0075] Query the SMS in the business system to determine whether the SMS messages to the mobile phone numbers in the test data have been sent successfully.

[0076] Write the final test results into the preset database.

[0077] The above are the steps of a single test case execution method taking the business system as the test object as an example, wherein the value of the status field of the test object database table can be set and adjusted in advance. In this embodiment, only one feasible numerical value is provided and is not limited. Similarly, the test case can also be replaced with the same type.

[0078] In step S104, the actual test result is compared with the expected test result to obtain the final test result, and a test report is generated.

[0079] In some embodiments, both the actual test results and the expected test results are in JSON format, and the comparison method includes:

[0080] Loop through each attribute and its expected attribute value in the expected test result. According to each attribute in the expected test result, take attribute A as an example, its expected attribute value is a, use the jsonpath method to retrieve attribute A and its test attribute value b in the actual test result, and determine whether the expected attribute value a of attribute A is consistent with the test attribute value b. If they are consistent, the test case result is passed, otherwise it fails. The same applies to other attributes.

[0081] In some embodiments, the test report is displayed in the form of an HTML page, and the test report includes the test case execution status, node data generated during the test execution process, etc.

[0082] Corresponding to the test case automation execution method, the present invention also provides a test case automation execution device, which includes a test data management module, a test case management module, a test case execution module, a test result checking module and a test report generation module, specifically:

[0083] The test data management module is used to construct and maintain multiple test data according to the fields to which the test objects belong, and store them in the database.

[0084] The test case management module is used to build and maintain multiple test cases according to the fields to which the test objects belong, and store them in the database. The test cases at least include the test case ID, test steps and expected test results.

[0085] The test case execution module is used to send the test task to the message queue based on the preset scheduling mechanism. The idle working process takes the test task from the message queue and executes the single test case in sequence according to the test case ID in the test task. Among them, when executing a single test case, according to the test case type, a test data is randomly selected from the corresponding test data, the selected test data is assembled into a business message, and a business test is initiated. The data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and test steps until the last step is executed.

[0086] The test result checking module is used to compare the actual test results obtained by the test case execution module with the expected test results to obtain the final test results.

[0087] The test report generation module is used to generate a test report based on the final test results.

[0088] The present invention also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the test case automatic execution method are implemented.

[0089] Corresponding to the above method, the present invention also provides a device, which includes a computer device, the computer device includes a processor and a memory, the memory stores computer instructions, the processor is used to execute the computer instructions stored in the memory, and when the computer instructions are executed by the processor, the device implements the steps of the method described above.

[0090] The embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the aforementioned edge computing server deployment method are implemented. The computer-readable storage medium can be a tangible storage medium, such as a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a floppy disk, a hard disk, a removable storage disk, a CD-ROM, or any other form of storage medium known in the technical field.

[0091] In summary, the present invention provides a method and device for automatic execution of test cases, including: constructing and storing multiple test cases and test data thereof in advance according to the field described by the test object; obtaining the test object and selecting the corresponding test case from the database to execute the test task; sending the test task to the message queue based on the scheduling mechanism; the idle working process takes out the test task from the message queue, and executes a single test case in sequence according to the test case ID in the test task to obtain the actual test result; when executing a single test case, a test data is selected from the test data according to the test case type to assemble a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the execution is completed; the actual test result is compared with the expected test result to obtain the final test result, and a test report is generated. The method provided by the present invention realizes the automation of test case execution by real-time monitoring of the data status of the test object, and timely performing the next operation, without manual intervention, and greatly improves the test accuracy. Further, the method provided by the present invention can realize the simultaneous execution of multiple test cases, which greatly improves the test efficiency.

[0092] It should be understood by those skilled in the art that the exemplary components, systems and methods described in conjunction with the embodiments disclosed herein can be implemented in hardware, software or a combination of the two. Whether it is performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link via a data signal carried in a carrier.

[0093] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0094] In the present invention, features described and / or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, and / or combined with or replace features of other embodiments.

[0095] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the embodiments of the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for automated execution of test cases, It is characterized in that According to the fields to which the test objects belong, multiple test cases and their test data are constructed and maintained in advance, and the test cases and their test data are stored in a database. The method comprises the following steps: Acquire the test object and select the corresponding test case from the database to execute the test task; the test case at least includes a test case ID, test steps and expected test results; Based on a preset scheduling mechanism, the test task is sent to a message queue; The idle working process takes out the test task from the message queue, executes the single test case in sequence according to the test case ID in the test task, and obtains the actual test result; Among them, when executing a single test case, according to the test case type, a test data is randomly selected from the corresponding test data, the selected test data is assembled into a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the last step is completed; Compare the actual test results with the expected test results to obtain final test results and generate a test report.

2. The test case automation execution method according to claim 1, It is characterized in that Based on a preset scheduling mechanism, the test task is sent to a message queue, including: The test task is asynchronously distributed to multiple worker processes for processing using the Celery asynchronous task queue.

3. The test case automation execution method according to claim 1, It is characterized in that Randomly select a piece of test data from the corresponding test data, assemble the selected test data into a service message, and initiate a service test, which also includes: According to the test case type, pre-associating and specifying a piece of test data for the test case; Assemble the business message through Requests and initiate business testing.

4. The test case automation execution method according to claim 1, It is characterized in that Monitor the data status of the test object in real time, and automatically execute the next test action according to the status value and the test step until the last step is completed, and also include: During the execution of the test case, the test step node data and the test results are saved to a preset database for subsequent review and display of the test results.

5. The test case automation execution method according to claim 1, It is characterized in that Execute a single test case in sequence according to the test case ID in the test task to obtain an actual test result. The actual test result is in XML and JSON formats. The method also includes: when the actual test result is in XML format, use the fromstring method to parse the XML string into an XML element tree, obtain the root element, loop through all child element tags and attributes under the root element, and serialize all tags and attributes into JSON format.

6. The test case automation execution method according to claim 5, It is characterized in that Compare the actual test result with the expected test result to obtain a final test result, wherein both the actual test result and the expected test result are in JSON format. The method includes: Loop through each attribute and its expected attribute value in the expected test result, and according to each attribute in the expected test result, use the jsonpath method to retrieve the corresponding attribute and its test attribute value in the actual test result. If the expected attribute value and the test attribute value of each attribute are consistent, the test case result is passed, otherwise it fails.

7. The test case automation execution method according to claim 1, It is characterized in that Generating a test report includes: displaying the test report in the form of an HTML page.

8. A test case automated execution device, It is characterized in that When the device is executed, it is used to implement the steps of the test case automatic execution method according to any one of claims 1 to 7, and the device includes: The test data management module is used to build and maintain multiple test data according to the fields to which the test objects belong, and store them in the database; A test case management module is used to construct and maintain multiple test cases according to the fields to which the test objects belong, and store them in a database; the test cases at least include a test case ID, test steps, and expected test results; The test case execution module is used to send the test task to the message queue based on the preset scheduling mechanism; the idle working process takes the test task from the message queue, and executes the single test case in sequence according to the test case ID in the test task; wherein, when executing a single test case, according to the test case type, a test data is randomly selected from the corresponding test data, the selected test data is assembled into a business message, and a business test is initiated; the data status of the test object is monitored in real time, and the next test action is automatically executed according to the status value and the test step until the last step is executed; A test result checking module is used to compare the actual test result obtained by the test case execution module with the expected test result to obtain a final test result; The test report generating module is used to generate a test report according to the final test result.

9. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer program product comprising a computer program / instructions, It is characterized in that When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images