Software definition-based virtuality and reality combined automatic test resource allocation method and software definition-based virtuality and reality combined automatic test resource allocation system

Abstract

The invention relates to the field of software automatic testing and resource compiling and matching, in particular to a virtual-real combined automatic testing resource compiling and matching method and system based on software definition, and the method comprises the steps: receiving a use case script compiled by a user side and a called packaging library basic method, and selecting a use case script execution plug-in; receiving task timing created by the user side and environment variables executed by the test case, and reading environment variable parameters executed by the test case and set by the user side through the case script; receiving a test definition created by a user at an automatic test system end, calling a scheduling tool to process the test definition, and generating a task definition; receiving an execution instruction triggered by a user at an automatic test system end, generating a task instance according to the task definition by calling a scheduling tool, and starting an execution environment to execute a task; and receiving a running result sent by the execution environment, and judging a task execution condition based on the running result.

Description

Technical Field

[0001] The present application relates to the field of software automation testing and resource allocation, and in particular to a method and system for automated testing resource allocation based on software-defined virtual-real integration. Background Art

[0002] In the test process of the communication field, operators generally operate multiple instruments and equipment according to the process steps, and rely on designated software to obtain the corresponding test results, process and analyze them. For such test steps, operators often need to repeat them many times, and the operation steps are relatively cumbersome and highly reusable.

[0003] At the same time, task scheduling systems are widely used in the industry, such as Apache's DolphinScheduler, which aims to solve complex big data task dependencies and provide applications with data and relationships in various OPS orchestrations. It solves the problem of complex data R&D ETL dependencies and the inability to monitor the health status of tasks. To a certain extent, it supports the needs of automated task execution and provides comprehensive automated execution functions such as task script filling, task process formulation, task execution and result monitoring.

[0004] In addition, the emergence of the test data management platform is based on the need of enterprises to establish a platform to uniformly manage all the test data and all test-related information and business processes of the enterprise, and to have more comprehensive management of relevant information of the test business, incorporating task management, process management, resource management, data management, etc., to ensure the goal of data management of the entire test process with the test process as the main line.

[0005] The main methods for studying and implementing automated execution are: writing execution step scripts, filling in the parameters to be passed in, determining the execution environment, executing one or more scripts regularly or manually, and outputting generated result files. For more complex cases, the scripts need to be organized in sequence, and the use cases need to include judgment and other processing logic.

[0006] The main method of researching and implementing automated experiments is: on the basis of automated execution, corresponding management of the entire experimental process should be included, and control and information recovery solutions for experimental related elements such as hardware equipment should be provided.

[0007] When using a single test data management system or a single task scheduling system to conduct automated tests, it is difficult to fully meet the needs of automated tests due to the following reasons: 1. The test process management in the test business process, such as use case management, orchestration management, and result recovery, is not fully managed through the task scheduling system. For example, the scripts executed by each node of the process in the task scheduling system are generally filled in directly, which is not convenient to access when reuse is needed. When the results generated by the automatic test contain multiple files, the form of result recovery display is still not intuitive enough. The remote execution method does not provide an intuitive way for users to set up, view and manage in the task scheduling system; 2. The test data management system is oriented to the needs of automated tests, and there is still a lack of corresponding solutions for concurrent execution of test processes and real-time monitoring of results. The handling method when automated tests require the linkage of multiple devices and multiple software for process operations is still not clear enough.

[0008] Based on the above two problems, the task scheduling system provides strong support for automated execution, but lacks solutions that are more in line with business processes in terms of remote execution, use case script management, and execution result recovery. At the same time, the test data management platform covers the entire process management with the test process as the main line, but focuses on data processing and lacks functions related to the automated execution of test tasks.

[0009] In view of this, how to provide a software-defined, virtual-real combined automated testing and resource orchestration method that, on the basis of full-process test management, provides the ability to support remote execution of automated testing, multi-task execution and status monitoring has become a technical problem that urgently needs to be solved. Summary of the invention

[0010] The embodiments of the present application provide a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an automated test system end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a scheduling tool end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an execution environment end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a user end, a system for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an automated test system end, a device for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an automated test system end, a device for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a scheduling tool end, a device for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an execution environment end, a device for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a user end, an electronic device and a computer storage medium, which are used to solve the problem that the current management of the entire test process cannot provide the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0011] In a first aspect of an embodiment of the present application, a software-defined virtual-real combination automated test resource allocation method is provided, which is applied to an automated test system end, and includes:

[0012] Receive a use case script written by a user end, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes a basic method of a called encapsulation library;

[0013] Receiving a test definition created by a user on the automated test system, and processing the test definition by calling a scheduling tool to generate a task definition;

[0014] Receive the task timing set by the user on the automated test system end, and the environment variables for the test case execution, and read the environment variable parameters for the test case execution set by the user end through each case script under the test task;

[0015] Receive the execution instruction triggered by the user on the automated test system end, generate a task instance according to the task definition by calling the scheduling tool, and start the execution task in the execution environment;

[0016] Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task is completed. During the execution of each test case, obtain the execution status of the task and each test case under the task through the scheduling tool at regular intervals, and determine the task execution status based on the task execution status until all the test cases under the task are completed;

[0017] When the task is completed, a test report is generated, the test result file is downloaded, and the task execution is ended.

[0018] In a second aspect of an embodiment of the present application, a virtual-real combined automated test resource allocation device based on software definition is provided, which is applied to an automated test system end, and includes:

[0019] A selection module is configured to receive a use case script written by a user end, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script contains a basic method of a called encapsulation library;

[0020] A processing module is configured to receive a test definition created by a user on the automated test system, process the test definition by calling a scheduling tool, and generate a task definition;

[0021] The reading module is configured to receive the task timing set by the user on the automated test system side, and the environment variables for the execution of the test case, and read the environment variable parameters for the execution of the test case set by the user side through each case script under the test task;

[0022] A startup module is configured to receive an execution instruction triggered by a user at the automated test system end, generate a task instance according to the task definition by calling a scheduling tool, and start executing the task in an execution environment;

[0023] The judgment module is configured to receive the operation result sent by the execution environment, and based on the operation result, judge whether the execution of each test case under the task is completed, and during the execution of each test case, obtain the execution status of the task and each test case under the task through the scheduling tool at regular intervals, and judge the task execution status based on the task execution status until all the test cases under the task are completed;

[0024] The generation module is configured to generate a test report, download the test result file, and end the task execution when the task execution is completed.

[0025] In a third aspect of an embodiment of the present application, a software-defined virtual-real combination automated test resource allocation method is provided, which is applied to a scheduling tool end and includes:

[0026] Receive test cases sent by the automated test system;

[0027] Based on the test definition, scheduling the distribution plug-in to execute, and distributing the execution resources to the specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script and the proxy plug-in to the execution environment;

[0028] The agent plug-in is called through the distribution plug-in, and the test case is executed according to the execution script and execution parameters.

[0029] In a fourth aspect of an embodiment of the present application, a software-defined virtual-real combination automated test resource allocation method is provided, which is applied to a scheduling tool end and includes:

[0030] A first receiving module is configured to receive a test case sent by the automated test system;

[0031] A first distribution module is configured to schedule the distribution plug-in execution based on the test definition, and distribute the execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script and a proxy plug-in to the execution environment;

[0032] The first execution module is configured to call the proxy plug-in through the distribution plug-in and execute the test case according to the execution script and execution parameters.

[0033] In a fifth aspect of the embodiment of the present application, a method for automated test resource allocation based on software-defined virtual-real integration is provided, which is applied to an execution environment end and includes:

[0034] Receiving execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0035] Calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters;

[0036] When the execution of the execution environment is completed, the operation result is collected to the automated test system through the distribution plug-in, and a task operation result report is generated according to the custom report template.

[0037] In a sixth aspect of the embodiment of the present application, a method for automated test resource allocation based on software-defined virtual-real integration is provided, which is applied to an execution environment end and includes:

[0038] A second receiving module is configured to receive execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0039] A second execution module is configured to call the proxy plug-in through the distribution plug-in, and execute the use case script according to the execution script and execution parameters;

[0040] The generation module is configured to recover the operation result to the automated test system through the distribution plug-in when the execution of the execution environment is completed, and generate a task operation result report according to the custom report template.

[0041] In a seventh aspect of the embodiments of the present application, a method for automated test resource allocation based on software-defined virtual-real integration is provided, which is applied to a user end and includes:

[0042] Write a use case script, and based on the use case script, call the basic method of the encapsulation library, wherein the basic method of the encapsulation library includes a basic interaction mode of the suffix name, a basic tool class mode, and specific business operations performed on related instruments and equipment based on the basic interaction mode in a hierarchical manner;

[0043] Create a test case arrangement, organize the created test cases based on the case arrangement, generate an arrangement combination, create a test definition based on the arrangement combination, and send the test definition to the automated test system end, wherein the case arrangement includes the execution parameters of all test cases under the case arrangement, the connection parameters of the remote execution environment, and the sequence of each case;

[0044] Setting task timing and environment variables for the test case execution, and writing the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0045] Triggering the execution instruction to execute the task, wherein the execution task is triggered, including triggering the execution task through task timing, and triggering the execution instruction to execute the task manually by the user.

[0046] In an eighth aspect of the embodiments of the present application, a method for automated test resource allocation based on software-defined virtual-real integration is provided, which is applied to a user end and includes:

[0047] A writing module is configured to write a use case script, and based on the use case script, call a basic method of a package library, wherein the basic method of the package library includes a basic interaction mode of a suffix name, a basic tool class mode, and specific business operations performed on relevant instruments and equipment based on the basic interaction mode in a hierarchical manner;

[0048] A creation module is configured to create a test case arrangement, organize the created test cases based on the case arrangement, generate an arrangement combination, create a test definition based on the arrangement combination, and send the test definition to the automated test system end, wherein the case arrangement includes the execution parameters of all test cases under the case arrangement, the connection parameters of the remote execution environment, and the sequence of each case;

[0049] A setting module is configured to set task timing and environment variables for the execution of the test case, and write the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0050] The trigger module is configured to trigger the execution instruction to execute the task, wherein the execution task is triggered, including the execution task being triggered by task timing and the execution task being triggered manually by the user.

[0051] According to a ninth aspect of an embodiment of the present application, there is provided a computing device, including:

[0052] Memory and processor;

[0053] The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions. When the computer executable instructions are executed by the processor, the steps of the above-mentioned software-defined virtual-real combination automated test resource allocation method are implemented.

[0054] According to the tenth aspect of the embodiments of the present application, a computer-readable storage medium is provided, which stores computer-executable instructions, and when the instructions are executed by a processor, the steps of the above-mentioned software-defined virtual-real combination automated test resource allocation method are implemented.

[0055] The present application provides a software-defined virtual-real combination automated test resource allocation method, which is applied to the automated test system end, including: first, receiving a use case script written by a user end, selecting a use case script execution plug-in based on the language of the use case script, and storing the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script contains a basic method of a package library called; then, receiving a test definition created by a user on the automated test system end, processing the test definition by calling a scheduling tool, and generating a task definition; secondly, receiving the task timing set by the user on the automated test system end, and the environment variables for the execution of the test case, and executing the test case through each use case script under the test task. The method reads the environment variable parameters for executing the test case set by the user end; secondly, receives the execution instruction triggered by the user on the automated test system end, generates a task instance according to the task definition by calling the scheduling tool, and starts executing the task in the execution environment; thirdly, receives the running result sent by the execution environment, and based on the running result, determines whether the execution of each test case under the task is completed. During the execution of each test case, the execution status of the task and each test case under the task is obtained periodically through the scheduling tool, and the task execution status is determined based on the task execution status until all the test cases under the task are completed; finally, when the task execution is completed, generates a test report, downloads the test result file, and ends the task execution.

[0056] The software-defined virtual-real automated test resource allocation method provided in the embodiment of the present application is applied. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation methods during the test process are optimized; a script design method is constructed with a basic library as the support for the implementation of the use case script, the use case script as the core of the test operation, and the script control of multiple equipment and instruments. The automated test system is used as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is implemented, and a distribution plug-in is used to distribute resources to the execution environment. The distribution plug-in calls the proxy plug-in. The proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters. The distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability of supporting remote execution of automated tests, multi-task execution and status monitoring.

[0057] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, which can be implemented in accordance with the contents of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0059] Figure 1 A flowchart of a method for allocating virtual-real automated test resources based on software definition applied to an automated test system provided in an embodiment of the present application;

[0060] Figure 2 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to a scheduling tool provided in an embodiment of the present application;

[0061] Figure 3 A flowchart of a method for automating test resource allocation based on software-defined virtual-real integration applied to an execution environment provided in an embodiment of the present application;

[0062] Figure 4 A flowchart of a method for automating test resource allocation based on software-defined virtual-real integration applied to a user end provided in an embodiment of the present application;

[0063] Figure 5A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration for a specific scenario provided in an embodiment of the present application;

[0064] Figure 6 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to an automated test system end provided in an embodiment of the present application;

[0065] Figure 7 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to a scheduling tool end provided in an embodiment of the present application;

[0066] Figure 8 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to an execution environment end provided in an embodiment of the present application;

[0067] Fig. 9 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to a user end provided in an embodiment of the present application;

[0068] Fig.10 A schematic diagram of a framework of a software-defined virtual-real combined automated test resource orchestration system provided in an embodiment of the present application;

[0069] Fig.11 A structural block diagram of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0071] See also Figure 1 , Figure 1 The present invention provides a flowchart of a method for allocating virtual and real automated test resources based on software definition applied to an automated test system. Figure 1 As shown, the specific steps include the following steps.

[0072] Step S102: receiving a use case script written by the user, selecting a use case script execution plug-in based on the language of the use case script, and storing the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes a basic method of a called encapsulation library.

[0073] Step S104: receiving the test definition created by the user on the automated test system side, and processing the test definition by calling a scheduling tool to generate a task definition.

[0074] Step S106: receiving the task timing set by the user at the automated test system end, and the environment variables for the test case execution, and reading the environment variable parameters for the test case execution set by the user end through each case script under the test task.

[0075] Step S108: receiving an execution instruction triggered by a user at the automated test system end, generating a task instance according to the task definition by calling a scheduling tool, and starting to execute the task in the execution environment.

[0076] Step S110: Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task has been completed. During the execution of each test case, the execution status of the task and each test case under the task is obtained periodically through the scheduling tool, and the task execution status is determined based on the task execution status until all test cases under the task are completed.

[0077] Step S112: When the task execution is completed, a test report is generated, the test result file is downloaded, and the task execution is ended.

[0078] Step S114: when there is an abnormality in the execution of a test case during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

[0079] In an embodiment of the present application, judging whether the execution of each test case of the task is completed based on the running result includes: during the task execution process, if the test case has a scheduling execution exception, then displaying the full log of the scheduling tool executing the test case in the automated test system, and not recovering invalid execution results; if the test case scheduling is executed normally, then on the basis of recovering content related to the test case execution result, displaying a log with the actual execution output of the script in the automated test system, wherein the normal execution status of the test case includes execution success and execution failure, and success and failure are determined by the business logic of the test case.

[0080] Figure 2 A flowchart of a software-defined virtual-real combined automated test resource allocation method applied to a scheduling tool provided in an embodiment of the present application.

[0081] Step S202: receiving a test case sent by the automated test system;

[0082] Step S204: Based on the test definition, schedule the distribution plug-in to execute, and distribute the execution resources to the specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script and the proxy plug-in to the execution environment;

[0083] Step S206: calling the proxy plug-in through the distribution plug-in, and executing the test case according to the execution script and execution parameters.

[0084] Figure 3 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to an execution environment provided in an embodiment of the present application.

[0085] Step S302: receiving execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script and an agent plug-in to the execution environment;

[0086] Step S304: calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters;

[0087] Step S306: When the execution of the execution environment is completed, the operation result is collected to the automated test system through the distribution plug-in, and a task operation result report is generated according to the custom report template.

[0088] Figure 4 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to a user side provided in an embodiment of the present application.

[0089] Step S402: Write a use case script, and based on the use case script, call the basic method of the encapsulation library, wherein the basic method of the encapsulation library includes a basic interaction mode of the suffix name, a basic tool class mode, and specific business operations performed on related instruments and equipment based on the basic interaction mode in a hierarchical manner;

[0090] Step S404: Create a test case arrangement, organize the created test cases based on the case arrangement, generate an arrangement combination, create a test definition based on the arrangement combination, and send the test definition to the automated test system end, wherein the case arrangement includes the execution parameters of all test cases under the case arrangement, the connection parameters of the remote execution environment, and the sequence of each case;

[0091] Step S406: setting task timing and environment variables for the test case execution, and writing the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0092] Step S408: triggering the execution instruction to execute the task, wherein the execution task is triggered, including by task timing triggering the execution task, and by the user manually triggering the execution instruction to execute the task.

[0093] In an embodiment of the present application, the use case script is written, including: writing a use case script according to a target process step, and calling multiple instruments and equipment based on the use case script, wherein the target process step includes: writing a script based on setting connection information, establishing a connection, executing a specific business method through the connection, processing and parsing the execution results through a tool class or other method, and disconnecting the connection.

[0094] Figure 5 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration for a specific scenario provided in an embodiment of the present application.

[0095] like Figure 5 As shown, the automated test and resource allocation method provided in the embodiment of the present application includes the following steps:

[0096] Step 1: The user writes a use case script and calls the basic methods of the encapsulation library.

[0097] Specifically, the user writes a use case script, which can call the basic methods of the encapsulation library. Select the use case script execution plug-in, create a test case, and add the written script to the use case.

[0098] In one embodiment of the present application, a basic method encapsulation library of Python language is provided, which includes basic interaction methods such as ssh, com, basic tool methods, and specific business operations performed on related instruments and equipment based on the basic interaction methods, such as the execution of specific commands, etc. The user writes a script based on the steps of setting connection information, establishing a connection, executing a specific business method through the connection, processing and parsing the execution results through tools or other methods, and disconnecting the connection, so as to realize the test case script involving calling multiple instruments and equipment.

[0099] In one embodiment of the present application, the execution host needs to ensure that the ssh server is turned on, as well as the relevant execution environment for executing the use case call, such as Java, Python, etc. If a Python script is used as a use case script, and the script calls the method of the encapsulation library, it is necessary to ensure that the execution host has the Python execution environment installed, and the encapsulation library and its related dependent libraries have been installed.

[0100] Step 2: The user selects the use case plug-in and saves the use case to the automated testing system.

[0101] Specifically, the use case script execution plug-in is written with reference to the execution methods of different types of scripts, packaged as a jar file in the form of a Java project, and input is script file, script parameters, execution-related parameters, etc. The plug-in reads the script file and script parameters, configures the execution method according to the execution-related parameters, executes the script, and processes the output of the script according to the requirements. Each use case script execution plug-in corresponds to a scripting language. The execution parameters are related to the execution methods of different types of scripts. The automated test system will record the use case script, execution parameters, the use case execution plug-in used, and related basic information for each test case. Use cases are classified and used as a reusable use case library for use case arrangement.

[0102] Step 3: The user creates a use case orchestration in the automated test system.

[0103] Specifically, the user creates a test case orchestration, organizes the created test cases to form an orchestration combination, and configures the network connection information of the execution host.

[0104] In one embodiment of the present application, the test case arrangement in the automated test system is composed of multiple test case scripts in the order of execution, and the remote execution host connection information is recorded in the form of global parameters of the arrangement. The arrangement content includes the execution parameters of all test cases, the connection parameters of the remote execution environment, the sequence of each test case, etc., which will be passed to the scheduling tool when creating the test definition.

[0105] Step 4: The user creates a test definition based on the orchestration.

[0106] Step 5: The automated test system calls the scheduling tool to generate task definitions.

[0107] Step 6: Schedule or manually trigger the execution of the task.

[0108] Step 7: The automated test system calls the scheduling tool to generate a task instance based on the task definition and starts the task.

[0109] Specifically, set the task to execute at a scheduled time, set the execution environment variables, execute the test task at a scheduled time or manually according to the test definition, distribute relevant resources to the execution host, and use the case to control the operation of related software and hardware equipment.

[0110] In one embodiment of the present application, after creating the test definition, the task timing can be set according to the year, month, day, hour, minute, second and seven days of the week. After that, the test task will be triggered to execute according to the set time loop timing. The timing setting can be canceled or created again. After creating the test definition, the environment variables for the use case execution can be set. The set content will be written into the environment variables of the execution environment during execution. The environment variable parameters can be read in different scripting languages ​​and used in the script execution steps. The content of the environment variables is mainly based on the network connection information of remote devices and instruments, and includes some parameters distinguished by test tasks.

[0111] Step 8: The scheduling tool schedules the distribution plug-in execution.

[0112] Step 9: Distribute plug-ins Distribute the Java execution environment, execution plug-ins, execution scripts, agent plug-ins, etc. to the execution environment.

[0113] Step 10: The execution environment receives the distributed resources.

[0114] Step 11: The distribution plug-in calls the proxy plug-in to execute the use case script.

[0115] Specifically, during the execution of the test task, each execution case is scheduled by the scheduling tool to execute the following steps through the distribution plug-in: the distribution plug-in sends the proxy plug-in, script execution plug-in, Java execution environment, and execution script file to the execution environment according to the network connection information of the execution environment, and then the distribution plug-in calls the proxy plug-in to execute the case according to the execution script and execution parameters. In the automated test system, the distribution plug-in is responsible for transferring the basic Java execution environment, script execution plug-in, proxy plug-in, and script execution file to the specified path of the execution environment. The operation of downloading and starting the distribution plug-in will be automatically written into the task flow when the test definition is created. The proxy plug-in calls the execution plug-in corresponding to the case and injects the execution script, execution parameters and other information saved by the case.

[0116] Step 12: The execution environment is completed and the running results are generated.

[0117] Step 13: Distribute the plug-in to recover the running results to the automated test system.

[0118] Step 14: Determine whether all use cases of the task have been executed. If so, end the scheduling tool process; if not, execute step 8.

[0119] Step 15: The automated test system periodically obtains the task execution status from the scheduling tool.

[0120] Step 16: Determine whether the task has been completed. If so, execute step 17; if not, execute step 15.

[0121] Step 17: The automated test system generates a test report, downloads the test result file, and ends.

[0122] Specifically, after the operation is completed, the operation logs, generated files, etc. are collected to the system for download.

[0123] In one embodiment of the present application, after the task execution is completed, the distribution plug-in writes the result back to the automated test system. The generated file of each execution use case consists of a script running log, script generation related files, basic information of the execution environment, and a full log of the scheduling process execution. The results are packaged and recovered according to the task ID and provided for download. The execution status and execution time of the task and each use case under the task are obtained and synchronized to the system according to the external interface of the scheduling tool. During the task execution process, if the use case fails to be scheduled, the full log of the scheduling tool executing the use case is displayed in the system on the basis of recovering all relevant content. If the scheduling execution is normal, the log displayed in the system is the content of the actual execution output of the script. The report format for generating the test task execution results is based on a customized report template.

[0124] In one embodiment of the present application, the interaction between the automated test system and the scheduling tool refers to the external interface of the scheduling tool. The related entities designed in the scheduling tool need to be repackaged in the automated test system or establish associations with existing entities to achieve the ability to manage and control the scheduling tool and obtain results through the automated test system.

[0125] The software-defined virtual-real automated test resource allocation method provided in the embodiment of the present application is applied. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation methods during the test process are optimized; a script design method is constructed with a basic library as the support for the implementation of the use case script, the use case script as the core of the test operation, and the script control of multiple equipment and instruments. The automated test system is used as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is implemented, and a distribution plug-in is used to distribute resources to the execution environment. The distribution plug-in calls the proxy plug-in. The proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters. The distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability of supporting remote execution of automated tests, multi-task execution and status monitoring.

[0126] Corresponding to the above method embodiment, this specification also provides an embodiment of a software-defined virtual-real combination automated test resource allocation device applied to an automated test system. Figure 6 The present invention provides a schematic diagram of a software-defined virtual-real combination automated test resource allocation device for an automated test system. Figure 6 As shown, the device comprises:

[0127] The selection module 602 is configured to receive a use case script written by a user end, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes a basic method of a called encapsulation library;

[0128] The processing module 604 is configured to receive a test definition created by a user on the automated test system, process the test definition by calling a scheduling tool, and generate a task definition;

[0129] The reading module 606 is configured to receive the task timing set by the user on the automated test system side, and the environment variables for the test case execution, and read the environment variable parameters for the test case execution set by the user side through each case script under the test task;

[0130] The start module 608 is configured to receive an execution instruction triggered by a user at the automated test system end, generate a task instance according to the task definition by calling a scheduling tool, and start executing the task in the execution environment;

[0131] The judgment module 610 is configured to receive the operation result sent by the execution environment, and based on the operation result, judge whether the execution of each test case under the task is completed, and in the execution process of each test case, obtain the execution status of the task and each test case under the task regularly through the scheduling tool, and judge the task execution status based on the task execution status until all the test cases under the task are completed;

[0132] The generation module 612 is configured to generate a test report, download the test result file, and end the task execution when the task execution is completed.

[0133] In an optional embodiment, the determination module 610 is further configured to:

[0134] During the task execution process, if the test case has a scheduling execution exception, the full log of the scheduling tool executing the test case is displayed in the automated test system, and invalid execution results are not recovered;

[0135] If the test case scheduling is executed normally, then on the basis of recovering the content related to the test case execution result, a log with the actual execution output of the script as the content is displayed in the automated test system, wherein the normal execution status of the test case includes successful execution and failed execution, and success and failure are determined by the business logic of the test case.

[0136] In an optional embodiment, the determination module 610 is further configured to:

[0137] In the case where there is an execution exception of a test case during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

[0138] Corresponding to the above method embodiment, this specification also provides an embodiment of a software-defined virtual-real combination automated test resource allocation device applied to a scheduling tool end, Figure 7 The present invention provides a schematic diagram of a software-defined virtual-real combination automated test resource allocation device for a scheduling tool end. Figure 7 As shown, the device comprises:

[0139] A first receiving module 702 is configured to receive a test case sent by the automated test system;

[0140] A first distribution module 704 is configured to schedule the distribution plug-in execution based on the test definition, and distribute the execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script and the proxy plug-in to the execution environment;

[0141] The first execution module 706 is configured to call the proxy plug-in through the distribution plug-in and execute the test case according to the execution script and execution parameters.

[0142] Corresponding to the above method embodiment, this specification also provides an embodiment of a software-defined virtual-real combination automated test resource allocation device applied to an execution environment end, Figure 8 The present invention provides a schematic diagram of a software-defined virtual-real combination automated test resource allocation device for an execution environment end. Figure 8 As shown, the device comprises:

[0143] The second receiving module 802 is configured to receive the execution resources and use case scripts distributed by the automated test system, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script and the proxy plug-in to the execution environment;

[0144] A second execution module 804 is configured to call the proxy plug-in through the distribution plug-in, and execute the use case script according to the execution script and execution parameters;

[0145] The generation module 806 is configured to, when the execution of the execution environment is completed, recycle the operation result to the automated test system through the distribution plug-in, and generate a task operation result report according to the custom report template.

[0146] Corresponding to the above method embodiment, this specification also provides an embodiment of a software-defined virtual-real combination automated test resource allocation device applied to a user end, Fig. 9 The present invention provides a schematic diagram of a software-defined virtual-real combination automated test resource allocation device for a user terminal. Fig. 9 As shown, the device comprises:

[0147] The writing module 902 is configured to write a use case script and call a basic method of the encapsulation library based on the use case script, wherein the basic method of the encapsulation library includes a basic interaction mode of a suffix name, a basic tool class mode, and specific business operations performed on related instruments and devices based on the basic interaction mode in a hierarchical manner;

[0148] The creation module 904 is configured to create a test case arrangement, organize the created test cases based on the case arrangement, generate an arrangement combination, create a test definition based on the arrangement combination, and send the test definition to the automated test system end, wherein the case arrangement includes the execution parameters of all test cases under the case arrangement, the connection parameters of the remote execution environment, and the sequence of each case;

[0149] A setting module 906 is configured to set task timing and environment variables for the test case execution, and write the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0150] The trigger module 908 is configured to trigger the execution instruction to execute the task, wherein the execution task is triggered, including the execution task being triggered by the task timing, and the execution task being triggered by the user manually.

[0151] In an optional embodiment, the writing module 902 is further configured to:

[0152] According to the target process steps, a use case script is written, and based on the use case script, multiple instruments and equipment are called, wherein the target process steps include: writing a script based on the steps of setting connection information, establishing connection, executing specific business methods through connection, processing and parsing execution results through tool classes or other methods, and disconnecting.

[0153] The software-defined virtual-real automated test resource allocation device provided in the embodiment of the present application is applied. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation methods during the test process are optimized; a script design method is constructed with a basic library as the support for the implementation of the use case script, the use case script as the core of the test operation, and the script control of multiple equipment and instruments. The automated test system is used as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is implemented, and a distribution plug-in is used to distribute resources to the execution environment. The distribution plug-in calls the proxy plug-in. The proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters. The distribution plug-in packages the results and recovers them to the system after the execution. A remote distribution execution method is provided, which realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0154] Fig.10 A schematic diagram of the framework of a software-defined virtual-real automated test resource orchestration system provided in an embodiment of the present application.

[0155] The verification library management unit 1002 is used to encapsulate basic operations, tool operations and business operations, and write use case scripts;

[0156] The test case management unit 1004 is used to add, modify, and search test cases, and save the case execution script, the selected execution plug-in, the execution parameters, and the basic information of the case;

[0157] The test arrangement management unit 1006 is used to add, modify, and search for test arrangements, and save the test arrangement process information consisting of test case nodes, execution order, and global parameters;

[0158] The test definition management unit 1008 is used to create a corresponding test definition according to the test arrangement, and call the scheduling tool to create a corresponding test process, and set the timing and environment variables;

[0159] The test execution management unit 1010 is used to create a test execution task based on the test definition, call the scheduling tool to start the test process, and regularly obtain the monitoring results of the scheduling tool on the task, and provide the download of the recovery results;

[0160] The test report management unit 1012 is used to generate a task running result report according to a custom report template.

[0161] The software-defined virtual-real automated test resource orchestration system provided in the embodiment of the present application is applied. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation methods during the test process are optimized; a script design method is constructed with a basic library as the support for the implementation of the use case script, the use case script as the core of the test operation, and the script control of multiple equipment and instruments. The automated test system is used as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is implemented, and a distribution plug-in is used to distribute resources to the execution environment. The distribution plug-in calls the proxy plug-in. The proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters. The distribution plug-in packages the results and recovers them to the system after the execution. The remote distribution execution method realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0162] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the automatic test resource allocation device based on software-defined virtual-real combination, since it is basically similar to the automatic test resource allocation method embodiment based on software-defined virtual-real combination, the description is relatively simple, and the relevant parts can be referred to the partial description of the automatic test resource allocation method embodiment based on software-defined virtual-real combination.

[0163] Fig.11 This is a block diagram of a computing device provided in an embodiment of the present application. The components of the computing device 1100 include but are not limited to a memory 1110 and a processor 1120. The processor 1120 is connected to the memory 1110 via a bus 1130, and the database 1150 is used to store data.

[0164] The computing device 1100 also includes an access device 1140, which enables the computing device 1100 to communicate via one or more networks 1160. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 1140 may include one or more of any type of network interface (e.g., a network interface card (NIC)) of wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a world-wide interoperability for microwave access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, and a near field communication (NFC).

[0165] In one embodiment of the present specification, the above components of the computing device 1100 and Fig.11 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Fig.11 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.

[0166] The computing device 1100 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or a personal computer (PC). The computing device 1100 may also be a mobile or stationary server.

[0167] The processor 1120 is used to execute the following computer executable instructions, which, when executed by the processor, implement the steps of the above-mentioned software-defined virtual-real combination automated test resource allocation method.

[0168] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computing device embodiment, since it is basically similar to the embodiment of the automated test resource allocation method based on software-defined virtual-real combination, the description is relatively simple, and the relevant parts can be referred to the partial description of the embodiment of the automated test resource allocation method based on software-defined virtual-real combination.

[0169] An embodiment of the present specification further provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the above-mentioned software-defined virtual-real combination automated test resource allocation method.

[0170] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computer-readable storage medium embodiment, since it is basically similar to the embodiment of the automated test resource allocation method based on software-defined virtual-real combination, the description is relatively simple, and the relevant parts can be referred to the partial description of the embodiment of the automated test resource allocation method based on software-defined virtual-real combination.

[0171] An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned software-defined virtual-real combination automated test resource allocation method.

[0172] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computer program embodiment, since it is basically similar to the embodiment of the automated test resource allocation method based on software-defined virtual-real combination, the description is relatively simple, and the relevant parts can be referred to the partial description of the embodiment of the automated test resource allocation method based on software-defined virtual-real combination.

[0173] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0174] The computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0175] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0176] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The optional embodiments do not describe all the details in detail, nor do they limit the invention to only the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that technicians in the relevant technical field can well understand and use this specification. This specification is only limited by the claims and their full scope and equivalents.

Claims

1. A software-defined virtual-real combination automated test resource allocation method, characterized in that: Applied to automated test systems, including: Receive a use case script written by a user end, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes a basic method of a called encapsulation library; Receiving a test definition created by a user on the automated test system, and processing the test definition by calling a scheduling tool to generate a task definition; Receive the task timing set by the user on the automated test system end, and the environment variables for the test case execution, and read the environment variable parameters for the test case execution set by the user end through each case script under the test task; Receive the execution instruction triggered by the user on the automated test system end, generate a task instance according to the task definition by calling the scheduling tool, and start the execution task in the execution environment; Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task is completed. During the execution of each test case, obtain the execution status of the task and each test case under the task through the scheduling tool at regular intervals, and determine the task execution status based on the task execution status until all the test cases under the task are completed; When the task is completed, a test report is generated, the test result file is downloaded, and the task execution is ended.

2. The method according to claim 1, characterized in that The step of judging whether each test case under the task is executed based on the running result includes: During the task execution process, if the test case has a scheduling execution exception, the full log of the scheduling tool executing the test case is displayed in the automated test system, and invalid execution results are not recovered; If the test case scheduling is executed normally, then on the basis of recovering the content related to the test case execution result, a log with the actual execution output of the script as the content is displayed in the automated test system, wherein the normal execution status of the test case includes successful execution and failed execution, and success and failure are determined by the business logic of the test case.

3. The method according to claim 1, characterized in that The determining of the task execution status based on the task execution status further includes: In the case where there is an execution exception of a test case during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

4. A software-defined virtual-real combination automated test resource orchestration method, characterized in that: Applied to the scheduling tool side, including: Receive test cases sent by the automated test system; Based on the test definition, scheduling the distribution plug-in to execute, and distributing the execution resources to the specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script and the proxy plug-in to the execution environment; The agent plug-in is called through the distribution plug-in, and the test case is executed according to the execution script and execution parameters.

5. A software-defined virtual-real combination automated test resource orchestration method, characterized in that: Applied to the execution environment, including: Receiving execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment; Calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters; When the execution of the execution environment is completed, the operation result is collected to the automated test system through the distribution plug-in, and a task operation result report is generated according to the custom report template.

6. A software-defined virtual-real combination automated test resource allocation method, characterized in that: Applied to the user side, including: Write a use case script, and based on the use case script, call the basic method of the encapsulation library, wherein the basic method of the encapsulation library includes a basic interaction mode of the suffix name, a basic tool class mode, and specific business operations performed on related instruments and equipment based on the basic interaction mode in a hierarchical manner; Create a test case arrangement, organize the created test cases based on the case arrangement, generate an arrangement combination, create a test definition based on the arrangement combination, and send the test definition to the automated test system end, wherein the case arrangement includes the execution parameters of all test cases under the case arrangement, the connection parameters of the remote execution environment, and the sequence of each case; Setting task timing and environment variables for the test case execution, and writing the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task; Triggering the execution instruction to execute the task, wherein the execution task is triggered, including triggering the execution task through task timing, and triggering the execution instruction to execute the task manually by the user.

7. The method according to claim 6, characterized in that The writing of the use case script includes: According to the target process steps, a use case script is written, and based on the use case script, multiple instruments and equipment are called, wherein the target process steps include: writing a script based on the steps of setting connection information, establishing connection, executing specific business methods through connection, processing and parsing execution results through tool classes or other methods, and disconnecting.

8. A software-defined virtual-real combination automated test resource orchestration system, characterized in that: include: Verification library management module, used to encapsulate basic operations, tool operations and business operations, and write use case scripts; The test case management module is used to add, modify, and search test cases, and save the test case execution script, the selected execution plug-in, the execution parameters, and the basic information of the test case; The test arrangement management module is used to add, modify, and search test arrangements, and save the test arrangement process information consisting of test case nodes, execution order, and global parameters; The test definition management module is used to create corresponding test definitions according to the test arrangement, call the scheduling tool to create the corresponding test process, and set the timing and environment variables; The test execution management module is used to create test execution tasks based on test definitions, call the scheduling tool to start the test process, and regularly obtain the monitoring results of the scheduling tool on the task, and provide downloading of the recovery results; The test report management module is used to generate task operation result reports based on custom report templates.

9. A computing device comprising: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the software-defined virtual-real combination automated test resource orchestration method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an implementation program for information transmission, and when the program is executed by the processor, the steps of the software-defined virtual-real combination automated test resource orchestration method according to any one of claims 1 to 7 are implemented.

Images