A software-defined virtual-real combination automated test resource allocation method and system

Abstract

The present application relates to the field of software automation testing and resource orchestration, and relates to a method and system for automated testing resource orchestration based on a combination of virtual and real elements defined by software. The method comprises: receiving a use case script written by a user end and a basic method of a package library called and selecting a use case script execution plug-in; receiving a task timing created by the user end and an environment variable for executing a test case, and reading the environment variable parameters for executing the test case set by the user end through a use case script; receiving a test definition created by a user on an automated testing system end, calling a scheduling tool to process the test definition and generate a task definition; receiving an execution instruction triggered by a user on an automated testing system end, generating a task instance according to the task definition by calling a scheduling tool, and starting an execution environment to execute the task; receiving an operation result sent by the execution environment, and judging the task execution status based on the operation result.

Description

Technical Field

[0001] The present application relates to the field of software automation testing and resource allocation, and in particular to a method and system for automated testing resource allocation based on software-defined virtual-real integration. Background Art

[0002] During communications testing, operators typically follow a process flow to operate multiple instruments and devices, relying on specialized software to obtain, process, and analyze test results. These test steps often require repeated iterations, making them relatively cumbersome and requiring high levels of reusability.

[0003] Meanwhile, task scheduling systems are widely used in the industry, such as Apache's DolphinScheduler, which aims to resolve complex big data task dependencies and provide applications with data and the relationships between various OPS orchestrations. This addresses the complex dependencies in data R&D ETL and the inability to monitor task health. To a certain extent, it supports the need for automated task execution, providing comprehensive automated execution capabilities such as task scripting, task process development, task execution, and result monitoring.

[0004] In addition, the emergence of the test data management platform is based on the need of enterprises to establish a platform to uniformly manage all the test data and all test-related information and business processes of the enterprise, and to have more comprehensive management of relevant information of the test business, incorporating task management, process management, resource management, data management, etc., to ensure the goal of data management of the entire test process with the test process as the main line.

[0005] The main methods for researching and implementing automated execution are: writing execution step scripts, filling in the parameters to be passed in, determining the execution environment, executing one or more scripts regularly or manually, and outputting generated result files. For more complex cases, the scripts need to be organized in sequence, and judgment and other processing logic must be included between use cases.

[0006] The main approach to the research and implementation of automated testing is to incorporate appropriate management of the entire testing process on the basis of automated execution, and to provide control and information recovery solutions for experimental-related elements such as hardware equipment.

[0007] When using a single test data management system or a single task scheduling system for automated testing, it is difficult to fully meet the needs of automated testing due to the following reasons: 1. The test process management in the test business process, such as use case management, orchestration management, and result recovery, cannot be fully managed through the task scheduling system. For example, the scripts executed by each node of the process in the task scheduling system are generally filled in directly, which is not convenient to access when reuse is needed. When the results generated by the automatic test contain multiple files, the form of result recovery display is still not intuitive enough. The remote execution method does not provide an intuitive way for users to set up, view and manage in the task scheduling system; 2. The test data management system is oriented towards the needs of automated testing, but there is still a lack of corresponding solutions for the concurrent execution of test processes and real-time monitoring of results. The handling method when automated testing requires the linkage of multiple devices and multiple software to perform process operations is still not clear enough.

[0008] Given these two issues, the task scheduling system provides strong support for automated execution, but lacks solutions more aligned with business processes in areas such as remote execution, use case script management, and execution result recovery. Furthermore, the test data management platform covers the entire process of test flow, but primarily focuses on data processing and lacks functionality related to automated test task execution.

[0009] In view of this, how to provide a software-defined, virtual-real combined automated testing and resource orchestration method that, on the basis of full-process testing management, provides support for remote execution of automated testing, multi-task execution and status monitoring capabilities has become a technical problem that urgently needs to be solved. Summary of the Invention

[0010] The embodiments of the present application provide a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an automated test system end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a scheduling tool end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to an execution environment end, a method for arranging automated test resources based on a combination of virtual and real based on software definition and applied to a user end, an automated test resource orchestration system based on a combination of virtual and real based on software definition and applied to an automated test system end, an automated test resource orchestration device based on a combination of virtual and real based on software definition and applied to a scheduling tool end, an automated test resource orchestration device based on a combination of virtual and real based on software definition and applied to an execution environment end, an automated test resource orchestration device based on a combination of virtual and real based on software definition and applied to a user end, an electronic device and a computer storage medium, for solving the problem that the current management of the entire test process cannot provide the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0011] In a first aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to an automated test system, including:

[0012] Receive a use case script written by a user, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in, and related information in the form of a test case in the automated test system, wherein the use case script includes a basic method of a called package library;

[0013] Receive the test definition created by the user on the automated test system, process the test definition by calling the scheduling tool, and generate a task definition;

[0014] Receive the task timing set by the user on the automated test system side, as well as the environment variables for the test case execution, and read the environment variable parameters for the test case execution set by the user side through each case script under the test task;

[0015] Receive the execution instruction triggered by the user on the automated test system side, generate a task instance according to the task definition by calling the scheduling tool, and start executing the task in the execution environment;

[0016] Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task is complete. During the execution of each test case, obtain the execution status of the task and each test case under the task at regular intervals through the scheduling tool, and determine the task execution status based on the task execution status until all test cases under the task are completed;

[0017] When the task is completed, a test report is generated, the test result file is downloaded, and the task execution is ended.

[0018] In a second aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource allocation device is provided, which is applied to an automated test system, including:

[0019] A selection module is configured to receive a use case script written by a user, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in, and related information in the form of a test case in the automated test system, wherein the use case script includes a basic method of a package library that is called;

[0020] a processing module configured to receive a test definition created by a user on the automated test system side, process the test definition by calling a scheduling tool, and generate a task definition;

[0021] A reading module is configured to receive the task timing set by the user on the automated test system side and the environment variables for the execution of the test case, and read the environment variable parameters for the execution of the test case set by the user side through each use case script under the test task;

[0022] The startup module is configured to receive an execution instruction triggered by a user on the automated test system side, generate a task instance according to the task definition by calling a scheduling tool, and start executing the task in the execution environment;

[0023] a judgment module configured to receive the execution results sent by the execution environment and, based on the execution results, determine whether the execution of each test case under the task has been completed; during the execution of each test case, periodically obtain the execution status of the task and each test case under the task through the scheduling tool; and determine the task execution status based on the task execution status until all test cases under the task are completed;

[0024] The generating module is configured to generate a test report, download the test result file, and end the task execution when the task execution is completed.

[0025] In a third aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to a scheduling tool, including:

[0026] Receive test cases sent by the automated test system;

[0027] Based on the test definition, scheduling the distribution plug-in for execution, and distributing execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0028] The agent plug-in is called through the distribution plug-in, and the test case is executed according to the execution script and execution parameters.

[0029] In a fourth aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to a scheduling tool, including:

[0030] A first receiving module is configured to receive a test case sent by the automated test system;

[0031] A first distribution module is configured to schedule the execution of a distribution plug-in based on the test definition, and distribute execution resources to a specified path of an execution environment through the distribution plug-in, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0032] The first execution module is configured to call the proxy plug-in through the distribution plug-in and execute the test case according to the execution script and execution parameters.

[0033] In a fifth aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to an execution environment, including:

[0034] Receive execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in into the execution environment;

[0035] Calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters;

[0036] When the execution of the execution environment is completed, the operation results are collected to the automated test system through the distribution plug-in, and a task operation result report is generated according to the custom report template.

[0037] In a sixth aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to an execution environment, including:

[0038] A second receiving module is configured to receive execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0039] A second execution module is configured to call the proxy plug-in through the distribution plug-in and execute the use case script according to the execution script and execution parameters;

[0040] The generation module is configured to, when the execution of the execution environment is completed, recycle the operation results to the automated test system through the distribution plug-in, and generate a task operation result report according to the customized report template.

[0041] In a seventh aspect of an embodiment of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to a user end and includes:

[0042] Write a use case script and call the basic method of the package library based on the use case script, wherein the basic method of the package library includes a hierarchical distribution of basic interaction methods of suffix names, basic tool class methods, and specific business operations performed on related instruments and equipment based on the basic interaction methods;

[0043] Create a test case orchestration, organize the created test cases based on the use case orchestration to generate an orchestration combination, create a test definition based on the orchestration combination, and send the test definition to the automated test system. The use case orchestration includes the execution parameters of all test cases under the use case orchestration, the connection parameters of the remote execution environment, and the sequence of each test case;

[0044] Setting task timing and environment variables for the test case execution, and writing the environment variables into the execution environment during execution, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0045] Triggering the execution instruction to execute the task, wherein the execution task is triggered, including triggering the execution task through task timing, and manually triggering the execution instruction to execute the task by the user.

[0046] In an eighth aspect of the embodiments of the present application, a software-defined virtual-real combined automated test resource orchestration method is provided, which is applied to a user end and includes:

[0047] A writing module is configured to write a use case script and call a basic method of the package library based on the use case script, wherein the basic method of the package library includes a hierarchical distribution of a basic interaction mode of a suffix name, a basic tool class mode, and specific business operations performed on related instruments and equipment based on the basic interaction mode;

[0048] a creation module configured to create a test case orchestration, organize the created test cases based on the use case orchestration, generate an orchestration combination, create a test definition based on the orchestration combination, and send the test definition to the automated test system, wherein the use case orchestration includes the execution parameters of all test cases under the use case orchestration, the connection parameters of the remote execution environment, and the sequence of each test case;

[0049] A setting module is configured to set task timing and environment variables for the execution of the test case, and write the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0050] The trigger module is configured to trigger the execution instruction to execute the task, wherein the execution task is triggered, including the execution task being triggered by the task timing and the execution task being triggered by the user manually.

[0051] According to a ninth aspect of an embodiment of the present application, a computing device is provided, including:

[0052] memory and processor;

[0053] The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the above-mentioned software-defined virtual-real combined automated test resource allocation method are implemented.

[0054] According to the tenth aspect of the embodiments of the present application, a computer-readable storage medium is provided, which stores computer-executable instructions. When the instructions are executed by a processor, the steps of the above-mentioned software-defined virtual-real combined automated test resource allocation method are implemented.

[0055] The present application provides a software-defined virtual-real combination automated test resource allocation method, which is applied to the automated test system end, including: first, receiving a use case script written by the user end, selecting a use case script execution plug-in based on the language of the use case script, and storing the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes a basic method of the package library called; then, receiving the test definition created by the user on the automated test system end, processing the test definition by calling a scheduling tool, and generating a task definition; secondly, receiving the task timing set by the user on the automated test system end, as well as the environment variables for the execution of the test case, and executing the test case through each use case script under the test task This method reads the environmental variable parameters for the execution of the test case set by the user end; secondly, receives the execution instruction triggered by the user on the automated test system end, generates a task instance according to the task definition by calling the scheduling tool, and starts the execution task in the execution environment; thirdly, receives the running result sent by the execution environment, and based on the running result, determines whether the execution of each test case under the task is completed. During the execution of each test case, the execution status of the task and each test case under the task is obtained regularly through the scheduling tool, and based on the task execution status, determines the task execution status until all the test cases under the task are completed; finally, when the task execution is completed, generates a test report, downloads the test result file, and ends the task execution.

[0056] The embodiment of the present application provides a software-defined virtual-real integrated automated test resource allocation method. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation mode during the test process is optimized; a basic library is constructed as the support for the implementation of the use case script, the use case script is the core of the test operation, and the script design method of the script controls multiple equipment instruments, as well as an automated test system as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is provided, and a distribution plug-in is used to distribute resources to the execution environment, the distribution plug-in calls the proxy plug-in, the proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters, and the distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0057] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, which can be implemented in accordance with the contents of the specification, and to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present application. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0059] Figure 1 A flowchart of a method for allocating automated test resources based on software-defined virtual-real integration applied to an automated test system provided in an embodiment of the present application;

[0060] Figure 2 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to a scheduling tool provided in an embodiment of the present application;

[0061] Figure 3 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to an execution environment provided in an embodiment of the present application;

[0062] Figure 4 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to a user end provided in an embodiment of the present application;

[0063] Figure 5A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration for a specific scenario provided in an embodiment of the present application;

[0064] Figure 6 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to an automated test system provided in an embodiment of the present application;

[0065] Figure 7 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to a scheduling tool provided in an embodiment of the present application;

[0066] Figure 8 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to an execution environment provided in an embodiment of the present application;

[0067] Figure 9 A schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device for a user terminal provided in an embodiment of the present application;

[0068] Figure 10 A schematic diagram of a framework of a software-defined, virtual-real combined automated test resource orchestration system provided in an embodiment of the present application;

[0069] Figure 11 A structural block diagram of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0071] See also Figure 1 , Figure 1 The present invention provides a flowchart of a method for allocating resources for automated testing based on software-defined virtual-real integration applied to an automated testing system. Figure 1 As shown, the specific steps include the following steps.

[0072] Step S102: Receive a use case script written by the user end, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case to the automated test system, wherein the use case script includes the basic method of the package library called.

[0073] Step S104: receiving a test definition created by a user on the automated test system side, processing the test definition by calling a scheduling tool, and generating a task definition.

[0074] Step S106: receiving the task timing set by the user on the automated test system side and the environment variables for the test case execution, and reading the environment variable parameters for the test case execution set by the user side through each use case script under the test task.

[0075] Step S108: receiving the execution instruction triggered by the user on the automated test system side, generating a task instance according to the task definition by calling the scheduling tool, and starting the execution task in the execution environment.

[0076] Step S110: Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task is completed. During the execution of each test case, the execution status of the task and each test case under the task is obtained regularly through the scheduling tool, and the task execution status is determined based on the task execution status until all test cases under the task are completed.

[0077] Step S112: When the task execution is completed, a test report is generated, the test result file is downloaded, and the task execution is ended.

[0078] Step S114: When there is an abnormality in the execution of a test case during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

[0079] In an embodiment of the present application, the determination of whether the execution of each test case of the task is completed based on the running results includes: during the task execution process, if the scheduling execution of the test case is abnormal, then the full log of the scheduling tool executing the test case is displayed in the automated test system, and invalid execution results are not recovered; if the scheduling execution of the test case is normal, then on the basis of recovering content related to the execution result of the test case, a log with the actual execution output of the script is displayed in the automated test system, wherein the normal execution status of the test case includes successful execution and failed execution, and success and failure are determined by the business logic of the test case.

[0080] Figure 2 A flowchart of a software-defined virtual-real combined automated test resource allocation method applied to a scheduling tool provided in an embodiment of the present application.

[0081] Step S202: receiving a test case sent by the automated test system;

[0082] Step S204: Based on the test definition, schedule the distribution plug-in for execution, and distribute the execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script, and the proxy plug-in to the execution environment;

[0083] Step S206: calling the proxy plug-in through the distribution plug-in, and executing the test case according to the execution script and execution parameters.

[0084] Figure 3 A flowchart of a software-defined virtual-real combined automated test resource allocation method applied to an execution environment provided in an embodiment of the present application.

[0085] Step S302: receiving execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in into the execution environment;

[0086] Step S304: calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters;

[0087] Step S306: When the execution of the execution environment is completed, the execution result is recovered to the automated test system through the distribution plug-in, and a task execution result report is generated according to the customized report template.

[0088] Figure 4 A flowchart of a method for automated test resource allocation based on software-defined virtual-real integration applied to a user side provided in an embodiment of the present application.

[0089] Step S402: Write a use case script, and call the basic method of the package library based on the use case script, wherein the basic method of the package library includes a hierarchical distribution of basic interaction methods of suffix names, basic tool class methods, and specific business operations performed on related instruments and equipment based on the basic interaction methods;

[0090] Step S404: Create a test case orchestration, organize the created test cases based on the use case orchestration, generate an orchestration combination, create a test definition based on the orchestration combination, and send the test definition to the automated test system. The use case orchestration includes the execution parameters of all test cases under the use case orchestration, the connection parameters of the remote execution environment, and the sequence of each test case.

[0091] Step S406: Setting the task timing and the environment variables for executing the test case, and writing the environment variables into the execution environment during the execution process, wherein the content of the environment variables includes the network connection information of the remote device and instrument, and the distinguishing parameters of each test task;

[0092] Step S408: triggering the execution instruction to execute the task, wherein the execution task is triggered, including triggering the execution task by task timing, and manually triggering the execution instruction to execute the task by the user.

[0093] In an embodiment of the present application, the writing of the use case script includes: writing a use case script according to the target process steps, and calling multiple instruments and equipment based on the use case script, wherein the target process steps include: writing a script based on setting connection information, establishing a connection, executing a specific business method through the connection, processing the parsed execution results through a tool class or other method, and disconnecting the connection.

[0094] Figure 5 A flowchart of a software-defined virtual-real combined automated test resource allocation method for a specific scenario provided in an embodiment of the present application.

[0095] like Figure 5 As shown, the automated testing and resource allocation method provided in the embodiment of the present application includes the following steps:

[0096] Step 1: The user writes a use case script and calls the basic methods of the encapsulation library.

[0097] Specifically, users write a use case script that can call basic methods in the package library. Select the use case script execution plug-in, create a test case, and add the written script to the use case.

[0098] In one embodiment of the present application, a Python-based basic method encapsulation library is provided. This encapsulation library hierarchically includes basic interaction methods such as SSH and COM, basic utility methods, and specific business operations performed on related instruments and devices based on these basic interaction methods, such as executing specific commands. Users can write scripts based on the steps of setting connection information, establishing a connection, executing specific business methods through the connection, processing and parsing execution results through tools or other methods, and disconnecting, thus implementing test case scripts involving the invocation of multiple instruments and devices.

[0099] In one embodiment of the present application, the execution host must ensure that the SSH server is enabled and that the relevant execution environment for executing the use case call, such as Java, Python, etc., is enabled. If a Python script is used as the use case script and the script calls a package library method, it is necessary to ensure that the execution host has the Python execution environment installed and that the package library and its related dependent libraries are installed.

[0100] Step 2: The user selects the use case plug-in and saves the use case to the automated test system.

[0101] Specifically, the use case script execution plug-in is written with reference to the execution methods of different types of scripts, and is packaged as a jar file in the form of a Java project for use. The input is the script file, script parameters, execution-related parameters, etc. The plug-in reads the script file and script parameters, configures the execution method according to the execution-related parameters, executes the script, and processes the output results of the script according to the requirements. Each use case script execution plug-in corresponds to a script language. The execution parameters are related to the execution methods of different types of scripts. The automated test system will record the use case script, execution parameters, the use case execution plug-in used, and related basic information for each test case. Use cases are classified and used as a reusable use case library for use case orchestration.

[0102] Step 3: The user creates a use case orchestration in the automated test system.

[0103] Specifically, the user creates a test case orchestration, organizes the created test cases into an orchestration combination, and configures the network connection information of the execution host.

[0104] In one embodiment of the present application, the test case orchestration in an automated testing system consists of multiple test case scripts arranged in a sequence of execution, with remote execution host connection information recorded as global parameters within the orchestration. The orchestration includes execution parameters for all test cases, connection parameters for the remote execution environment, and the order of each test case. These parameters are passed to the scheduling tool when the test definition is created.

[0105] Step 4: The user creates a test definition based on the orchestration.

[0106] Step 5: The automated test system calls the scheduling tool to generate task definitions.

[0107] Step 6: Schedule or manually trigger the execution of the task.

[0108] Step 7: The automated test system calls the scheduling tool to generate a task instance based on the task definition and starts the task.

[0109] Specifically, set the task to execute at a scheduled time, set the execution environment variables, execute the test task at a scheduled or manual time according to the test definition, distribute relevant resources to the execution host, and use the use case to control the operation of related software and hardware equipment.

[0110] In one embodiment of the present application, after creating the test definition, the task timing can be set according to the year, month, day, hour, minute, second and seven days of the week. After that, the test task will be triggered to execute according to the set time loop. The timing setting can be canceled or re-created. After creating the test definition, the environment variables for the use case execution can be set. The set content will be written into the environment variables of the execution environment during execution. The environment variable parameters can be read through different scripting languages ​​and used in the script execution steps. The content of the environment variable is mainly the network connection information of the remote device and instrument, and includes some parameters distinguished by the test task.

[0111] Step 8: The scheduling tool schedules the distribution plug-in execution.

[0112] Step 9: Distribute plug-ins Distribute the Java execution environment, execution plug-ins, execution scripts, agent plug-ins, etc. to the execution environment.

[0113] Step 10: The execution environment receives the distributed resources.

[0114] Step 11: The distribution plug-in calls the proxy plug-in to execute the use case script.

[0115] Specifically, during the execution of the test task, each execution use case is scheduled by the scheduling tool to execute the following steps through the distribution plug-in: the distribution plug-in sends the proxy plug-in, script execution plug-in, Java execution environment, and execution script file to the execution environment according to the network connection information of the execution environment, and then the distribution plug-in calls the proxy plug-in to execute the use case according to the execution script and execution parameters. In the automated test system, the distribution plug-in is responsible for transferring the basic Java execution environment, script execution plug-in, proxy plug-in, and script execution file to the specified path of the execution environment. The operation of downloading and starting the distribution plug-in will be automatically written into the task flow when the test definition is created. The proxy plug-in calls the execution plug-in corresponding to the use case and injects the execution script, execution parameters and other information saved by the use case.

[0116] Step 12: The execution environment is completed and the running results are generated.

[0117] Step 13: Distribute the plug-in recovery operation results to the automated test system.

[0118] Step 14: Determine whether all use cases of the task have been executed. If so, end the scheduling tool process; if not, execute step 8.

[0119] Step 15: The automated test system obtains the task execution status from the scheduling tool at regular intervals.

[0120] Step 16: Determine whether the task is completed. If so, execute step 17; if not, execute step 15.

[0121] Step 17: The automated test system generates a test report, downloads the test result file, and ends.

[0122] Specifically, after the operation is completed, the operation logs, generated files, etc. are collected and sent to the system for download.

[0123] In one embodiment of the present application, after the task execution is completed, the distribution plug-in writes the results back to the automated test system. The generated file of each execution use case is composed of the script running log, script generation related files, basic information of the execution environment, and the full log of the scheduling process execution. The results are packaged and recovered according to the task ID and provided for download. The execution status and execution time of the task and each use case under the task are obtained and synchronized to the system based on the external interface of the scheduling tool. During the task execution process, if the use case fails to be scheduled, the full log of the scheduling tool execution use case is displayed in the system on the basis of recovering all relevant content. If the scheduling execution is normal, the log displayed in the system is the content of the actual execution output of the script. The report format for generating the test task execution results is based on a customized report template.

[0124] In one embodiment of the present application, the interaction between the automated test system and the scheduling tool refers to the scheduling tool's external interface. The relevant entities designed in the scheduling tool need to be repackaged or associated with existing entities in the automated test system to enable the automated test system to manage, control, and obtain results from the scheduling tool.

[0125] The embodiment of the present application provides a software-defined virtual-real integrated automated test resource allocation method. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation mode during the test process is optimized; a basic library is constructed as the support for the implementation of the use case script, the use case script is the core of the test operation, and the script design method of the script controls multiple equipment instruments, as well as an automated test system as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is provided, and a distribution plug-in is used to distribute resources to the execution environment, the distribution plug-in calls the proxy plug-in, the proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters, and the distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0126] Corresponding to the above method embodiment, this specification also provides an embodiment of an automated test resource allocation device based on software-defined virtual-real combination applied to an automated test system. Figure 6 This is a schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device for an automated test system provided in an embodiment of the present application. Figure 6 As shown, the device includes:

[0127] The selection module 602 is configured to receive a use case script written by a user, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in, and related information in the form of a test case in the automated test system, wherein the use case script includes a basic method of a package library being called;

[0128] The processing module 604 is configured to receive a test definition created by a user on the automated test system, process the test definition by calling a scheduling tool, and generate a task definition;

[0129] The reading module 606 is configured to receive the task timing set by the user on the automated test system side and the environment variables for the test case execution, and read the environment variable parameters for the test case execution set by the user side through each use case script under the test task;

[0130] The starting module 608 is configured to receive an execution instruction triggered by a user on the automated test system side, generate a task instance according to the task definition by calling a scheduling tool, and start executing the task in the execution environment;

[0131] The judgment module 610 is configured to receive the execution results sent by the execution environment and, based on the execution results, determine whether the execution of each test case under the task is complete. During the execution of each test case, the scheduling tool periodically obtains the execution status of the task and each test case under the task, and determines the task execution status based on the task execution status until all test cases under the task are completed.

[0132] The generating module 612 is configured to generate a test report, download the test result file, and end the task execution when the task execution is completed.

[0133] In an optional embodiment, the determination module 610 is further configured to:

[0134] During the task execution process, if the test case has a scheduling execution exception, the full log of the scheduling tool executing the test case will be displayed in the automated test system, and invalid execution results will not be recovered;

[0135] If the test case scheduling is executed normally, then based on the recovery of content related to the test case execution result, a log with the actual execution output of the script is displayed in the automated test system, where the normal execution status of the test case includes successful execution and failed execution, and success and failure are determined by the business logic of the test case.

[0136] In an optional embodiment, the determination module 610 is further configured to:

[0137] In the case where a test case execution exception occurs during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

[0138] Corresponding to the above method embodiment, this specification also provides an embodiment of an automated test resource allocation device based on software-defined virtual-real integration applied to a scheduling tool. Figure 7 This is a schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device for a scheduling tool provided in an embodiment of the present application. Figure 7 As shown, the device includes:

[0139] A first receiving module 702 is configured to receive a test case sent by the automated test system;

[0140] A first distribution module 704 is configured to schedule the execution of the distribution plug-in based on the test definition, and distribute the execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include the JAVA execution environment, the execution plug-in, the execution script, and the proxy plug-in to the execution environment;

[0141] The first execution module 706 is configured to call the proxy plug-in through the distribution plug-in and execute the test case according to the execution script and execution parameters.

[0142] Corresponding to the above method embodiment, this specification also provides an embodiment of an automated test resource allocation device based on software-defined virtual-real combination applied to an execution environment end. Figure 8 This is a schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device applied to an execution environment end provided in an embodiment of the present application. Figure 8 As shown, the device includes:

[0143] The second receiving module 802 is configured to receive execution resources and use case scripts distributed by the automated test system, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment;

[0144] A second execution module 804 is configured to call the proxy plug-in through the distribution plug-in and execute the use case script according to the execution script and execution parameters;

[0145] The generation module 806 is configured to, when the execution of the execution environment is completed, recycle the execution result to the automated test system through the distribution plug-in, and generate a task execution result report according to the customized report template.

[0146] Corresponding to the above method embodiment, this specification also provides an embodiment of a software-defined virtual-real combined automated test resource allocation device applied to a user terminal. Figure 9 This is a schematic diagram of the structure of a software-defined virtual-real combined automated test resource allocation device for a user terminal provided in an embodiment of the present application. Figure 9 As shown, the device includes:

[0147] The writing module 902 is configured to write a use case script and call the basic method of the package library based on the use case script, wherein the basic method of the package library includes a hierarchical distribution of a basic interaction mode of a suffix name, a basic tool class mode, and specific business operations performed on related instruments and equipment based on the basic interaction mode;

[0148] The creation module 904 is configured to create a test case orchestration, organize the created test cases based on the use case orchestration, generate an orchestration combination, create a test definition based on the orchestration combination, and send the test definition to the automated test system. The use case orchestration includes the execution parameters of all test cases under the use case orchestration, the connection parameters of the remote execution environment, and the order of each test case.

[0149] A setting module 906 is configured to set task timing and environment variables for the test case execution, and write the environment variables into the execution environment during execution, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task;

[0150] The trigger module 908 is configured to trigger the execution instruction to execute the task, wherein the execution task is triggered, including the execution task being triggered by the task timing, and the execution task being triggered by the user manually.

[0151] In an optional embodiment, the writing module 902 is further configured to:

[0152] According to the target process steps, a use case script is written, and based on the use case script, multiple instruments and equipment are called, wherein the target process steps include: writing a script based on setting connection information, establishing a connection, executing specific business methods through the connection, processing and parsing execution results through tool classes or other methods, and disconnecting the connection.

[0153] The embodiment of the present application provides an automated test resource allocation device based on software-defined virtual-real integration. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation mode during the test process is optimized; a script design method is constructed with a basic library as the support for the implementation of use case scripts, the use case script is the core of the test operation, and the script controls multiple devices and instruments, as well as an automated test system as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is provided, and a distribution plug-in is used to distribute resources to the execution environment, the distribution plug-in calls the proxy plug-in, the proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters, and the distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0154] Figure 10 A schematic diagram of the framework of a software-defined, virtual-real integrated automated test resource orchestration system provided in an embodiment of the present application.

[0155] Verification library management unit 1002, used to encapsulate basic operations, tool operations and business operations, and write use case scripts;

[0156] The test case management unit 1004 is used to add, modify, and search test cases, and save the test case execution script, the selected execution plug-in, the execution parameters, and the basic information of the test case;

[0157] The test arrangement management unit 1006 is used to add, modify, and search test arrangements, and save the test arrangement process information consisting of test case nodes, execution sequence, and global parameters;

[0158] The test definition management unit 1008 is used to create corresponding test definitions according to the test arrangement, call the scheduling tool to create the corresponding test process, and set the timing and environment variables;

[0159] The test execution management unit 1010 is used to create a test execution task based on the test definition, call the scheduling tool to start the test process, and regularly obtain the monitoring results of the scheduling tool on the task, and provide download of the collection results;

[0160] The test report management unit 1012 is used to generate a task running result report according to a custom report template.

[0161] The embodiment of the present application provides a software-defined virtual-real integrated automated test resource allocation system. By combining the task scheduling execution capability of the scheduling tool, the management capability of each test process is established on its basis, and the front-end management and operation methods during the test process are optimized; a basic library is constructed as the support for the implementation of the use case script, the use case script is the core of the test operation, and the script design method of the script controls multiple devices and instruments, as well as an automated test system as the platform for operation and result recovery. Through the scheduling tool, a working method of executing tasks in a specified execution environment is provided, and a distribution plug-in is used to distribute resources to the execution environment, the distribution plug-in calls the proxy plug-in, the proxy plug-in calls the execution plug-in to run the use case script according to specific use case information and parameters, and the distribution plug-in packages the results and recovers them to the system after the execution is completed. A remote distribution execution method is provided, which realizes the ability to support remote execution of automated tests, multi-task execution and status monitoring.

[0162] Each embodiment in this specification is described in a progressive manner. Similar portions between embodiments can be referenced to each other. Each embodiment focuses on the differences from other embodiments. In particular, the description of the automated test resource orchestration device based on software-defined virtual-real integration is relatively simple, as it is fundamentally similar to the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration. For relevant portions, refer to the description of the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration.

[0163] Figure 11 This is a block diagram of a computing device according to an embodiment of the present application. The components of the computing device 1100 include, but are not limited to, a memory 1110 and a processor 1120. The processor 1120 is connected to the memory 1110 via a bus 1130, and a database 1150 is used to store data.

[0164] The computing device 1100 also includes an access device 1140 that enables the computing device 1100 to communicate via one or more networks 1160. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 1140 may include one or more of any type of network interface (e.g., a network interface card (NIC)) whether wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, or a near field communication (NFC) interface.

[0165] In one embodiment of the present specification, the above components of the computing device 1100 and Figure 11 Other components not shown in the figure may also be connected to each other, for example, via a bus. Figure 11 The computing device structure block diagram shown is for illustrative purposes only and is not intended to limit the scope of this specification. Those skilled in the art may add or replace other components as needed.

[0166] Computing device 1100 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, personal digital assistant, laptop computer, notebook computer, netbook computer, etc.), a mobile phone (e.g., a smartphone), a wearable computing device (e.g., a smartwatch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or personal computer (PC). Computing device 1100 may also be a mobile or stationary server.

[0167] The processor 1120 is configured to execute the following computer executable instructions, which, when executed by the processor, implement the steps of the aforementioned software-defined virtual-real combined automated test resource allocation method.

[0168] The various embodiments in this specification are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences from the other embodiments. In particular, the computing device embodiment is generally similar to the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration, so the description is relatively simple. For relevant portions, refer to the description of the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration.

[0169] An embodiment of the present specification further provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the aforementioned software-defined virtual-real combined automated test resource allocation method.

[0170] The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences from the other embodiments. In particular, the computer-readable storage medium embodiment is generally similar to the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration, so the description is relatively simple. For relevant parts, refer to the description of the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration.

[0171] An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned software-defined virtual-real combined automated test resource allocation method.

[0172] The various embodiments in this specification are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences from the other embodiments. In particular, the computer program embodiment, because it is fundamentally similar to the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration, is described more simply. For relevant portions, refer to the description of the embodiment of the automated test resource orchestration method based on software-defined virtual-real integration.

[0173] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0174] The computer instructions include computer program code, which may be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal, and software distribution medium. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0175] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0176] The preferred embodiments disclosed above are intended only to help illustrate this specification. The optional embodiments do not exhaustively describe all details, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made based on the content of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that those skilled in the art can better understand and utilize this specification. This specification is limited only by the claims and their full scope and equivalents.

Claims

1. A software-defined virtual-real combination automated test resource allocation method, characterized in that: Applied to an automated test system, the method includes: Receive a use case script written by a user, select a use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in, and related information in the form of a test case in the automated test system, wherein the use case script includes a basic method of a package library to be called, the test case arrangement is composed of multiple use case scripts in an execution order, and the remote execution host connection information is recorded in the form of global parameters of the arrangement; Receive the test definition created by the user on the automated test system, process the test definition by calling the scheduling tool, and generate a task definition; Receive the task timing set by the user on the automated test system side, as well as the environment variables for the execution of the test case, and read the environment variable parameters for the execution of the test case set by the user side through each use case script under the test task, wherein the content of the environment variables includes the network connection information of the remote device and instrument, and the distinguishing parameters of each test task; Receive an execution instruction triggered by a user on the automated test system side, generate a task instance according to the task definition by calling a scheduling tool, and start executing the task in the execution environment, wherein the execution task is triggered, including by a task timer triggering the execution of the task and by a user manually triggering the execution instruction to execute the task; Receive the running results sent by the execution environment, and based on the running results, determine whether the execution of each test case under the task is complete. During the execution of each test case, obtain the execution status of the task and each test case under the task at regular intervals through the scheduling tool, and determine the task execution status based on the task execution status until all test cases under the task are completed; When the task is completed, a test report is generated, the test result file is downloaded, and the task execution is terminated; The step of judging whether each test case under the task is completed based on the running result includes: During the task execution process, if the test case has a scheduling execution exception, the full log of the scheduling tool executing the test case will be displayed in the automated test system, and invalid execution results will not be recovered; If the test case scheduling is executed normally, then based on the recovery of content related to the test case execution result, a log with the actual execution output of the script is displayed in the automated test system, where the normal execution status of the test case includes successful execution and failed execution, and success and failure are determined by the business logic of the test case.

2. The method according to claim 1, characterized in that The determining of the task execution status based on the task execution status further includes: In the event that a test case execution exception occurs during the task execution process, the task status is determined to be abnormal, and subsequent test cases after the test case will not continue to be executed.

3. The method according to claim 1, characterized in that The method is also applied to a scheduling tool, and includes: Receiving a test case sent by an automated test system, wherein the test case is a test case script written by a user end in response to the automated test system end receiving the test case script, selecting a test case script execution plug-in based on the language of the test case script, and storing the test case script, the selected plug-in, and related information in the form of a test case, wherein the test case script includes a basic method of a package library to be called, the test case arrangement is composed of multiple use case scripts in an execution order, and remote execution host connection information is recorded in the form of global parameters of the arrangement; Based on the test definition, scheduling the distribution plug-in for execution, and distributing execution resources to a specified path of the execution environment through the distribution plug-in, wherein the execution resources include a JAVA execution environment, an execution plug-in, an execution script, and an agent plug-in to the execution environment; The agent plug-in is called through the distribution plug-in, and the test case is executed according to the execution script and execution parameters.

4. The method according to claim 1, wherein The method is also applied to an execution environment, and includes: Receive execution resources and use case scripts distributed by the automated test system, wherein the test case is a response to the automated test system receiving the use case script written by the user end, select the use case script execution plug-in based on the language of the use case script, and store the use case script, the selected plug-in and related information in the form of a test case, wherein the use case script includes the basic method of the package library to be called, the test case arrangement is composed of multiple use case scripts in the order of execution, and the remote execution host connection information is recorded in the form of global parameters of the arrangement, and the execution resources include a JAVA execution environment, an execution plug-in, an execution script and a proxy plug-in to the execution environment; Calling the proxy plug-in through the distribution plug-in, and executing the use case script according to the execution script and execution parameters; When the execution of the execution environment is completed, the operation results are collected to the automated test system through the distribution plug-in, and a task operation result report is generated according to the custom report template.

5. The method according to claim 1, characterized in that The method is also applied to a user terminal, and includes: Write a use case script and call the basic method of the package library based on the use case script, wherein the basic method of the package library includes a hierarchical distribution of basic interaction methods of suffix names, basic tool class methods, and specific business operations performed on related instruments and equipment based on the basic interaction methods; Create a test case orchestration, organize the created test cases based on the use case orchestration to generate an orchestration combination, create a test definition based on the orchestration combination, and send the test definition to the automated test system. The use case orchestration includes the execution parameters of all test cases under the use case orchestration, the connection parameters of the remote execution environment, and the sequence of each use case. The test case orchestration consists of multiple use case scripts in the order of execution, and the remote execution host connection information is recorded in the form of global parameters of the orchestration. Setting task timing and environment variables for the test case execution, and writing the environment variables into the execution environment during execution, wherein the content of the environment variables includes network connection information of remote devices and instruments, and distinguishing parameters of each test task; Triggering the execution instruction to execute the task, wherein the execution task is triggered, including triggering the execution task through task timing, and manually triggering the execution instruction to execute the task by the user.

6. The method according to claim 5, characterized in that The writing of the use case script includes: According to the target process steps, a use case script is written, and based on the use case script, multiple instruments and equipment are called, wherein the target process steps include: writing a script based on setting connection information, establishing a connection, executing specific business methods through the connection, processing and parsing execution results through tool classes or other methods, and disconnecting the connection.

7. A software-defined virtual-real combination automated test resource allocation system, characterized by: The method for automated test resource orchestration based on software-defined virtual-real integration as described in any one of claims 1 to 6, wherein the system comprises: The verification library management module is used to encapsulate basic operations, tool operations, and business operations, and write use case scripts. The use case scripts contain the basic methods of the encapsulated library that are called. The test case arrangement consists of multiple use case scripts in the order of execution, and the remote execution host connection information is recorded in the form of global parameters of the arrangement. The test case management module is used to add, modify, and search test cases, and save the test case execution script, selected execution plug-in, execution parameters, and basic information of the test case; The test arrangement management module is used to add, modify, and search test arrangements, and save the test arrangement process information consisting of test case nodes, execution sequence, and global parameters; The test definition management module is used to create corresponding test definitions according to the test arrangement, call the scheduling tool to create the corresponding test process, and set the timing and environment variables; The test execution management module is used to create test execution tasks based on test definitions, call the scheduling tool to start the test process, and regularly obtain the monitoring results of the scheduling tool on the task, and provide download of the recovery results; The test report management module is used to generate task operation result reports based on custom report templates.

8. A computing device comprising: memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the software-defined virtual-real combined automated test resource allocation method described in any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores an information transmission implementation program, and when the program is executed by the processor, the steps of the software-defined virtual-real combination automated test resource allocation method according to any one of claims 1 to 6 are implemented.

Images