Operation maintenance method and device for test process

Abstract

The embodiment of the invention provides an operation maintenance method for a test process, and the method comprises the steps: obtaining process operation information of a test process of each to-be-tested machine operated in an execution machine which is used for testing the equipment performance of the corresponding to-be-tested machine through the test process, the process running information is used for representing a network connection state between the execution machine and the to-be-tested machine corresponding to the test process when the test process runs; predicting a target test process in an abnormal running state on the current execution machine according to the process running information; generating a process maintenance operation on the target test process according to the network connection information of the target to-be-tested machine to which the target test process belongs; and executing a process maintenance operation on the target test process. Through the method and the device, the problem of relatively low test efficiency of batch execution of the test tasks in related technologies is solved, so that the effect of improving the test efficiency of batch execution of the test tasks is achieved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computers, and more specifically, to a method and device for operating and maintaining a test process. Background Art

[0002] During the automated testing process, the server often chooses to execute test tasks in batches in order to improve the test efficiency, that is, to deploy an execution machine for performance testing of the machine to be tested, and use the execution machine to connect to multiple machines to be tested so as to perform batch testing on multiple machines to be tested. When performing batch testing, an execution machine needs to remotely connect to multiple machines to be tested at the same time for parallel testing. The execution machine and the machines to be tested are connected through a network. The execution machine sends test instructions to the machine to be tested in real time through the network connection relationship with the machine to be tested, and then the running results obtained by the machine to be tested in response to the test quality operation will be returned to the execution machine through the network connection, so that the execution machine can send subsequent test instructions to the machine to be tested. The entire test process may design more test items, and the test duration is long. Once a network failure occurs at a certain moment, the test task execution will fail, and the performance test of the machine to be tested needs to be re-executed, which seriously wastes time costs, labor costs and test configuration costs, resulting in low test efficiency of batch execution test tasks. Summary of the invention

[0003] The embodiments of the present application provide a method and device for operating and maintaining a test process, so as to at least solve the problem of low test efficiency of batch execution of test tasks in the related art.

[0004] According to an embodiment of the present application, a method for running and maintaining a test process is provided. The test system includes an execution machine and multiple machines to be tested. The execution machine is connected to each of the machines to be tested via a network. The execution machine is used to test the device performance of the machine to be tested. The method is applied to the execution machine, and the method includes:

[0005] Obtaining process running information of the test process of each of the machines to be tested running in the execution machine, wherein the execution machine is used to test the device performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running;

[0006] Predicting a target test process that is currently in an abnormal running state on the execution machine according to the process running information;

[0007] Generate a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process;

[0008] The process maintenance operation is performed on the target test process.

[0009] According to another embodiment of the present application, a test process operation and maintenance device is provided. The test system includes an execution machine and multiple machines to be tested. The execution machine is connected to each of the machines to be tested via a network. The execution machine is used to test the equipment performance of the machine to be tested. The device is applied to the execution machine, and the device includes:

[0010] An acquisition module is used to acquire process running information of the test process of each of the machines to be tested running in the execution machine, wherein the execution machine is used to test the device performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running;

[0011] A prediction module, used to predict a target test process that is currently in an abnormal running state on the execution machine according to the process running information;

[0012] A generation module, used to generate a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process;

[0013] A maintenance module is used to perform the process maintenance operation on the target test process.

[0014] Optionally, predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes:

[0015] Obtain reference running information obtained by the execution machine running the test process within a reference time period before the current moment, wherein the reference running information is used to indicate the network connection status between the execution machine and the corresponding machine to be tested when the test process is in a failed state within the reference time period;

[0016] The target test process is selected from all the test processes running on the execution machine according to the reference running information and the process running information.

[0017] Optionally, the step of selecting the target test process from all the test processes running on the execution machine according to the reference running information and the process running information includes:

[0018] Perform similarity matching on the first feature information and the second feature information to obtain a first matching degree, and perform similarity matching on the third feature information and the fourth feature information to obtain a second matching degree, wherein the first feature information and the second feature information are used to indicate the completion status of the test operation implemented by the test process, the third feature information and the fourth feature information are used to indicate the transmission status of data transmitted between the execution machine and the test machine through the test process, the process operation information includes the first feature information and the third feature information, and the reference operation information includes the second feature information and the fourth feature information;

[0019] Summing up the first matching degree and the second matching degree of the test process to obtain a target matching degree of each test process;

[0020] The test process whose target matching degree is greater than or equal to a target threshold is determined as the target test process.

[0021] Optionally, the step of generating a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs includes:

[0022] Searching for a target key field from the network connection information, wherein the target key field is used to represent a connection state of the target machine to be tested connecting to the execution machine through the target test process;

[0023] Filtering out a target device for executing a target closing operation from the target to-be-tested machine and the execution machine according to the field value of the target key field, wherein the target closing operation is used to close the target test process;

[0024] Controlling the target device to perform the target shutdown operation is determined as the process maintenance operation.

[0025] Optionally, the step of selecting a target device for performing a target shutdown operation from the target machine to be tested and the execution machine according to the field value of the target key field includes:

[0026] In a case where the field value of the target key field indicates that the target machine to be tested has been connected to the execution machine, determining the execution machine as the target device;

[0027] In a case where the field value of the target key field indicates that the target machine under test is not connected to the execution machine, the target machine under test is determined as the target device.

[0028] Optionally, predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes:

[0029] Acquire candidate running information obtained by the execution machine running the test process at multiple times within a candidate time period before the current time;

[0030] Using the candidate operation information as training samples to train the initial prediction model, to obtain a target prediction model, wherein the target prediction model records the change relationship of the operation information of the test process over time;

[0031] Inputting the process running information of the reference test process among the plurality of test processes running on the execution machine into a target prediction model;

[0032] Obtaining target operation information of the reference test process at a target time after the current time output by the target prediction model, wherein the target operation information is used to indicate the operation state of the reference test process at the target time;

[0033] Perform similarity matching between each of the multiple sub-information included in the target running information and the preset information parameters to obtain the initial similarity of each of the sub-information, wherein the multiple sub-information is used to characterize the running state of the reference test process at the target time from multiple dimensions, and the preset information parameters are used to indicate the information parameters of the test process in the running failure state;

[0034] When the initial similarity is greater than or equal to a set threshold, the reference test process is determined as the target test process that is currently in the abnormal running state on the execution machine.

[0035] Optionally, performing the process maintenance operation on the target test process includes:

[0036] Obtaining a process running log of a target device, wherein the process running log records the running status of the target device on the target test process, the target device is a device selected from the target to-be-tested machine and the execution machine for executing a target closing operation, the target closing operation being used to close the target test process;

[0037] Find the target location field from the process operation log;

[0038] Extracting a target file descriptor from the process running log according to the relative position relationship between the target positioning field and the file descriptor, wherein the file descriptor is used to indicate the file started to implement the target test process running;

[0039] Adding the target file descriptor to a corresponding position in the initial close instruction to obtain a target close instruction, wherein the initial close instruction records the closing logic of the file;

[0040] The target close instruction is sent to the target device, wherein the target close instruction is used to instruct to perform the target close operation on the target test process on the target device side, and the process maintenance operation includes performing the target close operation on the target test process on the target device side.

[0041] According to another embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when run.

[0042] According to another embodiment of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0043] Through the present application, by obtaining the process running information of the test process of each to-be-tested machine running in the execution machine, the network connection status between the execution machine and the to-be-tested machine corresponding to the test process when the test process is running can be determined according to the process running information, and the target test process in an abnormal running state on the current execution machine can be predicted according to the network connection status, and then by querying the network connection establishment status between the target to-be-tested machine to which the target test process belongs and the corresponding execution machine, a process maintenance operation for the target test process is generated, and then the running state of the target test process is maintained. In the above manner, the network connection status of the running test process between the execution machine and the to-be-tested machine can be monitored in real time, and the target test process that may be in an abnormal running state under this network connection state can be predicted and process maintained, that is, fault maintenance is performed when the process is in an abnormal state, so as to avoid the failure of the process execution resulting in the failure of the equipment performance test of the to-be-tested machine, thereby avoiding the occurrence of the test re-run event caused by the failure of the equipment performance test, and effectively reducing the waste of the test resources of the execution machine. Therefore, the problem of low test efficiency of batch execution of test tasks in the related technology can be solved, and the effect of improving the test efficiency of batch execution of test tasks can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 It is a hardware structure block diagram of a server device of a method for operating and maintaining a test process according to an embodiment of the present application;

[0045] Figure 2 is a flow chart of a method for operating and maintaining a test process according to an embodiment of the present application;

[0046] Figure 3 is a schematic diagram of a test platform task execution according to an embodiment of the present application;

[0047] Figure 4 is a schematic diagram of a network monitoring module according to an embodiment of the present application;

[0048] Figure 5 is a process automatic repair module flow chart according to an embodiment of the present application;

[0049] Figure 6 It is a structural block diagram of an operation and maintenance device for a test process according to an embodiment of the present application. DETAILED DESCRIPTION

[0050] The embodiments of the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0051] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0052] The method embodiments provided in the embodiments of the present application can be executed in a server device or a similar computing device. Taking running on a server device as an example, Figure 1 1 is a hardware structure block diagram of a server device of a method for operating and maintaining a test process according to an embodiment of the present application. Figure 1 As shown, the server device may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the server device may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above server device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0053] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the operation and maintenance method of the test process in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the server device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0054] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the server device. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0055] In this embodiment, a method for running and maintaining a test process is provided. Figure 2 The flowchart of a method for operating and maintaining a test process according to an embodiment of the present application is a flowchart of a method for operating and maintaining a test process according to an embodiment of the present application. The test system includes an execution machine and multiple test machines. The execution machine is connected to each of the test machines through a network. The execution machine is used to test the device performance of the test machine. The method is applied to the execution machine, such as Figure 2 As shown, the process includes the following steps:

[0056] Step S202, obtaining process running information of the test process of each of the machines to be tested running in the execution machine, wherein the execution machine is used to test the device performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running;

[0057] Step S204, predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information;

[0058] Step S206, generating a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process;

[0059] Step S208: performing the process maintenance operation on the target test process.

[0060] Through the above steps, by obtaining the process running information of the test process of each to-be-tested machine running in the execution machine, the network connection status between the execution machine and the to-be-tested machine corresponding to the test process when the test process is running can be determined according to the process running information, and then the target test process in an abnormal running state on the current execution machine can be predicted according to the network connection status, and then by querying the network connection establishment status between the target to-be-tested machine to which the target test process belongs and the corresponding execution machine, a process maintenance operation for the target test process is generated, and then the running state of the target test process is maintained. In this way, the network connection status of the running test process between the execution machine and the to-be-tested machine can be monitored in real time, and the target test process that may be in an abnormal running state under this network connection state can be predicted and process maintained, that is, fault maintenance is performed when the process is in an abnormal state, so as to avoid the failure of the process execution leading to the failure of the equipment performance test of the to-be-tested machine, thereby avoiding the occurrence of the test re-run event caused by the failure of the equipment performance test, and effectively reducing the waste of the test resources of the execution machine. Therefore, the problem of low test efficiency of batch execution of test tasks in the related technology can be solved, and the effect of improving the test efficiency of batch execution of test tasks can be achieved.

[0061] Optionally, in an embodiment of the present application, an execution machine is used to perform batch testing on multiple machines to be tested, that is, one execution machine can be connected to multiple machines to be tested at the same time, and the performance of the multiple connected machines to be tested can be tested simultaneously through the execution machine. For the connection between the execution machine and the machine to be tested through a network (such as Ethernet, Wi-Fi, VPN, etc.), the execution machine can build a test process with the corresponding machine to be tested through the network connection relationship, and the execution machine can transmit data between the test process and the machine to be tested, that is, the execution machine can send corresponding test instructions to the machine to be tested through the test process, and the machine to be tested will respond to the test instructions and execute related services. After returning the running data to the execution machine through the test process, the execution machine can execute subsequent test tasks for the machine to be tested according to the returned test instructions and build subsequent test processes. When the network connection status between the execution machine and the machine to be tested can affect the running status of the test process, it will cause the test process to fail to execute, thereby causing the execution of the entire test task of the machine to be tested to fail.

[0062] In the embodiment provided in the above step S202, the process running information is information used to characterize the execution status of the test operation corresponding to the test process under the current network connection environment between the executing machine and the machine to be tested. The running information may include but is not limited to macro information (first characteristic information) used to characterize the execution result of the test operation corresponding to the test process, or it may also be micro information (third characteristic information) used to characterize the data transmission status between the executing machine and the machine to be tested through the test process when executing the corresponding test operation, wherein the macro information may include but is not limited to BMC (Baseboard Management Controller) connection status, server power on and off status, whether ping is successful, whether ssh login is successful, etc.; the micro information may be information on network transmission parameters that reflect the network transmission performance in the test process, such as network delay, delay standard deviation, CPU (Central Processing Unit) utilization, memory occupancy, packet loss rate, etc., which is not limited in this scheme.

[0063] In the embodiment provided by the above step S204, the test process constructed between the execution machine and the machine to be tested depends on the network connection environment between the execution machine and the test machine during operation. Different test processes have different network environment requirements during operation. Therefore, the network connection status between the execution machine and the machine to be tested can be reflected based on the process running information during the test process running process, and then the running status of the corresponding test process under the network connection status can be predicted based on the network connection status.

[0064] Optionally, in an embodiment of the present application, the abnormal state is the running state before the test process fails and the subsequent test operations cannot be performed. The abnormal running state may include but is not limited to a process running state that is being tested but stuck, a blocked process running state, a process running state that is looping and outputting network abnormal data, etc. This solution does not limit this.

[0065] Optionally, in an embodiment of the present application, the operation of the test process is dependent on the network connection status between the execution machine and the machine to be tested. Because the operation of different test processes has different requirements for the network connection status, the running status of the test process under the current network connection state can be predicted based on the network connection status indicated by the process running information. In this embodiment, predicting the target test process in an abnormal running state on the current execution machine based on the process running information can be performed by creating an identification rule base, in which the reference process running information of the test process that has been determined to be running abnormally is recorded. Then, the reference process running information and the process running information obtained by running the current test process can be similarly matched to obtain a target matching value between the reference process running information and the process running information, and then the test process with a target matching value greater than or equal to the target threshold is used as the target test process in an abnormal state; when the target matching value is obtained by process similarity matching, multiple reference sub-running information included in the reference process running information can be similarly matched with the sub-running information of the corresponding dimension in the process running information to obtain an initial matching value, wherein the multiple reference sub-running information is used to characterize the execution status of the test operation corresponding to the test process from multiple dimensions; and then a weight parameter corresponding to each reference sub-running information is obtained, and the weight parameter is used to perform weighted sum calculation on the multiple initial matching values ​​to obtain a target matching value, wherein the weight parameter is used to characterize the influence of the sub-running information of the corresponding dimension on determining the running state type of the test process. The creation method of the identification rule base mentioned in the embodiment of the present application can be: batch statistics of the processes that failed the test due to network anomalies in the historical test processes of each test machine connected to the current execution machine to obtain a target process set, and create an identification rule base by analyzing the network anomaly manifestations that caused the process failure in the target process set (reference process running information), and the identification rule base records the abnormal process information of the test failure due to network anomalies.

[0066] Optionally, in an embodiment of the present application, the target test process in an abnormal running state on the current execution machine can also be predicted by training a machine learning model, which can be achieved in the following manner: the reference process running information of the test process marked with a state identifier is used as a training sample to train an initial prediction model (such as logistic regression, support vector machine (SVM), random forest, gradient boosting tree, deep learning model, etc.) to obtain a target prediction model, wherein the state identifier is used to indicate whether the test process corresponding to the process running information currently input into the initial prediction model is abnormal, and the state identifier includes a normal state and an abnormal state. The reference process running information is information collected during the test process running in a reference time period before the current moment, which represents the execution status of the test operation corresponding to the test process in the corresponding network connection environment. The target prediction model records the process running information and the running state of the test process under the network connection state indicated by the process running information; and then the process running information can be input into the target prediction model to obtain a target prediction result output by the target prediction model. When the target prediction result indicates that the current test process is in an abnormal state, the test process is determined as a target test process in an abnormal running state.

[0067] In the embodiment provided in the above step S206, the network connection information is information that records the connection status of the device to other devices. The network connection information may be, but is not limited to, information indicating that the machine under test performs a connection action on the execution machine side (i.e., whether the machine under test has performed an action of connecting to the execution machine through the network, and whether it is connected to the execution machine). The network connection information may also be information indicating that the execution machine side performs a connection action on the machine under test (i.e., whether the execution machine has performed an action of connecting to the machine under test through the network, and whether it is connected to the execution machine). The information is used to characterize the network communication status and performance between the execution machine and the target machine under test. The network connection information may be, but is not limited to, TCP (Transmission Control Protocol) connection, ICMP (Internet Control Message Protocol) connection, virtual private network (VPN) connection, etc., and this solution does not limit this.

[0068] Optionally, in an embodiment of the present application, when the network connection information is information indicating that the machine under test performs a connection action on the execution machine, the network connection information may be generated by the machine under test, and the execution machine obtains the network connection information generated by the machine under test by sending a network connection information acquisition request to the machine under test.

[0069] Optionally, in an embodiment of the present application, a process maintenance operation is used to maintain the running state of a test process that is in an abnormal running state, so that the test process can resume normal running state. The process maintenance operation may be, but is not limited to, performing a restart operation on a target test process that is in an abnormal running state. The specific implementation method may be to perform a process closing operation on the test process connected to the other end on the execution machine side or the machine to be tested side. After the process is closed, in order to ensure the continuation of the test task of the machine to be tested, the system will create the test process again, so that the test process in a blocked state can continue.

[0070] Optionally, in an embodiment of the present application, the process maintenance operation may also be to obtain the abnormal position of the test process that is currently in an abnormal state, that is, the abnormal test process is in a blocked or stuck state during the execution of the corresponding test operation. Therefore, the test operation currently executed by the test process can be detected, and then an operation running result is generated for the test operation, and the operation running result is given to the target test process, and then the target test process can continue to execute other test operations after the stuck test operation according to the operation running result; in an embodiment of the present application, a method for generating an operation running result for the target test process may be to obtain the operating parameters that have been generated by the target test process before the stuck test operation, and input the operating parameters into the test process model to obtain the operation running result output by the test process model, wherein the test process model records the same test logic as the target test process.

[0071] As an optional embodiment, predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes:

[0072] Obtain reference running information obtained by the execution machine running the test process within a reference time period before the current moment, wherein the reference running information is used to indicate the network connection status between the execution machine and the corresponding machine to be tested when the test process is in a failed state within the reference time period;

[0073] The target test process is selected from all the test processes running on the execution machine according to the reference running information and the process running information.

[0074] Optionally, in an embodiment of the present application, reference operation information is used to reflect the execution status of the test operations corresponding to the test process within the reference time period in different dimensions. Since the operation of the test process depends on the network connection environment between the execution machine and the machine to be tested, the execution status of the test operations corresponding to the test process can reflect the network connection status between the execution machine and the machine to be tested.

[0075] Optionally, in an embodiment of the present application, the reference running information may be information characterizing the execution status of the corresponding test operation executed by the test process that is in a failed state within the reference time period, for example, it may be information characterizing whether the corresponding test operation can respond normally, or it may be information on the data transmission status when data is transmitted between the execution machine and the machine to be tested through the test process.

[0076] Optionally, in an embodiment of the present application, a method for predicting a target test process based on reference running information and process running information may be a method of similarly matching the reference running information and the process running information, thereby determining a test process having a matching degree greater than or equal to a target matching degree as the target test process.

[0077] Optionally, in an embodiment of the present application, a method for predicting a target test process based on reference running information and process running information may also be to input the process running information into a process information prediction model, wherein the process information prediction model records the relationship between the changes in the process running information of the test process over time, and then obtain the candidate process running information that may appear in the test process after the current time output by the process information prediction model, and then perform similarity matching between the candidate process running information and the reference running information to obtain a target matching degree. When the target matching degree is greater than a target threshold, it can be determined that the test process will be in a failed running state after the current moment, and then the test process with a target matching degree greater than the target threshold can be determined as the target test process that is currently in an abnormal running state.

[0078] By obtaining the network connection status between the executor and the corresponding machine to be tested when the test process running on the executor is in a failed state within a reference time period, the critical values ​​of various operating parameters of the test process under abnormal network connection can be obtained, thereby effectively screening out the target test process from all test processes running on the executor.

[0079] As an optional embodiment, the step of selecting the target test process from all the test processes running on the execution machine according to the reference running information and the process running information includes:

[0080] Perform similarity matching on the first feature information and the second feature information to obtain a first matching degree, and perform similarity matching on the third feature information and the fourth feature information to obtain a second matching degree, wherein the first feature information and the second feature information are used to indicate the completion status of the test operation implemented by the test process, the third feature information and the fourth feature information are used to indicate the transmission status of data transmitted between the execution machine and the test machine through the test process, the process operation information includes the first feature information and the third feature information, and the reference operation information includes the second feature information and the fourth feature information;

[0081] Summing up the first matching degree and the second matching degree of the test process to obtain a target matching degree of each test process;

[0082] The test process whose target matching degree is greater than or equal to a target threshold is determined as the target test process.

[0083] Optionally, in an embodiment of the present application, the first characteristic information and the second characteristic information are information used to reflect the execution status of the test operation requested to be executed by the test process. The first characteristic information and the second characteristic information may include but are not limited to BMC (Baseboard Management Controller) connection status, server power on and off status, whether pinging is possible, whether ssh login is successful, etc. This solution does not limit this.

[0084] Optionally, in an embodiment of the present application, the third characteristic information and the fourth characteristic information are information of network transmission parameters used to characterize the network transmission performance of the test process. The third characteristic information and the fourth characteristic information may include but are not limited to network delay, delay standard deviation, CPU (Central Processing Unit) utilization, memory occupancy, packet loss rate, etc. This solution does not limit this.

[0085] Optionally, in an embodiment of the present application, the matching degree of each test process can be obtained by directly summing the first matching degree and the second matching degree of the test process, or by assigning different weight parameters to the first matching degree and the second matching degree according to the importance of different feature information in reflecting the network status of the test process, and multiplying the first matching degree and the second matching degree by the corresponding weight parameters respectively and then summing them to obtain the target matching degree of each test process. This scheme does not limit this.

[0086] Through the above steps, the characteristic information of the process running information and the characteristic information of the reference running information are matched to obtain the first matching degree and the second matching degree, and then the two are summed up to obtain the target matching degree of each test process, and then the target matching degree is matched with the target threshold to determine the target test process. The network status of the test process can be evaluated from multiple dimensions, thereby improving the accuracy of predicting the target test process.

[0087] As an optional embodiment, the step of generating a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs includes:

[0088] Searching for a target key field from the network connection information, wherein the target key field is used to represent a connection state of the target machine to be tested connecting to the execution machine through the target test process;

[0089] Filtering out a target device for executing a target closing operation from the target to-be-tested machine and the execution machine according to the field value of the target key field, wherein the target closing operation is used to close the target test process;

[0090] Controlling the target device to perform the target shutdown operation is determined as the process maintenance operation.

[0091] Optionally, in an embodiment of the present application, the target key field is a status field that characterizes the TCP connection status established between the target machine under test and the execution machine. The target key field may include but is not limited to LISTEN, SYN-SENT, SYN-RECEIVED, etc., and this solution does not limit this.

[0092] Optionally, in an embodiment of the present application, a target device for performing a target shutdown operation is screened out from the target standby machine and the executor machine according to the field value of the target key field, which can be done in the following manner: if the field value of the target key field indicates that there is a TCP connection between the target standby machine and the executor machine, it is determined that the network anomaly occurs on the side of the target standby machine. In this case, the target standby machine is determined to be the target device, and the test process on the side of the target standby machine needs to be closed; if the field value of the target key field indicates that there is no TCP connection between the target standby machine and the executor machine, it is determined that the network anomaly occurs on the side of the executor machine. In this case, the executor machine is determined to be the target device, and the test process on the side of the executor machine needs to be closed.

[0093] Optionally, in an embodiment of the present application, after the process maintenance operation is completed and the test process on the target device side is closed, the system program will automatically restore and restart the test process, thereby maintaining the abnormal test process and avoiding the direct failure of the test process, which makes it impossible to perform remedial maintenance measures on it.

[0094] Through the above content, by searching the target keyword used to characterize the connection status of the target test machine through the test process and the execution machine in the network connection information, and then filtering out the target device used to execute the process shutdown operation from the execution machine and the target machine to be tested according to the connection status of the target test machine through the test process and the execution machine, thereby ensuring the execution accuracy of the process maintenance operation and ensuring the process maintenance efficiency.

[0095] As an optional embodiment, the step of selecting a target device for executing a target shutdown operation from the target machine to be tested and the execution machine according to the field value of the target key field includes:

[0096] In a case where the field value of the target key field indicates that the target machine to be tested has been connected to the execution machine, determining the execution machine as the target device;

[0097] In a case where the field value of the target key field indicates that the target machine under test is not connected to the execution machine, the target machine under test is determined as the target device.

[0098] Optionally, in an embodiment of the present application, when the field value of the target key field is ESTABLISHED, it indicates that the TCP connection has been established and both nodes can transmit data or other information, indicating that the target machine to be tested is connected to the execution machine, and the execution machine is determined as the target device; when the field value of the target key field is CLOSED, it indicates that the TCP connection is in a closed state, indicating that the target machine to be tested is not connected to the execution machine, and the target machine to be tested is determined as the target device.

[0099] Through the above steps, due to abnormal TCP connections, network delays, data loss, connection timeouts and other problems may occur, thus affecting the execution and results of the test. Therefore, by parsing the fields of the TCP connection status and then determining the location where the network anomaly occurs, the accuracy of locating the abnormal test process can be improved.

[0100] As an optional embodiment, predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes:

[0101] Acquire candidate running information obtained by the execution machine running the test process at multiple times within a candidate time period before the current time;

[0102] Using the candidate operation information as training samples to train the initial prediction model, to obtain a target prediction model, wherein the target prediction model records the change relationship of the operation information of the test process over time;

[0103] Inputting the process running information of the reference test process among the plurality of test processes running on the execution machine into a target prediction model;

[0104] Obtaining target operation information of the reference test process at a target time after the current time output by the target prediction model, wherein the target operation information is used to indicate the operation state of the reference test process at the target time;

[0105] Perform similarity matching between each of the multiple sub-information included in the target running information and the preset information parameters to obtain the initial similarity of each of the sub-information, wherein the multiple sub-information is used to characterize the running state of the reference test process at the target time from multiple dimensions, and the preset information parameters are used to indicate the information parameters of the test process in the running failure state;

[0106] When the initial similarity is greater than or equal to a set threshold, the reference test process is determined as the target test process that is currently in the abnormal running state on the execution machine.

[0107] Optionally, in an embodiment of the present application, obtaining candidate operation information may be to collect various operation information when running the test process on the execution machine at regular intervals (such as every minute or every second) within a candidate time period, and the candidate operation information may include but is not limited to process operation information reflecting the state of the test process, such as BMC (Baseboard Management Controller) connection status, server power on and off status, whether ping is possible, whether SSH login is successful, etc.; it may also be network transmission parameters reflecting the network transmission performance in the test process, such as network delay, delay standard deviation, CPU (Central Processing Unit) utilization, memory occupancy, packet loss rate, etc., which are not limited in this solution.

[0108] Optionally, in an embodiment of the present application, the initial prediction model can be a machine learning model, such as a model built based on algorithms such as neural networks, decision trees, random forests, etc. During the training phase, the initial prediction model will use a large amount of data to learn the changing relationship of the running information of the test process over time to obtain the target prediction model.

[0109] Optionally, in an embodiment of the present application, the reference test process is a test process among multiple test processes used to input a target prediction model. The target prediction model will predict the target operation information of each test process at a future target time based on the input test process. The target operation information includes multiple sub-information used to characterize the operating status of the reference test process at the target time. The sub-information may include but is not limited to CPU usage, memory usage, response time, network delay, network traffic, etc. This solution does not limit this.

[0110] Optionally, in an embodiment of the present application, by calculating the similarity between each sub-information and the preset information parameters (such as using cosine similarity, Euclidean distance, etc. as a metric), an initial similarity is obtained, thereby being able to quantify the degree of similarity between the running state of the test process at a future moment and the known failure state, and then determining the reference test process whose initial similarity is greater than or equal to the set threshold as the target test process that is currently in an abnormal running state on the execution machine.

[0111] Through the above steps, the target prediction model is constructed to predict the running status of the reference test process in the future time period, and then the process indicated by the prediction result as a test failure is determined as the target test process, thereby improving the prediction accuracy of the target test process.

[0112] As an optional embodiment, performing the process maintenance operation on the target test process includes:

[0113] Obtaining a process running log of a target device, wherein the process running log records the running status of the target device on the target test process, the target device is a device selected from the target to-be-tested machine and the execution machine for executing a target closing operation, the target closing operation being used to close the target test process;

[0114] Find the target location field from the process operation log;

[0115] Extracting a target file descriptor from the process running log according to the relative position relationship between the target positioning field and the file descriptor, wherein the file descriptor is used to indicate the file started to implement the target test process running;

[0116] Adding the target file descriptor to a corresponding position in the initial close instruction to obtain a target close instruction, wherein the initial close instruction records the closing logic of the file;

[0117] The target close instruction is sent to the target device, wherein the target close instruction is used to instruct to perform the target close operation on the target test process on the target device side, and the process maintenance operation includes performing the target close operation on the target test process on the target device side.

[0118] Optionally, in an embodiment of the present application, the target file descriptor cannot be accurately found in the process operation log, and the target file descriptor can be found by searching the target location field and based on the relative position relationship between the target file descriptor and the location field. In an embodiment of the present application, the target location field can be but is not limited to keywords such as "IPv4", "TCP", "ESTABLISHED" in the process operation log.

[0119] Optionally, in an embodiment of the present application, the target file descriptor is used to indicate the file started to implement the target test process operation, and the target file descriptor may be but is not limited to the "12U" field recorded in the process operation log.

[0120] Optionally, in an embodiment of the present application, the target file descriptor can be found based on the relative position relationship between the target location field and the target file descriptor in the process execution log, and then the gdb-p "process number" instruction is used to connect to the process, call the call close (target file descriptor) command, close the abnormal Socket connection, and resume the test process.

[0121] As an optional implementation, the present application also provides a device for ensuring the stable operation of the server automated test process. Through network monitoring technology, data accumulation and analysis, network monitoring, intelligent analysis and rule training are combined to achieve a safe and robust network monitoring and repair device to ensure the stable operation of the automated test process, and it has dynamic expansion and self-learning capabilities. It combines python, shell, and third-party libraries such as Pandas and Matplotlib to complete data collection, analysis, logging, screening and feedback learning. Through netstat, lsof and gdb commands, the abnormal TCP connection is located and intervened, and a single abnormal Socket connection in the test process is terminated, thereby completing the automatic repair of the process.

[0122] Figure 3 is a schematic diagram of a test platform task execution according to an embodiment of the present application, such as Figure 3As shown in the figure, the master control is an automated test platform, which manages and controls multiple execution machines, and each execution machine can test multiple machines under test at the same time, so as to achieve the goal of batch execution of test tasks and collect logs to generate test reports. After the test is completed, the tester views and analyzes the test report through the test platform. The test task is sent from the test platform to the execution machine. This process is not real-time, so there is no network impact. Therefore, in fact, network anomalies often occur between the execution machine and the machine under test.

[0123] Figure 4 is a schematic diagram of a network monitoring module according to an embodiment of the present application, Figure 5 is a process automatic repair module flow chart according to an embodiment of the present application, such as Figure 4 and Figure 5 As shown, the network monitoring module and the process automatic repair module are a set of devices mainly deployed on the execution machine, where:

[0124] 1. Identify rule base:

[0125] A scalable network monitoring solution is derived by collecting and analyzing historical data. By batch counting the tasks that failed due to network reasons during the historical automated testing process, the macro and micro manifestations of network anomalies are screened and defined, such as BMC connection status, power on and off status, whether ping and ssh login are successful, and other "macro manifestations" and network average maximum delay, delay standard deviation, packet loss rate and other micro manifestations. The automated testing platform retrieves these rules and sends them in batches to the network detection modules of all executors, and continuously collects test reports fed back by all executors. Testers can analyze the test reports and give corresponding test conclusions, which in turn can promote the continuous improvement of the recognition rule base.

[0126] 2. Network monitoring module:

[0127] It is deployed on the execution machine, runs locally, and monitors all automated processes being tested in a multi-threaded manner. On the one hand, the network monitoring module manages all machines under test in the current test connection in a unified manner by calling and parsing the identification rules issued by the automated test platform, and monitors, identifies and records network fluctuations and network abnormality data in real time during the test; on the other hand, it monitors and analyzes the status of the automated test task process being executed by the execution machine, collects the automated processes with abnormal stuck, output network abnormal stack and other information in the test log, and records the corresponding process number information. By comparing the abnormal automated process with the abnormal network data, the failed process, the process being tested but stuck, and the process that is cyclically outputting network abnormal stack data are identified. Among them, the process being tested but stuck and the process that is cyclically outputting network abnormal data are processes that can be intervened and repaired, that is, the test process that has an abnormality but has not been completed. The process status and process number are sent to the automatic repair module in a unified manner. And record key logs such as the network monitoring process, original network dynamics and result judgment.

[0128] 3. Process automatic repair module:

[0129] (1) This module is the core to ensure the stable operation of the test process. It receives abnormal process information sent by the network monitoring module, searches for the abnormal main process and its sub-processes, and determines the location where the network anomaly occurs. If the sub-process is stuck or abnormal, the sub-process is repaired. If the main process is stuck or abnormal, the main process is repaired.

[0130] (2) Use the netstat-antp|grep "process number" command to find the abnormal process on the execution machine side, find the IP of the test machine to which the process is connected, and SSH to one end of the test machine. Use the netstat-antp|grep "process number" command to find the TCP connection information currently established with the execution machine. If there is a connection, the abnormality occurs on the test machine side. You need to close the TCP connection on the test machine side, and then the execution machine side will return to normal. If there is no TCP connection with the execution machine, the abnormality occurs on the execution machine side, and you need to close the TCP connection on the execution machine side.

[0131] (3) After determining whether the abnormal location is the machine under test or the execution machine, use the lsof-np "process number" command on the abnormal side to obtain the process open file descriptor, filter out and record information with keywords such as "IPv4", "TCP", and "ESTABLISHED". Intercept fields similar to "12u", then use the gdb-p "process number" command to connect to the process, call the call close (12u) command, close the abnormal socket connection, and resume the test process.

[0132] (4) Finally, query the relevant logs of the test process to confirm that the test process has resumed test execution. And record the time when the process was repaired, the status before and after the repair, and other information.

[0133] 4. Test report module:

[0134] After the test is completed, the test report generation module will generate a test report for each test process. By actively collecting relevant logs of the corresponding test process in the network monitoring module and the process automatic repair module, it outputs information such as the number of network fluctuations, time, duration, and process repair process, number of repairs, specific test nodes for repair, and other information, and displays them to testers to assist testers in locating and analyzing test results so as to promptly discover related server test problems.

[0135] The network monitoring and automatic repair tool implemented based on the embodiment of the present application is deployed on the execution machine to realize the function of the network status of the execution machine during the execution of the local batch monitoring task. By identifying, recording, analyzing and processing the network abnormal process, the goal of automatically repairing the abnormal test process and intelligently recovering the test is achieved. Especially for batch testing at night, if a network abnormality occurs, the technical solution of the present invention can automatically repair the abnormal test process in batches, effectively improve the utilization rate of test resources, reduce test risks, and improve test reliability. By establishing an identification rule library, all execution machines share unified rule resources, and use the large amount of test task data generated by the automatic testing platform to improve the recognition accuracy and intelligent training capabilities. By establishing a feedback mechanism with a large number of testers, it has the ability to learn continuously.

[0136] 1. Improve test efficiency: The network monitoring module can monitor the network status in real time, discover potential problems and locate them quickly, while the automatic repair module can reduce the time and cost of manual intervention, thereby improving the execution efficiency of automated testing.

[0137] 2. Reduce the error rate: The automatic repair function automatically repairs the detected network problems, avoiding the errors that may be caused by human operation. This rule-based automatic repair can ensure that the problems are solved accurately and promptly, reducing the error rate during the test process.

[0138] 3. Improve test reliability: The combination of network monitoring module and automatic repair module can ensure that automated testing is carried out in a more stable and reliable network environment. This can not only improve the accuracy of test results, but also reduce the number of test failures and retests caused by network problems, further improving the reliability of the test.

[0139] 4. Simplify the testing process: Network monitoring and automatic repair can help testers automatically complete some tedious and repetitive tasks, such as network status inspection, problem location, and repair. This can not only reduce the workload of testers, but also make the testing process more simplified and efficient.

[0140] 5. Effective feedback: The network monitoring module provides intuitive and detailed feedback of network status information through test reports, so that testers can understand changes in network status in a timely manner and take corresponding response strategies.

[0141] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0142] In this embodiment, a test process operation and maintenance device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0143] Figure 6 is a structural block diagram of an operation and maintenance device for a test process according to an embodiment of the present application, such as Figure 6As shown, the test system includes an execution machine and multiple machines to be tested, the execution machine is connected to each of the machines to be tested via a network, the execution machine is used to test the equipment performance of the machines to be tested, and the device is applied to the execution machine, the device includes: 62 an acquisition module, used to obtain process running information of the test process of each machine to be tested running in the execution machine, wherein the execution machine is used to test the equipment performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running; 64 a prediction module, used to predict the target test process that is in an abnormal running state on the current execution machine according to the process running information; 66 a generation module, used to generate a process maintenance operation for the target test process according to the network connection information of the target machine to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process; 68 a maintenance module, used to perform the process maintenance operation on the target test process.

[0144] Through the above content, by obtaining the process running information of the test process of each to-be-tested machine running in the execution machine, the network connection status between the execution machine and the to-be-tested machine corresponding to the test process when the test process is running can be determined according to the process running information, and then the target test process in the abnormal running state on the current execution machine can be predicted according to the network connection status, and then by querying the network connection establishment status between the target to-be-tested machine to which the target test process belongs and the corresponding execution machine, a process maintenance operation for the target test process is generated, and then the running state of the target test process is maintained. In this way, the network connection status of the running test process between the execution machine and the to-be-tested machine can be monitored in real time, and the target test process that may be in an abnormal running state under this network connection state can be predicted and process maintained, that is, fault maintenance is performed when the process is in an abnormal state, so as to avoid the failure of process execution leading to the failure of the equipment performance test of the to-be-tested machine, thereby avoiding the occurrence of test re-run events caused by the failure of the equipment performance test, and effectively reducing the waste of test resources of the execution machine. Therefore, the problem of low test efficiency of batch execution of test tasks in related technologies can be solved, and the effect of improving the test efficiency of batch execution of test tasks can be achieved.

[0145] Optionally, the prediction module includes:

[0146] A first acquisition unit is used to acquire reference running information obtained by the execution machine running the test process within a reference time period before a current moment, wherein the reference running information is used to indicate a network connection status between the execution machine and the corresponding machine to be tested when the test process is in a failed state within the reference time period;

[0147] The first screening unit is used to screen out the target test process from all the test processes running on the execution machine according to the reference running information and the process running information.

[0148] Optionally, the first screening unit is further used for:

[0149] Perform similarity matching on the first feature information and the second feature information to obtain a first matching degree, and perform similarity matching on the third feature information and the fourth feature information to obtain a second matching degree, wherein the first feature information and the second feature information are used to indicate the completion status of the test operation implemented by the test process, the third feature information and the fourth feature information are used to indicate the transmission status of data transmitted between the execution machine and the test machine through the test process, the process operation information includes the first feature information and the third feature information, and the reference operation information includes the second feature information and the fourth feature information;

[0150] Summing up the first matching degree and the second matching degree of the test process to obtain a target matching degree of each test process;

[0151] The test process whose target matching degree is greater than or equal to a target threshold is determined as the target test process.

[0152] Optionally, the generating module includes:

[0153] A first search unit, configured to search a target key field from the network connection information, wherein the target key field is used to represent a connection state of the target machine to be tested connecting to the execution machine through the target test process;

[0154] A second screening unit, configured to screen out a target device for performing a target closing operation from the target to-be-tested machine and the execution machine according to a field value of the target key field, wherein the target closing operation is used to close the target test process;

[0155] The first determining unit is configured to determine controlling the target device to perform the target closing operation as the process maintenance operation.

[0156] Optionally, the second screening unit is further used for:

[0157] In a case where the field value of the target key field indicates that the target machine to be tested has been connected to the execution machine, determining the execution machine as the target device;

[0158] In a case where the field value of the target key field indicates that the target machine under test is not connected to the execution machine, the target machine under test is determined as the target device.

[0159] Optionally, the prediction module further includes:

[0160] A second acquisition unit is used to acquire candidate running information obtained by the execution machine running the test process at multiple moments in the candidate time period before the current moment;

[0161] A training unit, configured to train an initial prediction model using the candidate operation information as a training sample to obtain a target prediction model, wherein the target prediction model records a change relationship of the operation information of the test process over time;

[0162] An input unit, used for inputting the process running information of the reference test process among the plurality of test processes running on the execution machine into a target prediction model;

[0163] A third acquisition unit is used to acquire target operation information of the reference test process at a target time after the current time output by the target prediction model, wherein the target operation information is used to indicate the operation state of the reference test process at the target time;

[0164] A matching unit, used for similarly matching each of the multiple sub-information included in the target running information with the preset information parameters to obtain the initial similarity of each of the sub-information, wherein the multiple sub-information is used to characterize the running state of the reference test process at the target time from multiple dimensions, and the preset information parameters are used to indicate the information parameters of the test process in the running failure state;

[0165] The second determining unit is configured to determine the reference test process as the target test process currently in the abnormal running state on the execution machine when the initial similarity is greater than or equal to a set threshold.

[0166] Optionally, the maintenance module includes:

[0167] A fourth acquisition unit is used to acquire a process running log of a target device, wherein the process running log records the running status of the target device on the target test process, and the target device is a device selected from the target to-be-tested machine and the execution machine for performing a target shutdown operation, and the target shutdown operation is used to close the target test process;

[0168] The second search unit is used to search the target location field from the process running log;

[0169] An extraction unit, configured to extract a target file descriptor from the process running log according to a relative position relationship between the target positioning field and the file descriptor, wherein the file descriptor is used to indicate a file started to implement the target test process running;

[0170] an adding unit, configured to add the target file descriptor to a corresponding position in an initial closing instruction to obtain a target closing instruction, wherein the initial closing instruction records the closing logic of the file;

[0171] A sending unit is used to send the target closing instruction to the target device, wherein the target closing instruction is used to instruct to perform the target closing operation on the target test process on the target device side, and the process maintenance operation includes performing the target closing operation on the target test process on the target device side.

[0172] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0173] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0174] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0175] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0176] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0177] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps in any one of the above method embodiments are implemented.

[0178] An embodiment of the present application further provides another computer program product, including a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0179] The embodiments of the present application also provide a computer program, which includes computer instructions, which are stored in a computer-readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in any one of the above method embodiments.

[0180] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0181] Obviously, those skilled in the art should understand that the above modules or steps of the present application can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0182] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for operating and maintaining a test process, characterized in that: The test system includes an execution machine and a plurality of machines to be tested, wherein the execution machine is respectively connected to each of the machines to be tested via a network, and the execution machine is used to test the equipment performance of the machines to be tested. The method is applied to the execution machine, and the method includes: Obtain process running information of the test process of each of the machines to be tested running in the execution machine, wherein the execution machine is used to test the device performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running; predict the target test process that is currently in an abnormal running state on the execution machine based on the process running information; Generate a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process; The process maintenance operation is performed on the target test process.

2. The method according to claim 1, characterized in that The step of predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes: Obtain reference running information obtained by the execution machine running the test process within a reference time period before the current moment, wherein the reference running information is used to indicate the network connection status between the execution machine and the corresponding machine to be tested when the test process is in a failed state within the reference time period; The target test process is selected from all the test processes running on the execution machine according to the reference running information and the process running information.

3. The method according to claim 2, characterized in that The step of selecting the target test process from all the test processes running on the execution machine according to the reference running information and the process running information includes: Perform similarity matching on the first feature information and the second feature information to obtain a first matching degree, and perform similarity matching on the third feature information and the fourth feature information to obtain a second matching degree, wherein the first feature information and the second feature information are used to indicate the completion status of the test operation implemented by the test process, the third feature information and the fourth feature information are used to indicate the transmission status of data transmitted between the execution machine and the test machine through the test process, the process operation information includes the first feature information and the third feature information, and the reference operation information includes the second feature information and the fourth feature information; Summing up the first matching degree and the second matching degree of the test process to obtain a target matching degree of each test process; The test process whose target matching degree is greater than or equal to a target threshold is determined as the target test process.

4. The method according to claim 1, characterized in that The step of generating a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs includes: Searching for a target key field from the network connection information, wherein the target key field is used to represent a connection state of the target machine to be tested connecting to the execution machine through the target test process; Filtering out a target device for executing a target closing operation from the target to-be-tested machine and the execution machine according to the field value of the target key field, wherein the target closing operation is used to close the target test process; Controlling the target device to perform the target shutdown operation is determined as the process maintenance operation.

5. The method according to claim 4, characterized in that The step of selecting a target device for performing a target shutdown operation from the target to-be-tested machine and the execution machine according to the field value of the target key field includes: In a case where the field value of the target key field indicates that the target machine to be tested has been connected to the execution machine, determining the execution machine as the target device; In a case where the field value of the target key field indicates that the target machine under test is not connected to the execution machine, the target machine under test is determined as the target device.

6. The method according to claim 1, characterized in that The step of predicting the target test process that is currently in an abnormal running state on the execution machine according to the process running information includes: Acquire candidate running information obtained by the execution machine running the test process at multiple times within a candidate time period before the current time; Using the candidate operation information as training samples to train the initial prediction model, to obtain a target prediction model, wherein the target prediction model records the change relationship of the operation information of the test process over time; Inputting the process running information of the reference test process among the plurality of test processes running on the execution machine into a target prediction model; Obtaining target operation information of the reference test process at a target time after the current time output by the target prediction model, wherein the target operation information is used to indicate the operation state of the reference test process at the target time; Perform similarity matching between each of the multiple sub-information included in the target running information and the preset information parameters to obtain the initial similarity of each of the sub-information, wherein the multiple sub-information is used to characterize the running state of the reference test process at the target time from multiple dimensions, and the preset information parameters are used to indicate the information parameters of the test process in the running failure state; When the initial similarity is greater than or equal to a set threshold, the reference test process is determined as the target test process that is currently in the abnormal running state on the execution machine.

7. The method according to claim 1, characterized in that The performing the process maintenance operation on the target test process includes: Obtaining a process running log of a target device, wherein the process running log records the running status of the target device on the target test process, the target device is a device selected from the target to-be-tested machine and the execution machine for executing a target closing operation, the target closing operation being used to close the target test process; Find the target location field from the process operation log; Extracting a target file descriptor from the process running log according to the relative position relationship between the target positioning field and the file descriptor, wherein the file descriptor is used to indicate the file started to implement the target test process running; Adding the target file descriptor to a corresponding position in the initial close instruction to obtain a target close instruction, wherein the initial close instruction records the closing logic of the file; The target close instruction is sent to the target device, wherein the target close instruction is used to instruct to perform the target close operation on the target test process on the target device side, and the process maintenance operation includes performing the target close operation on the target test process on the target device side.

8. A test process operation and maintenance device, characterized in that: The test system includes an execution machine and multiple machines to be tested, wherein the execution machine is connected to each of the machines to be tested via a network, and the execution machine is used to test the equipment performance of the machines to be tested. The device is applied to the execution machine, and the device includes: An acquisition module is used to acquire process running information of the test process of each of the machines to be tested running in the execution machine, wherein the execution machine is used to test the device performance of the corresponding machine to be tested through the test process, and the process running information is used to characterize the network connection status between the execution machine and the machine to be tested corresponding to the test process when the test process is running; A prediction module, used to predict a target test process that is currently in an abnormal running state on the execution machine according to the process running information; A generation module, used to generate a process maintenance operation for the target test process according to the network connection information of the target machine to be tested to which the target test process belongs, wherein the network connection information is used to indicate the establishment of the network connection between the execution machine and the target machine to be tested, and the process maintenance operation is used to maintain the running state of the target test process; A maintenance module is used to perform the process maintenance operation on the target test process.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program implements the steps of the method described in any one of claims 1 to 7 when executed by a processor.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method described in any one of claims 1 to 7 are implemented.

Images