Test methods, systems, electronic devices, and readable storage media

Abstract

Embodiments of the present application provide a test method, system, electronic device and readable storage medium, the method is applied to a control end, the control end is connected with a plurality of to-be-tested machines; comprising: in response to a device selection operation, determining the to-be-tested machine selected by the device selection operation as a target to-be-tested machine for this test; for any target to-be-tested machine, in response to a use case selection operation, determining the test case selected by the use case selection operation as a target test case corresponding to the target to-be-tested machine; obtaining a test environment file corresponding to the target test case, and sending the test environment file to the target to-be-tested machine to control the target to-be-tested machine to build a test environment based on the test environment file; controlling the target to-be-tested machine to execute a test operation based on the test environment according to the target test case, and returning a test result of the test operation to the control end; and performing specified processing on the received test result. The implementation cost of interactive testing can be reduced, and the test efficiency can be improved.

Description

Technical Field

[0001] This invention belongs to the field of computer technology, and in particular relates to a testing method, system, electronic device, and readable storage medium. Background Technology

[0002] With the development of the times and the advancement of technology, the server field has developed rapidly, market demand has gradually increased, and the difficulty and complexity of after-sales maintenance have also increased accordingly. In order to reduce the difficulty of after-sales service and maintenance and meet the needs of users for use and updates, interactive testing based on user experience has been applied to the server field, and the requirements for server interactive testing are becoming more stringent and diverse.

[0003] In existing technologies, interactive server testing typically involves testers manually testing a single server. Specifically, testers manually set up the test environment, manually test the machine under test according to test cases, and manually collect test data. However, this approach is costly and inefficient. Summary of the Invention

[0004] This invention provides a testing method, system, electronic device, and readable storage medium to solve the technical problems of high testing implementation cost and low testing efficiency in interactive testing.

[0005] To solve the above-mentioned technical problems, the present invention is implemented as follows:

[0006] In a first aspect, the present invention provides a testing method applied to a control terminal, wherein the control terminal is connected to multiple devices under test; the method includes:

[0007] In response to the device selection operation, the device under test selected by the device selection operation is determined as the target device under test for this test;

[0008] For any of the target test machines, in response to the test case selection operation, the test case selected by the test case selection operation is determined as the target test case corresponding to the target test machine;

[0009] Obtain the test environment file corresponding to the target test case, and send the test environment file to the target test machine to control the target test machine to build a test environment based on the test environment file;

[0010] The system controls the target device under test to perform test operations based on the test environment according to the target test cases, and returns the test results of the test operations to the control terminal.

[0011] Perform the specified processing on the received test results.

[0012] Optionally, obtaining the test environment file corresponding to the target test case and sending the test environment file to the target device under test to control the target device under test to build a test environment based on the test environment file includes:

[0013] Based on the operating system information and / or component information represented by the target test case, a specified file corresponding to the operating system information and / or component information is obtained from the database corresponding to the control terminal, and the specified file is used as the test environment file corresponding to the target test case.

[0014] The test environment file is sent to the target device under test, and the target device under test is controlled to install the test environment file in order to build the test environment corresponding to the target test case.

[0015] Optionally, controlling the target device under test to perform test operations based on the test environment according to the target test case includes:

[0016] Based on the test content in the target test case, a test execution instruction is sent to the target machine under test;

[0017] The test execution instruction is used to control the target device under test to execute the test operation indicated by the test execution instruction based on the test environment.

[0018] Optionally, if the control terminal is connected to a pairing machine, and the target test case includes pairing test content, the method further includes:

[0019] Send a test connection command to the connected machine to control the connected machine to establish a connection with the target test machine corresponding to the target test case in response to the test connection command;

[0020] Send a couplet test environment file to the couplet machine to control the couplet machine to build a couplet test environment based on the couplet test environment file;

[0021] The step of sending test execution instructions to the target machine under test according to the test content in the target test case includes:

[0022] Based on the couplet test content in the target test case, send a couplet test execution instruction to the target device under test;

[0023] The pair test execution instruction is used to control the target device under test to execute the test operation indicated by the pair test execution instruction based on the test environment and the pair test environment in the pair machine.

[0024] Optionally, the step of determining the device under test selected by the device selection operation as the target device under test for this test operation in response to the device selection operation includes:

[0025] In response to a device selection operation, the device information of the device under test selected by the device selection operation is determined from the device information of the plurality of devices under test collected in advance;

[0026] Based on the device information, the target device under test for this test is determined from the plurality of devices under test connected to the control terminal.

[0027] Optionally, in response to the test case selection operation, determining the test case selected by the test case selection operation as the target test case corresponding to the target machine under test includes:

[0028] In response to the test case selection operation, determine the test case number of the test case selected by the test case selection operation;

[0029] The test case corresponding to the test case number is obtained from the database corresponding to the control terminal, and the obtained test case is determined as the target test case corresponding to the target test machine.

[0030] Optionally, before controlling the target device under test to perform test operations based on the test environment according to the target test case, the method further includes:

[0031] For any of the target devices under test, a test task is generated for the target device under test based on the target test cases and device information corresponding to the target device under test;

[0032] The task information of the test task is displayed on the interface of the control terminal so that the user of the control terminal can view the task information; wherein, the task information includes the execution progress of the target test case;

[0033] The test results include the execution results and data files of the target test cases, and the specified processing of the received test results includes:

[0034] The received execution result and the file identifier of the data file are added to the task information so that the user at the control end can perform data analysis on the target device under test based on the task information.

[0035] Secondly, the present invention provides a testing system, the system comprising a control terminal and a plurality of devices under test; the control terminal is connected to the plurality of devices under test.

[0036] The control terminal is used to respond to the device selection operation and determine the device under test selected by the device selection operation as the target device under test for this test;

[0037] The control terminal is also used to, in response to a test case selection operation, determine the test case selected by the test case selection operation as the target test case corresponding to the target test machine for any of the target test machines;

[0038] The control terminal is also used to obtain the test environment file corresponding to the target test case and send the test environment file to the target test machine;

[0039] The target device under test is used to build a test environment based on the test environment file;

[0040] The control terminal is also used to control the target device under test to perform test operations based on the test environment according to the target test case.

[0041] The target device under test is also used to return the test results of the test operation to the control terminal;

[0042] The control terminal is also used to perform specified processing on the received test results.

[0043] Thirdly, the present invention provides an electronic device comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the above-described testing method.

[0044] Fourthly, the present invention provides a readable storage medium that, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to perform the above-described test method.

[0045] Fifthly, the present invention provides a testing device applied to a control terminal, wherein the control terminal is connected to multiple devices under test; the device includes:

[0046] The first determination module is used to determine the device under test selected by the device selection operation as the target device under test for this test in response to the device selection operation.

[0047] The second determining module is used to determine, in response to a test case selection operation, the test case selected by the test case selection operation as the target test case corresponding to the target test machine for any of the target test machines;

[0048] The control module is used to obtain the test environment file corresponding to the target test case and send the test environment file to the target test machine to control the target test machine to build a test environment based on the test environment file;

[0049] The execution module is used to control the target device under test to perform test operations based on the test environment according to the target test case, and return the test results of the test operations to the control terminal;

[0050] The processing module is used to perform specified processing on the received test results.

[0051] The testing method of this invention is applied to a control terminal connected to multiple devices under test (DUTs). A target DUT is determined in response to a device selection operation. For any target DUT, a target test case is determined in response to a test case selection operation, and the target DUT is controlled to build a test environment based on the test environment file corresponding to the target test case. This facilitates the determination of target test cases for the target DUT in this test. Compared to the manual setup of the test environment by testers in the prior art, this invention can automatically build the test environment for the target DUT under the control of the control terminal, thus reducing the manpower cost required for setting up the test environment. Furthermore, by controlling the target DUT to execute test operations based on the test environment according to the target test case, returning the test results to the control terminal, and the control terminal performing specified processing on the received test results, the target DUT can be automatically tested under the control of the control terminal. Compared to the manual testing of the DUT by testers in the prior art, this can reduce the test implementation cost of interactive testing and improve test efficiency to a certain extent. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0053] Figure 1 This is a flowchart of the steps of a testing method provided in an embodiment of the present invention;

[0054] Figure 2 This is a flowchart of another testing method provided in an embodiment of the present invention;

[0055] Figure 3 This is a schematic diagram of the add machine page of the control system provided in an embodiment of the present invention;

[0056] Figure 4 This is a schematic diagram of the use case selection page of the control system provided in an embodiment of the present invention;

[0057] Figure 5 This is a schematic diagram of the test task page of the control system provided in an embodiment of the present invention;

[0058] Figure 6This is a schematic diagram of the task details page of the control system provided in an embodiment of the present invention;

[0059] Figure 7 This is a structural diagram of a testing system provided in an embodiment of the present invention;

[0060] Figure 8 This is a structural diagram of a testing device provided in an embodiment of the present invention;

[0061] Figure 9 This is a structural diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0062] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0063] It should be noted that, in the embodiments of this invention, a test case refers to a description of a testing task for a specific software product, embodying the test plan, methods, techniques, and strategies. Its content includes test objectives, test environment, input data, test steps, expected results, test scripts, etc., ultimately forming a document. A test case can be understood as a set of test inputs, execution conditions, and expected results compiled for a specific objective, used to verify whether a specific software requirement is met.

[0064] like Figure 1 As shown, this embodiment of the invention provides a testing method applied to a control terminal, wherein the control terminal is connected to multiple devices under test; the method includes:

[0065] Step 101: In response to the device selection operation, the device under test selected by the device selection operation is determined as the target device under test for this test.

[0066] In this embodiment of the invention, the control terminal can be a computer device with an external interface, such as a server or computer, and the device under test (DUT) can be a computer device with interactive capabilities, such as a server. This is merely an example, and the embodiments of the invention do not impose limitations on this. Multiple DUTs can connect to the control terminal through its external interface, enabling interactive testing under the control of the control terminal. Furthermore, the multiple DUTs can include different models to facilitate simultaneous testing of multiple different models. Interactive testing refers to a testing method aimed at testing user experience, including functional interaction, interface interaction, and other testing content.

[0067] In this embodiment of the invention, the device selection operation can be a trigger operation by a user on the control terminal to select any device under test (DUT) corresponding to the device selection control on the control terminal's interface. This can be triggered by a click, a long press, etc., which are merely examples and are not limited in this embodiment. Alternatively, the device selection operation can be an operation where the control terminal receives input from a user on an input control on the control terminal's interface, and determines device selection information based on the input content in response to the user's input action. The device selection information can be related information about the selected DUT, allowing the control terminal to determine the user-selected DUT from multiple DUTs based on this information. This embodiment is not limited in this respect. The target DUT refers to the object selected by the user's device selection operation on the control terminal among multiple DUTs, i.e., the DUT selected by the device selection operation. The target DUT can be one or more, and this embodiment is not limited in this respect.

[0068] In this embodiment of the invention, in response to a device selection operation, the device under test selected by the device selection operation can be determined according to the device selection information corresponding to the device selection operation, and then the device under test selected by the device selection operation can be determined as the target device under test for this test from multiple devices under test.

[0069] Step 102: For any of the target test machines, in response to the test case selection operation, the test case selected by the test case selection operation is determined as the target test case corresponding to the target test machine.

[0070] In this embodiment of the invention, the test case selection operation can be a trigger operation by the user on the control terminal to select a test case corresponding to any test case on the control terminal's interface. This can be triggered by a click, a long press, etc., which are merely examples and are not limited in this embodiment. Alternatively, the test case selection operation can be an operation where the control terminal receives input from the user to a search control on the control terminal's interface, and, in response to the user's input, selects the corresponding test case based on test case related information. The test case related information can be keywords of the selected test case, such as the test case name, test case number, etc., which are merely examples and are not limited in this embodiment. The target test case refers to the test case selected by the user's test case selection operation on the control terminal, that is, the test case used for interactive testing of the target device under test. There can be one or more target test cases, which are not limited in this embodiment.

[0071] In this embodiment of the invention, for any target device under test (DUT), test cases to be executed during the current interactive test can be determined. Specifically, in response to a test case selection operation, the test cases selected by the operation can be determined based on the test case selection information corresponding to the operation, and then the selected test cases can be obtained and identified as the target test cases corresponding to the target DUT.

[0072] Step 103: Obtain the test environment file corresponding to the target test case, and send the test environment file to the target test machine to control the target test machine to build a test environment based on the test environment file.

[0073] In this embodiment of the invention, the test environment file refers to the relevant files required to build the test environment corresponding to the target test case. The test environment file may include installation files for the operating system, related firmware, related drivers, test tools, etc., used by the target device under test (DUT) to build the test environment based on the installation files. Firmware (FW) refers to the program written to an erasable programmable read-only memory (EPR). The test environment refers to the operating system, firmware, drivers, test tools, etc., corresponding to the target test case. This is merely an example, and this embodiment of the invention does not impose any limitations.

[0074] In this embodiment of the invention, the test environment file corresponding to the target test case can be obtained based on the relevant information of the test environment represented by the target test case, and the obtained test environment file can be sent to the target test machine through the transmission path between the control terminal and the target test machine. The test environment represented by the target test case is the test environment required for testing based on the target test case. The control terminal can control the target test machine to receive the test environment file and build the test environment corresponding to the target test case based on the test environment file. It should be noted that any target test machine can correspond to one or more target test cases, and the test environment files corresponding to one or more target test cases may have the same parts. In this embodiment of the invention, a comprehensive analysis can be performed based on one or more target test cases to determine a comprehensive test environment file corresponding to one or more test cases of the target test machine, and then obtain this comprehensive test environment file. This can reduce the amount of data transmitted and the system occupancy rate of the target test machine, and can improve the efficiency of test environment construction to a certain extent.

[0075] Step 104: Control the target device under test to perform test operations based on the test environment according to the target test case, and return the test results of the test operations to the control terminal.

[0076] In this embodiment of the invention, a test operation refers to the test process that needs to be executed in the test environment corresponding to the target test case; for example, it may be a specific test step. A test result refers to the relevant information obtained by the target device under test after executing the test operation based on the test environment; for example, it may be test data. This is merely an illustrative example, and this embodiment of the invention does not impose any limitations on it.

[0077] In this embodiment of the invention, the control terminal can control the target device under test (DUT) to execute the test operations in the target test case based on the relevant information of the test operations in the target test case, thereby obtaining the test results corresponding to the test operations. In one feasible implementation, the target DUT saves the test results in a specified storage location within the target DUT. Furthermore, the target DUT can send the obtained test results to the control terminal via a transmission path between the control terminal and the target DUT for specified processing by the control terminal. The transmission path can be a wired connection path, for example, it can be based on a computer bus capable of data transmission, such as a Universal Serial Bus (USB). Alternatively, the transmission path can be based on the connection lines between the control terminal and an intermediate device, and between the intermediate device and the target DUT, where the intermediate device can be a switch. Alternatively, the transmission path can also be a wireless connection path, for example, the control terminal and the DUT can be connected via a wireless network.

[0078] Step 105: Perform the specified processing on the received test results.

[0079] In this embodiment of the invention, the control terminal can perform specified processing on the test results sent by the target device under test (DUT) through the transmission path between the control terminal and the target DUT. This specified processing may include saving the test results to a pre-set storage location, analyzing and processing the test results, or displaying the information in the test results on the control terminal's interface. These are merely illustrative examples, and this embodiment of the invention does not impose any limitations on them.

[0080] The testing method of this invention is applied to a control terminal connected to multiple devices under test (DUTs). A target DUT is determined in response to a device selection operation. For any target DUT, a target test case is determined in response to a test case selection operation, and the target DUT is controlled to build a test environment based on the test environment file corresponding to the target test case. This facilitates the determination of target test cases for the target DUT in this test. Compared to the manual setup of the test environment by testers in the prior art, this invention can automatically build the test environment for the target DUT under the control of the control terminal, thus reducing the manpower cost required for setting up the test environment. Furthermore, by controlling the target DUT to execute test operations based on the test environment according to the target test case, returning the test results to the control terminal, and the control terminal performing specified processing on the received test results, the target DUT can be automatically tested under the control of the control terminal. Compared to the manual testing of the DUT by testers in the prior art, this can reduce the test implementation cost of interactive testing and improve test efficiency to a certain extent.

[0081] It should be noted that in this embodiment of the invention, the device selection operation can select multiple devices under test (DUTs), and correspondingly, this test includes multiple target DUTs. Multiple target DUTs can be tested simultaneously via the control terminal. The testing process for any target DUT can be referred to steps 101 to 105, and will not be repeated here. In this way, compared to the operation of testing a single DUT by a tester in the prior art, the time cost required for testing can be reduced to a certain extent, thereby improving testing efficiency.

[0082] like Figure 2 As shown, this embodiment of the invention provides another testing method applied to a control terminal, wherein the control terminal is connected to multiple devices under test; the method includes:

[0083] Step 201: In response to the device selection operation, the device under test selected by the device selection operation is determined as the target device under test for this test.

[0084] Specifically, the implementation method of this step can be referred to the relevant description of step 101, which will not be repeated here.

[0085] Step 202: For any of the target test machines, in response to the test case selection operation, the test case selected by the test case selection operation is determined as the target test case corresponding to the target test machine.

[0086] Specifically, the implementation method of this step can be referred to the relevant description of step 102, which will not be repeated here.

[0087] Step 203: Based on the operating system information and / or component information represented by the target test case, obtain the specified file corresponding to the operating system information and / or component information from the database corresponding to the control terminal, and use the specified file as the test environment file corresponding to the target test case.

[0088] In this embodiment of the invention, the operating system information may include the type and version of the operating system (OS). For example, the type information may be Linux, Windows, etc., and the version information may be Windows 7, Windows 8, or Windows 10, etc. Component information may include the name and model of the component, such as a Baseboard Management Controller (BMC) or a Complex Programmable Logic Device (CPLD). The database is used to store relevant information for each stage of the interactive test, as well as various files required for this test. The test stages include test preparation, test execution, and test analysis. The database may be storage space within the control terminal or storage space within any device connected to the control terminal. For example, the database may be located on a server, and the control terminal establishes a connection with the server to retrieve relevant files from the database. The specified file refers to the relevant file used to build the test environment for the target test cases, determined based on the operating system information and / or component information, such as the operating system installation file. This is merely an example, and this embodiment of the invention does not impose any limitations.

[0089] In this embodiment of the invention, the target test case may include relevant information about the operating system environment and / or component environment required for testing, i.e., operating system information and / or component information. The database may include an operating system library, a component library, a firmware library, a driver library, and a tool library. The operating system library contains installation files for mainstream operating systems; the component library contains component information for components required for interactive testing; the firmware library contains firmware installation files for each component; the driver library contains driver installation files for various components under different operating systems; and the tool library contains testing tools for interactive testing, such as system-wide testing tools and component testing tools. The operating system library and driver library can be associated through operating system version information, and the component library can be associated with the driver library, firmware library, and tool library through component information.

[0090] In this embodiment of the invention, the operating system installation file can be obtained from the operating system library, and the operating system driver file can be obtained from the driver library based on the operating system information. Firmware installation files, component driver files, and / or test tool installation files can be obtained from the firmware library, driver library, and / or tool library based on the component information; that is, the specified files corresponding to the operating system information and / or component information. These specified files are then used as the test environment files corresponding to the target test cases.

[0091] Step 204: Send the test environment file to the target device under test and control the target device under test to install the test environment file in order to build the test environment corresponding to the target test case.

[0092] In this embodiment of the invention, a test environment file can be sent to the target device under test (DUT) via the transmission path between the control terminal and the target DUT, and a test environment setup command can be sent to the target DUT to control the target DUT to respond to the test environment setup command, receive and install the environment test file, and build the test environment corresponding to the target test case. The control terminal and multiple DUTs can be connected via a switch, which can serve as the connection medium for data transmission between the control terminal and the DUTs.

[0093] Step 205: Control the target device under test to perform test operations based on the test environment according to the target test case, and return the test results of the test operations to the control terminal.

[0094] Specifically, the implementation method of this step can be referred to the relevant description of step 104, which will not be repeated here.

[0095] Step 206: Perform the specified processing on the received test results.

[0096] Specifically, the implementation method of this step can be referred to the relevant description of step 105, which will not be repeated here.

[0097] The testing method of this invention is applied to a control terminal connected to multiple devices under test (DUTs). A target DUT is determined in response to a device selection operation. For any target DUT, a target test case is determined in response to a test case selection operation. A test environment file is generated based on operating system information and / or component information. The control terminal then installs the test environment file sent by the control terminal to build the test environment. The target DUT is controlled to perform test operations based on the test environment according to the target test case, and the test results are returned to the control terminal. The control terminal performs specified processing on the received test results. This allows for convenient acquisition of the test environment file based on system information and / or component information, and automatic installation of the test environment file on the target DUT under the control of the control terminal to build the test environment. Compared to the prior art where testers manually download and install relevant files for building the test environment, this method reduces the time cost required to build the test environment and improves the efficiency of test environment setup.

[0098] Optionally, step 104 may include the following steps:

[0099] Step 1041: Send a test execution instruction to the target device under test according to the test content in the target test case; wherein, the test execution instruction is used to control the target device under test to execute the test operation indicated by the test execution instruction based on the test environment.

[0100] In this embodiment of the invention, test content refers to the description of the test process in the test case, which embodies the test plan, methods, techniques, and strategies. Test content may include test objectives, test environment, input data, test steps, expected results, and test scripts. A test execution instruction is a command sent from the control terminal to the target device under test (DUT), used to control the DUT to execute the instructed test operations based on the test environment. An instruction is the smallest functional unit of computer operation.

[0101] In this embodiment of the invention, test execution instructions can be determined based on the test content, such as test steps, in the target test case. These instructions may include relevant information required to complete the test steps, such as the model of the component under test, action execution instructions, and data storage path. In one feasible implementation, the component under test can be determined based on its model in the test content, and the test tool, the actions required by the component under test, etc., can be determined based on the test steps in the test content. The storage path for the test data of the component under test can also be determined based on the type of the test tool. The address of the component under test, the identifier of the test tool, the action instructions, and the data storage path are then added to a preset instruction template to obtain the test execution instructions.

[0102] In this embodiment of the invention, a test execution command can be sent to the target device under test via the transmission path between the control terminal and the target device under test, so as to control the target device under test to respond to the test execution command and execute the test steps indicated by the test execution command based on the test environment.

[0103] In this embodiment of the invention, test execution instructions are sent to the target device under test (DUT) according to the test content in the target test case. This allows for convenient control of the DUT to automatically execute the test operations indicated by the test execution instructions based on the test environment, which differs from the manual testing of a single DUT by testers in existing technologies. Therefore, it can reduce the manpower costs required in the test execution phase, and under the control of the control terminal, it can also reduce the time costs required in the test execution phase, thereby improving test efficiency.

[0104] Optionally, if the control terminal is connected to a pairing machine, and the target test case includes pairing test content, the method further includes:

[0105] Step 106: Send a test connection command to the connected machine to control the connected machine to establish a connection with the target test machine corresponding to the target test case in response to the test connection command.

[0106] In this embodiment of the invention, the connecting machine can be a computer device with interactive capabilities, such as a server or computer. The connecting machine is used to connect to the target device under test (DUT) under the control of the control terminal to perform connecting tests on the DUT. The connecting machine can access the control terminal through its external interface. In one feasible implementation, the connecting machine can establish a connection with the control terminal through a switch; this invention does not impose limitations on this. The connecting test content refers to the test content that can only be performed when the target DUT is connected to a computer device with connecting test conditions, such as network card-related tests. In this embodiment of the invention, the computer device with connecting test conditions is the connecting machine. The test connection command is a computer command used to control the connecting machine to establish a connection with the target DUT corresponding to the target test case.

[0107] In this embodiment of the invention, when the target test case includes connection test content, a test connection command can be sent to the connection machine via the transmission path between the control terminal and the connection machine, such as a switch, to control the connection machine to establish a connection with the target device under test in response to the test connection command. The connection between the connection machine and the target device under test can be a physical connection or a network connection; this embodiment of the invention does not impose any limitations on this.

[0108] Step 107: Send a couplet test environment file to the couplet machine to control the couplet machine to build a couplet test environment based on the couplet test environment file.

[0109] In this embodiment of the invention, the "pairing test environment file" refers to the relevant files required to build the pairing test environment corresponding to the pairing test content in the target test case. The pairing test environment file can be the component to be tested, such as the installation files related to a network card, used by the target device under test to build the pairing test environment based on the installation files. The pairing test environment refers to the firmware, drivers, testing tools, etc., corresponding to the pairing test content; this is merely an example, and this embodiment of the invention does not impose any limitations on it.

[0110] In this embodiment of the invention, a couplet test environment file can be obtained based on the relevant information of the couplet test environment represented by the couplet test content in the target test case, and the obtained couplet test environment file can be sent to the couplet machine through the transmission path between the control terminal and the couplet machine. The control terminal can control the couplet machine to receive the couplet test environment file and build the couplet test environment corresponding to the target test case based on the couplet test environment file.

[0111] Step 1041 may include the following steps:

[0112] Step 1041a: Based on the paired test content in the target test case, send a paired test execution instruction to the target device under test; wherein, the paired test execution instruction is used to control the target device under test to execute the test operation indicated by the paired test execution instruction based on the test environment and the paired test environment in the paired machine.

[0113] In this embodiment of the invention, the pair test execution command can be a computer command sent from the control terminal to the target device under test (DUT) to control the target DUT to perform a pair test between itself and the pair test machine based on the pair test part in its own test environment and the pair test environment in the pair test machine. That is, to execute the test steps indicated by the pair test execution command.

[0114] In this embodiment of the invention, the execution instructions for paired tests can be determined based on the paired test content in the target test case, such as the test steps. These paired test execution instructions may include relevant information required to complete the test steps, such as the model of the component under test, the action execution instructions, and the data storage path. In one feasible implementation, the paired test component, such as the network card (NIC), can be determined based on the component model in the paired test content, such as the NIC model. The test tool is determined based on the test steps in the paired test content; for example, if the test step is a NIC stress test, then the test tool is determined as a NIC stress test tool. The actions required for the NIC to perform are also determined, such as inputting various parameters into the NIC to test its main performance characteristics. The storage path for the test data of the NIC is determined based on the type of test tool; for example, a storage area in the memory of the target machine under test specified by the NIC stress test tool. The address of the NIC under test, the identifier of the test tool, the action instructions, and the data storage path are added to a preset instruction template, which is then used as the paired test execution instructions.

[0115] In this embodiment of the invention, a pairwise test execution command can be sent to the target device under test (DUT) via the transmission path between the control terminal and the target DUT. This controls the target DUT to respond to the pairwise test execution command and execute the test steps indicated by the command, based on the pairwise test portion of its own test environment and the pairwise test environment in the paired machine. For example, when performing network interface card (NIC) testing on the target DUT, the target DUT and the paired machine are configured on the same network segment. The target DUT responds to the pairwise test execution command, receives the test parameters in the command, and inputs them into its NIC testing tool to generate a test command. The NIC testing tool of the paired machine calls the test command to generate a NIC test script and sends the script to the target DUT. The target DUT executes the NIC test script to obtain the variables of the input test parameters and uses these variables as the test result.

[0116] In this embodiment of the invention, by sending test connection instructions and a test environment file to the connected machine, the connected machine can be conveniently controlled to automatically establish a connection with the target device under test (DUT) and set up a test environment. Furthermore, by sending a test execution instruction to the target DUT based on the test content in the target test case, the target DUT can be conveniently controlled to automatically execute the test operations indicated by the test execution instruction based on the test environment and the test environment in the connected machine. This differs from the manual operation of establishing a connection between a single DUT and the connected machine, setting up the test environment on the connected machine, and performing manual testing. Therefore, the manual labor cost required for connected testing can be reduced, and the time cost can be reduced under the control of the control terminal, thereby improving testing efficiency.

[0117] Optionally, step 101 includes the following steps:

[0118] Step 1011: In response to the device selection operation, determine the device information of the device under test selected by the device selection operation from the device information of the plurality of devices under test collected in advance.

[0119] In this embodiment of the invention, the database corresponding to the control terminal may include a device under test (DUT) information database. Device information of multiple DUTs connected to the control terminal can be collected in advance and stored in the DUT information database for backup and retrieval by the control terminal. In one feasible implementation, the control terminal can send a device information collection command to the DUT based on the DUT's Baseboard Controller IP (BMC IP) or Operating System IP (OS IP) to control the DUT to collect and return device information. The device information may include the DUT's BMC IP, component model, etc.

[0120] In this embodiment of the invention, in response to a user's trigger operation on the device selection control corresponding to any device under test (DUT) on the control system interface, or a trigger operation on inputting device selection information into the input control on the control system interface, the device information of the DUT selected by the device selection operation can be retrieved from the DUT information database. The DUT information database stores pre-collected device information for the plurality of DUTs.

[0121] Step 1012: Based on the device information, determine the target device under test for this test from the plurality of devices under test connected to the control terminal.

[0122] In this embodiment of the invention, based on the device information, the device under test represented by the device information can be selected as the target device under test in the device selection operation from multiple devices under test connected to the control terminal, that is, the target device under test for this test can be determined.

[0123] Figure 3 This is a schematic diagram of the "Add Machine" page of the control system provided in an embodiment of the present invention, as shown below. Figure 3 As shown, the control terminal can receive user input on the BMC IP space or OS IP control. For example, it can be a click input that automatically triggers a device information collection command sent to the device under test (DUT) based on the DUT's BMC IP or OS IP, controlling the DUT to collect and return device information. The control terminal can also receive user input on the add button control. Based on the device information returned by the DUT, it selects the DUT represented by the device information from among multiple DUTs connected to the control terminal as the target DUT for the device selection operation, thus determining the target DUT for this test. Figure 3As shown, after determining the target device under test (DUT) for this test, the control terminal can display the DUT's device information on the machine list on the control system interface for testers to view and perform related operations. For example, they can edit the DUT's device information or delete the device information to cancel the target DUT for this test. The machine list can include the BMC IP, OS IP, model, Media Access Control (MAC) address, and operation information of any target DUT. The MAC address is a unique code assigned by the manufacturer to network hardware such as wireless or Ethernet network cards; each code corresponds to a unique device.

[0124] Optionally, after determining the target device under test (DUT) for this test, the control terminal can check whether the data transmission path with the target DUT is normal. Specifically, a verification command can be sent to the target DUT to control the target DUT to process the verification code in the verification command and return the verification result, thereby detecting the data transmission path between the control terminal and the target DUT.

[0125] In this embodiment of the invention, by pre-collecting device information of multiple devices under test, the control terminal can respond to the user's device selection operation and conveniently and automatically determine the target device under test from multiple devices under test based on the device information of the device under test selected by the device selection operation.

[0126] Optionally, step 102 may include the following steps:

[0127] Step 1021: In response to the test case selection operation, determine the test case number of the test case selected by the test case selection operation.

[0128] In this embodiment of the invention, the test case number refers to the test case identifier, used to distinguish different test cases. The control system interface on the control end can display information related to multiple test cases and their respective operation controls. For example, the information related to the test case can be the test case name, and the operation control can be a test case selection control. This is only an example, and this embodiment of the invention does not impose any limitations on it.

[0129] In this embodiment of the invention, for any target device under test, the system can respond to the user's trigger operation on the test case selection control corresponding to any test case on the control system interface, or the user inputs test case related information into the search control on the control system interface, and select the corresponding test case trigger operation based on the test case related information to determine the test case number of the test case selected by the test case selection operation.

[0130] Figure 4 This is a schematic diagram of a use case selection page for a control system provided in an embodiment of the present invention, as shown below.Figure 4 As shown, the test case library page displays information about multiple test cases and their respective operation controls, including information controls for Test Case 1, Test Case 2... Test Case N, as well as their respective add and delete controls. Users on the control side can directly select test cases for the target device under test using the add control based on the test case information. A test case search control is also provided on the page. The control side can receive test case information entered by the user into the search control and automatically trigger a search for the user-selected test case from the multiple test cases on the page.

[0131] Step 1022: Obtain the test case corresponding to the test case number from the database corresponding to the control terminal, and determine the obtained test case as the target test case corresponding to the target test machine.

[0132] In this embodiment of the invention, the database corresponding to the control terminal may include a test case library. This test case library is used to store various test cases for interactive testing and to manage the test cases. Based on the test case number selected by the test case selection operation, the test case corresponding to the test case number can be searched and retrieved from the test case library, and the retrieved test case can be used as the target test case for the target machine under test.

[0133] In this embodiment of the invention, by responding to the test case selection operation and determining the test case number of the test case selected by the test case selection operation, the target test case corresponding to the target test machine can be easily obtained from the database corresponding to the control terminal.

[0134] Optionally, prior to step 104, the method further includes:

[0135] Step 108: For any of the target devices under test, generate a test task for the target device under test based on the target test cases and device information corresponding to the target device under test.

[0136] In this embodiment of the invention, for any target device under test (DUT), a test task can be created based on the device information of the target DUT. The test task characterizes the test plan for the target DUT and includes device information and the test schedule. One or more target test cases to be executed are added to the test task created for the target DUT, and the test task with added target test cases is used as the generated test task for the target DUT.

[0137] Optionally, the test tasks of the target device under test (DUT) can be displayed on the control system interface of the control terminal, allowing the user on the control terminal to view the task information and test progress of the DUT, as well as perform related operations on the test tasks, such as modifying test tasks, adding or removing target test cases, or deleting test tasks. This is merely an example, and the embodiments of the present invention do not impose limitations on this.

[0138] Figure 5 This is a schematic diagram of the test task page of the control system of the control terminal provided in an embodiment of the present invention, as shown below. Figure 5 As shown, the task list includes test tasks for multiple target devices under test. Each test task includes a sequence number, the BMC IP of the target device under test, the test progress of the test task (e.g., executing, pending test, completed), and operation controls such as a view button, which can receive user input (e.g., click input) and display relevant information about the task.

[0139] Step 109: Display the task information of the test task on the interface of the control terminal so that the user of the control terminal can view the task information; wherein, the task information includes the execution progress of the target test case.

[0140] In this embodiment of the invention, the task information may include the test case name, execution progress, and test case execution time of the target test case. The task information of the test task for the target machine under test can be displayed on the control system interface so that users on the control end can view the task information and understand the details of the test task for the target machine under test.

[0141] The test results include the execution results and data files of the target test cases. Step 105 may include the following steps:

[0142] Step 1051: Add the received execution result and the file identifier of the data file to the task information so that the user at the control end can perform data analysis on the target device under test based on the task information.

[0143] In this embodiment of the invention, the test results returned by the target device under test (DUT) to the control terminal may include the execution results of the target test cases and data files. The execution results of the target test cases characterize the execution conclusion of the test cases, and may include, for example, pass, fail, skip, etc. The data files include the test data generated by the target DUT performing test operations. The file identifier of the data files is used to distinguish different test data files; for example, it may be the filename or storage address of the data files. This is merely an illustrative example, and this embodiment of the invention does not impose any limitations.

[0144] In this embodiment of the invention, the execution results of the target test cases received by the control terminal and the file identifier of the data files can be added to the task information of the test task to which the target test cases belong, so that the user on the control terminal can perform data analysis on the target device under test based on the task information. For example, the execution results of the target test cases can be used to analyze whether the interactive functions of the target device under test conform to the functional description of the interactive functions of the target device under test during the R&D phase. Specifically, the data files can be used to analyze the parts of the interactive functions of the target device under test that do not conform to the functional description or do not meet the specific requirements in the functional description, that is, to find the functional defects of the interactive functions, so as to obtain the analytical conclusion that the interactive functions of the target device under test do not match the functional description.

[0145] Figure 6 This is a schematic diagram of the task details page of the control system provided in an embodiment of the present invention, as shown below. Figure 6 As shown, the task details page can include the target test cases corresponding to the target test machine. The task details include the sequence number of each target test case, the test case name, the execution progress (e.g., completed, executing), the test case execution time, and the file identifier of the data file (e.g., the file name).

[0146] Optionally, the database corresponding to the control terminal also includes a test database, which is used to back up the data files returned by the target device under test. In this embodiment of the invention, the data files of the target test cases received by the control terminal can be stored in the test database for testers to view and download.

[0147] In this embodiment of the invention, for any target device under test (DUT), a test task is generated based on the target test cases and device information, and the task information is displayed on the control terminal's interface, allowing the user on the control terminal to easily view the task information. Furthermore, by adding the received execution results and the file identifier of the data file to the task information, the user on the control terminal can easily perform data analysis on the target DUT based on the task information, improving the practicality of the testing method in actual test line scenarios.

[0148] It should be noted that interactive testing involves many functions, and the corresponding test cases are also complex and diverse. For example, interactive testing includes interactive testing under system stress, the impact of BMC reset on the system, the impact of BMC upgrades and downgrades on the system, the impact of system stress on the BMC, the impact of system restart on the BMC, interactive testing of system stress and Basic Input / Output System (BIOS) refresh, interactive testing of system stress and CPLD refresh, interactive testing of system stress and Redundant Arrays of Independent Disks (RAID) card firmware refresh, and interactive testing of system stress and network card firmware refresh. Among them, the test process of interactive testing of system stress and CPLD refresh includes: First, setting up the test environment, including installing the mainstream OS, connecting the necessary drivers for the machine under test, the old and new versions of the motherboard CPLD files and refresh tools, the old and new versions of the CPLD files and refresh tools for one or more backplanes under test, and installing system stress testing tools such as CPU, memory, hard drive, and network card stress testing tools. Secondly, the test operations include repeatedly refreshing the motherboard CPLD 20 times and the backplane 20 times during system stress testing, with a system restart before each CPLD refresh to ensure CPLD activation. Through the testing method of this invention, tests that were previously performed manually, such as system stress testing, BMC refresh, BIOS refresh, CPLD refresh, network card interaction, and RAID interaction, can be automatically executed under the control of the control terminal. Therefore, testing costs can be reduced, work efficiency improved, and interactive testing under control can reduce human error, thus improving test quality and reliability.

[0149] This invention provides a testing system, the system comprising a control terminal and multiple devices under test (DUTs); the control terminal is connected to the multiple DUTs.

[0150] The control terminal is used to respond to the device selection operation and determine the device under test selected by the device selection operation as the target device under test for this test;

[0151] The control terminal is also used to, in response to a test case selection operation, determine the test case selected by the test case selection operation as the target test case corresponding to the target test machine for any of the target test machines;

[0152] The control terminal is also used to obtain the test environment file corresponding to the target test case and send the test environment file to the target test machine;

[0153] The target device under test is used to build a test environment based on the test environment file;

[0154] The control terminal is also used to control the target device under test to perform test operations based on the test environment according to the target test case.

[0155] The target device under test is also used to return the test results of the test operation to the control terminal;

[0156] The control terminal is also used to perform specified processing on the received test results.

[0157] Optionally, the system further includes a switch connected to the control terminal, and the control terminal connects to the plurality of devices under test (DUTs) through the switch; the switch is used to realize data transmission between the control terminal and any of the DUTs.

[0158] Optionally, the system further includes a pairing machine, which is connected to the switch and can be connected to any device under test under the control of the control terminal; the pairing machine is used to perform pairing tests on any of the devices under test under the control of the control terminal.

[0159] Optionally, the control terminal further includes a control system; the control system is used to receive the user's device selection operation and test case selection operation, and control the target device under test to build a test environment based on the test environment file and execute test operations based on the test environment, as well as receive the test operation returned by the target device under test and perform specified processing on the test results.

[0160] Optionally, the control terminal further includes a database; the database includes a device under test (DUT) information database, a test case database, an operating system database, a firmware database, a driver database, a component database, and a test database. The database is used to store relevant files for test cases, operating systems, firmware, and drivers required for interactive testing, as well as information about the DUT, component information, and test data.

[0161] Figure 7 This is a structural diagram of a testing system provided in an embodiment of the present invention, such as... Figure 7 As shown, the test system includes a control terminal, a switch, connected devices, and devices under test (DUT) 1 through N. The control terminal includes a control system and a database. The control terminal is connected to the switch, and the control terminal is connected to DUT 1 through DUT N via the switch. The control terminal is also connected to the connected devices via the switch, and the connected devices are connected to DUT 1 under the control of the control terminal.

[0162] In this embodiment of the invention, the database corresponding to the control terminal may include a switch database. The control terminal can acquire device data from the switch and store the device data in the switch database. The switch can serve as a connection medium between the control terminal, the device under test (DUT), and connected devices, enabling data transmission between the control terminal and multiple DUTs, as well as between the control terminal and connected devices.

[0163] Optionally, in one feasible implementation, the device under test (DUT) is equipped with a CPU, memory, motherboard, backplane, serial ATA (SATA) hard drive, non-volatile memory host controller (NVM Express, NVMe) hard drive, network card, and RAID card. The connected device is equipped with a CPU, memory, and the network card required by the DUT. The DUT and the connected device are connected to the control terminal via a switch.

[0164] This invention also provides a testing device applied to a control terminal, wherein the control terminal is connected to multiple devices under test; such as Figure 8 As shown, the device 30 includes:

[0165] The first determination module 301 is used to determine the device under test selected by the device selection operation as the target device under test for this test in response to the device selection operation.

[0166] The second determining module 302 is used to determine, in response to a test case selection operation, the test case selected by the test case selection operation as the target test case corresponding to the target test machine for any of the target test machines;

[0167] The control module 303 is used to obtain the test environment file corresponding to the target test case and send the test environment file to the target test machine to control the target test machine to build a test environment based on the test environment file;

[0168] The execution module 304 is used to control the target device under test to perform test operations based on the test environment according to the target test case, and return the test results of the test operations to the control terminal;

[0169] The processing module 305 is used to perform specified processing on the received test results.

[0170] Optionally, the control module 303 is specifically used for:

[0171] Based on the operating system information and / or component information represented by the target test case, a specified file corresponding to the operating system information and / or component information is obtained from the database corresponding to the control terminal, and the specified file is used as the test environment file corresponding to the target test case.

[0172] The test environment file is sent to the target device under test, and the target device under test is controlled to install the test environment file in order to build the test environment corresponding to the target test case.

[0173] Optionally, the execution module 304 is specifically used for:

[0174] Based on the test content in the target test case, a test execution instruction is sent to the target device under test; wherein, the test execution instruction is used to control the target device under test to execute the test operation indicated by the test execution instruction based on the test environment.

[0175] Optionally, the control terminal is connected to a pairing machine, and if the target test case includes pairing test content, the device further includes:

[0176] The first sending module is used to send a test connection command to the connected machine to control the connected machine to establish a connection with the target test machine corresponding to the target test case in response to the test connection command;

[0177] The second sending module is used to send a couplet test environment file to the couplet machine, so as to control the couplet machine to build a couplet test environment based on the couplet test environment file;

[0178] The execution module 304 is further specifically used for:

[0179] Based on the paired test content in the target test case, a paired test execution instruction is sent to the target device under test; wherein, the paired test execution instruction is used to control the target device under test to execute the test operation indicated by the paired test execution instruction based on the test environment and the paired test environment in the paired machine.

[0180] Optionally, the first determining module 301 is specifically used for:

[0181] In response to a device selection operation, the device information of the device under test selected by the device selection operation is determined from the device information of the plurality of devices under test collected in advance;

[0182] Based on the device information, the target device under test for this test is determined from the plurality of devices under test connected to the control terminal.

[0183] Optionally, the second determining module 302 is specifically used for:

[0184] In response to the test case selection operation, determine the test case number of the test case selected by the test case selection operation;

[0185] The test case corresponding to the test case number is obtained from the database corresponding to the control terminal, and the obtained test case is determined as the target test case corresponding to the target test machine.

[0186] Optionally, before controlling the target device under test to perform test operations based on the test environment according to the target test case, the device further includes:

[0187] The generation module is used to generate test tasks for any of the target test devices based on the target test cases and device information corresponding to the target test device.

[0188] The display module is used to display the task information of the test task on the interface of the control terminal, so that the user of the control terminal can view the task information; wherein, the task information includes the execution progress of the target test case;

[0189] The test results include the execution results and data files of the target test cases, and the processing module 305 is specifically used for:

[0190] The received execution result and the file identifier of the data file are added to the task information so that the user at the control end can perform data analysis on the target device under test based on the task information.

[0191] The present invention also provides an electronic device, see [link to relevant documentation]. Figure 9 It includes: a processor 401, a memory 402, and a computer program 4021 stored in the memory and executable on the processor, wherein the processor executes the program to implement the test method of the foregoing embodiments.

[0192] The present invention also provides a readable storage medium, wherein when the instructions in the storage medium are executed by the processor of an electronic device, the electronic device is able to perform the test method of the foregoing embodiments.

[0193] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.

[0194] The algorithms and displays provided herein are not inherently related to any particular computer, virtual system, or other device. The structure required to construct such a system is readily apparent from the above description. Furthermore, this invention is not directed to any particular programming language. It should be understood that the contents of the invention described herein can be implemented using various programming languages, and the above description of specific languages ​​is for the purpose of disclosing the best mode of implementation of the invention.

[0195] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.

[0196] Similarly, it should be understood that, in order to simplify the invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. However, this method of disclosure should not be construed as reflecting an intention that the claimed invention requires more features than expressly recited in each claim. Rather, as reflected in the following claims, inventive aspects lie in fewer than all features of a single foregoing disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into this detailed description, wherein each claim itself is a separate embodiment of the invention.

[0197] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0198] The various component embodiments of the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components in the sorting device according to the present invention. The present invention can also be implemented as a device or apparatus program for performing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0199] It should be noted that the above embodiments are illustrative of the invention and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

[0200] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0201] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

[0202] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0203] It should be noted that the various data-related processes in the embodiments of this application are carried out in compliance with the relevant data protection laws and policies of the country where the location is located, and with the authorization granted by the owner of the corresponding device.

Claims

1. A testing method, characterized in that, The method is applied to a control terminal, which is connected to multiple devices under test (DUTs); the method includes: In response to the device selection operation, the device under test selected by the device selection operation is determined as the target device under test for this test; For any of the target test machines, in response to the test case selection operation, the test case selected by the test case selection operation is determined as the target test case corresponding to the target test machine; Obtain the test environment file corresponding to the target test case and send the test environment file to the target device under test to control the target device under test to build a test environment based on the test environment file; the test environment file refers to the file required to build the test environment corresponding to the target test case; each target device under test corresponds to one or more target test cases, and a comprehensive test environment file corresponding to the one or more test cases of the target device under test is determined according to the one or more target test cases; The system controls the target device under test to perform test operations based on the test environment according to the target test cases, and returns the test results of the test operations to the control terminal. Perform the specified processing on the received test results; The step of obtaining the test environment file corresponding to the target test case and sending the test environment file to the target device under test to control the target device under test to build a test environment based on the test environment file includes: Based on the operating system information and / or component information represented by the target test case, a specified file corresponding to the operating system information and / or component information is obtained from the database corresponding to the control terminal, and the specified file is used as the test environment file corresponding to the target test case. The test environment file is sent to the target device under test, and the target device under test is controlled to install the test environment file in order to build the test environment corresponding to the target test case.

2. The method according to claim 1, characterized in that, The step of controlling the target device under test to perform test operations based on the test environment according to the target test case includes: Based on the test content in the target test case, a test execution instruction is sent to the target machine under test; The test execution instruction is used to control the target device under test to execute the test operation indicated by the test execution instruction based on the test environment.

3. The method according to claim 2, characterized in that, The control terminal is connected to a pair of machines. When the target test case includes pair testing content, the method further includes: Send a test connection command to the connected machine to control the connected machine to establish a connection with the target test machine corresponding to the target test case in response to the test connection command; Send a couplet test environment file to the couplet machine to control the couplet machine to build a couplet test environment based on the couplet test environment file; The step of sending test execution instructions to the target machine under test according to the test content in the target test case includes: Based on the couplet test content in the target test case, send a couplet test execution instruction to the target device under test; The pair test execution instruction is used to control the target device under test to execute the test operation indicated by the pair test execution instruction based on the test environment and the pair test environment in the pair machine.

4. The method according to claim 1, characterized in that, The step of responding to the device selection operation by determining the device under test selected in the device selection operation as the target device under test for this test operation includes: In response to a device selection operation, the device information of the device under test selected by the device selection operation is determined from the device information of the plurality of devices under test collected in advance; Based on the device information, the target device under test for this test is determined from the plurality of devices under test connected to the control terminal.

5. The method according to claim 1, characterized in that, The step of responding to the test case selection operation by determining the test case selected by the test case selection operation as the target test case corresponding to the target machine under test includes: In response to the test case selection operation, determine the test case number of the test case selected by the test case selection operation; The test case corresponding to the test case number is obtained from the database corresponding to the control terminal, and the obtained test case is determined as the target test case corresponding to the target test machine.

6. The method according to any one of claims 1-5, characterized in that, Before controlling the target device under test to perform test operations based on the test environment according to the target test case, the method further includes: For any of the target devices under test, a test task is generated for the target device under test based on the target test cases and device information corresponding to the target device under test; The task information of the test task is displayed on the interface of the control terminal so that the user of the control terminal can view the task information; wherein, the task information includes the execution progress of the target test case; The test results include the execution results and data files of the target test cases, and the specified processing of the received test results includes: The received execution result and the file identifier of the data file are added to the task information so that the user at the control end can perform data analysis on the target device under test based on the task information.

7. A testing system, characterized in that, The system includes a control terminal and multiple devices under test (DUTs); the control terminal is connected to the multiple DUTs. The control terminal is used to respond to the device selection operation and determine the device under test selected by the device selection operation as the target device under test for this test; The control terminal is also used to, in response to a test case selection operation, determine the test case selected by the test case selection operation as the target test case corresponding to the target test machine for any of the target test machines; The control terminal is also used to obtain the test environment file corresponding to the target test case and send the test environment file to the target test machine; the test environment file refers to the file required to build the test environment corresponding to the target test case; each target test machine corresponds to one or more target test cases, and the comprehensive test environment file corresponding to the one or more test cases of the target test machine is determined according to the one or more target test cases; The target device under test is used to build a test environment based on the test environment file; The control terminal is also used to control the target device under test to perform test operations based on the test environment according to the target test case. The target device under test is also used to return the test results of the test operation to the control terminal; The control terminal is also used to perform specified processing on the received test results; The control terminal is also used to obtain a specified file corresponding to the operating system information and / or component information from the database corresponding to the control terminal based on the operating system information and / or component information represented by the target test case, and send the specified file as the test environment file corresponding to the target test case to the target machine under test, and control the target machine under test to install the test environment file to build the test environment corresponding to the target test case.

8. An electronic device, characterized in that, include: A processor, a memory, and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the program, implements the test method as described in any one of claims 1-6.

9. A readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform one or more of the test methods described in claims 1-6.

Images