A system reliability test method, device, computer equipment and storage medium

Abstract

Embodiments of the present application disclose a system reliability test method and device, computer equipment and a storage medium, wherein the method comprises: a system obtaining test information corresponding to a test instruction, including test data and a test task; obtaining a test environment, a test process and a preset test result reference file corresponding to the test task, and system data corresponding to the test environment; analyzing based on the test data and the system data to determine effective test elements meeting system reliability test requirements; testing the system based on the effective test elements, the test environment and the test process; comparing the test file generated after the test with the test result reference file, and obtaining the system reliability based on the comparison result. Through the above manner, when the system reliability is tested, the data is analyzed and determined by the effective test elements first, the system is tested by the effective test elements, the accuracy of the test is improved, and the test effect is improved.

Description

Technical Field

[0001] This application relates to the field of testing technology, and in particular to a system reliability testing method, apparatus, computer equipment, and storage medium. Background Technology

[0002] Before a system is put into use, it needs to undergo reliability testing to verify its ability to handle faults. Only when the system's fault handling ability meets the requirements can the system be put into use.

[0003] Currently, when conducting reliability testing on a system, the system directly performs the test based on the input test data without filtering out the effective test elements. This method of directly testing based on the test data reduces the accuracy of the test results and leads to poor test performance. Summary of the Invention

[0004] This application provides a system reliability testing method, apparatus, computer equipment, and storage medium to solve the problems mentioned in the background art.

[0005] In a first aspect, embodiments of this application provide a system reliability testing method, the method comprising:

[0006] The system receives a test instruction and obtains test information corresponding to the test instruction, the test information including test data and test tasks;

[0007] Obtain the test environment, test process, and preset test result reference file corresponding to the test task, and obtain the system data corresponding to the test environment;

[0008] Based on the analysis of the test data and the system data, the effective test elements in the test data and system data that meet the system reliability test requirements are determined;

[0009] Based on the aforementioned effective test elements, test environment, and test process, the system is subjected to reliability testing.

[0010] Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0011] In some embodiments, the step of analyzing the test data and the system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements includes:

[0012] By training the test data and system data with a deep learning model, valid test elements that meet the system reliability test requirements in the test data and system data are determined.

[0013] In some embodiments, training the test data and the system data using a deep learning model to determine valid test elements in the test data and system data that meet the system reliability test requirements includes:

[0014] An environmental scene corresponding to the system data is constructed using a deep learning model, and the scene elements of the environmental scene are obtained.

[0015] Based on the scene elements, the test data is analyzed using the deep learning model, and data elements are selected from the test data;

[0016] The deep learning model is used to train the scene elements and the data elements to determine the valid test elements in the test data and the system data that meet the system reliability test requirements.

[0017] In some embodiments, the step of analyzing the test data and the system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements includes:

[0018] Data analysis is performed on the test data and the system data to obtain the corresponding parameter information;

[0019] Based on the parameter information, data is generated by selecting tables from the test data and the system data;

[0020] Based on the data generated from the table and the preset rules and strategies, a corresponding test strategy table is generated, and the test strategy table is equipped with element identifiers;

[0021] Obtain the identifier position of the element in the test strategy table, and use the table generation data and parameter information corresponding to the identifier position as valid test elements.

[0022] In some embodiments, after obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, and determining the system reliability based on the comparison result, the method further includes:

[0023] Obtain abnormal data from the test file, and based on the abnormal data, trace the location where the abnormal data occurred during the test process;

[0024] Select the valid test elements associated with the location where the anomaly occurred as the test elements to be confirmed;

[0025] Determine the reasonableness of the values ​​of the test elements to be confirmed, and automatically adjust the values ​​of the test elements to be confirmed based on the preset value method;

[0026] Based on the adjusted test elements to be determined, the system is retested from the location where the anomaly occurred.

[0027] In some embodiments, after retesting the system from the location of the anomaly based on the adjusted test elements to be determined, the method further includes:

[0028] Within the prediction time, the number of occurrences of each of the aforementioned anomaly occurrence locations is calculated, and the number of occurrences of each of the aforementioned anomaly data at each of the aforementioned anomaly occurrence locations is counted.

[0029] An anomaly statistics report is generated based on the number of times the data was generated, the abnormal data, and the number of times it occurred.

[0030] In some embodiments, obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, and determining the system reliability based on the comparison result includes:

[0031] Obtain the test file generated after the test is completed, and compare the test file with the test result reference file;

[0032] Determine the differences between the test file and the test result reference file, and mark the differences.

[0033] The system reliability is determined by the correspondence between the number of distinguishing positions and the preset number scoring table.

[0034] Secondly, embodiments of this application provide a system reliability testing apparatus, the apparatus comprising:

[0035] The instruction receiving unit is used to receive test instructions from the system and obtain test information corresponding to the test instructions, wherein the test information includes test data and test tasks.

[0036] The test acquisition unit is used to acquire the test environment, test process and preset test result reference file corresponding to the test task, and to acquire system data corresponding to the test environment.

[0037] The element determination unit is used to analyze the test data and the system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements.

[0038] The system testing unit is used to perform reliability testing on the system based on the effective test elements, the test environment, and the test process.

[0039] The result comparison unit is used to obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison result.

[0040] Thirdly, embodiments of this application also provide a computer device, including a memory and a processor, wherein the memory is used to store instructions and data, and the processor is used to execute the system reliability testing method described above.

[0041] Fourthly, embodiments of this application also provide a storage medium storing a plurality of instructions adapted for loading by a processor to execute the system reliability testing method described above.

[0042] The system reliability testing method in this application embodiment first analyzes and determines the effective test elements of the test data and system data during system reliability testing, and then tests the system through the effective test elements to improve the accuracy and effectiveness of the test. Attached Figure Description

[0043] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a flowchart of a system reliability testing method provided in an embodiment of this application.

[0045] Figure 2 This is another flowchart of a system reliability testing method provided in an embodiment of this application.

[0046] Figure 3 This is another flowchart of a system reliability testing method provided in the embodiments of this application.

[0047] Figure 4 This is another flowchart of a system reliability testing method provided in the embodiments of this application.

[0048] Figure 5 This is a schematic diagram of the structure of a system reliability testing device provided in an embodiment of this application.

[0049] Figure 6 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0050] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0051] This application provides a system reliability testing method, apparatus, computer equipment, and storage medium. By analyzing test data and system data, effective test elements are determined, and the system reliability is tested using these effective test elements, thereby improving test accuracy and effectiveness. The system reliability testing method, apparatus, computer equipment, and storage medium will be described in detail below.

[0052] Please see Figure 1 , Figure 1 A flowchart of a system reliability testing method provided in this application embodiment, the method including the following:

[0053] 101. The system receives a test instruction and obtains test information corresponding to the test instruction. The test information includes test data and test tasks.

[0054] Test commands are generally instructions that developers input into the system after development to test the system's performance and fault-handling capabilities. Since the system includes multiple application software and multiple application environments, and the system may have various faults, the test commands will be different depending on the test object.

[0055] After the developer enters a test command into the system, the system receives the test command and can obtain the test information corresponding to the test command.

[0056] In the embodiments of this application, the test information includes test data and test tasks. The test data may be test code, test files, interface information, etc., and may be data input by developers according to test tasks, as well as data pre-set by the system retrieved by the system according to test instructions.

[0057] 102. Obtain the test environment, test process, and preset test result reference file corresponding to the test task, and obtain the system data corresponding to the test environment.

[0058] Since the system includes multiple application software and multiple application environments, after receiving the test instruction, information such as the test environment, test process and preset test result reference files can be obtained based on the test instruction.

[0059] The testing process may vary for different testing tasks. Therefore, it is necessary to obtain the testing process corresponding to the testing instructions in order to achieve accurate testing.

[0060] For system testing, the testing process and / or test results can be presented in the form of documents. The accuracy of the test results can be judged by comparing the documents. Therefore, during development, developers usually set up preset test result reference documents in the system to verify the accuracy of the tests.

[0061] The test environment refers to the system's test environment. System data can be understood as the basic settings data of the system at the time of inputting test commands, as well as data related to the test environment.

[0062] 103. Based on the analysis of the test data and the system data, determine the effective test elements in the test data and the system data that meet the requirements of system reliability testing.

[0063] In the embodiments of this application, the test elements obtained through test data and system data analysis may include traffic environment, fault type, runtime and their combination, etc., and the effective test elements can be determined according to the pre-set element weights.

[0064] Effective test elements can be obtained by analyzing test data and system data through model training or by matching data with preset tables.

[0065] 104. Based on the effective test elements, the test environment, and the test process, perform reliability testing on the system.

[0066] The reliability test is to verify the reliability of the system, that is, to verify the system's ability to handle faults.

[0067] After obtaining the valid test elements, the system is tested in the corresponding test environment and test process, and the reliability of the system is obtained through the test results.

[0068] 105. Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0069] Test files can be video examples of the test process and results, or tabular examples of the test process and results. There are no restrictions on the file format or content of the test files.

[0070] Accordingly, the test result reference file can be a video reference example or a table reference example. There are no restrictions on the file format or content of the test result reference file.

[0071] It is understandable that the file formats of test files and test result reference files are set in advance by the developers, and the file formats of test files and test result reference files should be the same.

[0072] For example, when the test file is a table example, the test result reference file is a table reference example. By comparing the data in the two tables, the accuracy of the test can be obtained, thereby obtaining the test reliability of the system under this test instruction.

[0073] In some embodiments, this step includes: obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, determining the difference positions between the test file and the test result reference file, marking the difference positions, and determining the system reliability based on the correspondence between the number of difference positions and a preset number scoring table.

[0074] The distinguishing position mentioned can be a data distinguishing position or an image / text distinguishing position. The content of the distinguishing position can be set by the developers.

[0075] When there are data differences among the differences, these differences correspond to data. These differences are set as differences to be determined. When there are range values ​​among these differences to be determined, we can compare them to determine whether the differences to be determined are reasonable. If they are reasonable, they are excluded. The remaining differences to be determined are used as differences, and the test results are evaluated.

[0076] The system reliability testing method of this application includes: receiving a test instruction; acquiring test information corresponding to the test instruction, including test data and test tasks; acquiring a test environment, test process, and preset test result reference file corresponding to the test tasks, and acquiring system data corresponding to the test environment; analyzing the test data and system data to determine valid test elements that meet the system reliability testing requirements; performing reliability testing on the system based on the valid test elements, test environment, and test process; acquiring the test file generated after the test is completed; comparing the test file with the test result reference file; and determining the system reliability based on the comparison results. Through this method, when performing system reliability testing, valid test elements are first analyzed and determined from the test data and system data, and the system is tested using these valid test elements, thereby improving the accuracy and effectiveness of the test.

[0077] Please see Figure 2 , Figure 2 Another flowchart of a system reliability testing method provided in this application embodiment, the method includes the following:

[0078] 101. The system receives a test instruction and obtains test information corresponding to the test instruction. The test information includes test data and test tasks.

[0079] Test commands are generally instructions that developers input into the system after development to test the system's performance and fault-handling capabilities. Since the system includes multiple application software and multiple application environments, and the system may have various faults, the test commands will be different depending on the test object.

[0080] After the developer enters a test command into the system, the system receives the test command and can obtain the test information corresponding to the test command.

[0081] In the embodiments of this application, the test information includes test data and test tasks. The test data may be test code, test files, interface information, etc., and may be data input by developers according to test tasks, as well as data pre-set by the system retrieved by the system according to test instructions.

[0082] 102. Obtain the test environment, test process, and preset test result reference file corresponding to the test task, and obtain the system data corresponding to the test environment.

[0083] Since the system includes multiple application software and multiple application environments, after receiving the test instruction, information such as the test environment, test process and preset test result reference files can be obtained based on the test instruction.

[0084] The testing process may vary for different testing tasks. Therefore, it is necessary to obtain the testing process corresponding to the testing instructions in order to achieve accurate testing.

[0085] For system testing, the testing process and / or test results can be presented in the form of documents. The accuracy of the test results can be judged by comparing the documents. Therefore, during development, developers usually set up preset test result reference documents in the system to verify the accuracy of the tests.

[0086] The test environment refers to the system's test environment. System data can be understood as the basic settings data of the system at the time of inputting test commands, as well as data related to the test environment.

[0087] 103. Based on the analysis of the test data and the system data, determine the effective test elements in the test data and the system data that meet the requirements of system reliability testing.

[0088] In the embodiments of this application, the test elements obtained through test data and system data analysis may include traffic environment, fault type, runtime and their combination, etc., and the effective test elements can be determined according to the pre-set element weights.

[0089] Effective test elements can be obtained by analyzing test data and system data through model training or by matching data with preset tables.

[0090] 104. Based on the effective test elements, the test environment, and the test process, perform reliability testing on the system.

[0091] The reliability test is to verify the reliability of the system, that is, to verify the system's ability to handle faults.

[0092] After obtaining the valid test elements, the system is tested in the corresponding test environment and test process, and the reliability of the system is obtained through the test results.

[0093] 105. Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0094] Test files can be video examples of the test process and results, or tabular examples of the test process and results. There are no restrictions on the file format or content of the test files.

[0095] Accordingly, the test result reference file can be a video reference example or a table reference example. There are no restrictions on the file format or content of the test result reference file.

[0096] It is understandable that the file formats of test files and test result reference files are set in advance by the developers, and the file formats of test files and test result reference files should be the same.

[0097] For example, when the test file is a table example, the test result reference file is a table reference example. By comparing the data in the two tables, the accuracy of the test can be obtained, thereby obtaining the test reliability of the system under this test instruction.

[0098] In some embodiments, this step includes: obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, determining the difference positions between the test file and the test result reference file, marking the difference positions, and determining the system reliability based on the correspondence between the number of difference positions and a preset number scoring table.

[0099] The distinguishing position mentioned can be a data distinguishing position or an image / text distinguishing position. The content of the distinguishing position can be set by the developers.

[0100] When there are data differences among the differences, these differences correspond to data. These differences are set as differences to be determined. When there are range values ​​among these differences to be determined, we can compare them to determine whether the differences to be determined are reasonable. If they are reasonable, they are excluded. The remaining differences to be determined are used as differences, and the test results are evaluated.

[0101] 106. Obtain abnormal data from the test file, and based on the abnormal data, trace the location where the abnormal data was generated during the test process.

[0102] By comparing the test file with the test result reference file, abnormal data in the test file can be obtained. The abnormal data can be data that differs from the test result reference file. By obtaining the relevant formula of the abnormal data, or by obtaining other related data of the abnormal data, we can find out where it occurred during the test and the associated valid test elements.

[0103] 107. Select the valid test elements associated with the location where the anomaly occurred as the test elements to be confirmed.

[0104] 108. Determine the reasonableness of the values ​​of the test elements to be confirmed, and automatically adjust the values ​​of the test elements to be confirmed based on the preset value method.

[0105] After obtaining relevant valid test elements from the abnormal data, the system can automatically check and adjust these valid test elements.

[0106] 109. Based on the adjusted test elements to be determined, the system is retested from the location where the anomaly occurred.

[0107] After checking and automatically adjusting the valid test elements associated with the anomaly location, the system is retested from the location where the anomaly occurred, i.e., from the location where the anomaly occurred. The retesting involves retesting the location where the anomaly occurred and the steps that follow.

[0108] Optionally, if abnormal data still exists after the system automatically performs several retests, the tests can be checked and adjusted manually.

[0109] For example, if the system automatically performs a preset number of retests and still identifies abnormal data, then it marks this abnormal data and obtains relevant information about the retests. The marked abnormal data and the relevant retest information are then integrated, and the resulting file is sent to the developers on the development side for them to check and adjust the tests.

[0110] Optionally, after retesting the system from the location of the anomaly based on the adjusted test elements to be determined, the number of occurrences at each anomaly location is calculated within the predicted time, and the number of occurrences of each anomaly data at each anomaly location is counted. Based on the number of occurrences, anomaly data, and occurrence counts, an anomaly statistics report is generated.

[0111] After generating the anomaly statistics report, the anomaly statistics report is stored and then sent to the developer's development console.

[0112] The system reliability testing method of this application includes: receiving a test instruction; acquiring test information corresponding to the test instruction, including test data and test tasks; acquiring a test environment, test process, and preset test result reference file corresponding to the test tasks, and acquiring system data corresponding to the test environment; analyzing the test data and system data to determine valid test elements that meet the system reliability testing requirements; performing reliability testing on the system based on the valid test elements, test environment, and test process; acquiring the test file generated after the test is completed; comparing the test file with the test result reference file; and determining the system reliability based on the comparison results. Through this method, when performing system reliability testing, valid test elements are first analyzed and determined from the test data and system data, and the system is tested using these valid test elements, thereby improving the accuracy and effectiveness of the test.

[0113] Please see Figure 3 , Figure 3 Another flowchart of a system reliability testing method provided in this application embodiment is a detailed flowchart of step 103 above, including the following:

[0114] 1031. Construct an environmental scene corresponding to the system data using a deep learning model, and obtain the scene elements of the environmental scene.

[0115] Scenario elements are elements related to the test environment. Each test instruction is different, and its corresponding test environment and scenario elements may also be different.

[0116] 1032. Based on the scene elements, the test data is analyzed using the deep learning model, and data elements are selected from the test data.

[0117] Each test instruction is different, and its corresponding test environment and scenario elements may also be different. Therefore, the data elements of the corresponding test data may also be different.

[0118] 1033. The deep learning model is used to train the scene elements and the data elements to determine the valid test elements in the test data and the system data that meet the system reliability test requirements.

[0119] In the embodiments of this application, the test elements obtained through test data and system data analysis may include traffic environment, fault type, runtime and their combination, etc., and the effective test elements can be determined according to the pre-set element weights, which are pre-set according to the test instructions.

[0120] Please see Figure 4 , Figure 4Another flowchart of a system reliability testing method provided in this application embodiment is a detailed flowchart of step 103 above, including the following:

[0121] 1031. Perform data analysis on the test data and the system data to obtain the corresponding parameter information.

[0122] Optionally, test data and system data can contain relevant information. The system itself can analyze this data to obtain the corresponding parameter information, or the model or learning machine can analyze this data to obtain the corresponding parameter information. The parameter information can include data characters, parameter types, parameter weights, etc.

[0123] 1032. Based on the parameter information, select table data from the test data and the system data to generate data.

[0124] In embodiments of this application, parameter information may include data characters, parameter types, and parameter weights, etc.

[0125] 1033. Based on the data generated in the table and the preset rules and strategies, a corresponding test strategy table is generated, wherein the test strategy table is provided with element identifiers.

[0126] After selecting the data to be generated in the table, the data can be arranged according to the parameter information of the data in a preset arrangement. Then, based on the arrangement result and the preset table template, the data can be entered into the preset table template in sequence according to the arrangement result to generate the test strategy table.

[0127] Furthermore, the generated test strategy table is set with element identifiers, meaning that the data corresponding to the element identifier is a valid test element, or the data corresponding to the element identifier is used to obtain valid test elements.

[0128] 1034. Obtain the identifier position of the element in the test strategy table, and use the table generation data and parameter information corresponding to the identifier position as valid test elements.

[0129] The table data and parameter information corresponding to the identified location are used as valid test elements, or the table data and parameter information corresponding to the identified location are used to further obtain valid test elements.

[0130] Please see Figure 5 , Figure 5 This application provides a schematic diagram of the structure of a system reliability testing device 200, which includes the following units:

[0131] The instruction receiving unit 201 is used to receive test instructions from the system and obtain test information corresponding to the test instructions. The test information includes test data and test tasks.

[0132] Test commands are generally instructions that developers input into the system after development to test the system's performance and fault-handling capabilities. Since the system includes multiple application software and multiple application environments, and the system may have various faults, the test commands will be different depending on the test object.

[0133] After the developer enters a test command into the system, the system receives the test command and can obtain the test information corresponding to the test command.

[0134] In the embodiments of this application, the test information includes test data and test tasks. The test data may be test code, test files, interface information, etc., and may be data input by developers according to test tasks, as well as data pre-set by the system retrieved by the system according to test instructions.

[0135] The test acquisition unit 202 is used to acquire the test environment, test process and preset test result reference files corresponding to the test task, and to acquire system data corresponding to the test environment.

[0136] Since the system includes multiple application software and multiple application environments, after receiving the test instruction, information such as the test environment, test process and preset test result reference files can be obtained based on the test instruction.

[0137] The testing process may vary for different testing tasks. Therefore, it is necessary to obtain the testing process corresponding to the testing instructions in order to achieve accurate testing.

[0138] For system testing, the testing process and / or test results can be presented in the form of documents. The accuracy of the test results can be judged by comparing the documents. Therefore, during development, developers usually set up preset test result reference documents in the system to verify the accuracy of the tests.

[0139] The test environment refers to the system's test environment. System data can be understood as the basic settings data of the system at the time of inputting test commands, as well as data related to the test environment.

[0140] The element determination unit 203 is used to analyze test data and system data to determine the effective test elements in the test data and system data that meet the system reliability test requirements.

[0141] In the embodiments of this application, the test elements obtained through test data and system data analysis may include traffic environment, fault type, runtime and their combination, etc., and the effective test elements can be determined according to the pre-set element weights.

[0142] Effective test elements can be obtained by analyzing test data and system data through model training or by matching data with preset tables.

[0143] System test unit 204 is used to perform reliability testing on the system based on valid test elements, test environment and test process.

[0144] The reliability test is to verify the reliability of the system, that is, to verify the system's ability to handle faults.

[0145] After obtaining the valid test elements, the system is tested in the corresponding test environment and test process, and the reliability of the system is obtained through the test results.

[0146] The result comparison unit 205 is used to obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0147] Test files can be video examples of the test process and results, or tabular examples of the test process and results. There are no restrictions on the file format or content of the test files.

[0148] Accordingly, the test result reference file can be a video reference example or a table reference example. There are no restrictions on the file format or content of the test result reference file.

[0149] It is understandable that the file formats of test files and test result reference files are set in advance by the developers, and the file formats of test files and test result reference files should be the same.

[0150] For example, when the test file is a table example, the test result reference file is a table reference example. By comparing the data in the two tables, the accuracy of the test can be obtained, thereby obtaining the test reliability of the system under this test instruction.

[0151] In some embodiments, this step includes: obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, determining the difference positions between the test file and the test result reference file, marking the difference positions, and determining the system reliability based on the correspondence between the number of difference positions and a preset number scoring table.

[0152] The distinguishing position mentioned can be a data distinguishing position or an image / text distinguishing position. The content of the distinguishing position can be set by the developers.

[0153] When there are data differences among the differences, these differences correspond to data. These differences are set as differences to be determined. When there are range values ​​among these differences to be determined, we can compare them to determine whether the differences to be determined are reasonable. If they are reasonable, they are excluded. The remaining differences to be determined are used as differences, and the test results are evaluated.

[0154] Optionally, in some embodiments, the feature determination unit 203 may include the following sub-units:

[0155] The scene element acquisition subunit is used to construct an environmental scene corresponding to the system data through a deep learning model and to acquire the scene elements of the environmental scene.

[0156] The data element acquisition subunit is used to analyze test data based on scene elements using a deep learning model and select data elements from the test data.

[0157] The test element acquisition subunit is used to train scene elements and data elements through a deep learning model to determine the valid test elements in the test data and system data that meet the system reliability test requirements.

[0158] Optionally, in some embodiments, the element determination unit 203 may further include the following sub-units:

[0159] The data analysis subunit is used to perform data analysis on test data and system data to obtain corresponding parameter information.

[0160] The data selection sub-unit is used to select table data from test data and system data based on parameter information.

[0161] The table generation sub-unit is used to generate a corresponding test strategy table based on the table generation data and preset rules and strategies. The test strategy table contains element identifiers.

[0162] The test element confirmation subunit is used to obtain the identification position of the element identifier in the test strategy table, and the table generation data and parameter information corresponding to the identification position are used as valid test elements.

[0163] Optionally, the system reliability testing apparatus 200 in this application embodiment may also include other units and sub-units, which will not be described in detail here.

[0164] The system reliability testing apparatus 200 of this application embodiment includes an instruction receiving unit 201, used to receive test instructions and acquire test information corresponding to the test instructions, including test data and test tasks; a test acquisition unit 202, used to acquire the test environment, test process, and preset test result reference file corresponding to the test task, and acquire system data corresponding to the test environment; an element determination unit 203, used to analyze the test data and system data to determine the effective test elements in the test data and system data that meet the system reliability testing requirements; a system testing unit 204, used to perform reliability testing on the system based on the effective test elements, test environment, and test process; and a result comparison unit 205, used to acquire the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison result. Through the above apparatus, when performing system reliability testing, the effective test elements of the test data and system data are first analyzed and determined, and the system is tested using the effective test elements, thereby improving the accuracy and effectiveness of the test.

[0165] Please see Figure 6 , Figure 6 This is a schematic diagram of the structure of a computer device according to an embodiment of this application. The computer device 300 includes a processor 301 with one or more processing cores, a memory 302 with one or more computer-readable storage media, and a computer program stored on the memory 302 and executable on the processor 301. The processor 301 and the memory 302 are electrically connected. Those skilled in the art will understand that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0166] The processor 301 is the control center of the computer device 300. It connects various parts of the computer device 300 through various interfaces and lines. By running or loading software programs and / or modules stored in the memory 302, and calling data stored in the memory 302, it performs various functions of the computer device 300 and processes data, thereby monitoring the computer device 300 as a whole.

[0167] In this embodiment, the processor 301 in the computer device 300 loads the instructions corresponding to the processes of one or more applications into the memory 302 according to the following steps, and the processor 301 runs the applications stored in the memory 302 to achieve various functions:

[0168] The system receives test instructions and obtains the corresponding test information, which includes test data and test tasks.

[0169] Obtain the test environment, test process, and preset test result reference files corresponding to the test task, and obtain the system data corresponding to the test environment;

[0170] Based on the analysis of test data and system data, the effective test elements in the test data and system data that meet the requirements of system reliability testing are identified.

[0171] Based on effective test elements, test environment and test process, conduct reliability testing on the system;

[0172] Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0173] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0174] Optionally, the computer device 300 also includes a data transmission module 303, a display module 304, and a power supply module 305. The data transmission module 303, the display module 304, and the power supply module 305 are all electrically connected to the processor 301. The data transmission module 303 is used to transmit data, the display module 304 is used to display the test process, test-related interfaces, and test results, and the power supply module 305 is used to provide power to the computer device 300.

[0175] Those skilled in the art will understand that Figure 6 The computer device structure shown does not constitute a limitation on the computer device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0176] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0177] As can be seen from the above, the computer device provided in this application embodiment receives a test instruction, obtains test information corresponding to the test instruction, including test data and test tasks; obtains the test environment, test process, and preset test result reference file corresponding to the test task, and obtains system data corresponding to the test environment; analyzes the test data and system data to determine the effective test elements in the test data and system data that meet the system reliability test requirements; performs reliability testing on the system based on the effective test elements, test environment, and test process; obtains the test file generated after the test is completed, compares the test file with the test result reference file, and determines the system reliability based on the comparison results.

[0178] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0179] Therefore, embodiments of this application provide a computer-readable storage medium storing a plurality of computer programs that can be loaded by a processor to execute steps in any of the system reliability testing methods provided in embodiments of this application. For example, the computer program can execute the following steps:

[0180] The system receives test instructions and obtains the corresponding test information, which includes test data and test tasks.

[0181] Obtain the test environment, test process, and preset test result reference files corresponding to the test task, and obtain the system data corresponding to the test environment;

[0182] Based on the analysis of test data and system data, the effective test elements in the test data and system data that meet the requirements of system reliability testing are identified.

[0183] Based on effective test elements, test environment and test process, conduct reliability testing on the system;

[0184] Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results.

[0185] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0186] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0187] Since the computer program stored in the storage medium can execute the steps in any of the system reliability testing methods provided in the embodiments of this application, the beneficial effects that any of the system reliability testing methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.

[0188] The above provides a detailed description of a system reliability testing method, apparatus, computer equipment, and storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A system reliability testing method, characterized in that, The method includes: The system receives a test instruction and obtains test information corresponding to the test instruction, the test information including test data and test tasks; Obtain the test environment, test process, and preset test result reference file corresponding to the test task, and obtain the system data corresponding to the test environment. The test environment is the system's test environment, and the system data is the basic setting data of the system at the time of inputting the test command and the data associated with the test environment. Based on the analysis of the test data and the system data, the effective test elements in the test data and system data that meet the system reliability test requirements are determined; Based on the aforementioned effective test elements, test environment, and test process, the system is subjected to reliability testing. Obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison results; The step of analyzing the test data and system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements includes: An environmental scene corresponding to the system data is constructed using a deep learning model, and the scene elements of the environmental scene are obtained. Based on the scene elements, the test data is analyzed using the deep learning model, and data elements are selected from the test data; The deep learning model is used to train the scene elements and the data elements to determine the valid test elements in the test data and the system data that meet the system reliability test requirements. The process of obtaining the test file generated after the test is completed, comparing the test file with the test result reference file, and determining the system reliability based on the comparison result includes: Obtain the test file generated after the test is completed, and compare the test file with the test result reference file; Determine the differences between the test file and the test result reference file, and mark the differences. The system reliability is determined by the correspondence between the number of distinguishing positions and the preset number scoring table; Obtain abnormal data from the test file, and trace the location where the abnormal data occurred during the test by obtaining the relevant formulas of the abnormal data; Select the valid test elements associated with the location where the anomaly occurred as the test elements to be confirmed; Determine the reasonableness of the values ​​of the test elements to be confirmed, and automatically adjust the values ​​of the test elements to be confirmed based on the preset value method; Based on the adjusted test elements to be confirmed, the system is retested from the location where the anomaly occurred; Within the prediction time, the number of occurrences of each of the aforementioned anomaly occurrence locations is calculated, and the number of occurrences of each of the aforementioned anomaly data at each of the aforementioned anomaly occurrence locations is counted. An anomaly statistics report is generated based on the number of times the data was generated, the abnormal data, and the number of times it occurred.

2. The system reliability testing method according to claim 1, characterized in that, The analysis based on the test data and the system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements includes: Data analysis is performed on the test data and the system data to obtain the corresponding parameter information; Based on the parameter information, data is generated by selecting tables from the test data and the system data; Based on the data generated from the table and the preset rules and strategies, a corresponding test strategy table is generated, and the test strategy table is equipped with element identifiers; Obtain the identifier position of the element in the test strategy table, and use the table generation data and parameter information corresponding to the identifier position as valid test elements.

3. A system reliability testing device, characterized in that, The device includes: The instruction receiving unit is used to receive test instructions from the system and obtain test information corresponding to the test instructions, wherein the test information includes test data and test tasks. The test acquisition unit is used to acquire the test environment, test process and preset test result reference file corresponding to the test task, and to acquire system data corresponding to the test environment. The test environment is the test environment of the system, and the system data is the basic setting data of the system at the time of input test command and the data associated with the test environment. The element determination unit is used to analyze the test data and the system data to determine the valid test elements in the test data and system data that meet the system reliability test requirements. The system testing unit is used to perform reliability testing on the system based on the effective test elements, the test environment, and the test process. The result comparison unit is used to obtain the test file generated after the test is completed, compare the test file with the test result reference file, and determine the system reliability based on the comparison result. The element determination unit is further configured to construct an environmental scene corresponding to the system data through a deep learning model, and obtain scene elements of the environmental scene; based on the scene elements, analyze the test data through the deep learning model, and select data elements from the test data; train the scene elements and the data elements through the deep learning model to determine the effective test elements in the test data and the system data that meet the system reliability test requirements; The result comparison unit is also used to acquire the test file generated after the test is completed, compare the test file with the test result reference file, determine the difference positions between the test file and the test result reference file, mark the difference positions, and determine the system reliability based on the correspondence between the number of difference positions and the preset number scoring table. The result comparison unit is further configured to: acquire abnormal data in the test file; trace the location of the abnormal data during the test process by acquiring the relevant formulas of the abnormal data; select valid test elements associated with the location of the abnormal data as test elements to be confirmed; determine the rationality of the values ​​of the test elements to be confirmed; automatically adjust the values ​​of the test elements to be confirmed based on a preset value method; retest the system from the location of the abnormal data based on the adjusted test elements to be confirmed; calculate the number of occurrences of each location of the abnormal data within the predicted time, and count the number of occurrences of each piece of abnormal data at each location of the abnormal data; and generate an abnormal statistics report based on the number of occurrences, the abnormal data, and the number of occurrences.

4. A computer device, characterized in that, It includes a memory and a processor, the memory being used to store instructions and data, and the processor being used to execute the system reliability testing method according to any one of claims 1-2.

5. A storage medium, characterized in that, The storage medium stores multiple instructions, which are adapted to be loaded by a processor to execute the system reliability testing method according to any one of claims 1-2.

Images