An ammunition integrated test automated evaluation system and method

Abstract

The present application belongs to the technical field of ammunition testing, and particularly relates to an ammunition integrated testing automatic evaluation system and method, aiming to provide a general automatic evaluation framework for ammunition integrated testing, comprising: (1) a testing data management module, which converts original data into application data with practical significance and saves and maintains the application data; (2) an evaluator module, which evaluates data to obtain evaluation results and conclusions; and (3) a testing evaluation management module, which manages the operation of the testing data management module and the evaluator module according to different testing types. Compared with the prior art, the present application replaces visual inspection with automatic diagnosis, reduces the workload of people in batch production, reduces the probability of false detection, improves work efficiency, and reduces production cost. The evaluation type, evaluation requirement and output report of the present application can be customized again according to a project without changing the software.

Description

Technical Field

[0001] This invention belongs to the field of ammunition testing technology, specifically relating to an automatic evaluation system and method for integrated ammunition testing. Background Technology

[0002] The final assembly of ammunition involves multiple tests to verify the function and performance of each component. Currently, one technology involves data acquisition and recording devices collecting operational data from each component during testing, displaying it as curves, indicator lights, and tables. Humans then visually inspect the data against inspection standards to determine its correctness. This method is inefficient and prone to errors. The difficulty in replacing humans with machines to perform these inspection tasks lies in the significant differences in evaluation methods for various inspection items, and the lack of categorization.

[0003] Current technology still has a problem: the analysis software for different products is not compatible. The reasons for this incompatibility are as follows:

[0004] (1) Different requirements for different types of products lead to different evaluation criteria;

[0005] (2) Even for the same type of product, different types of tests have different evaluation criteria;

[0006] (3) The results of different assessments are represented in very different ways. Some results are binary variables of "yes / no", some results are real numbers, and some results are curves that change over time.

[0007] (4) Some models have multiple acquisition devices to collect the same data, and each acquisition device saves data in a different format.

[0008] (5) Different products have different requirements for the format of the evaluation report. Summary of the Invention

[0009] (a) Technical problems to be solved

[0010] The technical problem to be solved by this invention is: in order to improve the evaluation efficiency and accuracy of ammunition testing and reduce the cost of repeated development of various ammunitions, how to provide an automatic evaluation system and method that can be adapted to different types of ammunition by modifying the configuration.

[0011] (II) Technical Solution

[0012] To address the aforementioned technical problems, this invention provides an automated evaluation system for ammunition integration testing, the system comprising:

[0013] The test data management module is used to transform raw data into meaningful evaluation data and to save and maintain it.

[0014] The evaluator module is used to obtain the data to be evaluated from the test data management module, analyze it to obtain the evaluation results, compare the evaluation results with the specified requirements to obtain a conclusion on whether it passes or fails, form a requirement description, and form an evaluation result description.

[0015] The test evaluation management module is used to select the corresponding evaluator module according to different test types, assign the test data management module to the evaluator module as the source of the data to be evaluated, set requirements for the evaluator module, and summarize the evaluation results description, requirement description, and pass / fail conclusion from one or more evaluator modules to generate an inspection report.

[0016] The test data management module includes modifiable data configurations, which include data format definitions based on the data acquisition and recording device.

[0017] The evaluator module includes modifiable general attributes, including:

[0018] (1) Test data to be evaluated: used to provide an interface for allocating the test data management module, which is a reference to the test data management module;

[0019] (2) Assessor's Name: Used to provide an identifier that distinguishes the assessor;

[0020] (3) List of evaluated parameter names: used to provide the names of all evaluated data obtained by the evaluator module from the test data management module;

[0021] (4) Requirements description: Used to generate inspection reports, each special assessor converts their own special requirements into a consistent written form that can be read by humans;

[0022] (5) Description of assessment results: Used to form an inspection report, each special assessor converts their own special assessment results into a consistent textual description of assessment results that can be read by humans.

[0023] The evaluator module includes the following types:

[0024] (1) Data integrity assessor, who is used to assess the integrity of the collected data;

[0025] (2) Two-level state signal evaluator, which is used to evaluate whether a voltage signal with two numerical ranges meets the requirements;

[0026] (3) Workflow evaluator, who evaluates whether the object has entered the corresponding state as required;

[0027] (4) Pulse signal evaluator, which is used to evaluate whether the rising edge and width of the pulse signal meet the requirements;

[0028] (5) An executive evaluator, who assesses the health status of the executive based on the executive’s instructions and feedback in the application data.

[0029] The test evaluation management module includes a modifiable test report template, and the evaluator module uses this test report template to determine the location and format of each item to be filled in the test report.

[0030] Furthermore, the present invention also provides an automatic evaluation method for ammunition integration testing, the method being implemented based on the above-mentioned system, the method comprising:

[0031] Step S0: Configuration evaluation, including the following steps:

[0032] Step S0.1: Prepare data configuration according to the data acquisition and recording device;

[0033] Step S0.2: Prepare the test evaluation item configuration and test evaluation parameter configuration according to the inspection items and requirements;

[0034] Step S0.3: Prepare the inspection report template according to the inspection requirements;

[0035] Step S1: Collect and record the working data of the onboard equipment and save it as a raw data file;

[0036] Step S2: Enter the product number;

[0037] Step S3: Enter the test type;

[0038] Step S4: Based on the test type described in Step S3, select the test evaluation item configuration and test evaluation parameter configuration described in Step S0.2;

[0039] Step S5: Select the inspection report template described in step S0.3 according to the test type described in step S3;

[0040] Step S6: Read the original data file described in step S1 according to the data configuration described in step S0.1 and convert it into application data;

[0041] Step S7: Based on the selected evaluation type configuration and parameter configuration described in Step S4, perform an evaluation on the application data described in Step S6 to obtain an evaluation result and form an evaluation result description. Compare the evaluation result with the specified requirements to obtain a conclusion on whether it passes or fails.

[0042] Step S8: The description of the evaluation results, evaluation criteria, and whether the evaluation passed are automatically written into the inspection report specified in step S5.

[0043] Step S8 further includes:

[0044] Step S8.1: Enter the data address;

[0045] Step S8.2: Enter the product number;

[0046] Step S8.3: Enter the assessor's name;

[0047] Step S8.4: Fill in the requirement description;

[0048] Step S8.5: Enter the evaluation result description;

[0049] Step S8.6: Enter whether the evaluation passed;

[0050] Step S8.7: Enter the data curve.

[0051] In step S0.1, the data configuration is implemented using an Excel spreadsheet.

[0052] In step S0.3, the inspection report template is implemented using a Word template.

[0053] Step S8 is implemented by the test evaluation management module.

[0054] (III) Beneficial Effects

[0055] Compared with the prior art, the present invention has the following beneficial effects:

[0056] (1) By replacing visual inspection with automated diagnosis, the workload of people in mass production is reduced, the probability of false detection is reduced, work efficiency is improved, and production costs are reduced.

[0057] (2) The assessment type, assessment requirements, and output report can be customized according to the project without changing the software. Attached Figure Description

[0058] Figure 1 This is a class diagram of a specific embodiment of the automatic evaluation system for ammunition integration testing of the present invention.

[0059] Figure 2 This is a flowchart of a specific embodiment of the automatic evaluation method for ammunition integration testing of the present invention.

[0060] Figure 3 This is a schematic diagram of an inspection report template according to a specific embodiment of the present invention. Detailed Implementation

[0061] To make the objectives, contents, and advantages of the present invention clearer, the specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples.

[0062] To address the aforementioned technical problems, this invention provides an automated evaluation system for ammunition integration testing, the system comprising:

[0063] The test data management module is used to transform raw data into meaningful evaluation data and to save and maintain it.

[0064] The evaluator module is used to obtain the data to be evaluated from the test data management module, analyze it to obtain the evaluation results, compare the evaluation results with the specified requirements to obtain a conclusion on whether it passes or fails, form a requirement description, and form an evaluation result description.

[0065] The test evaluation management module is used to select the corresponding evaluator module according to different test types, assign the test data management module to the evaluator module as the source of the data to be evaluated, set requirements for the evaluator module, and summarize the evaluation results description, requirement description, and pass / fail conclusion from one or more evaluator modules to generate an inspection report.

[0066] The test data management module includes modifiable data configurations, which include data format definitions based on the data acquisition and recording device.

[0067] The evaluator module includes modifiable general attributes, including:

[0068] (1) Test data to be evaluated: used to provide an interface for allocating the test data management module, which is a reference to the test data management module;

[0069] (2) Assessor's Name: Used to provide an identifier that distinguishes the assessor;

[0070] (3) List of evaluated parameter names: used to provide the names of all evaluated data obtained by the evaluator module from the test data management module;

[0071] (4) Requirements description: Used to generate inspection reports, each special assessor converts their own special requirements into a consistent written form that can be read by humans;

[0072] (5) Description of assessment results: Used to form an inspection report, each special assessor converts their own special assessment results into a consistent textual description of assessment results that can be read by humans.

[0073] The evaluator module includes the following types:

[0074] (1) Data integrity assessor, who is used to assess the integrity of the collected data;

[0075] (2) Two-level state signal evaluator, which is used to evaluate whether a voltage signal with two numerical ranges meets the requirements;

[0076] (3) Workflow evaluator, who evaluates whether the object has entered the corresponding state as required;

[0077] (4) Pulse signal evaluator, which is used to evaluate whether the rising edge and width of the pulse signal meet the requirements;

[0078] (5) An executive evaluator, who assesses the health status of the executive based on the executive’s instructions and feedback in the application data.

[0079] The test evaluation management module includes a modifiable test report template, and the evaluator module uses this test report template to determine the location and format of each item to be filled in the test report.

[0080] Furthermore, the present invention also provides an automatic evaluation method for ammunition integration testing, the method being implemented based on the above-mentioned system, the method comprising:

[0081] Step S0: Configuration evaluation, including the following steps:

[0082] Step S0.1: Prepare data configuration according to the data acquisition and recording device;

[0083] Step S0.2: Prepare the test evaluation item configuration and test evaluation parameter configuration according to the inspection items and requirements;

[0084] Step S0.3: Prepare the inspection report template according to the inspection requirements;

[0085] Step S1: Collect and record the working data of the onboard equipment and save it as a raw data file;

[0086] Step S2: Enter the product number;

[0087] Step S3: Enter the test type;

[0088] Step S4: Based on the test type described in Step S3, select the test evaluation item configuration and test evaluation parameter configuration described in Step S0.2;

[0089] Step S5: Select the inspection report template described in step S0.3 according to the test type described in step S3;

[0090] Step S6: Read the original data file described in step S1 according to the data configuration described in step S0.1 and convert it into application data;

[0091] Step S7: Based on the selected evaluation type configuration and parameter configuration described in Step S4, perform an evaluation on the application data described in Step S6 to obtain an evaluation result and form an evaluation result description. Compare the evaluation result with the specified requirements to obtain a conclusion on whether it passes or fails.

[0092] Step S8: The description of the evaluation results, evaluation criteria, and whether the evaluation passed are automatically written into the inspection report specified in step S5.

[0093] Step S8 further includes:

[0094] Step S8.1: Enter the data address;

[0095] Step S8.2: Enter the product number;

[0096] Step S8.3: Enter the assessor's name;

[0097] Step S8.4: Fill in the requirement description;

[0098] Step S8.5: Enter the evaluation result description;

[0099] Step S8.6: Enter whether the evaluation passed;

[0100] Step S8.7: Enter the data curve.

[0101] In step S0.1, the data configuration is implemented using an Excel spreadsheet.

[0102] In step S0.3, the inspection report template is implemented using a Word template.

[0103] Step S8 is implemented by the test evaluation management module. Example

[0104] This embodiment specifically describes the application of the present invention in the integrated testing of ammunition product production.

[0105] The ammunition product integration test involves two steps: electronic system integration testing and environmental testing. The connection methods and judgment criteria used in these two steps differ. During testing, two data acquisition and recording devices, A and B, record the operational data of the onboard equipment. The two devices store data in different formats, resulting in some overlap in the recorded data. In some cases, data acquisition and recording device B is not present. During a single test, both devices record the onboard operational data and save it as data files with different names. All data files from a single test are stored in a single data folder. After the test is completed, the data acquisition and recording devices activate the invention and provide the data folder address, test type, and product number.

[0106] Figure 1 A class diagram illustrating a specific embodiment of the first aspect of the present invention is shown below, and is described in detail below:

[0107] The test data management module 01 converts the raw data into data with actual physical meaning and saves it as a data structure variable according to the format specified in the data configuration file. There is a one-to-one correspondence between the acquisition and recording device 10 and the test data management module 01. In this embodiment, the two acquisition and recording devices A and B correspond to the two test data management modules 01.

[0108] The data configuration file 07 is written according to the status of the acquisition and recording device 10 and is implemented using tables. It defines the file name, format and content of the recording data of each recording device and is provided by the test evaluation management module 03 to the test data management module 01 for data conversion.

[0109] Evaluator02 is a generic class that includes the following generic properties:

[0110] (1) Test data to be evaluated: Provide an interface for allocating the test data management module 01, which is a reference to the test data management module 01;

[0111] (2) Evaluator name: Provides an identifier to distinguish evaluators. In this embodiment, the evaluator name is a string. The names of all evaluators in a single test cannot be repeated. When it is necessary to evaluate the same data collected by different acquisition devices using the same method at the same time, different names need to be assigned when creating the evaluators.

[0112] (3) List of evaluated parameter names: Provides the names of all evaluated data obtained by the evaluator module from the test data management module 01. In this embodiment, the evaluated parameter names are strings;

[0113] (4) Requirements Description: Used to generate inspection report 08, each special assessor converts their own special requirements into a consistent textual form that can be read by humans. In this embodiment, the requirements description is a string;

[0114] (5) Evaluation result description: used to form inspection report 08, each special evaluator converts their own special evaluation results into a consistent textual form of evaluation result description that can be read by humans. In this embodiment, the evaluation result description is a string.

[0115] Evaluator 02 also has special subclasses that inherit its attributes and behaviors, including:

[0116] Data integrity assessor 1021 is used to assess the integrity of the collected data;

[0117] Two-level status signal evaluator 022 is used to evaluate whether multiple power supplies on the missile meet the requirements;

[0118] Workflow evaluator 023 is used to evaluate whether multiple electronic components on the missile have entered the corresponding state according to instructions or timing.

[0119] The pulse signal evaluator 024 is used to evaluate whether the rise time and width of multiple ignition pulse signals meet the requirements.

[0120] The Executive Assessment 025 is used to assess whether the servo motor meets the requirements.

[0121] Test Evaluation Management Module 03 is responsible for managing the entire evaluation process, and its functions are implemented as follows:

[0122] (1) Select the corresponding type of evaluator module: Select the corresponding test evaluation project configuration file 06 according to the test type. The test evaluation project configuration file 06 depends on the type of test 11. There is one test evaluation project configuration file for each test. In this embodiment, there are two tests, so there are two test evaluation project configuration files. It is implemented by an Excel spreadsheet. Each test evaluation project configuration file contains a table that specifies the evaluator type, name and the data collection and recording device from which all test items included in the test type are obtained. The test evaluation management module 03 creates the corresponding evaluator 02 according to the table and assigns it a name and data to be evaluated.

[0123] (2) Assign the test data management module to the evaluator as the data to be evaluated: This is achieved by assigning the test data management module 01 as a reference to the test data attribute of the evaluator 02.

[0124] (3) Set requirements for the evaluator module: select to read the corresponding evaluation parameter configuration file 05 according to the test type. The test evaluation parameter configuration file 05 depends on the type of test 11. There is one test evaluation parameter configuration file for each test. In this embodiment, there are two tests, so there are two test evaluation parameter configuration files. The configuration files are implemented by an Excel spreadsheet. The evaluator name, parameter name and parameter value are specified under the test type. The test evaluation management module 03 modifies all evaluator parameters in turn according to the table. The parameters that are not modified use the default value.

[0125] (4) The assessment result descriptions, requirement descriptions, and assessment pass / fail status from one or more of the assessor modules are summarized and written into the inspection report 08: The test assessment management module 03 selects and reads the corresponding report template 04 according to the test type. This template is created by Word and includes, for example, Figure 3 The table shown has a content identifier for each blank space. The content identifier for the blank spaces containing test items is divided into two parts: a front and a back section. Test evaluation managers perform different operations based on these content identifiers:

[0126] If the content identifier is "Data ID", enter the data folder address;

[0127] If the content identifier is "Product Number", enter the product number;

[0128] If the content identifier is "Name", extract the evaluator's name from the row specified after the content identifier in the master report and fill it in;

[0129] If the part before the content identifier is "requirement", extract the requirement description from the row specified after the content identifier in the master report and fill it in;

[0130] If the first part of the content identifier is "actual result", extract the evaluation result description from the row specified after the content identifier in the summary report and fill it in;

[0131] If the first part of the content identifier is "Conclusion", extract the evaluation conclusion from the row specified after the content identifier in the summary report. If the evaluation conclusion meets the requirements, fill in "Passed"; otherwise, fill in "Failed" and set the font to red.

[0132] If the content identifier is "drawing", copy the name of the graphic file specified after the content identifier into the blank space.

[0133] Figure 2 A specific embodiment of the second aspect of the present invention is illustrated below, and is described in detail below:

[0134] Step S0: Configuration evaluation, including the following steps:

[0135] Step S0.1: Prepare data configuration according to the data acquisition and recording device. The data configuration is implemented in an Excel spreadsheet, which specifies the data file name and format of different data acquisition and recording devices. There are two acquisition devices that share a configuration file.

[0136] Step S0.2: Prepare the test evaluation item configuration and test evaluation parameter configuration according to the test items and requirements, using an Excel spreadsheet. This specifies the evaluator type, name, and data acquisition and recording device from which the data being evaluated comes for all test items included in this test type. There are four files in total, with two test evaluation item configuration files and two test evaluation parameter configuration files for each of the two test types, distinguished by filename.

[0137] Step S0.3: Prepare an inspection report template according to the inspection requirements, using a Word template, specifying the location and format of each item to be filled in the inspection report. Figure 3 The style of the table is shown;

[0138] Step S1: Collect and record the working data of the onboard equipment and save it as a raw data file. The two acquisition and recording devices jointly collect the onboard working data, forming multiple binary raw data files, which are stored in a data folder.

[0139] Step S2: Input the product number, which is a string type. The data acquisition and recording device writes it to a specific text file, which is stored in the same folder as the original data. The test evaluation and management module 03 reads the product number from this file.

[0140] Step S3: Input the test type. The test type is a string type, which is written to a specific text file by the data acquisition and recording device. The file is stored in the same folder as the original data. The test evaluation and management module reads the test type from this file.

[0141] Step S4: Based on the test type, select the corresponding test evaluation project configuration and test evaluation parameter configuration. The test evaluation management module 03 converts the test type into a configuration file name according to certain rules, and then reads the configuration file.

[0142] Step S5: Select the corresponding test report template according to the test type. The test evaluation management module converts the test type into a report template name according to certain rules.

[0143] Step S6: Read the original data file described in step S1 according to the data configuration described in step S0.1 and convert it into application data. This is executed by the test data management module. The converted application data is stored in a data structure.

[0144] Step S7: Based on the selected test evaluation item configuration and test evaluation parameter configuration described in Step S4, perform an evaluation on the application data described in Step S6 to obtain evaluation results and form an evaluation result description. Compare the evaluation results with the specified requirements to obtain a conclusion on whether it passes or fails. First, the test evaluation manager creates multiple different evaluators according to the test evaluation item configuration selected in Step S4. Each evaluator has its own default attributes. The test evaluation manager then modifies the attributes of each evaluator according to the test evaluation parameter configuration selected in Step S4. Then, the evaluators obtain data from the test data management module according to their own input parameter table. Each evaluator completes the evaluation according to their own methods and criteria and forms their own report. The evaluation manager combines these reports into a summary report. The summary report contains n rows, where n is the number of test items. The columns of the summary report are evaluator name, requirement description, evaluation result description, and evaluation conclusion. In addition, the test evaluation management module also requests each evaluator to draw the data curves to be output and save them as temporary graphic files.

[0145] Step S8: The evaluation result description, evaluation criteria, and evaluation pass / fail status are written into the inspection report specified in step S5, which is implemented by the test evaluation management module 03, including:

[0146] Step S8.1: Enter the data address;

[0147] Step S8.2: Enter the product number;

[0148] Step S8.3: Enter the assessor's name;

[0149] Step S8.4: Fill in the requirement description;

[0150] Step S8.5: Enter the evaluation result description;

[0151] Step S8.6: Enter whether the evaluation passed;

[0152] Step S8.7: Enter the data curve.

[0153] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. An ammunition integrated test automated evaluation system, comprising: The system includes: The test data management module is used to transform raw data into meaningful evaluation data and to save and maintain it. The evaluator module is used to obtain the data to be evaluated from the test data management module, analyze it to obtain the evaluation results, compare the evaluation results with the specified requirements to obtain a conclusion on whether it passes or fails, form a requirement description, and form an evaluation result description. The test evaluation management module is used to select the corresponding evaluator module according to different test types, assign the test data management module to the evaluator module as the source of the data to be evaluated, set requirements for the evaluator module, and summarize the evaluation results description, requirement description, and pass / fail conclusion from one or more evaluator modules to generate an inspection report. The test data management module includes modifiable data configuration, which includes data format definitions based on the data acquisition and recording device. The evaluator module includes modifiable general attributes, including: (1) Test data to be evaluated: used to provide an interface for allocating the test data management module, which is a reference to the test data management module; (2) Assessor's Name: Used to provide an identifier that distinguishes the assessor; (3) List of evaluated parameter names: used to provide the names of all evaluated data obtained by the evaluator module from the test data management module; (4) Requirements description: Used to generate inspection reports, each special assessor converts their own special requirements into a consistent written form that can be read by humans; (5) Evaluation result description: used to form an inspection report, each special evaluator converts their own special evaluation results into a consistent textual form that can be read by humans; The evaluator module includes the following types: (1) Data integrity assessor, who is used to assess the integrity of the collected data; (2) Two-level state signal evaluator, which is used to evaluate whether a voltage signal with two numerical ranges meets the requirements; (3) Workflow evaluator, who evaluates whether the object has entered the corresponding state as required; (4) Pulse signal evaluator, which is used to evaluate whether the rising edge and width of the pulse signal meet the requirements; (5) An executive evaluator, who assesses the health status of the executive agency based on the executive agency’s instructions and feedback in the data being evaluated; The test evaluation management module includes a modifiable test report template, and the evaluator module uses this test report template to determine the location and format of each item to be filled in the test report.

2. An ammunition integrated test automated evaluation method, characterized by, It is implemented based on the automatic evaluation system for ammunition integration testing as described in claim 1, wherein the automatic evaluation method for ammunition integration testing includes: Step S0: Configuration evaluation, including the following steps: Step S0.1: Prepare data configuration according to the data acquisition and recording device; Step S0.2: Prepare the test evaluation item configuration and test evaluation parameter configuration according to the inspection items and requirements; Step S0.3: Prepare the inspection report template according to the inspection requirements; Step S1: Collect and record the working data of the onboard equipment and save it as a raw data file; Step S2: Enter the product number; Step S3: Enter the test type; Step S4: Based on the test type described in Step S3, select the test evaluation item configuration and test evaluation parameter configuration described in Step S0.2; Step S5: Select the inspection report template described in step S0.3 according to the test type described in step S3; Step S6: Read the original data file described in step S1 according to the data configuration described in step S0.1 and convert it into the data to be evaluated; Step S7: Based on the selected evaluation item configuration and parameter configuration described in Step S4, perform an evaluation on the data to be evaluated in Step S6 to obtain an evaluation result and form an evaluation result description. Compare the evaluation result with the specified requirements to obtain a conclusion on whether it passes or fails. Step S8: Automatically write the evaluation result description, the specified requirements, and whether the evaluation passed into the inspection report specified in step S5; Step S8 further includes: Step S8.1: Enter the data address; Step S8.2: Enter the product number; Step S8.3: Enter the assessor's name; Step S8.4: Fill in the requirement description; Step S8.5: Enter the evaluation result description; Step S8.6: Enter whether the evaluation passed; Step S8.7: Enter the data curve.

3. The ammunition integrated test automated evaluation method of claim 2, wherein, In step S0.1, the data configuration is implemented using an Excel spreadsheet.

4. The ammunition integrated test automated evaluation method of claim 2, wherein, In step S0.3, the inspection report template is implemented using a Word template.

5. The ammunition integrated test automated evaluation method of claim 2, wherein, Step S8 is implemented by the test evaluation management module.

Images