Test data fusion and evaluation management system

Abstract

The present application relates to a test data fusion and evaluation management system, including: a test data management module, which is used for receiving, storing and retrieving test data from multiple sources. A test data fusion module, a communication connection test data management module, which is used to fuse and process control system equivalent data, simulated telemetry data and test console data, and output flight trajectory data and system working status data. A test result evaluation module, a communication connection test data management module, which is used to conduct a post-comprehensive test effect evaluation based on the post-data provided by the test data management module, and to conduct a real-time online test effect evaluation based on external real-time data. A scene display and visualization module, a communication connection test data management module, which is used to visualize data based on the data provided by the test data management module and external real-time data. The efficiency of test data management is greatly improved.

Description

Technical Field

[0001] The invention belongs to the technical field of data processing and relates to a test data fusion and evaluation management system. Background Art

[0002] In the process of conducting earth-space information simulation test, each simulation node needs to store and interact data according to the specific test process. In order to judge the consistency of earth-space simulation information and the effectiveness of information transmission, a unified data storage and processing center is needed to complete the unified aggregation, storage and comparative analysis of the data of each simulation node in the simulation test, and evaluate the test results. However, in the process of realizing the present invention, the inventor found that the current traditional data system only provides conventional data acquisition management or single-mode data fusion processing, and has not yet provided business support for multi-node channel real-time monitoring, unified data aggregation, and real-time data processing combined with post-processing. It cannot meet the one-stop full-process service requirements for the collection, storage, processing, comparison, fusion and analysis of simulation information of each device in the whole process of earth-space information simulation test, and there is a technical problem of low test data management efficiency. Summary of the invention

[0003] In view of the problems existing in the above-mentioned traditional methods, the present invention proposes a test data fusion and evaluation management system which can greatly improve the test data management efficiency.

[0004] In order to achieve the above objectives, the embodiments of the present invention adopt the following technical solutions:

[0005] Provided is a test data fusion and evaluation management system, including:

[0006] Test data management module, used for receiving, storing and retrieving test data from multiple sources;

[0007] The test data fusion module is connected to the test data management module in communication, and is used to fuse and process the control system equivalent device data, simulated telemetry data and test console data, and output flight trajectory data and system working status data;

[0008] A test result evaluation module, which is in communication connection with the test data management module, is used to conduct a post-test comprehensive test effect evaluation based on the post-test data provided by the test data management module, and is used to conduct a real-time online test effect evaluation based on external real-time data;

[0009] The scene display and visualization module is communicated with the test data management module and is used for data visualization display based on the data provided by the test data management module and external real-time data.

[0010] In one embodiment, the test data management module includes:

[0011] The channel management submodule is used to receive test data from multiple sources without losing any points by providing visual management of each communication channel and monitoring the working status of each communication channel;

[0012] The interactive command response submodule is used to parse the command input of the human-computer interaction interface into data management commands; the data management commands include data query requirements and search keywords;

[0013] A data management instruction response submodule is used to parse the data management instruction into a data query or data insertion statement;

[0014] The data operation service submodule is used to generate database query or data insertion statements, submit SQL scripts to the database server and receive feedback on execution results;

[0015] The external data interface service submodule is used to access the control system equivalent device data, simulation telemetry data, test console data and test data, and provide an integrated interface for data acquisition and management;

[0016] The human-computer interaction interface service submodule is used to provide a human-computer interaction interface for test data management.

[0017] In one embodiment, the test data fusion module includes:

[0018] The external interface service submodule is used to access test data and multi-source information and provide an integrated interface for data acquisition and management; the multi-source information includes control system equivalent data, simulation telemetry data, and test console data;

[0019] The data preprocessing submodule is used to perform coordinate transformation and data alignment processing on the test data and multi-source information;

[0020] The fusion algorithm library submodule is used to provide the call of multi-sensor data fusion algorithm and target tracking algorithm, as well as the addition, modification and deletion of response algorithms;

[0021] The fusion result output submodule is used to submit the fusion result to the test data management module for result data storage, and output the fusion result to the human-computer interaction interface; the fusion result includes flight trajectory data and system working status data;

[0022] The human-computer interaction interface submodule is used to display decision-making auxiliary information based on the fusion structure.

[0023] In one embodiment, the process of invoking a multi-sensor data fusion algorithm and a target tracking algorithm to perform fusion tracking on the pre-processed multi-source information includes:

[0024] Based on multi-source information, the Monte Carlo method is used to generate the initial set;

[0025] Calculate the forecast set and forecast state mean using the initial set;

[0026] Calculate the Kalman gain matrix of the ensemble Kalman filter based on the prediction set and the prediction state mean;

[0027] According to the Kalman gain matrix, the analysis set, the analysis state mean and the analysis state error covariance of the ensemble Kalman filter are calculated;

[0028] Determine whether tracking is ended;

[0029] If so, output the filtered target state, otherwise return to the step of using the initial set to calculate the predicted set and the predicted state mean.

[0030] In one embodiment, the test result evaluation module includes:

[0031] The indicator management submodule is used to execute indicator system construction and indicator parameter configuration processing;

[0032] The evaluation submodule is used to perform single capability evaluation, target threat rating and comprehensive capability evaluation according to the data provided by the test data management module and the called indicator parameters, and generate evaluation results;

[0033] The sensitivity analysis submodule is used to analyze the impact of a single indicator on the target based on the called indicator and evaluation results, and generate analysis results;

[0034] The evaluation result display submodule is used to display information, provide decision-making support information feedback, store result data and generate evaluation reports based on the evaluation results and analysis results; information display includes evaluation scenario display, dynamic result change display and evaluation result comparison display.

[0035] In one of the embodiments, the indicator normalization processing method adopted by the indicator management submodule includes a straight line processing method, a curve normalization processing method and a broken line normalization processing method.

[0036] In one embodiment, the index synthesis method adopted by the index management submodule includes weighted synthesis, ideal point, grey correlation or fuzzy comprehensive evaluation.

[0037] In one embodiment, the sensitivity analysis submodule performs sensitivity analysis through numerical differentiation.

[0038] In one embodiment, the information is displayed in a form of a data table and / or a chart.

[0039] In one embodiment, the scene display and visualization module includes:

[0040] The data interface service submodule is used to parse data access instructions during post-playback and to submit query requests to the test data management module;

[0041] Data classification display submodule, used to display test data and system working status in a graphical manner;

[0042] The 2D scene display submodule is used to display the target trajectory on the 2D map and update it in real time, as well as respond to map panning and zooming operations;

[0043] The evaluation result display submodule is used to display the evaluation results output by the test result evaluation module online in the form of charts.

[0044] One of the above technical solutions has the following advantages and beneficial effects:

[0045] The above-mentioned test data fusion and evaluation management system adopts a system design of test data management module, test data fusion module, test result evaluation module and scene display and visualization module. The test data management module provides the functions of receiving, storing and managing multi-source data; the test data fusion module provides flight trajectory data and system working status data by processing control system equivalent data, simulated telemetry data and test console data, and provides auxiliary information for flight control decision-making; the test result evaluation module provides data analysis and test effect evaluation functions, and the scene display and visualization module provides data visualization display functions in the form of curves, charts and bar charts, supports dynamic updates and system working status display, so as to meet the one-stop full-process service needs of collecting, storing, processing, comparing, integrating and analyzing simulation information of various equipment in the whole process of space-ground information simulation test, thereby achieving the purpose of greatly improving the efficiency of test data management. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0047] Figure 1 A schematic diagram of the structure of a test data fusion and evaluation management system in one embodiment;

[0048] Figure 2 A schematic diagram of the structure of a test data management module in one embodiment;

[0049] Figure 3 A schematic diagram of an interface design of a test data management module in one embodiment;

[0050] Figure 4 A schematic diagram of the structure of a test data fusion module in an embodiment;

[0051] Figure 5 A schematic diagram of an interface design of a test data fusion module in one embodiment;

[0052] Figure 6 A schematic diagram of a target tracking algorithm flow based on ensemble Kalman filtering in one embodiment;

[0053] Figure 7 A schematic diagram of a data fusion working process in one embodiment;

[0054] Figure 8 A schematic diagram of the structure of a test result evaluation module in one embodiment;

[0055] Fig. 9 A schematic diagram of an interface design of a test result evaluation module in one embodiment;

[0056] Fig.10 A schematic diagram of the structure of a scene display and visualization module in one embodiment;

[0057] Fig.11 A schematic diagram of the interface design of a scene display and visualization module in one embodiment;

[0058] Fig.12 The figure is a schematic diagram of the overall architecture of a test data fusion and evaluation management system in one embodiment. DETAILED DESCRIPTION

[0059] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0060] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0061] It should be noted that the reference to "embodiment" in this document means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present invention. The presentation of the phrase at various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments.

[0062] Those skilled in the art will appreciate that the embodiments described herein may be combined with other embodiments. The term "and / or" used in the present specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0063] In the research work, the test data fusion processing and evaluation management system can be deployed based on data fusion and processing equipment (such as high-performance servers) as the data center of the task monitoring simulation test. It can be interconnected with other simulation devices in the simulation verification platform based on high-performance network switches to complete the simulation information collection, storage, processing, comparison, fusion and analysis of each device in the whole process of the simulation test, thereby realizing the consistency of information transmission and the effectiveness of the test in the closed-loop simulation mode of task monitoring.

[0064] The following will describe the implementation of the present invention in detail with reference to the accompanying drawings in the embodiment diagram of the present invention.

[0065] See also Figure 1 In one embodiment, the embodiment of the present application provides a test data fusion and evaluation management system 100, including a test data management module 12, a test data fusion module 14, a test result evaluation module 16, and a scene display and visualization module 18. The test data management module 12 is used for receiving, storing, and retrieving test data from multiple sources. The test data fusion module 14 is communicatively connected to the test data management module 12, and is used to fuse and process control system equivalent device data, simulated telemetry data, and test console data, and output flight trajectory data and system working status data. The test result evaluation module 16 is communicatively connected to the test data management module 12, and is used to perform post-comprehensive test effect evaluation based on post-data provided by the test data management module 12, and is used to perform real-time online test effect evaluation based on external real-time data. The scene display and visualization module 18 is communicatively connected to the test data management module 12, and is used to perform data visualization display based on data provided by the test data management module 12 and external real-time data.

[0066] It can be understood that the main external information sources in the task monitoring simulation test may include the control system equivalent, the telemetry data source and the test console. The communication connection between the modules can be a wired communication connection or a wireless communication connection, as long as the required data transmission function can be achieved. The test data management module 12 is used to provide the required data management functions. According to the reception and storage of test data, it can uniformly manage the data of each information source and the wireless channel, etc., and can query the database according to the needs of the user, so as to facilitate the timely search and retrieval of test information, and can also maintain the database, such as having management functions such as data entry editing, updating, adding and deleting. The test data may include the test-generated data related to the task in the task monitoring simulation test.

[0067] The test data fusion module 14 is used to provide the required data fusion function, and can fuse and associate relevant test data (such as control system equivalent data, simulation telemetry data and test console data), and give prompts such as task changes and implementation of security control based on the fusion results, providing decision support for the command center simulation node.

[0068] The test result evaluation module 16 is used to provide the required test result evaluation function. Based on the data fusion and processing results, combined with the full simulation system operation process, the test result evaluation is performed under the specific combat mission background and environmental conditions. The scene display and visualization module 18 is used to provide the required multi-dimensional scene display function, which can display and present the test information flow, flight trajectory changes and target point damage in a high dynamic range, and can provide a display interface for detailed test data, and can display the test data in multiple ways (for example, but not limited to reports, curves, charts and bar graphs in different areas).

[0069] The above-mentioned test data fusion and evaluation management system 100 adopts the system design of test data management module 12, test data fusion module 14, test result evaluation module 16 and scene display and visualization module 18, wherein the test data management module 12 provides the receiving, storage and management functions of multi-source data; the test data fusion module 14 provides flight trajectory data and system working status data by processing control system equivalent data, simulated telemetry data and test console data, and provides auxiliary information for flight control decision-making; the test result evaluation module 16 provides data analysis and test effect evaluation functions, and the scene display and visualization module 18 provides data visualization display functions in the form of curves, charts and bar charts, supports dynamic updates and system working status displays, so as to meet the one-stop full-process service requirements for the collection, storage, processing, comparison, fusion and analysis of simulation information of various equipment in the whole process of the space-ground information simulation test, thereby achieving the purpose of greatly improving the efficiency of test data management.

[0070] In one embodiment, Figure 2As shown, the test data management module 12 includes a channel management submodule 121, an interactive instruction response submodule 122, a data management instruction response submodule 123, a data operation service submodule 124, an external data interface service submodule 125 and a human-computer interaction interface service submodule 126. Among them, the channel management submodule 121 is used to receive multi-source test data without loss by providing visual management of each communication channel and monitoring the working status of each communication channel. The interactive instruction response submodule 122 is used to parse the instruction input of the human-computer interaction interface into data management instructions. The data management instruction includes data query requirements and search keywords. The data management instruction response submodule 123 is used to parse the data management instruction into data query or data insertion statements. The data operation service submodule 124 is used to generate database query or data insertion statements, submit SQL scripts to the database server and receive execution result feedback. The external data interface service submodule 125 is used to access the control system equivalent device data, simulation telemetry data, test console data and test data respectively, and provide a data acquisition and management integrated interface. The human-computer interaction interface service submodule 126 is used to provide a human-computer interaction interface for test data management.

[0071] It can be understood that the test data management module 12 mainly includes a channel management submodule 121, an interactive instruction response submodule 122, a data management instruction response submodule 123, a data operation service submodule 124, an external data interface service submodule 125 and a human-computer interaction interface service submodule 126 according to different functions. The channel management submodule 121 provides a communication channel visualization management function, monitors the working status of each channel, and ensures that multi-source information is received without loss.

[0072] The interactive instruction response submodule 122 is responsible for responding to the human-computer interaction interface instruction input, parsing it into data query requirements and search keywords, and passing the data management instruction to the next module. The data management instruction response submodule 123 is responsible for responding to the data management instruction, parsing it into data query statements or data insertion statements, and submitting it to the data operation service submodule 124. The data operation service submodule 124 is mainly responsible for generating database query statements or insertion statements, submitting SQL scripts to the database server configured for the task, and receiving feedback on the execution results.

[0073] The external data interface service submodule 125 provides the input of control system equivalent test data, test console data, telemetry data and other test data, provides multi-source information receiving function, and provides data acquisition and management integrated interface. The human-computer interaction interface service submodule 126 provides the human-computer interaction interface for test data management, such as Figure 3 FIG. 1 is a schematic diagram of the interface relationship of the test data management module 12. Through the above submodules, each required data management function is fully supported, and the function implementation structure is concise and efficient.

[0074] In one embodiment, Figure 4 As shown, the test data fusion module 14 includes an external interface service submodule 141, a data preprocessing submodule 142, a fusion algorithm library submodule 143, a fusion result output submodule 144 and a human-computer interaction interface submodule 145. Among them, the external interface service submodule 141 is used to access the test data and multi-source information, and provide an integrated interface for data acquisition and management. The multi-source information includes control system equivalent data, simulated telemetry data and test console data. The data preprocessing submodule 142 is used to perform coordinate conversion and data alignment processing on the test data and multi-source information. The fusion algorithm library submodule 143 is used to provide the call of multi-sensor data fusion algorithm and target tracking algorithm, as well as the addition, modification and deletion of response algorithms. The fusion result output submodule 144 is used to submit the fusion result to the test data management module 12 for result data storage, and output the fusion result to the human-computer interaction interface; the fusion result includes flight trajectory data and system working status data. The human-computer interaction interface submodule 145 is used to display decision-making auxiliary information according to the fusion structure.

[0075] It can be understood that the test data fusion module 14 mainly includes an external interface service submodule 141, a data preprocessing submodule 142, a fusion algorithm library submodule 143, a fusion result output submodule 144 and a human-computer interaction interface submodule 145 according to different functions. The test data fusion module 14 processes the control system equivalent device data, the test console data and the simulated telemetry data, and uses the state estimator such as Kalman filter to provide flight trajectory data and system working status data, and provide auxiliary information for flight control decision-making.

[0076] Specifically, the external interface service submodule 141 provides the simulation system test data input and multi-source information receiving functions, and provides an integrated interface for data acquisition and management. The data preprocessing submodule 142 performs preprocessing operations such as coordinate conversion and data alignment on the original information of the data (such as estimating the local target track based on the data measured by each sensor in the task monitoring simulation test). The fusion algorithm library submodule 143 provides the call of a variety of multi-sensor data fusion algorithms and target tracking algorithms, and supports operations such as adding, modifying and deleting algorithms. The fusion result output submodule 144 submits the result data to the test data management module 12 for result data storage management based on the fusion result, and can output the result data to the human-computer interaction interface submodule 145. The human-computer interaction interface submodule 145 provides a human-computer interaction interface that displays user decision-making auxiliary information (such as the flight trajectory data and system working status data in the aforementioned fusion result).

[0077] like Figure 5FIG. 1 is a schematic diagram of the interface relationship of the test data fusion module 14. Through the above submodules, each required data fusion processing function is fully supported, and the interface complexity is not high.

[0078] In one embodiment, a multi-sensor data fusion algorithm and a target tracking algorithm are called to perform fusion tracking on the pre-processed multi-source information, such as Figure 6 As shown, the processing flow includes the following:

[0079] Based on multi-source information, the Monte Carlo method is used to generate the initial set;

[0080] Calculate the forecast set and forecast state mean using the initial set;

[0081] Calculate the Kalman gain matrix of the ensemble Kalman filter based on the prediction set and the prediction state mean;

[0082] According to the Kalman gain matrix, the analysis set, the analysis state mean and the analysis state error covariance of the ensemble Kalman filter are calculated;

[0083] Determine whether tracking is ended;

[0084] If so, output the filtered target state, otherwise return to the step of using the initial set to calculate the predicted set and the predicted state mean.

[0085] It can be understood that in the data fusion function, a distributed fusion method is proposed. Specifically, in the mission monitoring simulation test, each sensor has its own independent tracking filter. Based on the data measured by each sensor, the local target track is estimated and sent to the fusion center. The fusion center performs spatial alignment and time calibration on these incoming local target tracks, and then performs track association, and then selects a suitable fusion algorithm for track fusion. The data fusion process is as follows: Figure 7 shown.

[0086] Preferably, the fusion algorithm mainly adopts a nonlinear target tracking algorithm that comprehensively utilizes the ensemble Kalman filter technology and the particle filter technology, uses the block idea to generate the initial set, and then performs covariance weighted fusion between the blocks. The ensemble Kalman filter algorithm and the particle filter algorithm are effectively combined together, and two independent sets are used. First, an independent set is used for ensemble Kalman filtering, and then the analysis set of the ensemble Kalman filter and the other independent set are used to form a reference distribution for particle filtering, and particle filtering is performed. This algorithm has the advantages of the ensemble Kalman filter algorithm and the particle filter algorithm, can handle the non-Gaussian problem of sensor observation noise, reduce sensor measurement errors, improve system tracking performance, and meet real-time tracking requirements. Its specific processing flow is as follows: Figure 6 shown.

[0087] In one embodiment, Figure 8As shown, the test result evaluation module 16 includes an indicator management submodule 161, an evaluation submodule 162, a sensitivity analysis submodule 163 and an evaluation result display submodule 164. Among them, the indicator management submodule 161 is used to execute the indicator system construction and indicator parameter configuration processing. The evaluation submodule 162 is used to perform single capability evaluation, target threat rating and comprehensive capability evaluation according to the data provided by the test data management module 12 and the called indicator parameters, and generate evaluation results. The sensitivity analysis submodule 163 is used to analyze the degree of influence of a single indicator on the target according to the called indicators and evaluation results, and generate analysis results. The evaluation result display submodule 164 is used to display information, feedback decision-making auxiliary information, store result data and generate evaluation reports according to the evaluation results and analysis results; information display includes evaluation scenario display, dynamic result change display and evaluation result comparison display.

[0088] It can be understood that the test result evaluation module 16 can be developed and implemented based on the universal combat effectiveness evaluation toolkit, and can provide functions such as custom effectiveness indicators, indicator system editing, indicator normalization and weighted aggregation methods, and sensitivity analysis. For different simulation experiments, the evaluation indicator system can be dynamically established respectively, and the corresponding evaluation indicator values ​​can be obtained based on the test result statistics. The test result evaluation can be divided into real-time online evaluation and post-comprehensive evaluation according to different data collection modes. Real-time online evaluation supports dynamic indicator editing and management, online data collection and analysis storage, online evaluation solution, evaluation result display and decision information feedback. Post-comprehensive evaluation supports single-task evaluation and multi-task evaluation result comparison, and provides single capability evaluation and comprehensive capability evaluation.

[0089] Specifically, the indicator management submodule 161 may include two parts: one is the indicator system construction, which is used to configure the corresponding indicator system. The other is the indicator parameter processing, which is used to select different normalization processing methods for indicator processing according to different indicator characteristics. The evaluation submodule 162 can be divided into three major parts: single capability evaluation, target threat rating and comprehensive capability evaluation. Single capability evaluation refers to the evaluation of the capability indicator layer, which is a comprehensive evaluation based on the performance indicator layer; target threat rating refers to rating according to the target threat level; comprehensive capability is to obtain the evaluation result of the entire task by performing a comprehensive evaluation after assigning weights to different targets.

[0090] The sensitivity analysis submodule 163 is used to analyze the impact of a single indicator on the target after completing the comprehensive evaluation. The evaluation result display submodule 164 implements functions such as evaluation scene display, dynamic result change, and evaluation result comparison information display. Fig. 9As shown, it is a schematic diagram of the interface relationship of the test result evaluation module 16. Among them, the external interface can be used for: loading evaluation data through the test data management module 12; saving the evaluation process data and results through the data service request module; after the evaluation is completed, the user forms a word evaluation report with the evaluation results through the report generation interface; and about the internal interface: the main interface of the indicator management submodule 161 includes evaluation indicator configuration, display, parameter input and parameter processing, and the indicator system structure is saved through the test data management module 12; the main interface of the evaluation submodule 162 includes selecting evaluation items and evaluation methods, evaluation calculation, and saving the results through the test data management module 12; the sensitivity analysis submodule 163 loads the comprehensive evaluation results, selects important indicators for sensitivity analysis and displays them, and can save them through the test data management module 12; the evaluation result display submodule 164 can view the evaluation results by selecting tasks, select multi-task evaluation results for comparison and display, and generate a word report document.

[0091] Through the above sub-modules, the efficient implementation of the required test result evaluation function is fully supported.

[0092] In one embodiment, the indicator normalization processing method adopted by the indicator management submodule includes a straight line processing method, a curve normalization processing method and a broken line normalization processing method.

[0093] Specifically, regarding indicator processing, different normalization processing methods can be selected according to different indicator characteristics. Among them, the linear processing method: when the data characteristics of the indicator are relatively simple, the linear normalization processing method is convenient to process, and the processing results will be relatively accurate. However, for complex indicators, since the data characteristics of each indicator are not considered, the impact of the indicator value on the evaluation value is processed in proportion, resulting in a large difference between the evaluation result and the actual situation.

[0094] Compared with the linear normalization processing method, the curve normalization processing method takes better into account the data characteristics of the index and processes the index more finely. However, it also has two main problems: first, the selection of the normalization processing formula is very difficult, and second, under the premise that the parameters in the processing model cannot be accurately determined, the accuracy of the evaluation value cannot be guaranteed. In addition, in view of the shortcomings of the above two processing methods, this embodiment can also adopt a broken line normalization processing method, that is, segmentation of the linear processing method or linear approximation of the curve processing method. In this way, the required index processing function can be realized more efficiently.

[0095] In one embodiment, the index synthesis method adopted by the index management submodule includes weighted synthesis, ideal point, grey correlation degree or fuzzy comprehensive evaluation.

[0096] Specifically, the commonly used existing methods of index comprehensive methods include weighted comprehensive, ideal point, grey correlation and fuzzy comprehensive evaluation. Among them, fuzzy comprehensive evaluation can well solve the uncertainty and ambiguity of the boundaries of qualitative evaluation indicators, thereby converting semi-qualitative and semi-quantitative problems into quantitative problems for analysis, which can be used as an optimal solution.

[0097] In one embodiment, the sensitivity analysis submodule performs sensitivity analysis through numerical differentiation. Specifically, the sensitivity analysis can be performed through numerical differentiation, perturbing different indicator data to efficiently analyze the degree of influence on the evaluation results.

[0098] In one embodiment, the information display method includes data table display and / or chart display. Optionally, the evaluation results can be processed in the following two ways, but not limited to, one is to display in the form of data table and chart display, and the result file in the format of JPG and Word can be exported. The other is to feed back the evaluation results as decision-making auxiliary information to the equivalent control system, which can be transmitted through the TCP / IP protocol.

[0099] In one embodiment, Fig.10 As shown, the scene display and visualization module 18 includes a data interface service submodule 181, a data classification display submodule 182, a two-dimensional scene display submodule 183 and an evaluation result display submodule 184. Among them, the data interface service submodule 181 is used to parse data access instructions during the post-playback process and to submit query requests to the test data management module 12. The data classification display submodule 182 is used to graphically display the test data and the system working status. The two-dimensional scene display submodule 183 is used to display the target trajectory on a two-dimensional map and update it in real time, as well as respond to map translation and zoom operations. The evaluation result display submodule 184 is used to display the evaluation results output by the test result evaluation module 16 online in the form of charts.

[0100] Specifically, the data interface service submodule 181 parses the data access instructions during the post-playback process and submits the query request to the test data management module 12. The evaluation result display submodule 184 can be combined with the test result evaluation module 16 to display the online evaluation results in the form of charts. The two-dimensional scene display submodule 183 displays the target trajectory on the two-dimensional map, supports real-time updates, and supports common operations such as map translation and zooming. The data classification display submodule 182 can display the test data and system working status in the form of bar graphs, curves and charts, and supports the selection of focus parameters for comparison, observation range selection and change of display themes.

[0101] like Fig.11 FIG. 1 is a schematic diagram of the interface relationship of the scene display and visualization module 18. The above submodules can efficiently support the required scene display and data visualization functions.

[0102] In one embodiment, in practical applications, Fig.12 As shown, the performance of the above-mentioned test data fusion and evaluation management system 100 can support: multi-source data reception without loss; real-time data upper and lower limit analysis and judgment; real-time test data acquisition frequency is 200 frames / second, and the data volume is 10K / second; real-time test data can be displayed in different areas in the form of curves, charts and bar charts; data display can be visually edited and maintained on the publishing and browsing interfaces without modifying the program; real-time data refresh time is less than 0.2 seconds; data display mode and type are configurable; the database has the functions of query, update, modification, deletion and data import and export; historical test data can realize single test playback and multiple test comparison display functions.

[0103] The system interface design is concise and clear, the operation is smooth, and it complies with the general Windows software interface design specifications. It has a complete fault reporting and processing mechanism. The average time between failures is more than 5,000 hours, and the average fault recovery time is less than 1 hour. The system network preferably uses 1000M Ethernet, exchanges data through the core switch, and is physically isolated from other networks to ensure information security.

[0104] Each module in the above-mentioned test data fusion and evaluation management system 100 can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in a high-performance server device in the form of hardware or independent of a specific data processing function, or can be stored in the memory of the above-mentioned device in the form of software, so that the processor can call and execute the operations corresponding to each of the above-mentioned modules. The above-mentioned device can be, but is not limited to, various types of data processing devices already available in the art.

[0105] Each module of the test data fusion and evaluation management system 100 can be constructed using existing programming languages ​​and existing programming methods in the computer field to realize the corresponding functions of each module. The system can run on a server and a computer terminal, such as a server with a main frequency of 2.0 GHz or more, a memory of 16 GB or more, a SAS hot-swappable hard disk of 200 GB or more, and a RAID mode support, or a computer terminal with a main frequency of 2.0 or more, a memory of 4 GB or more, and an operating system of Window XP or more.

[0106] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0107] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and all of them belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A test data fusion and evaluation management system, characterized in that: include: Test data management module, used for receiving, storing and retrieving test data from multiple sources; A test data fusion module, which is communicatively connected to the test data management module and is used for fusing and processing control system equivalent device data, simulation telemetry data and test console data, and outputting flight trajectory data and system working status data; A test result evaluation module, which is communicatively connected to the test data management module and is used to perform a post-test comprehensive test effect evaluation based on the post-test data provided by the test data management module, and to perform a real-time online test effect evaluation based on external real-time data; A scene display and visualization module, which is communicatively connected to the test data management module and is used for performing data visualization display based on the data provided by the test data management module and external real-time data; The test result evaluation module includes: The indicator management submodule is used to execute indicator system construction and indicator parameter configuration processing; An evaluation submodule, used to perform single capability evaluation, target threat rating and comprehensive capability evaluation according to the data provided by the test data management module and the called indicator parameters, and generate evaluation results; The sensitivity analysis submodule is used to analyze the influence of a single indicator on the target according to the called indicator and the evaluation result, and generate the analysis result; An evaluation result display submodule is used to display information, provide decision-making auxiliary information feedback, store result data and generate an evaluation report based on the evaluation results and the analysis results; the information display includes evaluation scenario display, dynamic result change display and evaluation result comparison display; The test result evaluation module includes an indicator management submodule, an evaluation submodule, a sensitivity analysis submodule and an evaluation result display submodule, which fully supports the efficient implementation of the required test result evaluation functions.

2. The test data fusion and evaluation management system according to claim 1, characterized in that: The test data management module comprises: The channel management submodule is used to receive test data from multiple sources without losing any points by providing visual management of each communication channel and monitoring the working status of each communication channel; An interactive instruction response submodule is used to parse the instruction input of the human-computer interaction interface into a data management instruction; the data management instruction includes a data query requirement and a search keyword; A data management instruction response submodule, used for parsing the data management instruction into a data query or data insertion statement; The data operation service submodule is used to generate the data query or data insertion statement, submit the SQL script to the database server and receive execution result feedback; An external data interface service submodule, used to access the control system equivalent device data, the simulation telemetry data, the test console data and the test data respectively, and provide a data acquisition and management integrated interface; The human-computer interaction interface service submodule is used to provide a human-computer interaction interface for test data management.

3. The test data fusion and evaluation management system according to claim 1, characterized in that: The test data fusion module comprises: An external interface service submodule, used to access the test data and multi-source information, and provide a data acquisition and management integrated interface; the multi-source information includes the control system equivalent device data, the simulation telemetry data and the test console data; A data preprocessing submodule, used for performing coordinate conversion and data alignment processing on the test data and the multi-source information; The fusion algorithm library submodule is used to provide the call of multi-sensor data fusion algorithm and target tracking algorithm, as well as the addition, modification and deletion of response algorithms; A fusion result output submodule is used to submit the fusion result to the test data management module for result data storage, and output the fusion result to the human-computer interaction interface; the fusion result includes the flight trajectory data and the system working status data; The human-computer interaction interface submodule is used to display decision-making auxiliary information according to the fusion result.

4. The test data fusion and evaluation management system according to claim 3, characterized in that: The process of calling the multi-sensor data fusion algorithm and the target tracking algorithm to perform fusion tracking on the pre-processed multi-source information includes: Based on the multi-source information, an initial set is generated using a Monte Carlo method; Calculating a predicted set and a predicted state mean using the initial set; Calculating a Kalman gain matrix of a collective Kalman filter according to the prediction set and the prediction state mean; Calculating the analysis set, analysis state mean and analysis state error covariance of the ensemble Kalman filter according to the Kalman gain matrix; Determine whether tracking is ended; If so, the filtered target state is output, otherwise the step of calculating the predicted set and the predicted state mean using the initial set is returned to.

5. The test data fusion and evaluation management system according to any one of claims 1 to 4, characterized in that: The index normalization processing methods adopted by the index management submodule include a straight line processing method, a curve normalization processing method and a broken line normalization processing method.

6. The test data fusion and evaluation management system according to any one of claims 1 to 4, characterized in that: The index comprehensive methods adopted by the index management submodule include weighted comprehensive, ideal point, grey correlation or fuzzy comprehensive evaluation.

7. The test data fusion and evaluation management system according to any one of claims 1 to 4, characterized in that: The sensitivity analysis submodule performs sensitivity analysis through numerical differentiation.

8. The test data fusion and evaluation management system according to any one of claims 1 to 4, characterized in that: The information display method includes data table display and / or chart display.

9. The test data fusion and evaluation management system according to claim 1, characterized in that: The scene display and visualization module includes: A data interface service submodule, used for parsing data access instructions during post-playback and for submitting query requests to the test data management module; A data classification display submodule is used to display the test data and system working status in a graphical manner; The 2D scene display submodule is used to display the target trajectory on the 2D map and update it in real time, as well as respond to map panning and zooming operations; The evaluation result display submodule is used to display the evaluation result output by the test result evaluation module online in the form of a chart.

Images