Radar confrontation simulation credibility evaluation method based on data consistency check
Through the method based on data consistency inspection, a credibility evaluation index system and consistency inspection method library of radar countermeasure simulation system was established, which solved the problem of inconsistency between radar countermeasure simulation system and model dimensions, and realized the radar countermeasure simulation system. Quantitative credibility evaluation of multi-type simulation parameters improves the evaluation accuracy and credibility of the simulation system.
Patent Information
- Application Number
- CN202411066378.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-05
- Publication Date
- 2024-11-12
AI Technical Summary
The existing radar countermeasure simulation systems and models have dimension inconsistencies in terms of credibility assessment, especially the evaluation of signal-level simulation and semi-physical simulation systems, and the evaluation methods are qualitative, making it difficult to perform systematic and dynamic checksum quantitative description of nature.
Using a method based on data consistency testing, a confidence evaluation index system for radar countermeasure simulation system is established, and a consistency testing method library is formed through consistency testing of static randomness, dynamic periodicity, dynamic non-periodicity and other types of simulation parameters. , and through the conversion of consistency test results and credibility, the dimensionless credibility calculation results are output, and the comprehensive credibility evaluation of the radar countermeasure simulation system is finally realized.
Quantitative credibility evaluation of multi-type radar countermeasure simulation systems and models is realized, and standardized credibility evaluation results are provided, which can be applied to different types of radar countermeasure simulation systems, improving the accuracy of credibility evaluation of simulation systems. Sex and reliability.
Smart Images

Figure CN118940531A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of radar electronic countermeasures, and in particular to a radar countermeasure simulation credibility assessment method based on data consistency verification, which is used to implement credibility assessment of radar countermeasure simulation systems and models, can effectively analyze the weak links of the credibility of radar countermeasure simulation systems and models, and provide a reference for realistic transformation of radar countermeasure simulation systems and optimization of simulation models. Background Art
[0002] Radar confrontation simulation is an important source of radar confrontation performance evaluation data. It has many advantages such as low cost and good repeatability. It can perform a large number of simulations under different conditions and meet the large sample size requirements of radar confrontation performance evaluation. Foreign countries rely heavily on the application of simulation methods in radar confrontation performance testing. In the 1980s, foreign scholars studied the impact of natural environments such as haze on radar confrontation performance and created mathematical models. The large-scale use of simulation methods is an important source of radar confrontation performance evaluation data. However, due to the constraints of the development of radar confrontation simulation modeling technology, the credibility of radar confrontation simulation is limited, and the credibility level varies. As a result, how to quantitatively evaluate the credibility of radar confrontation simulation systems and results has become one of the difficult problems that need to be solved in the field of radar confrontation simulation.
[0003] Foreign countries attach great importance to the credibility assessment technology of radar countermeasure simulation, and have developed a mature technical system including VV&A and credibility assessment theory, technology, standard specifications, tools and application research. The research on the credibility assessment theory of simulation system mainly includes the research on concepts, principles, mechanisms, processes and so on. In 1978, the Society for Computer Simulation (SCS) of the United States established the "Technical Committee on Model Credibility (TCMC)" to standardize the concepts and terms related to model credibility. In the standard terms related to model credibility released by TCMC, model verification and model validation (abbreviated as V&V) are used as two terms in simulation credibility research to standardize their definitions. Among them, verification refers to the verification of the logical rationality and code correctness of computer programs, and validation refers to the verification of the behavioral consistency between simulation models and simulation objects. As the test result of model verification work, model verification tools play an important supporting role in simulation credibility assessment. Representative achievements abroad include: Orca Company of the United States has developed a simulation modeling credibility assessment environment, which uses the client / server model to highly integrate the verification results of subsystems and submodules. Holmes designed and developed a toolbox for simulation model verification and credibility assessment, which includes commonly used static and dynamic model verification methods, including Turing test, expert judgment, hypothesis testing method, TIC method, correlation analysis method, regression analysis method, etc.
[0004] my country's work on credibility assessment of radar countermeasure simulation systems started relatively late. Wang Weiping, Zhu Yifan and others first elaborated on the concepts, methods, significance and definition of credibility of model verification and validation in the book "Validation and Verification of Simulation Models". Through recent research, simulation credibility assessment theory, evaluation methods and evaluation tools have made great progress. However, with the diversification of simulation needs, the scale of simulation systems is getting larger, the structure is getting more complex, and the fields involved are getting wider, which brings new problems and challenges to simulation credibility assessment work. However, the following problems still need further research and solution: the existing credibility assessment of radar countermeasure simulation models mainly focuses on the verification of digital models and simulation modules. The evaluation focuses on static simulation output results. The evaluation method is qualitative. How to conduct systematic and dynamic verification and quantitative description of credibility of signal-level countermeasure simulation is an issue that needs to be studied and discussed urgently. In addition, there is little research on credibility assessment of radar countermeasure semi-physical simulation systems. Summary of the invention
[0005] The purpose of the present invention is to provide a radar confrontation simulation credibility assessment method based on data consistency verification, to solve the problem of inconsistent dimensions of multi-type radar confrontation simulation systems and model assessment results, and to provide a quantitative basis for the comprehensive credibility assessment of radar confrontation simulation systems.
[0006] The technical solution to realize the present invention is: a radar confrontation simulation credibility assessment method based on data consistency verification, the steps are as follows:
[0007] Step 1: According to the composition structure of the radar countermeasure simulation system, a credibility evaluation index system of the radar countermeasure simulation system consisting of each subsystem and its related indicators is established. Based on the verification theory, the credibility evaluation level and related index items of each model module are standardized to form a complete and clear credibility evaluation index system as shown in Table 1, which provides input for the credibility evaluation technology research;
[0008] Step 2: According to different simulation parameter properties, sort out the corresponding data consistency inspection methods and inspection criteria to form a simulation data consistency inspection method library;
[0009] Step 3: Based on the inspection principles of different methods and the correlation between the inspection results and the definition of credibility, the consistency inspection results are converted into credibility, and the dimensionless credibility calculation results are output;
[0010] Step 4: According to the bottom-up layer-by-layer aggregation method, the credibility evaluation results of all indicators in the credibility evaluation index system are obtained, and finally the credibility of the complete radar countermeasure simulation system is evaluated, and the credibility analysis is performed based on the specific situation of the simulation system.
[0011] Compared with the prior art, the present invention has the following significant advantages:
[0012] (1) The consistency verification methods corresponding to different types of simulation parameters in radar countermeasure simulation, such as static determinism, static randomness, dynamic periodicity, and dynamic aperiodicity, are given to form a radar countermeasure simulation data consistency verification method library, which can be applied to the credibility evaluation of various types of radar countermeasure simulation systems and models.
[0013] (2) The present invention proposes a radar countermeasure simulation credibility assessment method based on data consistency verification. On the basis of disassembling and analyzing the components of the radar countermeasure simulation system, different types of simulation data output during the operation of the radar countermeasure simulation system are used to design consistency verification methods corresponding to different types of simulation parameters such as static randomness, dynamic periodicity, and dynamic non-periodicity. A normalization model based on the consistency verification results is established to achieve the conversion between consistency verification results and credibility. This method can provide standardized credibility assessment results for the credibility assessment of each component subsystem of the radar countermeasure simulation. In combination with the weight determination method of the simulation system credibility index, the credibility aggregation method between subsystems and systems is studied according to the system function realization principle, and a comprehensive credibility assessment model for the radar countermeasure simulation system is established. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 The present invention is a flowchart of the radar countermeasure simulation credibility assessment method.
[0015] Figure 2 This is the radar confrontation simulation credibility evaluation index system of the present invention. DETAILED DESCRIPTION
[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0017] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.
[0018] In addition, in the present invention, the descriptions such as "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0019] In the present invention, unless otherwise clearly specified and limited, the terms "connection", "fixation" and the like should be understood in a broad sense. For example, "fixation" can be a fixed connection, a detachable connection, or an integral connection; "connection" can be a mechanical connection or an electrical connection. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0020] In addition, the technical solutions between the various embodiments of the present invention can be combined with each other, but it must be based on the fact that ordinary technicians in the field can implement it. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention.
[0021] The following will further introduce the specific implementation method, as well as the technical difficulties and inventive points of this invention in combination with this design example.
[0022] The present invention proposes a credibility assessment method for a radar confrontation simulation system based on data consistency verification. On the basis of disassembling and analyzing the components of the radar confrontation simulation system, based on the properties of radar confrontation simulation parameters and using different types of simulation data output during the operation of the radar confrontation simulation system, a consistency verification method corresponding to different types of simulation parameters such as static determinism, static randomness, dynamic periodicity, and dynamic aperiodicity is designed. A compatibility-credibility model and a distance-credibility model based on the consistency verification results are established to realize the conversion between the consistency verification results and the credibility, and to provide standardized credibility assessment results for the credibility assessment of each component system of the radar confrontation simulation. Through weight design and weighted aggregation, a comprehensive credibility assessment of the radar confrontation simulation system is realized.
[0023] Combination Figure 1 and Figure 2 The present invention is a radar confrontation simulation credibility assessment method based on data consistency verification, comprising the following steps:
[0024] Step 1. According to the composition structure of the radar countermeasure simulation system, a credibility evaluation index system of the radar countermeasure simulation system consisting of each subsystem and its related indicators is established. Based on the verification theory, the evaluation level of each subsystem is decomposed and divided respectively, and the credibility evaluation level and related indicators of each model and subsystem are established and standardized to form a complete and clear credibility evaluation index system. The credibility evaluation index system includes the credibility of the complex electromagnetic environment simulation subsystem, the credibility of the operation control subsystem, and the credibility of the operation support subsystem. The credibility of the complex electromagnetic environment simulation subsystem includes the consistency of clutter signals, the consistency of target RCS, and the consistency of interference signals. The credibility of the operation control subsystem includes the consistency of attitude angles, the consistency of heading angles, and the consistency of speed. The credibility of the operation support subsystem includes the bit error rate, the transmission rate, and the delay.
[0025] Step 2: According to the different properties of simulation parameters, sort out the corresponding data consistency verification methods and verification criteria to form a simulation data consistency verification method library.
[0026] Step 2-1: According to the output data types of the simulation model and the real system, the credibility evaluation index is divided into one of static deterministic data, static random data, dynamic non-periodic time series, and dynamic periodic time series.
[0027] Step 2-2: Input the simulation data and benchmark data for consistency test of each indicator, determine the consistency test method corresponding to the specific usage conditions according to the nature of the indicator, and form a radar countermeasure simulation system consistency test method library as shown in Table 1.
[0028] Table 1 Radar countermeasure simulation system consistency verification method library
[0029]
[0030] Step 2-3: Perform consistency check according to the radar countermeasure system consistency check method library to obtain the consistency check results of various credibility assessment indicators. If it belongs to the output static randomness indicator, the confidence interval is output; if it belongs to the static deterministic indicator, the deviation is output; if it belongs to the dynamic periodic indicator, the consistency coefficient is output; if it belongs to the dynamic non-periodic indicator, the correlation coefficient is output.
[0031] Step 3: Based on the inspection principles of different methods and the correlation between the inspection results and the credibility definition, the consistency inspection results are converted into credibility, and the dimensionless credibility calculation results are output.
[0032] Step 3-1: Check the consistency of the static randomness index, i.e. the confidence interval [X hig ,X low], using the hypothesis test normalization method based on confidence interval, calculate the center and width of the confidence interval for normalization, and output the corresponding credibility assessment result con 1 :
[0033]
[0034] Among them, X hig and X low are the upper and lower limits of the confidence interval, and Δ is the difference between the mean output data of the simulation model and the real system.
[0035] Step 3-2: For the simulation result x of the static deterministic index, the point estimation and interval construction method are used to design the credibility measurement. 0 In the case of 2 :
[0036]
[0037] Among them, con 2 represents the consistency result, x is the calculated value of the credibility evaluation index, X 0 is the baseline value.
[0038] When the indicator has a benchmark interval [X max ,X min ], its credibility evaluation result is 3 :
[0039]
[0040] Among them, con 3 Represents the credibility calculation result, X max and X min are the upper and lower limits of the benchmark interval, and x is the calculated value of the indicator.
[0041] Step 3-3: Based on the consistency test results of dynamic periodicity indicators, a normalization method based on frequency domain sequence consistency is used to design the credibility measurement. The credibility evaluation result is con 4 :
[0042]
[0043] Among them, z i and i are the i-th sampling point values of the simulation test data sequence and the real system output data sequence, respectively. and are the means of the two series respectively.
[0044] Step 3-4: For the consistency test results of dynamic non-periodic indicators, the direct normalization method is used to design the measurement of pity. For the grey correlation analysis method, the grey correlation coefficient ρ is the correlation degree, which can be directly used as the consistency result. For the TIC method, 1 minus the TIC coefficient can be used to obtain the credibility evaluation result in the range of 0-1, which is con 5
[0045] con 5 =1-ρ(A,B)
[0046] Among them, ρ(A, B) is the TIC coefficient after verification, A is the simulation test sequence, and B is the benchmark sequence.
[0047] Step 4: According to the bottom-up layer-by-layer aggregation method, the credibility evaluation results of all indicators in the credibility evaluation index system are obtained, and finally the credibility of the complete radar countermeasure simulation system is evaluated, and the credibility analysis is performed based on the specific situation of the simulation system.
[0048] Step 4-1, using the Analytical Hierarchy Process (AHP), according to the hierarchical relationship of "model-module-subsystem" and the relative importance of the indicators, the weights of the credibility indicators of each component of the radar countermeasure simulation system are designed. Experts in the field of radar countermeasure simulation mainly rank and score them according to their importance in affecting the test results of the simulation test. The importance level is divided into three levels, including important, medium, and general, to obtain the weights of the credibility evaluation indicators at each level;
[0049] Step 4-2: Based on the system verification results, a hierarchical weighted credibility comprehensive evaluation model is constructed around the credibility index system of the radar countermeasure simulation system to conduct a bottom-up comprehensive credibility evaluation of the simulation test system. Finally, the credibility evaluation result R e for:
[0050]
[0051] Where N is the total number of subsystems in the radar countermeasure simulation system, J is the total number of bottom-level credibility evaluation indicators in the radar countermeasure simulation system, ω n is the subsystem weight, ω j is the corresponding weight of the three-level credibility evaluation index, con j Calculation result of the jth underlying credibility indicator.
Claims
1. A radar confrontation simulation credibility assessment method based on data consistency verification, characterized in that: Here are the steps: Step 1: According to the composition structure of the radar countermeasure simulation system, a credibility evaluation index system of the radar countermeasure simulation system consisting of each subsystem and its related indicators is established. Based on the verification theory, the credibility evaluation level and related index items of each model module are standardized to form a complete and clear credibility evaluation index system as shown in Table 1, which provides input for the credibility evaluation technology research; Step 2: According to different simulation parameter properties, sort out the corresponding data consistency verification methods and verification criteria to form a simulation data consistency verification method library; Step 3: Based on the inspection principles of different methods and the correlation between the inspection results and the definition of credibility, the consistency inspection results are converted into credibility, and the dimensionless credibility calculation results are output; Step 4: According to the bottom-up layer-by-layer aggregation method, the credibility evaluation results of all indicators in the credibility evaluation index system are obtained, and finally the credibility of the complete radar countermeasure simulation system is evaluated, and the credibility analysis is performed based on the specific situation of the simulation system.
2. The radar confrontation simulation credibility assessment method based on data consistency verification according to claim 1 is characterized in that: In step 1, the credibility evaluation index system includes the credibility of the complex electromagnetic environment simulation subsystem, the credibility of the operation control subsystem, and the credibility of the operation support subsystem. The credibility of the complex electromagnetic environment simulation subsystem includes the consistency of clutter signals, the consistency of target RCS, and the consistency of interference signals. The credibility of the operation control subsystem includes the consistency of attitude angles, the consistency of heading angles, and the consistency of speed. The credibility of the operation support subsystem includes the bit error rate, the transmission rate, and the delay.
3. The radar confrontation simulation credibility assessment method based on data consistency verification according to claim 2 is characterized in that: In step 2, according to different simulation parameter properties, the corresponding data consistency verification methods and verification criteria are sorted out to form a simulation data consistency verification method library, which is as follows: Step 2-1, according to the output data types of the simulation model and the real system, the credibility evaluation index is divided into one of static deterministic data, static random data, dynamic non-periodic time series, and dynamic periodic time series; Step 2-2: Input the simulation data and benchmark data for consistency test of each indicator, determine the consistency test method corresponding to the specific use conditions according to the nature of the indicator, and form a consistency test method library for the radar countermeasure simulation system, as shown in Table 1: Table 1 Radar countermeasure simulation system consistency verification method library Step 2-3: Perform consistency check according to the radar countermeasure system consistency check method library to obtain the consistency check results of various credibility assessment indicators. If it belongs to the output static randomness indicator, the confidence interval is output; if it belongs to the static deterministic indicator, the deviation is output; if it belongs to the dynamic periodic indicator, the consistency coefficient is output; if it belongs to the dynamic non-periodic indicator, the correlation coefficient is output.
4. The radar countermeasure simulation credibility assessment method based on data consistency verification according to claim 3 is characterized in that: In step 3, based on the inspection principles of different methods and the correlation between the inspection results and the definition of credibility, the consistency inspection results are converted into credibility, and the dimensionless credibility calculation results are output, as follows: Step 3-1: Check the consistency of the static randomness index, i.e. the confidence interval [X hig ,X low ], using the hypothesis test normalization method based on confidence interval, calculate the center and width of the confidence interval for normalization, and output the corresponding credibility assessment result con1: Among them, X hig and X low are the upper and lower limits of the confidence interval, Δ is the difference between the mean output data of the simulation model and the real system; Step 3-2: For the simulation result x of the static deterministic index, the point estimation and interval construction method are used to design the credibility measurement. When the index has a reference value X0, its credibility evaluation result con2 is: Among them, con2 represents the consistency result, x is the measured value of the credibility evaluation index, and X0 is the reference value; When the indicator has a benchmark interval [X max ,X min ], its credibility evaluation result is con3: Among them, con3 represents the credibility calculation result, X max and X min are the upper and lower limits of the benchmark interval, and x is the indicator measurement value; Step 3-3: Based on the consistency test results of dynamic periodic indicators, a normalization method based on frequency domain sequence consistency is used to design the credibility measurement, and the credibility evaluation result is con4: Among them, z i and i are the i-th sampling point values of the simulation test data sequence and the real system output data sequence, respectively. and are the means of the two series respectively; Step 3-4: For the consistency test results of dynamic non-periodic indicators, the direct normalization method is used to design the measurement of pity. For the grey correlation analysis method, the grey correlation coefficient ρ is the correlation degree, which can be directly used as the consistency result. For the TIC method, 1 minus the TIC coefficient can be used to obtain the credibility evaluation result in the range of 0-1, which is con5. con5=1-ρ(A,B) Among them, ρ(A, B) is the TIC coefficient after verification, A is the simulation test sequence, and B is the benchmark sequence.
5. The radar confrontation simulation credibility assessment method based on data consistency verification according to claim 4 is characterized in that: In step 4, the credibility evaluation results of all indicators in the credibility evaluation index system are obtained according to the bottom-up layer-by-layer aggregation method. Finally, the credibility of the complete radar countermeasure simulation system is evaluated and the credibility analysis is performed in combination with the specific situation of the simulation system, as follows: Step 4-1, using AHP, according to the "model-module-subsystem" hierarchical relationship and the relative importance of the indicators, the credibility index weights of each component of the radar countermeasure simulation system are designed. Experts in the field of radar countermeasure simulation mainly rank and score them according to their importance in affecting the test results of the simulation test. The importance level is divided into three levels, including important, medium, and general, to obtain the weights of the credibility evaluation indicators at each level; Step 4-2: Based on the system verification results, a hierarchical weighted credibility comprehensive evaluation model is constructed around the credibility index system of the radar countermeasure simulation system to conduct a bottom-up comprehensive credibility evaluation of the simulation test system. Finally, the credibility evaluation result R of the radar countermeasure simulation system is e for: Where N is the total number of subsystems in the radar countermeasure simulation system, J is the total number of bottom-level credibility evaluation indicators in the radar countermeasure simulation system, ω n is the subsystem weight, ω j is the corresponding weight of the three-level credibility evaluation index, con j Calculation result of the jth underlying credibility indicator.
Citation Information
Cited By
Intelligent sound wave confrontation system and method
CN119289784A
Comprehensive efficiency and performance evaluation method based on system multi-index joint simulation
CN119396674A
A comprehensive performance and capability evaluation method based on system multi-index joint simulation
CN119396674B
Credibility evaluation method and device, equipment, medium and program product
CN119721843A
Simulation system credibility evaluation method and system based on data quality
CN119903681A
