Performance analysis and evaluation method and device for command and control system

By establishing evaluation functions and weight calculations, a real-time processing performance evaluation matrix of the accusation system is formed, which solves the problems of low processing efficiency and simple evaluation standards in high-density tasks, and achieves rapid and accurate analysis and intelligent performance of the accusation system. Decision support.

CN118917523APending Publication Date: 2024-11-08CHINESE PEOPLES LIBERATION ARMY UNIT 92941

Patent Information

Application Number
CN202410934030.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-12
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing accusation system exhibits low processing efficiency, error-prone, long processing cycles and simple evaluation criteria in high-density, cross-parallel tasks, and cannot quickly and accurately analyze performance, resulting in the inability to effectively support command decisions.

Method used

By obtaining the real-time data processing performance analysis indicators of the accusation system, an accuracy, completeness, continuity and real-time evaluation functions are established, and the weight is calculated using the seven-scale comparison calculation method to form a real-time processing performance evaluation matrix, and a matrix transformation is performed to output synthesis Evaluation results.

Benefits of technology

It realizes automated performance analysis of the accusation system, provides scientific basis and intelligent decision-making support, and improves the evaluation ability of data processing and aggregate distribution capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118917523A_ABST
    Figure CN118917523A_ABST
Patent Text Reader

Abstract

The invention provides a performance analysis and evaluation method and device for a command and control system, which can fully utilize a large amount of test data collected in a command and control center to automatically analyze the data collection and distribution capability and the data processing capability of measurement and control equipment of the command and control system, and output an evaluation result. And a scientific basis and an auxiliary means are provided for command decision intelligentization.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of command and control technology, and in particular to a performance analysis and evaluation method and device for a command and control system. Background Art

[0002] During the target's flight, the command and control system completes the collection and distribution of equipment data, real-time data processing of the target's track, and displays the situation of equipment data tracking and real-time processing, on which command decisions are made. In recent years, the tasks undertaken by the command and control system have shown the characteristics of high density and cross-parallelism. As the difficulty increases, the pressure on the command and control system to complete the task becomes more prominent. The command and control system is flexible in capturing and identifying targets, and the difference in information interaction relationships also makes the command and control system show different overall performance in different tasks. At present, this part of the work is mainly implemented manually, which presents certain disadvantages:

[0003] 1) Low-level repetition is not conducive to accumulating previous experience;

[0004] 2) Low processing efficiency, unable to provide timely and accurate information for command decision-making. Error-prone

[0005] 3) The processing cycle is long, which is not conducive to making quick decisions on the next task.

[0006] 4) The evaluation criteria are too simple and lack a comprehensive analysis and assessment of the performance of the command and control system in completing the task, nor can they provide reasonable suggestions for the organization and implementation of subsequent measurement and control tasks.

[0007] Therefore, the traditional analysis and assessment methods cannot adapt to the task requirements under the new situation, and it is particularly urgent to quickly and accurately analyze and grasp the test status of the command and control system. Summary of the invention

[0008] The present invention aims to provide a method and device for performance analysis and evaluation of a command and control system that overcomes the above-mentioned problems or at least partially solves the above-mentioned problems.

[0009] To achieve the above object, the technical solution of the present invention is specifically implemented as follows:

[0010] One aspect of the present invention provides a performance analysis and evaluation method for a command and control system, comprising:

[0011] Acquire real-time data processing performance analysis indicators of the command and control system, wherein the real-time data processing performance analysis indicators include: accuracy indicator, integrity indicator, continuity indicator and real-time indicator;

[0012] Analyzing and calculating the real-time data processing performance analysis index, including:

[0013] Establishing an accuracy evaluation function, calculating the accuracy index, and obtaining an accuracy index calculation result r1;

[0014] Establishing an integrity evaluation function, calculating the integrity index, and obtaining the integrity index calculation result r2;

[0015] Establishing a continuity evaluation function, calculating the continuity index, and obtaining a continuity index calculation result r3;

[0016] Establishing a real-time evaluation function, calculating the real-time index, and obtaining a real-time index calculation result r4;

[0017] The seven-scale comparison calculation method is used to calculate the weights of the real-time data processing performance indicators to form a weight vector W;

[0018] The accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4 form a real-time processing performance evaluation matrix R;

[0019] Perform matrix transformation Obtaining a comprehensive evaluation result of the real-time processing performance, and outputting the comprehensive evaluation result of the real-time processing performance.

[0020] Optionally, the method further comprises:

[0021] Acquire the aggregation and distribution performance analysis index of the command and control system, wherein the aggregation and distribution performance analysis index of the command and control system includes: data format correctness index and real-time index;

[0022] The aggregation and distribution performance analysis index is analyzed, evaluated and calculated, including:

[0023] Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules;

[0024] Under the condition that the preset rules are met, the equipment original data is subjected to normative analysis, and the ratio of the correct number of original data transmissions to the total equipment original data is calculated to obtain the data format correctness index calculation result r1;

[0025] A real-time function is established, and the real-time index calculation result r2 is calculated using the real-time function:

[0026]

[0027] Among them, ft is the equipment delay, M t is the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay;

[0028] The seven-scale comparison calculation method is used to calculate the weights of the equipment aggregation and distribution performance indicators to form a weight vector W;

[0029] The correctness index calculation result r1 and the real-time index calculation result r2 are used to form a collection and distribution performance analysis evaluation matrix R;

[0030] Perform matrix transformation Obtain a comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

[0031] Optionally, the establishing of the accuracy evaluation function, calculating the accuracy index, and obtaining the accuracy index calculation result r1 includes:

[0032] Select the true value of the received data;

[0033] Calculate the processing accuracy of each real-time processing solution;

[0034] The accuracy evaluation function is established as follows:

[0035]

[0036] in, is the mean of processing accuracy, f p max is the ideal maximum value of the processing error, f p min The ideal minimum value of processing error, f pe is the position deviation error of the processing result.

[0037] Optionally, selecting a true value of the received data includes:

[0038] For the analysis of optical radar positioning results, high-precision GPS data is selected as the true value;

[0039] For the analysis of GPS positioning results, the results of a time window are accumulated and smoothed, and then the true value is fitted.

[0040] Optionally, the calculating the processing accuracy of each real-time processing solution includes:

[0041] Calculate the difference between the track point of the processing result at the same time and the corresponding true value track point, using the following formula:

[0042]

[0043] In the formula, S is the standard deviation of spatial distance error, N is the number of points to be evaluated, and x TRUE , x are the real ballistic point position and the processed ballistic point position respectively.

[0044] Optionally, the establishing of the integrity evaluation function, calculating the integrity index, and obtaining the integrity index calculation result r2 comprises:

[0045] The ratio of the effective track duration of the calculation processing scheme to the total flight duration of the entire mission target is established to establish the integrity evaluation function as follows:

[0046] g pv =f pv / F;

[0047] Among them, fpv is the effective processing track duration, and F is the total target flight duration.

[0048] Optionally, the establishing of the continuity evaluation function, calculating the continuity index, and obtaining the continuity index calculation result r3 comprises:

[0049] Establish the continuity evaluation function g ps as follows:

[0050]

[0051] Among them, f ps The number of track interruptions processed in real time during the mission, m ps The ideal minimum value for handling interrupts, M ps The ideal maximum value for handling interrupts.

[0052] Optionally, the establishing of a real-time evaluation function, calculating the real-time index, and obtaining a real-time index calculation result r4 includes:

[0053] The real-time evaluation function is established as follows:

[0054]

[0055] Among them, f d To handle the delay, M pd The maximum value of the processing delay allowed by this solution, m pd The minimum processing delay.

[0056] Another aspect of the present invention provides a performance analysis and evaluation device for a command and control system, comprising:

[0057] An acquisition module is used to acquire real-time data processing performance analysis indicators of the command and control system, wherein the real-time data processing performance analysis indicators include: accuracy indicators, integrity indicators, continuity indicators and real-time indicators;

[0058] An indicator calculation module, used to analyze and calculate the real-time data processing performance analysis indicator;

[0059] The indicator calculation module analyzes and calculates the real-time data processing performance analysis indicator in the following manner:

[0060] Establishing an accuracy evaluation function, calculating the accuracy index, and obtaining an accuracy index calculation result r1;

[0061] Establishing an integrity evaluation function, calculating the integrity index, and obtaining the integrity index calculation result r2;

[0062] Establishing a continuity evaluation function, calculating the continuity index, and obtaining a continuity index calculation result r3;

[0063] Establishing a real-time evaluation function, calculating the real-time index, and obtaining a real-time index calculation result r4;

[0064] A weight calculation module is used to calculate the weight of the real-time data processing performance index using a seven-scale comparison calculation method to form a weight vector W;

[0065] A generating module, used for forming a real-time processing performance evaluation matrix R by combining the accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4;

[0066] Evaluation module for matrix transformation Obtaining a comprehensive evaluation result of the real-time processing performance, and outputting the comprehensive evaluation result of the real-time processing performance.

[0067] Optionally,

[0068] The acquisition module is further used to acquire the aggregation and distribution performance analysis indicators of the command and control system, and the aggregation and distribution performance analysis indicators of the command and control system include: data format correctness indicators and real-time indicators;

[0069] The indicator calculation module is also used to analyze, evaluate and calculate the aggregation and distribution performance analysis indicators:

[0070] The indicator calculation module analyzes, evaluates and calculates the aggregation and distribution performance analysis indicator in the following manner:

[0071] Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules;

[0072] Under the condition that the preset rules are met, the equipment original data is subjected to normative analysis, and the ratio of the correct number of original data transmissions to the total equipment original data is calculated to obtain the data format correctness index calculation result r1;

[0073] A real-time function is established, and the real-time index calculation result r2 is calculated using the real-time function:

[0074]

[0075] Among them, ft is the equipment delay, M t is the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay;

[0076] The weight calculation module is also used to calculate the weight of the equipment aggregation and distribution performance index using a seven-scale comparison calculation method to form a weight vector W;

[0077] The generating module is further used to form a collection and distribution performance analysis evaluation matrix R by combining the correctness index calculation result r1 and the real-time index calculation result r2;

[0078] Evaluation module, also used to perform matrix transformation Obtain a comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

[0079] It can be seen that the performance analysis and evaluation method and device of the command and control system provided by the present invention can make full use of a large amount of test data collected in the command and control center, automatically analyze the data collection and distribution capabilities and data processing capabilities of the measurement and control equipment of the command and control system, and output evaluation results, thereby providing a scientific basis and auxiliary means for the intelligent command decision-making. BRIEF DESCRIPTION OF THE DRAWINGS

[0080] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0081] Figure 1 A flow chart of a performance analysis and evaluation method for a command and control system provided by an embodiment of the present invention;

[0082] Figure 2 A schematic diagram of the structure of a performance analysis and evaluation device for a command and control system provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0083] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0084] Figure 1 A flowchart showing a method for analyzing and evaluating the performance of a command and control system according to an embodiment of the present invention is shown. Figure 1 The performance analysis and evaluation method of the command and control system provided by the embodiment of the present invention includes:

[0085] S1, obtaining the real-time data processing performance analysis indicators of the command and control system, which include: accuracy indicator, integrity indicator, continuity indicator and real-time indicator;

[0086] S2, analyzes and calculates the real-time data processing performance analysis indicators, including:

[0087] Establish an accuracy evaluation function, calculate the accuracy index, and obtain the accuracy index calculation result r1;

[0088] Establish an integrity evaluation function, calculate the integrity index, and obtain the integrity index calculation result r2;

[0089] Establish a continuity evaluation function, calculate the continuity index, and obtain the continuity index calculation result r3;

[0090] Establish a real-time evaluation function, calculate the real-time index, and obtain the real-time index calculation result r4;

[0091] S3, using a seven-scale comparison calculation method to calculate the weights of the real-time data processing performance indicators to form a weight vector W;

[0092] S4, forming a real-time processing performance evaluation matrix R by using the accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4;

[0093] S5, perform matrix transformation Obtain a comprehensive evaluation result of the real-time processing performance, and output the comprehensive evaluation result of the real-time processing performance.

[0094] As an optional implementation of the embodiment of the present invention, an accuracy evaluation function is established, and the accuracy index is calculated to obtain the accuracy index calculation result r1 including:

[0095] Select the true value of the received data;

[0096] Calculate the processing accuracy of each real-time processing solution;

[0097] The accuracy evaluation function is established as follows:

[0098]

[0099] in, is the mean of processing accuracy, fpmax is the ideal maximum value of the processing error, f pmin The ideal minimum value of processing error, f pe is the position deviation error of the processing result.

[0100] As an optional implementation of the embodiment of the present invention, selecting the true value of the received data includes:

[0101] For the analysis of optical radar positioning results, high-precision GPS data is selected as the true value;

[0102] For the analysis of GPS positioning results, the results of a time window are accumulated and smoothed, and then the true value is fitted.

[0103] As an optional implementation of the embodiment of the present invention, calculating the processing accuracy of each real-time processing solution includes:

[0104] Calculate the difference between the track point of the processing result at the same time and the corresponding true value track point, using the following formula:

[0105]

[0106] In the formula, S is the standard deviation of spatial distance error, N is the number of points to be evaluated, and x TRUE , x are the real ballistic point position and the processed ballistic point position respectively.

[0107] When analyzing and evaluating the real-time data processing performance, the present invention can analyze and evaluate the processing accuracy. The specific implementation method is as follows:

[0108] 1. True value selection:

[0109] Different strategies can be selected according to different positioning types. For the analysis of optical radar positioning results, high-precision GPS data can be used as the true value. For the analysis of GPS positioning results, the results of a time window are accumulated and smoothed to fit the true value.

[0110] 2. Calculate the processing accuracy of each real-time processing solution:

[0111] The accuracy of the processing is evaluated by the track processing accuracy. The track processing accuracy index is defined as the difference between the track point of the processing result and the corresponding true value track point at the same time, that is, the standard deviation of the spatial distance error. It is defined as:

[0112]

[0113] Where N is the number of evaluation points, x TRUE , x are the real ballistic point position and the processed ballistic point position respectively. The smaller the position deviation, the better the processing accuracy.

[0114] 3. Calculation of processing accuracy index:

[0115] The processing accuracy evaluation function is established as follows:

[0116]

[0117] in, is the mean of processing accuracy, f pmax is the ideal maximum value of the processing error, f pmin The ideal minimum value of processing error, f pe is the position deviation error of the processing result.

[0118] As an optional implementation of the embodiment of the present invention, an integrity evaluation function is established, and the integrity index is calculated to obtain the integrity index calculation result r2 including:

[0119] The ratio of the effective track time of the processing scheme to the total flight time of the entire mission target is calculated, and the integrity evaluation function is established as:

[0120] g pv =f pv / F;

[0121] Among them, fpv is the effective processing track duration, and F is the total target flight duration.

[0122] When analyzing and evaluating the real-time data processing performance, the present invention can analyze and evaluate the processing integrity. The specific implementation method is as follows:

[0123] Integrity: refers to the ratio of the effective processing time of a certain processing scheme of the system to the total flight time of the entire mission target. The longer the processing time, the better the integrity, which is the larger the optimal type. The integrity evaluation function is:

[0124] g pv =f pv / F

[0125] Among them, fpv and F are the effective processing track time and the total target flight time respectively.

[0126] As an optional implementation of the embodiment of the present invention, a continuity evaluation function is established, and the continuity index is calculated to obtain the continuity index calculation result r3 including:

[0127] The continuity evaluation function gps is established as follows:

[0128]

[0129] Among them, f ps The number of track interruptions processed in real time during the mission, m psThe ideal minimum value for handling interrupts, M ps The ideal maximum value for handling interrupts.

[0130] When analyzing and evaluating the real-time data processing performance, the present invention can analyze and evaluate the processing continuity. The specific implementation method is as follows:

[0131] The number of interruptions in real-time data processing is used as an indicator to evaluate the continuity of processing. The fewer the interruptions in processing, the better the continuity of processing. ps The continuity evaluation function g is established as the number of track interruptions processed in real time during the mission process. ps as follows:

[0132]

[0133] Among them, m ps and M ps are the ideal minimum and maximum values ​​for processing interrupts. ps is 0.

[0134] As an optional implementation of the embodiment of the present invention, a real-time evaluation function is established to calculate the real-time index, and the real-time index calculation result r4 includes:

[0135] The real-time evaluation function is established as follows:

[0136]

[0137] Among them, f d To handle the delay, M pd The maximum value of the processing delay allowed by this solution, m pd The minimum processing delay.

[0138] When analyzing and evaluating the real-time data processing performance, the present invention can analyze and evaluate the real-time processing, and the specific implementation method is as follows:

[0139] The real-time processing is reflected in the delay of real-time processing, which refers to the difference between the time when a certain scheme track data is received and the time when the system receives the original measurement data corresponding to the track result. The processing process of this indicator is the same as the real-time measurement data.

[0140] The smaller the processing delay, the better the real-time performance. Suppose the processing delay is f d , the real-time evaluation function is established as follows:

[0141]

[0142] Among them, M pd The maximum value of the processing delay allowed by this solution, m pd The minimum processing delay.

[0143] Based on the above-obtained index calculation results, the present invention adopts a seven-scale comparison calculation method to calculate the real-time data processing performance index weights to form a weight vector W, and uses the accuracy, integrity, continuity, and real-time index calculation results of the real-time processing performance to form a real-time processing performance evaluation matrix R:

[0144]

[0145] Final matrix transformation Obtain and output comprehensive evaluation results of real-time processing performance to provide scientific basis and auxiliary means for intelligent command decision-making.

[0146] As an optional implementation of the embodiment of the present invention, a seven-scale comparison calculation method is used to calculate the weight of the real-time data processing performance index to form a weight vector W including:

[0147] Determine the indicator weight scale;

[0148] According to the indicator weight scale, a judgment matrix of the bottom-level indicators relative to the directly related upper-level indicators is constructed. The general formula of the matrix is ​​as follows:

[0149]

[0150] Where: f ij Indicates the relative importance of the i-th indicator and the j-th indicator;

[0151] The square root method was used to calculate the indicator weights and a consistency test was performed.

[0152] As an optional implementation of the embodiment of the present invention, the square root method is used to calculate the indicator weight, and the consistency check includes:

[0153] Calculate the product of each row of the judgment matrix and take it to the nth power to get the geometric mean M i :

[0154]

[0155] The geometric mean M i Normalize the index to get its weight w i :

[0156]

[0157] Among them, w i is the weight vector after the normalization of the eigenvector;

[0158] Calculate and obtain the index weight vector W of the required level;

[0159] Calculate the maximum eigenvalue λ of the judgment matrix max ;

[0160] The judgment matrix is ​​checked for consistency and the consistency index function is established as follows:

[0161]

[0162] Among them, CI is the consistency index, λ max is the maximum eigenvalue of the judgment matrix, and n is the latitude of the judgment matrix.

[0163] In specific implementation, the present invention adopts the seven-scale comparison calculation method to calculate the weight of the real-time data processing performance index and form the weight vector W, and performs the following operations:

[0164] a. Determine the indicator weight scale:

[0165] According to the degree of importance, the indicators subordinate to a certain indicator in the upper layer are compared to judge the importance of each indicator. The items adopt a comparison scale of 1 to 7 (the meaning is shown in Table 1).

[0166] Table 1 Judgment matrix construction method

[0167]

[0168] b. Construction of judgment matrix:

[0169] Through the indicator weight scale shown in step a, a judgment matrix of the bottom-level indicators relative to the directly related upper-level indicators is constructed. The general formula of the matrix is ​​as follows:

[0170]

[0171] Where f ij Indicates the relative importance of the i-th indicator and the j-th indicator;

[0172] c. Calculation of indicator weights and consistency test:

[0173] The specific calculation steps for calculating the index weight using the square root method are as follows:

[0174] ① Calculate the product of each row of the judgment matrix G and take it to the nth power to get the geometric mean M i :

[0175]

[0176] ② For M i Normalization processing is performed to obtain the weight w of the indicator i :

[0177]

[0178] Get the indicator weight vector W of the required level.

[0179] Calculate the maximum eigenvalue λ of the judgment matrix max ;

[0180] In order to ensure the overall rationality and transferability of the evaluation indicators in the multi-level structure of performance evaluation, it is necessary to conduct a consistency test on the judgment matrix. Assume that the consistency index is CI, then

[0181]

[0182] Among them, λ max is the maximum eigenvalue of the judgment matrix; n is the latitude of the judgment matrix, w i is the weight vector after the normalization of the feature vector. When CI = 0, there is complete consistency; when CI is close to 0, there is a relatively satisfactory consistency; the larger the CI, the lower the satisfaction with the consistency.

[0183] As an optional implementation of the embodiment of the present invention, the performance analysis and evaluation method of the command and control system provided by the embodiment of the present invention further includes:

[0184] Obtain the aggregation and distribution performance analysis indicators of the command and control system, which include: data format correctness indicators and real-time indicators;

[0185] Analyze and evaluate the aggregation and distribution performance analysis indicators, including:

[0186] Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules;

[0187] In the case of meeting the preset rules, the equipment original data is normatively analyzed, the ratio of the correct number of original data transmissions to the total equipment original data is calculated, and the calculation result r1 of the data format correctness index is obtained;

[0188] Establish a real-time function and use it to calculate the real-time index calculation result r2:

[0189]

[0190] Among them, ft is the equipment delay, M t is the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay;

[0191] The seven-scale comparison calculation method is used to calculate the weights of the equipment aggregation and distribution performance indicators to form a weight vector W;

[0192] The correctness index calculation result r1 and the real-time index calculation result r2 are used to form a collection and distribution performance analysis evaluation matrix R;

[0193] Perform matrix transformation Obtain the comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

[0194] The present invention can also evaluate the aggregation and distribution performance analysis indicators of the command and control system, and the specific implementation method is as follows:

[0195] 1. Check the correctness of the format:

[0196] The collection and distribution analysis module checks whether the information exchange relationship between the command center and the measurement and control equipment meets the regulations and requirements of the task information process for specific tasks. At present, the main fields included in the information transmission format are: source, destination, information category, data length and data content. Therefore, the information format and exchange relationship can be checked through the coding detection of the above fields. The correctness of each field in the data format is automatically checked against the information transmission specification, and the data format of the source, destination, information category, etc. of each equipment data of the specified task is checked.

[0197] 2. Calculation of aggregation and distribution performance analysis and evaluation indicators:

[0198] (1) Data format correctness:

[0199] After normative analysis of the original data of the equipment on the test network, the ratio of the correct number of original data transmissions of the measurement equipment received by the command and control center of this mission to the total original data of the equipment is statistically represented. The evaluation function is defined as:

[0200] g t =f t / F t

[0201] In the formula, f t Transmit the correct amount of raw data for measuring equipment; F t The number of all equipment participating in the mission.

[0202] (2) Real-time:

[0203] Real-time performance is reflected in the delay of data transmission, which refers to the difference between the time when the system gathers and distributes the received data packet and the time when the data packet is received. This indicator is of the smaller the better type, that is, the smaller the delay, the better the real-time performance. Assuming the equipment delay is ft, the real-time function is established as follows:

[0204]

[0205] Among them, M t is the ideal maximum value of data transmission delay, mt It is the ideal minimum value of data transmission delay.

[0206] 3. Use the seven-scale comparison calculation method to calculate the weights of the aggregation and distribution performance indicators and form a weight vector W.

[0207] As an optional implementation of the embodiment of the present invention, a seven-scale comparison calculation method is used to calculate the weight of the equipment aggregation distribution performance index to form a weight vector W including:

[0208] Determine the indicator weight scale;

[0209] According to the indicator weight scale, a judgment matrix of the bottom-level indicators relative to the directly related upper-level indicators is constructed. The general formula of the matrix is ​​as follows:

[0210]

[0211] Where: f ij Indicates the relative importance of the i-th indicator and the j-th indicator;

[0212] The square root method was used to calculate the indicator weights and a consistency test was performed.

[0213] As an optional implementation of the embodiment of the present invention, the square root method is used to calculate the indicator weight, and the consistency check includes:

[0214] Calculate the product of each row of the judgment matrix and take it to the nth power to get the geometric mean M i :

[0215]

[0216] The geometric mean M i Normalize and get the weight w of the indicator i :

[0217]

[0218] Among them, w i is the weight vector after the normalization of the eigenvector;

[0219] Calculate and obtain the index weight vector W of the required level;

[0220] Calculate the maximum eigenvalue λ of the judgment matrix max ;

[0221] The judgment matrix is ​​checked for consistency and the consistency index function is established as follows:

[0222]

[0223] Among them, CI is the consistency index, λmax is the maximum eigenvalue of the judgment matrix, and n is the latitude of the judgment matrix.

[0224] In specific implementation, the present invention uses the seven-scale comparison calculation method to calculate the weight of the equipment aggregation distribution performance index to form the weight vector W, and performs the following operations:

[0225] a. Determine the indicator weight scale:

[0226] According to the degree of importance, the indicators subordinate to a certain indicator in the upper layer are compared to judge the importance of each indicator. The items adopt a comparison scale of 1 to 7 (the meaning is shown in Table 1).

[0227] Table 1 Judgment matrix construction method

[0228]

[0229] b. Construction of judgment matrix:

[0230] Through the indicator weight scale shown in step a, a judgment matrix of the bottom-level indicators relative to the directly related upper-level indicators is constructed. The general formula of the matrix is ​​as follows:

[0231]

[0232] Where f ij Indicates the relative importance of the i-th indicator and the j-th indicator;

[0233] c. Calculation of indicator weights and consistency test:

[0234] The specific calculation steps for calculating the index weight using the square root method are as follows:

[0235] ③ Calculate the product of each row of the judgment matrix G and take it to the nth power to get the geometric mean M i :

[0236]

[0237] ④ For M i Normalization processing is performed to obtain the weight w of the indicator i :

[0238]

[0239] Get the indicator weight vector W of the required level.

[0240] Calculate the maximum eigenvalue λ of the judgment matrix max ;

[0241] In order to ensure the overall rationality and transferability of the evaluation indicators in the multi-level structure of performance evaluation, it is necessary to conduct a consistency test on the judgment matrix. Assume that the consistency index is CI, then

[0242]

[0243] Among them, λ max is the maximum eigenvalue of the judgment matrix; n is the latitude of the judgment matrix, w i is the weight vector after the normalization of the feature vector. When CI = 0, there is complete consistency; when CI is close to 0, there is a relatively satisfactory consistency; the larger the CI, the lower the satisfaction with the consistency.

[0244] 4. Use the calculation results of the correctness and real-time indicators of the aggregation and distribution performance to form the aggregation and distribution performance evaluation matrix R.

[0245]

[0246] 5. Final matrix transformation Obtain and output comprehensive evaluation results of aggregation and distribution performance to provide scientific basis and auxiliary means for intelligent command decision-making.

[0247] It can be seen that the performance analysis and evaluation method of the command and control system provided by the present invention can make full use of a large amount of test data collected in the command and control center, automatically analyze the data collection and distribution capabilities and data processing capabilities of the measurement and control equipment of the command and control system, and output evaluation results, thereby providing a scientific basis and auxiliary means for the intelligent command decision-making.

[0248] Figure 2 The structure diagram of the performance analysis and evaluation device of the command and control system provided by the embodiment of the present invention is shown. The performance analysis and evaluation device of the command and control system applies the above method. The following is only a brief description of the structure of the performance analysis and evaluation device of the command and control system. For other matters not covered, please refer to the relevant description of the performance analysis and evaluation method of the command and control system. Figure 2 , the performance analysis and evaluation device of the charge and control system provided by the embodiment of the present invention comprises:

[0249] An acquisition module is used to acquire the real-time data processing performance analysis indicators of the command and control system. The real-time data processing performance analysis indicators include: accuracy indicators, integrity indicators, continuity indicators and real-time indicators;

[0250] An indicator calculation module is used to analyze and calculate the real-time data processing performance analysis indicators;

[0251] The indicator calculation module analyzes and calculates the real-time data processing performance analysis indicators in the following ways:

[0252] Establish an accuracy evaluation function, calculate the accuracy index, and obtain the accuracy index calculation result r1;

[0253] Establish an integrity evaluation function, calculate the integrity index, and obtain the integrity index calculation result r2;

[0254] Establish a continuity evaluation function, calculate the continuity index, and obtain the continuity index calculation result r3;

[0255] Establish a real-time evaluation function, calculate the real-time index, and obtain the real-time index calculation result r4;

[0256] A weight calculation module is used to calculate the weight of the real-time data processing performance index using a seven-scale comparison calculation method to form a weight vector W;

[0257] A generation module, used to form a real-time processing performance evaluation matrix R by using the accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4;

[0258] Evaluation module for matrix transformation Obtain a comprehensive evaluation result of the real-time processing performance, and output the comprehensive evaluation result of the real-time processing performance.

[0259] As an optional implementation of the embodiment of the present invention,

[0260] The acquisition module is also used to acquire the aggregation and distribution performance analysis indicators of the command and control system. The aggregation and distribution performance analysis indicators of the command and control system include: data format correctness indicators and real-time indicators;

[0261] The indicator calculation module is also used to analyze and evaluate the aggregation and distribution performance analysis indicators:

[0262] The indicator calculation module analyzes, evaluates and calculates the aggregation and distribution performance analysis indicators in the following ways:

[0263] Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules;

[0264] In the case of meeting the preset rules, the equipment original data is normatively analyzed, the ratio of the correct number of original data transmissions to the total equipment original data is calculated, and the calculation result r1 of the data format correctness index is obtained;

[0265] Establish a real-time function and use it to calculate the real-time index calculation result r2:

[0266]

[0267] Among them, ft is the equipment delay, M tis the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay;

[0268] The weight calculation module is also used to calculate the weight of the equipment aggregation and distribution performance index using a seven-scale comparison calculation method to form a weight vector W;

[0269] The generation module is also used to form a collection and distribution performance analysis evaluation matrix R by combining the correctness index calculation result r1 and the real-time index calculation result r2;

[0270] Evaluation module, also used to perform matrix transformation Obtain the comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

[0271] As an optional implementation of the embodiment of the present invention, the index calculation module establishes an accuracy evaluation function in the following manner, calculates the accuracy index, and obtains the accuracy index calculation result r1:

[0272] Select the true value of the received data;

[0273] Calculate the processing accuracy of each real-time processing solution;

[0274] The accuracy evaluation function is established as follows:

[0275]

[0276] in, is the mean of processing accuracy, f p max is the ideal maximum value of the processing error, f p min The ideal minimum value of processing error, f pe is the position deviation error of the processing result.

[0277] As an optional implementation of the embodiment of the present invention, the indicator calculation module selects the true value of the received data in the following manner:

[0278] For the analysis of optical radar positioning results, high-precision GPS data is selected as the true value;

[0279] For the analysis of GPS positioning results, the results of a time window are accumulated and smoothed, and then the true value is fitted.

[0280] As an optional implementation of the embodiment of the present invention, the indicator calculation module calculates the processing accuracy of each real-time processing solution in the following manner:

[0281] Calculate the difference between the track point of the processing result at the same time and the corresponding true value track point, using the following formula:

[0282]

[0283] In the formula, S is the standard deviation of spatial distance error, N is the number of points to be evaluated, and x TRUE , x are the real ballistic point position and the processed ballistic point position respectively.

[0284] As an optional implementation of the embodiment of the present invention, the index calculation module establishes an integrity evaluation function in the following manner, calculates the integrity index, and obtains the integrity index calculation result r2:

[0285] The ratio of the effective track time of the processing scheme to the total flight time of the entire mission target is calculated, and the integrity evaluation function is established as:

[0286] g pv =f pv / F;

[0287] Among them, fpv is the effective processing track duration, and F is the total target flight duration.

[0288] As an optional implementation of the embodiment of the present invention, the index calculation module establishes a continuity evaluation function in the following manner, calculates the continuity index, and obtains the continuity index calculation result r3:

[0289] Establish continuity evaluation function g ps as follows:

[0290] Small value, M ps The ideal maximum value for handling interrupts.

[0291] As an optional implementation of the embodiment of the present invention, the index calculation module establishes a real-time evaluation function in the following manner, calculates the real-time index, and obtains the real-time index calculation result r4:

[0292] The real-time evaluation function is established as follows:

[0293]

[0294] Among them, f d To handle the delay, M pd The maximum value of the processing delay allowed by this solution, m pd The minimum processing delay.

[0295] It can be seen that the performance analysis and evaluation device of the command and control system provided by the present invention can make full use of a large amount of test data collected in the command and control center, automatically analyze the data collection and distribution capabilities and data processing capabilities of the command and control system's measurement and control equipment, and output evaluation results, thereby providing a scientific basis and auxiliary means for intelligent command decision-making.

[0296] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A performance analysis and evaluation method for a command and control system, characterized in that: include: Acquire real-time data processing performance analysis indicators of the command and control system, wherein the real-time data processing performance analysis indicators include: accuracy indicator, integrity indicator, continuity indicator and real-time indicator; Analyzing and calculating the real-time data processing performance analysis index, including: Establishing an accuracy evaluation function, calculating the accuracy index, and obtaining an accuracy index calculation result r1; Establishing an integrity evaluation function, calculating the integrity index, and obtaining the integrity index calculation result r2; Establishing a continuity evaluation function, calculating the continuity index, and obtaining a continuity index calculation result r3; Establishing a real-time evaluation function, calculating the real-time index, and obtaining a real-time index calculation result r4; The seven-scale comparison calculation method is used to calculate the weights of the real-time data processing performance indicators to form a weight vector W; The accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4 form a real-time processing performance evaluation matrix R; Perform matrix transformation Obtaining a comprehensive evaluation result of the real-time processing performance, and outputting the comprehensive evaluation result of the real-time processing performance.

2. The method according to claim 1, characterized in that Also includes: Acquire the aggregation and distribution performance analysis index of the command and control system, wherein the aggregation and distribution performance analysis index of the command and control system includes: data format correctness index and real-time index; The aggregation and distribution performance analysis index is analyzed, evaluated and calculated, including: Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules; Under the condition that the preset rules are met, the equipment original data is subjected to normative analysis, and the ratio of the correct number of original data transmissions to the total equipment original data is calculated to obtain the data format correctness index calculation result r1; A real-time function is established, and the real-time index calculation result r2 is calculated using the real-time function: Among them, ft is the equipment delay, M t is the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay; The seven-scale comparison calculation method is used to calculate the weights of the equipment aggregation and distribution performance indicators to form a weight vector W; The correctness index calculation result r1 and the real-time index calculation result r2 are used to form a collection and distribution performance analysis evaluation matrix R; Perform matrix transformation Obtain a comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

3. The method according to claim 1, characterized in that The accuracy evaluation function is established, the accuracy index is calculated, and the accuracy index calculation result r1 is obtained, which includes: Select the true value of the received data; Calculate the processing accuracy of each real-time processing solution; The accuracy evaluation function is established as follows: in, is the mean of processing accuracy, f pmax is the ideal maximum value of the processing error, f pmin The ideal minimum value of processing error, f pe is the position deviation error of the processing result.

4. The method according to claim 3, characterized in that The selecting of the true value of the received data comprises: For the analysis of optical radar positioning results, high-precision GPS data is selected as the true value; For the analysis of GPS positioning results, the results of a time window are accumulated and smoothed, and then the true value is fitted.

5. The method according to claim 3, characterized in that: The calculation of the processing accuracy of each real-time processing solution includes: Calculate the difference between the track point of the processing result at the same time and the corresponding true value track point, using the following formula: In the formula, S is the standard deviation of spatial distance error, N is the number of points to be evaluated, and x TRUE , x are the real ballistic point position and the processed ballistic point position respectively.

6. The method according to claim 1, characterized in that The establishment of the integrity evaluation function, the calculation of the integrity index, and the acquisition of the integrity index calculation result r2 include: The ratio of the effective track duration of the calculation processing scheme to the total flight duration of the entire mission target is established to establish the integrity evaluation function as follows: g pv =f pv / F; Among them, fpv is the effective processing track duration, and F is the total target flight duration.

7. The method according to claim 1, characterized in that The establishment of the continuity evaluation function, the calculation of the continuity index, and the obtaining of the continuity index calculation result r3 include: Establish the continuity evaluation function g ps as follows: Among them, f ps The number of track interruptions processed in real time during the mission, m ps The ideal minimum value for handling interrupts, M ps The ideal maximum value for handling interrupts.

8. The method according to claim 1, characterized in that The real-time evaluation function is established, the real-time index is calculated, and the real-time index calculation result r4 is obtained, which includes: The real-time evaluation function is established as follows: Among them, f d To handle the delay, M pd The maximum value of the processing delay allowed by this solution, m pd The minimum processing delay.

9. A performance analysis and evaluation device for a command and control system, characterized in that: include: An acquisition module is used to acquire real-time data processing performance analysis indicators of the command and control system, wherein the real-time data processing performance analysis indicators include: accuracy indicators, integrity indicators, continuity indicators and real-time indicators; An indicator calculation module, used to analyze and calculate the real-time data processing performance analysis indicator; The indicator calculation module analyzes and calculates the real-time data processing performance analysis indicator in the following manner: Establishing an accuracy evaluation function, calculating the accuracy index, and obtaining an accuracy index calculation result r1; Establishing an integrity evaluation function, calculating the integrity index, and obtaining the integrity index calculation result r2; Establishing a continuity evaluation function, calculating the continuity index, and obtaining a continuity index calculation result r3; Establishing a real-time evaluation function, calculating the real-time index, and obtaining a real-time index calculation result r4; A weight calculation module is used to calculate the weight of the real-time data processing performance index using a seven-scale comparison calculation method to form a weight vector W; A generating module, used for forming a real-time processing performance evaluation matrix R by combining the accuracy index calculation result r1, the integrity index calculation result r2, the continuity index calculation result r3 and the real-time index calculation result r4; Evaluation module for matrix transformation Obtaining a comprehensive evaluation result of the real-time processing performance, and outputting the comprehensive evaluation result of the real-time processing performance.

10. The device according to claim 9, characterized in that The acquisition module is further used to acquire the aggregation and distribution performance analysis indicators of the command and control system, and the aggregation and distribution performance analysis indicators of the command and control system include: data format correctness indicators and real-time indicators; The indicator calculation module is also used to analyze, evaluate and calculate the aggregation and distribution performance analysis indicators: The indicator calculation module analyzes, evaluates and calculates the aggregation and distribution performance analysis indicator in the following manner: Check whether the information exchange between the command and control center and the measurement and control equipment complies with the preset rules; Under the condition that the preset rules are met, the equipment original data is subjected to normative analysis, and the ratio of the correct number of original data transmissions to the total equipment original data is calculated to obtain the data format correctness index calculation result r1; A real-time function is established, and the real-time index calculation result r2 is calculated using the real-time function: Among them, ft is the equipment delay, M t is the ideal maximum value of data transmission delay, m t is the ideal minimum value of data transmission delay; The weight calculation module is also used to calculate the weight of the equipment aggregation and distribution performance index using a seven-scale comparison calculation method to form a weight vector W; The generating module is further used to form a collection and distribution performance analysis evaluation matrix R by combining the correctness index calculation result r1 and the real-time index calculation result r2; Evaluation module, also used to perform matrix transformation Obtain a comprehensive evaluation result of the aggregation and distribution performance, and output the comprehensive evaluation result of the aggregation and distribution performance.

Citation Information

Patent Citations

  • Aerospace measurement and control resource scheduling algorithm performance evaluation method

    CN115801601A

Cited By

  • Method and device for analyzing and evaluating equipment tracking performance of command and control system

    CN118747576A