An efficiency evaluation method from task link and application scene
By constructing a spacecraft mission link and conducting a comprehensive analysis of the time chain, accuracy chain, and cost-effectiveness chain, the static problem of existing performance evaluation methods is solved, enabling dynamic evaluation and optimization guidance of spacecraft mission performance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHINA ACAD OF LAUNCH VEHICLE TECH
- Filing Date
- 2024-10-29
- Publication Date
- 2026-07-07
AI Technical Summary
Existing performance evaluation methods are too static and fail to comprehensively consider the macro performance indicators of the mission chain and the performance indicators of the aircraft itself. They cannot fully evaluate the mission completion performance of the aircraft under time, accuracy and cost constraints.
The mission chain of the aircraft is constructed. Through comprehensive analysis of the time chain, accuracy chain and cost-effectiveness chain, the effectiveness of the aircraft in completing the mission is calculated. The weight and effectiveness value of each indicator are determined by methods such as the analytic hierarchy process and the sigmoid function, and a dynamic effectiveness evaluation model is established.
It enables dynamic evaluation of aircraft mission effectiveness, comprehensively considering time, accuracy, and cost, and provides a more comprehensive evaluation of mission completion, which can guide the optimization and improvement of aircraft.
Smart Images

Figure CN119515142B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a performance evaluation method based on task chains and application scenarios, belonging to the field of system performance evaluation technology. Background Technology
[0002] The operational effectiveness of an aircraft system in completing its mission is the overall goal pursued in the development and use of the aircraft. Traditional effectiveness assessment methods mainly focus on the performance of the aircraft itself or a certain part of its performance, such as the effectiveness of the support system or command and control. Classic methods include the Analytic Hierarchy Process (AHP), fuzzy comprehensive evaluation method, grey whitening weighted function clustering method, TOPSIS comprehensive evaluation method, and ADC effectiveness assessment method. These methods ignore the aircraft's performance in actual missions and the comprehensive impact of different missions and scenarios on the aircraft's performance. The corresponding effectiveness assessment models are biased towards static values and cannot reflect the dynamic changes in system effectiveness in real time.
[0003] With the application of information technology and other advanced military technologies, performance evaluation methods based on mission links such as OODA loops are becoming increasingly important. While complex network theory and graph theory techniques have made some progress in related performance evaluation problems, most research still focuses on macroscopic properties such as network connectivity, robustness, and overall stability. Although these macroscopic indicators can provide a preliminary understanding of the overall performance of the link, they often neglect in-depth analysis and optimization of the system's own performance. There is an urgent need for a new evaluation method that can comprehensively consider both the macroscopic properties of the mission link and the performance characteristics of the aircraft itself. This would not only allow for a more comprehensive evaluation of the entire mission link's performance but also provide specific guidance for aircraft optimization and improvement.
[0004] The effectiveness of an aircraft system is strongly correlated with its own performance, mission, and application scenario. In practical use, it is necessary to consider whether the basic conditions for the OODA loop / link to complete the mission are met, namely, completing the mission within the specified time and ensuring the accuracy of critical links, and also to consider the cost of completing the mission. However, a good evaluation method still lacks a comprehensive approach to assessing the effectiveness and cost of an aircraft in completing a mission under time and accuracy constraints. Summary of the Invention
[0005] The technical problem solved by this invention is to overcome the shortcomings of the prior art and provide a performance evaluation method based on the mission link and application scenario, which solves the problems of the prior art's performance evaluation method being too static and unable to simultaneously consider the macro performance indicators of the mission link and the performance indicators of the aircraft.
[0006] The technical solution of this invention is:
[0007] A performance evaluation method based on task chains and application scenarios includes the following steps:
[0008] (1) Construct the aircraft mission link and determine the angle for performance calculation of the mission link;
[0009] Based on the characteristics of the aircraft and mission, the aircraft mission link is constructed. The mission link includes detection, command and control, confrontation, assessment and support. The mission link is analyzed from different perspectives of time, accuracy and cost-effectiveness. The effectiveness of the aircraft mission link is calculated from different perspectives of time chain, accuracy chain and cost-effectiveness chain.
[0010] (2) Analyze the time chain of the aircraft and calculate its effectiveness. The time chain refers to the time required for the aircraft to complete the mission.
[0011] (3) Analyze the precision chain of the aircraft and calculate its effectiveness. The precision chain refers to the precision of each key link in the process of the aircraft completing the mission.
[0012] (4) Analyze the cost-effectiveness chain of the aircraft and calculate its effectiveness; the cost-effectiveness chain comprehensively considers the overall effectiveness of the aircraft in completing the mission and the cost or resources required. The effectiveness of the cost-effectiveness chain is defined as the effectiveness gain per unit cost, expressed as E. perc The calculation is as follows:
[0013]
[0014] Among them, E effc E represents the effectiveness of an aircraft in completing its mission. cost Cost chain efficiency for aircraft to accomplish missions;
[0015] (5) Based on the calculation results of steps (2), (3), and (4), calculate the efficiency of the aircraft in completing the entire mission link and complete the efficiency evaluation.
[0016] Furthermore, the analysis of the aircraft time chain and the calculation of its effectiveness specifically involve:
[0017] (2.1) Calculate the total time for the aircraft to complete the mission;
[0018] The process of the spacecraft completing its mission is divided into multiple stages according to the mission flow. Assume there are M overlapping stages in the flight process, and the time taken for each stage is T. i For i = 1, ..., M, the formula for calculating the time chain can be written as:
[0019]
[0020] (2.2) Calculate the time chain efficiency of the spacecraft in completing the mission;
[0021] The shorter the time required for an aircraft to complete a mission, the higher the time chain efficiency. Time chain efficiency is denoted as E.time The functional relationship between time and E is denoted as E. time =f time (T), the functional relationship between time chain performance and time can be chosen in several ways, including a linear function or a sigmoid function.
[0022] Furthermore, if there is a linear relationship between time chain efficiency and task completion time, then the calculation is as follows:
[0023]
[0024] If the relationship between time chain efficiency and task completion time satisfies the Sigmoid function, then the calculation is as follows:
[0025]
[0026] Where T min T is the shortest possible time for the spacecraft to complete its mission. max The maximum allowed time for the task chain, when T≥T max At that time, it was believed that the time requirement could not be met;
[0027] The time chain efficiency value is a value between [0,1].
[0028] Furthermore, the analysis and calculation of the effectiveness of the aircraft precision chain specifically involves:
[0029] (3.1) Establish a precision index system for each stage of the mission completion of the aircraft;
[0030] The mission process of the aircraft is analyzed to determine the accuracy indicators of key links. Detection accuracy includes angle positioning accuracy, distance positioning accuracy, and velocity positioning accuracy; flight accuracy includes guidance accuracy error.
[0031] (3.2) Calculate the accuracy chain efficiency of the spacecraft in completing the mission;
[0032] Let the precision chain efficiency be represented as E. acc The calculation is as follows:
[0033]
[0034] l represents the precision level of interest, w ai E represents the importance weight of the i-th precision. ai =f ai (ε ai ) represents the precision performance value and functional relationship of the corresponding link, ε ai This represents the expected error of the corresponding stage; the functional relationship includes linear relationship or Sigmoid function relationship.
[0035] Furthermore,
[0036] If there is a linear relationship between the accuracy performance value and the expected error of the corresponding stage, the accuracy performance of each stage is calculated as follows:
[0037]
[0038] If the Sigmoid function is chosen as the functional relationship for the accuracy performance value, then the performance value is calculated as follows:
[0039]
[0040] Where, ε ai,max To achieve the maximum permissible error for the task, when ε ai ≥ε ai,max At that time, it was believed that the accuracy chain requirements could not be met.
[0041] Furthermore, the analysis of the aircraft's cost-effectiveness chain and the calculation of its effectiveness specifically involve:
[0042] (4.1) Establish a mission completion performance index system for aircraft and calculate its performance.
[0043] Suppose the link has k links, E ej Let represent the efficiency of the j-th stage. Then, the efficiency of the aircraft in completing the mission is calculated as follows:
[0044]
[0045] (4.2) Calculate the cost chain efficiency E of the spacecraft in completing the mission. cost The cost chain efficiency of an aircraft in completing a mission includes the cost of aircraft operation (C). f and supporting resource costs C s ;
[0046] (4.3) Calculate the cost-effectiveness chain efficiency of the aircraft in completing the mission:
[0047]
[0048] γ∈[0,1] is the selected adjustment coefficient.
[0049] Furthermore, calculate the task link performance chain efficiency value E. effc Specifically:
[0050] (4.1.1) Analyze the mission profile of the aircraft and establish secondary indicators of the effectiveness chain.
[0051] Analyze the mission link of the aircraft, establish a mission profile, and establish secondary indicators for performance evaluation;
[0052] (4.1.2) Analyze the task profile support capability and decompose the indicator system.
[0053] The analysis of the mission profile supports the capabilities required to complete the mission, determines the effectiveness evaluation criteria and the effectiveness evaluation indicators at the third level and below. The detection indicators are subdivided into target detection capability, target recognition capability, and target localization and tracking capability. The target recognition capability is subdivided into indicators such as target recognition accuracy, imaging resolution area, and imaging cycle.
[0054] (4.1.3) Obtain the attribute values of each underlying indicator
[0055] The values of each underlying indicator are obtained. The values are determined based on the characteristics of the aircraft's mission chain. The values of the underlying indicators are then normalized. Normalization methods include arithmetic mean, geometric mean, or eigenvalue method.
[0056] (4.1.4) Determine the weights of the indicators
[0057] The pairwise comparison matrix method is used to compare elements in each level pairwise to construct a judgment matrix. The judgment matrix is then tested for consistency. If the consistency test fails, the judgment matrix is adjusted. If the consistency test passes, the weight of each lower-level indicator relative to the upper-level indicator is calculated based on the judgment matrix.
[0058] (4.1.5) The underlying indicators are aggregated layer by layer to obtain the performance values of the secondary indicators.
[0059] The lower-level indicators are aggregated to obtain the performance values of the upper-level indicators, and so on, until the performance values of the secondary indicators of the task profile are obtained through aggregation; let m capabilities {B} be required for the j-th link in the task chain. j1 B j2 ,…,B jm The importance weight of the support relative to the link is calculated as follows: Ability B ji ,1≤i≤m subject to {C ji1 C ji2 ,…,C jin The influence of the indicators, and the importance weight of each indicator are as follows: The efficiency value of the j-th stage is calculated as follows:
[0060]
[0061] If index C jip If we can continue to analyze its performance index factors, then E(C) jip E(C) is obtained by aggregating the indicators of the next lower level; otherwise, E(C) is obtained by aggregating the indicators of the next lower level. jip Determined directly based on the characteristics of the spacecraft's mission link;
[0062] (4.1.6) Calculate the task link performance value
[0063] Multiplying the performance values of each task profile yields the overall performance value of the task chain; assuming the chain has k links, Eej Let represent the efficiency of the j-th stage. Then, the efficiency of the aircraft in completing the mission is calculated as follows:
[0064]
[0065] Furthermore, the computational task chain cost chain efficiency E cost Specifically:
[0066] (4.2.1) Calculate the aircraft operating cost C f ;
[0067] C f =C single ×N cost
[0068] That is, the product of the cost of a single aircraft and the number of aircraft required to support the completion of the mission.
[0069] C single For the cost of using a single aircraft, N cost Indicates the number of aircraft required to complete the mission;
[0070] (4.2.2) An indicator system was established using the analytic hierarchy process (AHP), weights were determined, and the resource cost C for the spacecraft to complete its mission was calculated by aggregating the data layer by layer. s ;
[0071] (4.2.3) Calculate the total cost for the aircraft to complete the mission, i.e., the cost chain efficiency E. cost
[0072] Cost chain efficiency is calculated as follows:
[0073]
[0074] α∈[0,1] is a weighting coefficient that measures the relative importance of aircraft operating costs and supporting resource costs. C f,max The maximum possible cost of using an aircraft is determined by human intervention, so that the cost chain efficiency is between 0 and 1.
[0075] Furthermore, the cost C of a single aircraft single The calculation is obtained using the summation method or the estimation method based on similar aircraft, specifically as follows:
[0076] The summation method involves dividing the spacecraft into m parts, with each part having a cost of C. ci Then the cost calculation of a single aircraft
[0077] The estimation method using similar aircraft involves selecting several independent variables x that are sensitive to the cost of a single aircraft. qq = 1, ..., Q, where Q is the number of independent variables; establish a linear functional relationship between the cost and parameters of a single aircraft:
[0078] y = b0 + b1x1 + b2x2 + ... + b Q x Q +e
[0079] e is a random variable that follows an independent normal distribution; b0, b1, ..., b Q For coefficients;
[0080] When the costs of at least Q0 and Q0≥Q+1 similar aircraft are known, their cost vectors and parameter vectors are as follows:
[0081]
[0082] Then the undetermined parameters are calculated as follows: Determine the key parameter values x of the aircraft performing the mission. q (si), then the cost of a single aircraft is calculated as follows:
[0083]
[0084] Furthermore, the efficiency of the computing spacecraft in completing the entire mission chain is specifically as follows:
[0085] Performance E based on task chaining ch The calculation is as follows:
[0086]
[0087] E in =β1E time +β2E acc +β3E perc The coefficients β1+β2+β3=1;
[0088] The longest allowed time for the link is T. max The maximum accuracy error of each step is ε ai,max ,
[0089] The indicative function is expressed as:
[0090]
[0091] The advantages of this invention compared to the prior art are:
[0092] (1) This invention comprehensively considers both the macroscopic performance indicators of the aircraft in completing its mission and the aircraft's own performance indicators. The macroscopic performance indicators include mission completion time and accuracy, and innovatively proposes the concept of a cost-effectiveness chain, which comprehensively considers the efficiency and cost of completing the mission; in the efficiency part of the cost-effectiveness chain, the consideration of aircraft efficiency in traditional efficiency evaluation methods is incorporated.
[0093] (2) The performance evaluation method proposed in this invention evaluates the capabilities of the aircraft in specific tasks and application scenarios. It integrates the performance evaluation results of the time chain, accuracy chain, and cost-effectiveness chain. The performance evaluation model is dynamic and strongly correlated with the aircraft's tasks and scenarios.
[0094] (3) The performance evaluation model proposed in this invention has strong applicability. The calculation method and importance weight of time chain performance, precision chain performance and cost performance can be adjusted according to the specific application scenario. Attached Figure Description
[0095] Figure 1 This is a schematic diagram of the efficiency chain calculation process based on the analytic hierarchy process.
[0096] Figure 2 A flowchart of the resource cost indicator system for supporting aircraft in completing missions;
[0097] Figure 3 This is a flowchart of the link performance evaluation method of the present invention. Detailed Implementation
[0098] The specific embodiments of the present invention will now be described in further detail with reference to the accompanying drawings.
[0099] like Figure 3 As shown, this invention proposes a performance evaluation method based on task chains and application scenarios, comprising the following steps:
[0100] (1) Construct the aircraft mission link and determine the angle for performance calculation of the mission link.
[0101] First, based on the characteristics of the aircraft and the mission, the aircraft mission link is constructed, which usually includes multiple links such as detection, command and control, countermeasures, assessment, and support. The mission link is analyzed from different perspectives such as time, accuracy, and cost-effectiveness. Then, the effectiveness of the aircraft mission link is calculated from different perspectives such as time chain, accuracy chain, and cost-effectiveness chain.
[0102] (2) Analyze the time chain of the aircraft and calculate its effectiveness.
[0103] The time chain refers to the time required for an aircraft to complete a mission. Time chain analysis ensures that all actions of the aircraft are executed completely and in a tightly connected sequence during the mission.
[0104] (2.1) Calculate the total time for the spacecraft to complete the mission.
[0105] The process of an aircraft completing a mission can be divided into multiple stages according to the mission flow. For example, the classic OODA loop can be divided into four parts: observation time, localization time, decision time, and action time. Assume that the flight process has l intersecting stages, and the time T for each stage is... i (i = 1, ..., l), then the formula for calculating the time chain can be written as:
[0106]
[0107] (2.2) Calculate the time chain efficiency of the spacecraft to complete the mission
[0108] The shorter the time required for an aircraft to complete a mission, the higher the time chain efficiency. Time chain efficiency is denoted as E. time The functional relationship between time and E is denoted as E. time =f time (T), the functional relationship between time chain efficiency and time can be chosen in several ways, with linear functions or sigmoid functions being commonly used. If a linear relationship is assumed between time chain efficiency and task completion time, the calculation is as follows:
[0109]
[0110] If we assume that the relationship between time chain efficiency and task completion time satisfies the Sigmoid function, then the calculation is as follows:
[0111]
[0112] Where T min T is the shortest possible time for the spacecraft to complete its mission. max The maximum allowed time for the task chain, when T≥T max If the time requirement cannot be met, then the time chain performance is considered to be a value between [0,1]. In practical applications, a corresponding time chain performance function can be constructed based on the characteristics of the task chain.
[0113] (3) Analyze the precision chain of the aircraft and calculate its effectiveness.
[0114] Precision chain refers to the precision of each key link in the process of an aircraft completing a mission. Precision chain analysis ensures that the mission process of the aircraft is clearly handed over and that the mission can be completed.
[0115] (3.1) Establish a precision index system for each stage of the mission completion of the aircraft.
[0116] Analyze the mission flow of the aircraft to determine the accuracy indicators of key links, such as detection accuracy and flight accuracy. Each accuracy indicator can be further subdivided. For example, detection accuracy can include angle positioning accuracy, distance positioning accuracy, and velocity positioning accuracy, while flight accuracy includes guidance accuracy error.
[0117] (3.2) Calculate the accuracy chain efficiency of the spacecraft in completing the mission.
[0118] Let the precision chain efficiency be represented as E. acc The calculation is as follows:
[0119]
[0120] l represents the precision level of interest, w ai E represents the importance weight of the i-th precision. ai =f ai (ε ai ) represents the precision performance value and functional relationship of the corresponding link, ε ai This represents the expected error of the corresponding stage. Similarly, the precision performance value can be calculated in various ways. If there is a linear relationship between the precision performance value and the expected error of the corresponding stage, the precision performance of each stage can be calculated as follows:
[0121]
[0122] If the Sigmoid function is chosen as the functional relationship for the accuracy performance value, then the performance value can be calculated as follows:
[0123]
[0124] Where ε ai,max To achieve the maximum permissible error for the task, when ε ai ≥ε ai,max At that time, it was believed that the accuracy chain requirements could not be met.
[0125] (4) Analyze the cost-effectiveness chain of the aircraft and calculate its effectiveness.
[0126] The cost-effectiveness chain comprehensively considers the overall effectiveness of an aircraft in completing a mission and the costs or resources required. Cost-effectiveness chain effectiveness is defined as the performance gain per unit cost, denoted as E. perc The calculation is as follows:
[0127]
[0128] Where E effc E represents the effectiveness of an aircraft in completing its mission. cost The cost of enabling an aircraft to complete a mission.
[0129] (4.1) Establish a mission completion performance index system for aircraft and calculate its performance.
[0130] Suppose the link has k links, for example, the OODA loop proposed by the US military would have 4 links, E ej Let represent the efficiency of the j-th stage. Then, the efficiency of the aircraft in completing the mission is calculated as follows:
[0131]
[0132] The effectiveness of each stage can be calculated using effectiveness evaluation methods such as the Analytic Hierarchy Process (AHP), Fuzzy AHP, and Grey Relational Analysis, through steps such as establishing an indicator system, determining weights, and layer-by-layer aggregation. Here, a combination of indicator weighted aggregation and product aggregation methods is used. The effectiveness of each task stage profile is calculated using indicator weighted aggregation, and then the effectiveness of each task stage profile is multiplied. This is because the stages of the spacecraft mission link are closely related, and the multiplicative aggregation method can fully consider the impact of low effectiveness in a certain task profile on the final mission completion rate. For example, in extreme cases, if the spacecraft's detection effectiveness is 0, then the link for using the spacecraft to complete the mission cannot be established, and the effectiveness should be 0.
[0133] Taking the Analytic Hierarchy Process (AHP) as an example, the efficiency of the aircraft in completing its mission is calculated as follows:
[0134] (4.1.1) Analyze the mission profile of the aircraft and establish secondary indicators of the effectiveness chain.
[0135] Analyze the mission link of the aircraft, establish a mission profile, and establish secondary performance evaluation indicators. The secondary performance indicators may include detection, command and control, action, assessment, and support.
[0136] (4.1.2) Analyze the task profile support capability and decompose the indicator system.
[0137] Analyze the mission profile to support the capabilities required to complete the mission, determine the performance evaluation criteria and performance evaluation indicators at the third level and below. For example, the detection indicators can be subdivided into target detection capability, target recognition capability, target positioning and tracking capability, etc. The target recognition capability can be further subdivided into indicators such as target recognition accuracy, imaging resolution area, and imaging cycle.
[0138] (4.1.3) Obtain the attribute values of each underlying indicator
[0139] Obtain the values of each underlying indicator, which can come from expert scoring, performance indicator calculations, etc. Normalize the underlying indicator values using methods such as arithmetic mean, geometric mean, and eigenvalue method.
[0140] (4.1.4) Determine the weights of the indicators
[0141] The pairwise comparison matrix method is used to compare elements in each level pairwise to construct a judgment matrix. The judgment matrix is then tested for consistency. If the consistency test fails, the judgment matrix is adjusted. If the consistency test passes, the weight of each lower-level indicator relative to the upper-level indicator is calculated based on the judgment matrix.
[0142] (4.1.5) The underlying indicators are aggregated layer by layer to obtain the performance values of the secondary indicators.
[0143] The lower-level indicators are aggregated to obtain the performance values of the upper-level indicators, and so on, until the performance values of the secondary indicators of the task profile are obtained, such as the support performance value and the command and control performance value; let m capabilities {B} be required for the j-th link of the task chain. j1 B j2 ,…,B jm The importance weight of support relative to the process can be calculated as follows: Ability B ji (1≤i≤m) subject to {C ji1 C ji2 ,…,C jin The influence of the indicators, and the importance weight of each indicator are as follows: The efficiency value of the j-th stage can then be calculated as follows:
[0144]
[0145] If index C jip If we can continue to analyze its performance index factors, then E(C) jip E(C) is obtained by aggregating the indicators of the next lower level; otherwise, E(C) is obtained by aggregating the indicators of the next lower level. jip The results are obtained through expert scoring or normalization of indicator performance values.
[0146] (4.1.6) Calculate the task link performance value
[0147] Multiplying the performance values of each task profile yields the overall performance value of the task chain. Assume the chain has k links, E... ej Let represent the efficiency of the j-th stage. Then, the efficiency of the aircraft in completing the mission is calculated as follows:
[0148]
[0149] The calculation process is as follows Figure 1 As shown.
[0150] (4.2) Calculate the cost of the spacecraft completing the mission
[0151] In terms of cost, the main considerations are the two aspects of the cost of the aircraft completing the mission: the cost of aircraft operation C. f and supporting resource costs C s .
[0152] (4.2.1) Calculate the cost of using the aircraft
[0153] The cost of using the aircraft is calculated as follows:
[0154] C f =C single ×N cost
[0155] That is, the product of the cost of a single aircraft and the number of aircraft required to support the completion of the mission.
[0156] C single For the cost of using a single aircraft, N cost This represents the number of aircraft required to complete the mission. The cost of a single aircraft can be calculated using two methods: summation and estimation using similar aircraft. The summation method involves dividing the aircraft into several important components, such as airframe cost, propulsion system cost, and control system cost. Let there be m components in total, and the cost of each component be C. ci Then the cost calculation of a single aircraft The method of estimating using multiple aircraft involves selecting several independent variables x that are sensitive to the cost of a single aircraft. q (q=1,…,Q), such as flight distance, takeoff mass, maximum speed, and index error, establish a linear functional relationship between the cost of a single aircraft and its parameters:
[0157] y = b0 + b1x1 + b2x2 + ... + b Q x Q +e
[0158] Let e be an independent, normally distributed random variable. When the costs of at least Q0 (Q0 ≥ Q+1) similar aircraft are known, their cost vector and parameter vector are respectively:
[0159]
[0160] Then the undetermined parameters are calculated as follows: Determine the key parameter values x of the aircraft performing the mission. q (si), then the cost of a single aircraft can be calculated as:
[0161]
[0162] (4.2.2) Calculate the resource cost of the spacecraft to complete the mission.
[0163] The cost of supporting resources cannot be directly calculated numerically. Instead, it can be calculated using performance evaluation methods such as the Analytic Hierarchy Process (AHP), Fuzzy AHP, and Grey Relational Analysis. This involves establishing an indicator system, determining weights, and aggregating data layer by layer. The specific calculation process is the same as the method for calculating the performance of task sub-profiles, yielding a number between 0 and 1. A simple indicator system for supporting resource costs is as follows: Figure 2 As shown, its secondary indicators include command and control costs, maintenance and support costs, and support information costs. Command and control costs are further subdivided into command decision time, command operability, etc. Maintenance and support costs can be further subdivided into spare parts preparation costs, technical complexity, etc. Support information costs can be divided into radar usage costs, UAV usage costs, satellite usage costs, etc.
[0164] (4.2.3) Calculate the total cost of the spacecraft to complete the mission (cost chain efficiency)
[0165] Cost chain efficiency is calculated as follows:
[0166]
[0167] α∈[0,1] is a weighting coefficient that measures the relative importance of aircraft operating costs and supporting resource costs. C f,max The maximum possible cost of using an aircraft is determined by human intervention, so that the cost chain efficiency is between 0 and 1.
[0168] (4.3) Calculate the cost-effectiveness of the aircraft in completing the mission.
[0169] Because the formula for calculating the efficiency-cost ratio chain performance is: The efficiency chain and cost chain efficiency values are both numbers between [0,1]. This could lead to an infinitely large efficiency chain efficiency. To ensure that the efficiency chain efficiency is within the range of [0,1], its calculation formula is adjusted as follows:
[0170]
[0171] γ∈[0,1] is the selected adjustment coefficient, which is determined based on the maximum and minimum values of the efficiency chain and cost chain efficiency under different methods.
[0172] (5) Calculate the overall efficiency of the spacecraft in completing the mission and perform an efficiency assessment.
[0173] The overall efficiency of the mission link for an aircraft should consider the efficiency of the time link, accuracy link, and cost-effectiveness link simultaneously. It should also take into account the fundamental requirements for both time and accuracy in mission completion, with a maximum permissible link time of T. max The maximum accuracy error of each step is ε ai,max Link-based performance E ch The calculation is as follows:
[0174]
[0175] E in =β1E time +β2E acc +β3E perc ,β1+β2+β3=1
[0176] in Equations are indicator functions, and their expressions are:
[0177]
[0178] The indicator function measures whether the spacecraft's mission link time and accuracy meet the conditions. If the conditions are not met, the spacecraft cannot complete the mission, and the overall performance evaluation result is 0. β i (i = 1, 2, 3) are numbers between 0 and 1, representing the importance weights of the time chain, precision chain, and cost-effectiveness chain.
[0179] The parts of this invention not described in detail are common knowledge to those skilled in the art.
Claims
1. A performance evaluation method from task link and application scenario, characterized in that include: (1) Construct the aircraft mission link and determine the angle for performance calculation of the mission link; Based on the characteristics of the aircraft and mission, the aircraft mission link is constructed. The mission link includes detection, command and control, confrontation, assessment and support. The mission link is analyzed from different perspectives of time, accuracy and cost-effectiveness. The effectiveness of the aircraft mission link is calculated from different perspectives of time chain, accuracy chain and cost-effectiveness chain. (2) Analyze the time chain of the aircraft and calculate its effectiveness. The time chain refers to the time required for the aircraft to complete the mission. (3) Analyze the precision chain of the aircraft and calculate its effectiveness. The precision chain refers to the precision of each key link in the process of the aircraft completing the mission. (4) Analyze and calculate the effectiveness of the aircraft's cost-effectiveness chain; the cost-effectiveness chain comprehensively considers the overall effectiveness of the aircraft in completing the mission and the costs or resources required. The effectiveness of the cost-effectiveness chain is defined as the effectiveness gain per unit cost, expressed as: The calculation is as follows: in, This indicates the effectiveness of an aircraft in completing its mission. Cost chain efficiency for aircraft to accomplish missions; The selected adjustment factor; (5) Based on the calculation results of steps (2), (3), and (4), calculate the efficiency of the aircraft in completing the entire mission link and complete the efficiency evaluation; The analysis of the aircraft's cost-effectiveness chain and the calculation of its effectiveness are specifically as follows: (4.1) Establish a performance index system for aircraft mission completion and calculate its performance. Assume the link has a total Each step Indicates the first The efficiency of each stage is considered, and the efficiency of the aircraft in completing the mission is calculated as follows: (4.2) Calculate the cost chain efficiency of the aircraft in completing the mission. The cost chain efficiency of an aircraft in completing a mission includes the cost of using the aircraft. and supporting resource costs ; (4.3) Calculate the cost-effectiveness chain efficiency of the aircraft in completing the mission. ; Calculate the performance value of the task link. Specifically: (4.1.1) Analyze the mission profile of the aircraft and establish secondary indicators of the effectiveness chain: Analyze the mission link of the aircraft, establish a mission profile, and establish secondary indicators for performance evaluation; (4.1.2) Analyze the task profile support capability and decompose the indicator system: The analysis of the mission profile supports the capabilities required to complete the mission, determines the effectiveness evaluation criteria and the effectiveness evaluation indicators at the third level and below. The detection indicators are subdivided into target detection capability, target recognition capability, and target localization and tracking capability. The target recognition capability is subdivided into target recognition accuracy, imaging resolution area, and imaging cycle indicators. (4.1.3) Obtain the attribute values of each underlying indicator: Obtain the attribute values of each underlying indicator. The attribute values are determined based on the characteristics of the aircraft mission chain. Normalize the underlying indicator attribute values. Normalization methods include arithmetic mean, geometric mean, or eigenvalue method. (4.1.4) Determine the indicator weights: The pairwise comparison matrix method is used to compare elements in each level pairwise to construct a judgment matrix. The judgment matrix is then checked for consistency. If it fails, the judgment matrix is adjusted. If it passes, the weight of each lower-level indicator relative to the upper-level indicator is calculated based on the judgment matrix. (4.1.5) The underlying indicators are aggregated layer by layer to obtain the performance values of the secondary indicators: The lower-level metrics are aggregated to obtain the performance values of the upper-level metrics, and so on, until the performance values of the second-level metrics of the task profile are obtained through aggregation; let's assume that for the task link... Each step requires Item ability The importance weight of the support relative to the link is calculated as follows: ,ability by The influence of the indicators, and the importance weight of each indicator are as follows: Then the first The efficiency value of each step is calculated as follows: If the indicator If we can continue to analyze its performance index factors, then... It is obtained by aggregating the indicators of the next lower level, otherwise Determined directly based on the characteristics of the spacecraft's mission link; (4.1.6) Calculate the task link performance chain value: Multiplying the performance values of each task profile yields the overall performance value of the task chain; assuming the chain has a total of Each step Indicates the first The efficiency of each stage is considered, and the efficiency of the aircraft in completing the mission is calculated as follows: 。 2. The performance evaluation method based on task chains and application scenarios according to claim 1, characterized in that: The analysis of the spacecraft time chain and the calculation of its effectiveness are specifically as follows: (2.1) Calculate the total time for the aircraft to complete the mission; The process of an aircraft completing a mission is divided into multiple stages according to the mission flow. Let the flight process consist of... There are several interconnected steps, and the time taken for each step is... Then the formula for calculating the time chain can be written as: (2.2) Calculate the time chain efficiency of the spacecraft in completing the mission; The shorter the time required for an aircraft to complete a mission, the higher the time chain efficiency. Time chain efficiency can be expressed as... The functional relationship between time and denoted as The functional relationship between time chain performance and time includes linear functions or sigmoid functions.
3. The performance evaluation method based on task chains and application scenarios according to claim 2, characterized in that: If there is a linear relationship between time chain efficiency and task completion time, then the calculation is as follows: If the relationship between time chain efficiency and task completion time satisfies the Sigmoid function, then the calculation is as follows: in The shortest possible time for the aircraft to complete its mission. The maximum allowed time for the task chain, when At that time, it was believed that the time requirement could not be met; The time chain efficiency value is a value between [0,1].
4. The performance evaluation method based on task chains and application scenarios according to claim 1, characterized in that: The analysis and calculation of the effectiveness of the aircraft precision chain specifically involves: (3.1) Establish a precision index system for each stage of the aircraft's mission; The mission flow of the aircraft is analyzed to determine the accuracy indicators of key links. The accuracy indicators include detection accuracy and flight accuracy. Detection accuracy includes angle positioning accuracy, distance positioning accuracy, and velocity positioning accuracy. Flight accuracy includes guidance accuracy error. (3.2) Calculate the accuracy chain efficiency of the spacecraft in completing the mission; Express the precision chain efficiency as The calculation is as follows: Indicates the precision level to be focused on. Indicates the first The importance weight of each precision Indicates the first The accuracy chain performance value corresponding to each accuracy index. This represents the expected error of the corresponding step.
5. The performance evaluation method based on task chains and application scenarios according to claim 4, characterized in that: If there is a linear relationship between the accuracy performance value and the expected error of the corresponding stage, the accuracy performance of each stage is calculated as follows: If the Sigmoid function is chosen as the functional relationship for the accuracy performance value, then the performance value is calculated as follows: in, To achieve the maximum permissible error for the task, when At that time, it was believed that the accuracy chain requirements could not be met.
6. The performance evaluation method based on task chains and application scenarios according to claim 1, characterized in that: Computational task link cost chain efficiency Specifically: (4.2.1) Calculate the cost of using the aircraft ; That is, the product of the cost of a single aircraft and the number of aircraft required to support the completion of the mission. For the cost of using a single aircraft, Indicates the number of aircraft required to complete the mission; (4.2.2) Establish an indicator system, determine weights, and calculate the resource cost of the spacecraft to complete its mission by aggregating the data layer by layer using the analytic hierarchy process. ; (4.2.3) Calculate the total cost of the spacecraft to complete the mission, i.e., cost chain efficiency. Cost chain efficiency is calculated as follows: The weighted average is used to measure the relative importance of aircraft operating costs and supporting resource costs. The maximum possible cost of using an aircraft is determined by human intervention, so that the cost chain efficiency is between 0 and 1.
7. The performance evaluation method based on task chains and application scenarios according to claim 6, characterized in that: Cost of a single aircraft The calculation is obtained using the summation method or the estimation method based on similar aircraft, specifically as follows: The summation method is to divide the aircraft into... There are several parts, and the cost of each part is... Then the cost calculation of a single aircraft ; The estimation method using similar aircraft involves selecting several independent variables that are sensitive to the cost of a single aircraft. , Given the number of independent variables; establish a linear functional relationship between the cost and parameters of a single aircraft: Let them be random variables that follow an independent normal distribution; , … For coefficients; When there are not less than The costs of several similar aircraft are known, and their cost vectors and parameter vectors are as follows: Then the undetermined parameters are calculated as follows: Determine the key parameter values of the aircraft performing the mission. The cost of a single aircraft is then calculated as follows: 。 8. The performance evaluation method based on task chains and application scenarios according to claim 1, characterized in that: The efficiency of the computational spacecraft in completing the entire mission chain is specifically as follows: Performance based on task chain The calculation is as follows: coefficient ; Among them, the longest allowed time for the link is The maximum accuracy error of each step is , The indicative function is expressed as: 。