Efficiency evaluation method starting from task link and application scene
By constructing the aircraft mission link and analyzing it from the perspectives of time, accuracy, efficiency and cost ratio, the problem of the performance evaluation method in the existing technology is static and unable to comprehensively consider the mission link and aircraft performance, and a dynamic and comprehensive evaluation of the effectiveness of the aircraft mission link is achieved.
Patent Information
- Application Number
- CN202411521826.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-29
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-10-29
AI Technical Summary
The performance evaluation methods of the prior art are static and cannot consider both the macro performance indicators and the aircraft performance indicators of the mission link, and it is difficult to respond to dynamic changes in system performance in real time.
A performance evaluation method based on mission links and application scenarios is proposed. By constructing an aircraft mission link, including detection, command and control, confrontation, evaluation, and support links, the task links are analyzed and calculated from different angles such as time, accuracy, and efficiency ratio, and comprehensively consider the efficiency of the time chain, accuracy chain and efficiency ratio chain.
A comprehensive assessment of the effectiveness of the aircraft mission link is achieved, which can dynamically respond to changes in system performance and provide specific optimization and improvement guidance.
Smart Images

Figure CN119515142A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a performance evaluation method based on task links and application scenarios, and belongs to the technical field of system performance evaluation. Background Art
[0002] The effectiveness of the aircraft system in completing the mission is the overall goal of developing and using the aircraft. Traditional effectiveness evaluation methods mainly focus on the performance of the aircraft itself or the performance of a part of it, such as the effectiveness of the support system and the effectiveness of command and control. Classic methods include hierarchical analysis method, fuzzy comprehensive evaluation method, gray whitening weight function clustering method, TOPSIS comprehensive evaluation method, ADC effectiveness evaluation method, etc. These methods ignore the performance of the aircraft in actual tasks and the comprehensive impact of different tasks and scenarios on the performance of the aircraft. The corresponding effectiveness evaluation model is static and cannot reflect the dynamic changes of system effectiveness in real time.
[0003] With the application of information technology and other military high technologies, the effectiveness evaluation methods based on mission links such as OODA loops have become increasingly important. Complex network theory and graph theory related techniques have made some progress in related effectiveness evaluation issues, but most studies still focus on macro properties such as network connectivity, robustness, and overall stability. Although these macro indicators can provide a preliminary understanding of the overall performance of the link, they often ignore the in-depth exploration and optimization of the system's own performance. There is an urgent need for a new evaluation method that can comprehensively consider the macro properties of the mission link and the performance characteristics of the aircraft itself, so as to not only more comprehensively evaluate the effectiveness of the entire mission link, but also provide specific guidance for the optimization and improvement of the aircraft.
[0004] The efficiency of the aircraft system is strongly related to its own performance, mission, application scenario and other factors. In specific use, it should be considered whether the basic conditions of the OODA loop / link for the aircraft to complete the mission are met, that is, the mission is completed within the specified time and the accuracy of important links meets the requirements, and the cost of completing the mission should be considered. There is still no good evaluation method for comprehensively considering the efficiency and cost of the aircraft to complete the mission under the constraints of time and accuracy. Summary of the invention
[0005] The technical problem solved by the present invention is: to overcome the shortcomings of the prior art, to provide a performance evaluation method based on the mission link and application scenario, to solve the problems in the prior art that the performance evaluation method is relatively static and cannot simultaneously consider the macro performance indicators of the mission link and the aircraft performance indicators.
[0006] The technical solution of the present invention is:
[0007] A performance evaluation method based on task links and application scenarios includes the following steps:
[0008] (1) Construct the aircraft mission link and determine the angle for calculating the efficiency of the mission link;
[0009] According to the characteristics of the aircraft and its mission, the aircraft mission chain is constructed. The mission chain includes detection, command and control, confrontation, evaluation, and support. The mission chain is analyzed from different perspectives of time, accuracy, and cost-effectiveness. The effectiveness of the aircraft mission chain is calculated from different perspectives of time chain, accuracy chain, and cost-effectiveness chain.
[0010] (2) Analyze the aircraft time chain and calculate its effectiveness. The time chain refers to the time it takes for the aircraft to complete the mission;
[0011] (3) Analyze the aircraft's precision chain and calculate its effectiveness. The precision chain refers to the accuracy of each key link in the aircraft's mission completion process;
[0012] (4) Analyze the cost-effectiveness chain of the aircraft and calculate its effectiveness. The cost-effectiveness chain comprehensively considers the comprehensive effectiveness of the aircraft in completing the task and the cost or resources required. The effectiveness of the cost-effectiveness chain is defined as the efficiency gain brought by unit cost, expressed as E perc , calculated as:
[0013]
[0014] Among them, E effc Indicates the efficiency of the aircraft in completing the mission, E cost The cost chain effectiveness of completing the mission for the aircraft;
[0015] (5) Based on the calculation results of steps (2), (3), and (4), calculate the efficiency of the aircraft in completing the entire mission link and complete the efficiency evaluation.
[0016] Furthermore, the aircraft time chain is analyzed and its efficiency is calculated, specifically:
[0017] (2.1) Calculate the total time it takes for the aircraft to complete the mission;
[0018] The process of the aircraft completing the mission is divided into multiple links according to the mission flow. Assume that the flight process has M links that intersect from beginning to end, and the time taken for each link is T. i ,i=1,...,M, then the calculation formula of the time chain can be written as:
[0019]
[0020] (2.2) Calculate the time chain efficiency of the aircraft to complete the mission;
[0021] The shorter the time required for the aircraft to complete the mission, the higher the time chain efficiency. The time chain efficiency is expressed as Etime , and its function relationship with time is recorded as E time =f time (T), there are many options for the functional relationship between time chain performance and time, including linear function or Sigmoid function.
[0022] Furthermore, if there is a linear relationship between the time chain efficiency and the time to complete the task, the calculation is:
[0023]
[0024] If the relationship between the time chain efficiency and the time to complete the task satisfies the Sigmoid function, the calculation is:
[0025]
[0026] Where T min The shortest possible time for the aircraft to complete the mission, T max is the maximum allowed time of the task link, when T ≥ T max When the time requirement is considered unsatisfactory;
[0027] The time chain efficiency value is a value between [0,1].
[0028] Furthermore, the aircraft precision chain is analyzed and its efficiency is calculated, specifically:
[0029] (3.1) Establish an accuracy indicator system for each link of the aircraft's mission completion;
[0030] Analyze the mission process of the aircraft and determine the accuracy indicators of key links. The detection accuracy includes angle positioning accuracy, distance positioning accuracy, and speed positioning accuracy; the flight accuracy includes guidance accuracy error;
[0031] (3.2) Calculate the accuracy chain effectiveness of the aircraft in completing the mission;
[0032] Denote the precision chain efficiency as E acc , calculated as:
[0033]
[0034] l represents the number of precisions of interest, w ai represents the importance weight of the i-th precision, E ai =f ai (ε ai ) represents the accuracy performance value and function relationship of the corresponding link, ε ai Represents the expected error of the corresponding link; the functional relationship includes a linear relationship or a Sigmoid function relationship.
[0035] Furthermore,
[0036] If there is a linear relationship between the precision performance value and the expected error of the corresponding link, the precision performance of each link is calculated as:
[0037]
[0038] If the function relationship of the precision performance value is selected as the Sigmoid function, the performance value is calculated as:
[0039]
[0040] Among them, ε ai,max To complete the task with the maximum allowable error, when ε ai ≥ε ai,max , it is considered that the precision chain requirements cannot be met.
[0041] Furthermore, the aircraft cost-effectiveness chain is analyzed and its efficiency is calculated, specifically:
[0042] (4.1) Establishing an aircraft mission performance indicator system and calculating performance
[0043] Assume that the link has k links, E ej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as:
[0044]
[0045] (4.2) Calculate the cost chain efficiency E of the aircraft to complete the mission cost The cost chain efficiency of the aircraft to complete the mission includes the aircraft use cost C f and support resource cost C s ;
[0046] (4.3) Calculate the cost-effectiveness of the aircraft in completing the mission:
[0047]
[0048] γ∈[0,1] is the selected adjustment coefficient.
[0049] Further, calculate the task link efficiency chain efficiency value E effc , specifically:
[0050] (4.1.1) Analyze the mission profile of the aircraft and establish the secondary indicators of the performance chain
[0051] Analyze the aircraft mission links, establish mission profiles, and establish secondary indicators for performance evaluation;
[0052] (4.1.2) Analyze mission profile support capabilities and decompose the indicator system
[0053] Analyze the capabilities required to support mission completion in the mission profile, determine the effectiveness evaluation criteria and effectiveness evaluation indicators for level 3 and below, and subdivide the detection indicators into target detection capability, target recognition capability, and target positioning and tracking capability. The target recognition capability is subdivided into indicators such as target recognition accuracy, imaging resolution area, and imaging cycle;
[0054] (4.1.3) Obtaining the attribute values of each underlying indicator
[0055] Obtaining the values of each underlying indicator, which are determined according to the characteristics of the aircraft task chain itself, and normalizing the underlying indicator values. The normalization methods include arithmetic mean method, geometric mean method or eigenvalue method;
[0056] (4.1.4) Determine indicator weights
[0057] Use the paired comparison matrix method to compare the elements in each level, build a judgment matrix, and perform a consistency test on the judgment matrix. If it fails, adjust the judgment matrix. If it passes, calculate the weight of each bottom-level indicator relative to the upper-level indicator based on the judgment matrix.
[0058] (4.1.5) The bottom-level indicators are aggregated layer by layer to obtain the secondary indicator performance value
[0059] The bottom-level indicators are aggregated to obtain the upper-level indicator performance value, until the secondary indicator performance value of the task profile is obtained by aggregation; suppose that for the jth link of the task link, m capabilities are required {B j1 ,B j2 ,…,B jm} support, the importance weight relative to the link is calculated as Ability B ji , 1≤i≤m is subject to {C ji1 ,C ji2 ,…,C jin}Indicator impact, the importance weight of each indicator is Then the efficiency value of the jth link is calculated as:
[0060]
[0061] If the indicator C jip We can continue to analyze the performance index factors, then E(C jip ) is obtained by aggregating the next layer of indicators, otherwise E(C jip ) is determined directly based on the characteristics of the aircraft mission link;
[0062] (4.1.6) Calculate the task link efficiency chain efficiency value
[0063] The efficiency value of the entire task link can be calculated by multiplying the efficiency values of each task profile. Assuming that the link has k links, Eej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as:
[0064]
[0065] Furthermore, the cost chain efficiency E of the task link is calculated cost , specifically:
[0066] (4.2.1) Calculate the aircraft usage cost C f ;
[0067] C f =C single ×N cost
[0068] That is, the product of the cost of a single aircraft and the number of aircraft required to complete the mission.
[0069] C single is the cost of using a single aircraft, N cost Indicates the number of aircraft required to complete the mission;
[0070] (4.2.2) Establish an index system, determine weights, and calculate the cost of aircraft mission support resources C layer by layer through the hierarchical analysis method s ;
[0071] (4.2.3) Calculate the total cost of the aircraft to complete the mission, that is, the cost chain efficiency E cost
[0072] The cost chain efficiency is calculated as:
[0073]
[0074] α∈[0,1] is a weighting coefficient that measures the importance of the aircraft usage cost and the support resource cost. f,max The maximum possible cost of using an aircraft is artificially set so that the cost chain efficiency is between 0 and 1.
[0075] Furthermore, the cost of a single aircraft C single It is calculated by the addition method or the similar aircraft estimation method, specifically:
[0076] The summation method is to divide the aircraft into m parts, and the cost of each part is C ci , then the cost of a single aircraft is calculated as
[0077] The similar aircraft estimation rule is to select several independent variables x that are sensitive to the cost of a single aircraft. q, q=1,…,Q, Q is the number of independent variables; establish a linear function relationship between the cost of a single aircraft and the parameters:
[0078] y=b0+b1x1+b2x2+…+b Q x Q +e
[0079] e is a random variable that follows an independent normal distribution; b0, b1, …, b Q is the coefficient;
[0080] When the costs of at least Q0, Q0 ≥ Q+1 similar aircraft are known, their cost vector and parameter vector are:
[0081]
[0082] Then the calculated parameters are Determine the key parameter value x of the aircraft to perform the mission q (si), the cost of a single aircraft is calculated as:
[0083]
[0084] Furthermore, the calculation of the efficiency of the aircraft in completing the entire mission link is specifically:
[0085] Efficiency based on task links ch Calculated as:
[0086]
[0087] E in =β1E time +β2E acc +β3E perc , coefficient β1+β2+β3=1;
[0088] Among them, the maximum allowed time of the link is T max , the maximum accuracy error of each link is ε ai,max ,
[0089] is the characteristic function, and its expression is:
[0090]
[0091] The beneficial effects of the present invention compared with the prior art are:
[0092] (1) The present invention comprehensively considers the macro performance indicators of the aircraft to complete the mission and the performance indicators of the aircraft itself. The macro performance indicators include the mission completion time and accuracy, and innovatively proposes the concept of cost-effectiveness chain, which comprehensively considers the effectiveness and cost of completing the mission; in the effectiveness part of the cost-effectiveness chain, the consideration of aircraft effectiveness in traditional effectiveness evaluation methods is integrated.
[0093] (2) The performance evaluation method proposed in the present invention evaluates the capabilities of the aircraft in specific tasks and application scenarios, and integrates the performance evaluation results of the time chain, accuracy chain, and cost-effectiveness chain. The performance evaluation model is dynamic and strongly related to the aircraft's tasks and scenarios.
[0094] (3) The performance evaluation model proposed in the present invention has strong applicability. The calculation method and importance weight of time chain performance, precision chain performance, and cost performance can be adjusted according to specific application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS
[0095] Figure 1 It is a schematic diagram of the efficiency calculation process of the efficiency chain based on the hierarchical analysis method;
[0096] Figure 2 A framework diagram of the resource cost indicator system for aircraft mission support;
[0097] Figure 3 The present invention is a flow chart of the link performance evaluation method. DETAILED DESCRIPTION
[0098] The specific embodiments of the present invention are further described in detail below with reference to the accompanying drawings.
[0099] like Figure 3 As shown, the present invention proposes a performance evaluation method based on task links and application scenarios, including the following steps:
[0100] (1) Construct the aircraft mission link and determine the angle for calculating the efficiency of the mission link
[0101] First, based on the characteristics of the aircraft and its mission, an aircraft mission chain is constructed, which usually includes multiple links such as detection, command and control, confrontation, evaluation, and support. The mission chain is analyzed from different angles of time, accuracy, and cost-effectiveness. Then, the effectiveness of the aircraft mission chain is calculated from different angles of time chain, accuracy chain, and cost-effectiveness chain.
[0102] (2) Analyze the aircraft time chain and calculate its efficiency
[0103] The time chain refers to the time required for an aircraft to complete a mission. Time chain analysis ensures that all actions of the aircraft during the mission are executed completely and the timing is closely connected.
[0104] (2.1) Calculate the total time it takes for the aircraft to complete the mission
[0105] The process of the aircraft completing the mission is divided into multiple links according to the mission flow. For example, the classic OODA link can be divided into four parts: observation time, positioning time, decision time and action time. Assume that the flight process has a total of l intersecting links, and the time taken for each link is T i (i=1,…,l), then the calculation formula of the time chain can be written as:
[0106]
[0107] (2.2) Calculate the time chain efficiency of the aircraft to complete the mission
[0108] The shorter the time required for the aircraft to complete the mission, the higher the time chain efficiency. The time chain efficiency is expressed as E time , and its function relationship with time is recorded as E time =f time (T), there are many options for the functional relationship between time chain efficiency and time, and the commonly used ones are linear function or Sigmoid function. If it is assumed that there is a linear relationship between time chain efficiency and the time to complete the task, the calculation is:
[0109]
[0110] If the relationship between the time chain efficiency and the time to complete the task is considered to satisfy the Sigmoid function, then the calculation is:
[0111]
[0112] Where T min The shortest possible time for the aircraft to complete the mission, T max is the maximum allowed time of the task link, when T ≥ T max When , it is considered that the time requirement cannot be met. The time chain efficiency value is a value between [0,1]. In practical applications, the corresponding time chain efficiency function can be constructed according to the characteristics of the task link.
[0113] (3) Analyze the aircraft precision chain and calculate its effectiveness
[0114] Precision chain refers to the accuracy of each key link in the process of the aircraft completing the mission. Precision chain analysis ensures that the aircraft mission process is clearly handed over and the mission can be completed.
[0115] (3.1) Establishing an accuracy index system for each link of the aircraft mission
[0116] Analyze the aircraft mission process and determine the accuracy indicators of key links, such as detection accuracy, flight accuracy, etc. Each accuracy indicator can be further subdivided. For example, detection accuracy can include angle positioning accuracy, distance positioning accuracy, speed positioning accuracy, etc. Flight accuracy includes guidance accuracy error, etc.
[0117] (3.2) Calculate the accuracy chain performance of the aircraft to complete the mission
[0118] Denote the precision chain efficiency as E acc , calculated as:
[0119]
[0120] l represents the number of precisions of interest, w ai represents the importance weight of the i-th precision, E ai =f ai (ε ai ) represents the accuracy performance value and function relationship of the corresponding link, ε ai Indicates the expected error of the corresponding link. Similarly, the accuracy performance value can also be calculated in multiple ways. If there is a linear relationship between the accuracy performance value and the expected error of the corresponding link, the accuracy performance of each link can be calculated as:
[0121]
[0122] If the function relationship of the precision performance value is selected as the Sigmoid function, the performance value can be calculated as:
[0123]
[0124] where ε ai,max To complete the task with the maximum allowable error, when ε ai ≥ε ai,max , it is considered that the precision chain requirements cannot be met.
[0125] (4) Analyze the cost-effectiveness chain of the aircraft and calculate its effectiveness
[0126] The cost-effectiveness chain comprehensively considers the comprehensive effectiveness of the aircraft to complete the mission and the cost or resources required. The cost-effectiveness chain effectiveness is defined as the efficiency gain brought by unit cost, expressed as E perc , calculated as:
[0127]
[0128] Where E effc Indicates the efficiency of the aircraft in completing the mission, E cost The cost of completing the mission for the aircraft.
[0129] (4.1) Establishing an aircraft mission performance indicator system and calculating performance
[0130] Assume that the link has k links in total. For example, the OODA loop proposed by the US military has 4 links. ej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as:
[0131]
[0132] The effectiveness of each link can be calculated by the performance evaluation methods such as analytic hierarchy process, fuzzy analytic hierarchy process, grey correlation method, etc. by establishing an index system, determining weights, and aggregating layer by layer. Here, the index weighting and aggregation and product aggregation methods are used in combination. The effectiveness of each task link profile is calculated by the index weighting and aggregation method, and then the effectiveness of each task link profile is multiplied. This is because the links of the aircraft mission link are closely related. The multiplication aggregation method can fully consider the impact of the low effectiveness of a certain mission profile on the final mission completion. For example, in extreme cases, if the detection effectiveness of the aircraft is 0, the link that uses the aircraft to complete the task cannot be established, and the effectiveness should be 0.
[0133] Taking the analytic hierarchy process as an example, the efficiency of the aircraft in completing the mission is calculated as follows:
[0134] (4.1.1) Analyze the mission profile of the aircraft and establish the secondary indicators of the performance chain
[0135] Analyze the mission links of the aircraft, establish mission profiles, and establish secondary indicators for effectiveness evaluation. The secondary indicators may include detection, command and control, action, assessment, and support;
[0136] (4.1.2) Analyze mission profile support capabilities and decompose the indicator system
[0137] Analyze the capabilities required to support mission completion in the mission profile, determine the effectiveness evaluation criteria and effectiveness evaluation indicators for the third level and below, for example, the detection indicators can be subdivided into target detection capability, target recognition capability, target positioning and tracking capability, etc., and the target recognition capability can be further subdivided into indicators such as target recognition accuracy, imaging resolution area, and imaging cycle;
[0138] (4.1.3) Obtaining the attribute values of each underlying indicator
[0139] Obtain the values of each underlying indicator. The values can come from expert scoring, performance indicator value calculation, etc., and normalize the underlying indicator values. The normalization methods include arithmetic mean method, geometric mean method, eigenvalue method, etc.
[0140] (4.1.4) Determine indicator weights
[0141] Use the paired comparison matrix method to compare the elements in each level, build a judgment matrix, and perform a consistency test on the judgment matrix. If it fails, adjust the judgment matrix. If it passes, calculate the weight of each bottom-level indicator relative to the upper-level indicator based on the judgment matrix.
[0142] (4.1.5) The bottom-level indicators are aggregated layer by layer to obtain the secondary indicator performance value
[0143] The bottom-level indicators are aggregated to obtain the upper-level indicator performance value, until the secondary indicator performance value of the mission profile is obtained, such as the support performance value and the command and control performance value; suppose that for the jth link of the mission link, m capabilities are required {B j1 ,B j2 ,…,B jm} support, the importance weight relative to the link can be calculated as Ability B ji (1≤i≤m) is subject to {C ji1 ,C ji2 ,…,C jin}Indicator impact, the importance weight of each indicator is Then the efficiency value of the jth link can be calculated as:
[0144]
[0145] If the indicator C jip We can continue to analyze the performance index factors, then E(C jip ) is obtained by aggregating the next layer of indicators, otherwise E(C jip ) is obtained by expert scoring or normalization of indicator performance values.
[0146] (4.1.6) Calculate the task link efficiency chain efficiency value
[0147] The efficiency value of the entire task link can be calculated by multiplying the efficiency values of each task profile. Assume that the link has k links, E ej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as:
[0148]
[0149] The calculation process is as follows Figure 1 shown.
[0150] (4.2) Calculate the cost of the aircraft to complete the mission
[0151] In terms of cost, we mainly consider the two aspects of the cost of the aircraft to complete the mission, namely, the aircraft use cost C f and support resource cost C s .
[0152] (4.2.1) Calculate the cost of using the aircraft
[0153] The aircraft use cost is calculated as:
[0154] C f =C single ×N cost
[0155] That is, the product of the cost of a single aircraft and the number of aircraft required to complete the mission.
[0156] C single is the cost of using a single aircraft, N cost The cost of a single aircraft can be estimated by summing up the cost and using similar aircraft. The summing up method is to divide the aircraft into several important components, such as the fuselage cost, propulsion system cost, control system cost, etc. Suppose there are m parts in total, and the cost of each part is C. ci , then the cost of a single aircraft is calculated as The multiple aircraft estimation rule is to select several independent variables x that are sensitive to the cost of a single aircraft. q (q=1,…,Q), such as flight distance, takeoff mass, maximum speed, and index error, etc., to establish a linear function relationship between the cost and parameters of a single aircraft:
[0157] y=b0+b1x1+b2x2+…+b Q x Q +e
[0158] e is a random variable that obeys an independent normal distribution. When the costs of no less than Q0 (Q0 ≥ Q+1) similar aircraft are known, their cost vector and parameter vector are:
[0159]
[0160] Then the calculated parameters are Determine the key parameter value x of the aircraft to perform the mission q (si), the cost of a single aircraft can be calculated as:
[0161]
[0162] (4.2.2) Calculate the cost of supporting resources for aircraft mission completion
[0163] The cost of support resources cannot be directly calculated with numbers. It can be calculated by using the analytic hierarchy process, fuzzy analytic hierarchy process, grey correlation method and other performance evaluation methods through the steps of establishing an indicator system, determining weights, and layer-by-layer aggregation. The specific calculation process is the same as the calculation method of the task sub-profile effectiveness, and the result is a number between 0 and 1. A simple support resource cost indicator system such as Figure 2 As shown, its secondary indicators include command and control costs, maintenance and support costs, and support information costs. The command and control costs are subdivided into command decision-making time, command operability, etc. The maintenance and support costs can be subdivided into spare parts preparation costs, technical complexity, etc. The support information costs can be divided into radar usage costs, UAV usage costs, satellite usage costs, etc.
[0164] (4.2.3) Calculate the total cost of the aircraft to complete the mission (cost chain efficiency)
[0165] The cost chain efficiency is calculated as:
[0166]
[0167] α∈[0,1] is a weighting coefficient that measures the importance of the aircraft usage cost and the support resource cost. f,max The maximum possible cost of using an aircraft is artificially set so that the cost chain efficiency is between 0 and 1.
[0168] (4.3) Calculate the cost-effectiveness of the aircraft in completing the mission
[0169] Since the efficiency calculation formula of the cost-effective chain is The efficiency values of the efficiency chain and the cost chain are both between [0,1]. This may lead to an infinite efficiency of the efficiency-cost ratio chain. In order to ensure that the efficiency of the efficiency-cost ratio chain is between [0,1], the calculation formula is adjusted to:
[0170]
[0171] γ∈[0,1] is the selected adjustment coefficient, which is determined according to the maximum and minimum values of the efficiency chain and cost chain under different methods.
[0172] (5) Calculate the efficiency of the entire link of the aircraft to complete the mission and complete the efficiency evaluation
[0173] The efficiency of the entire link for the aircraft to complete the mission should take into account the efficiency of the time chain, precision chain and cost-effectiveness chain. At the same time, it should be considered that there are basic requirements for time and precision to complete the mission. The maximum allowable time of the link is T max , the maximum accuracy error of each link is ε ai,max , based on the link efficiency E ch Calculated as:
[0174]
[0175] E in =β1E time +β2E acc +β3E perc ,β1+β2+β3=1
[0176] in etc. are the indicative functions, and their expressions are:
[0177]
[0178] The indicative function measures whether the aircraft mission link time and accuracy meet the conditions. When the conditions are not met, the aircraft cannot complete the mission, and the overall performance evaluation result is 0. i (i=1,2,3) is a number between 0 and 1, indicating the importance weight of the time chain, precision chain, and cost-effectiveness chain.
[0179] Parts of the present invention that are not described in detail belong to common knowledge among those skilled in the art.
Claims
1. A performance evaluation method based on task links and application scenarios, characterized by include: (1) Construct the aircraft mission link and determine the angle for calculating the efficiency of the mission link; According to the characteristics of the aircraft and its mission, the aircraft mission chain is constructed. The mission chain includes detection, command and control, confrontation, evaluation, and support. The mission chain is analyzed from different perspectives of time, accuracy, and cost-effectiveness. The effectiveness of the aircraft mission chain is calculated from different perspectives of time chain, accuracy chain, and cost-effectiveness chain. (2) Analyze the aircraft time chain and calculate its effectiveness. The time chain refers to the time it takes for the aircraft to complete the mission; (3) Analyze the aircraft's precision chain and calculate its effectiveness. The precision chain refers to the accuracy of each key link in the aircraft's mission completion process; (4) Analyze the cost-effectiveness chain of the aircraft and calculate its effectiveness. The cost-effectiveness chain comprehensively considers the comprehensive effectiveness of the aircraft in completing the task and the cost or resources required. The effectiveness of the cost-effectiveness chain is defined as the efficiency gain brought by unit cost, expressed as E perc , calculated as: Among them, E effc Indicates the efficiency of the aircraft in completing the mission, E cost The cost chain effectiveness of completing the mission for the aircraft; (5) Based on the calculation results of steps (2), (3), and (4), calculate the efficiency of the aircraft in completing the entire mission link and complete the efficiency evaluation.
2. The method for evaluating the performance of a task chain and an application scenario according to claim 1, characterized in that: The analysis of the aircraft time chain and calculation of its effectiveness are specifically as follows: (2.1) Calculate the total time it takes for the aircraft to complete the mission; The process of the aircraft completing the mission is divided into multiple links according to the mission flow. Assume that the flight process has M links that intersect from beginning to end, and the time taken for each link is T. i ,i=1,...,M, then the calculation formula of the time chain can be written as: (2.2) Calculate the time chain efficiency of the aircraft to complete the mission; The shorter the time required for the aircraft to complete the mission, the higher the time chain efficiency. The time chain efficiency is expressed as E time , and its function relationship with time is recorded as E time =f time (T), there are many options for the functional relationship between time chain performance and time, including linear function or Sigmoid function.
3. The method for evaluating the performance of a task chain and an application scenario according to claim 2, characterized in that: If there is a linear relationship between time chain performance and the time to complete the task, the calculation is: If the relationship between the time chain efficiency and the time to complete the task satisfies the Sigmoid function, the calculation is: Where T min The shortest possible time for the aircraft to complete the mission, T max is the maximum allowed time of the task link, when T ≥ T max When the time requirement is considered unsatisfactory; The time chain efficiency value is a value between [0,1].
4. The method for evaluating the performance of a task chain and an application scenario according to claim 1, characterized in that: The analysis of the aircraft precision chain and calculation of its effectiveness are specifically as follows: (3.1) Establish an accuracy indicator system for each link of the aircraft's mission completion; Analyze the mission process of the aircraft and determine the accuracy indicators of key links. The detection accuracy includes angle positioning accuracy, distance positioning accuracy, and speed positioning accuracy; the flight accuracy includes guidance accuracy error; (3.2) Calculate the accuracy chain effectiveness of the aircraft in completing the mission; Denote the precision chain efficiency as E acc , calculated as: l represents the number of precisions of interest, w ai represents the importance weight of the i-th precision, E ai =f ai (ε ai ) represents the accuracy performance value and function relationship of the corresponding link, ε ai Represents the expected error of the corresponding link; the functional relationship includes a linear relationship or a Sigmoid function relationship.
5. The method for evaluating the performance of a task chain and an application scenario according to claim 4, characterized in that: If there is a linear relationship between the precision performance value and the expected error of the corresponding link, the precision performance of each link is calculated as: If the function relationship of the precision performance value is selected as the Sigmoid function, the performance value is calculated as: Among them, ε ai,max To complete the task with the maximum allowable error, when ε ai ≥ε ai,max , it is considered that the precision chain requirements cannot be met.
6. The method for evaluating the performance of a task chain and an application scenario according to claim 1, characterized in that: The analysis of the aircraft cost-effectiveness chain and calculation of its effectiveness are specifically as follows: (4.1) Establishing an aircraft mission performance indicator system and calculating performance Assume that the link has k links, E ej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as: (4.2) Calculate the cost chain efficiency E of the aircraft to complete the mission cost The cost chain efficiency of the aircraft to complete the mission includes the aircraft use cost C f and support resource cost C s ; (4.3) Calculate the cost-effectiveness of the aircraft in completing the mission: γ∈[0,1] is the selected adjustment coefficient.
7. The method for evaluating the effectiveness of a task chain and an application scenario according to claim 6, characterized in that: Calculate the task link efficiency chain efficiency value E effc , specifically: (4.1.1) Analyze the mission profile of the aircraft and establish the secondary indicators of the effectiveness chain. Analyze the mission chain of the aircraft, establish the mission profile, and establish the secondary indicators of effectiveness evaluation; (4.1.2) Analyze mission profile support capabilities and decompose the indicator system Analyze the capabilities required to support mission completion in the mission profile, determine the effectiveness evaluation criteria and effectiveness evaluation indicators for level 3 and below, and subdivide the detection indicators into target detection capability, target recognition capability, and target positioning and tracking capability. The target recognition capability is subdivided into indicators such as target recognition accuracy, imaging resolution area, and imaging cycle; (4.1.3) Obtain the attribute values of each underlying indicator Obtaining the values of each underlying indicator, which are determined according to the characteristics of the aircraft task chain itself, and normalizing the underlying indicator values. The normalization methods include arithmetic mean method, geometric mean method or eigenvalue method; (4.1.4) Determine indicator weights Use the paired comparison matrix method to compare the elements in each level, build a judgment matrix, and perform a consistency test on the judgment matrix. If it fails, adjust the judgment matrix. If it passes, calculate the weight of each bottom-level indicator relative to the upper-level indicator based on the judgment matrix. (4.1.5) The bottom-level indicators are aggregated layer by layer to obtain the secondary indicator performance value The bottom-level indicators are aggregated to obtain the upper-level indicator performance value, until the secondary indicator performance value of the task profile is obtained by aggregation; suppose that for the jth link of the task link, m capabilities are required {B j1 ,B j2 ,…,B jm } support, the importance weight relative to the link is calculated as Ability B ji , 1≤i≤m is subject to {C ji1 ,C ji2 ,…,C jin }Indicator impact, the importance weight of each indicator is Then the efficiency value of the jth link is calculated as: If the indicator C jip We can continue to analyze the performance index factors, then E(C jip ) is obtained by aggregating the next layer of indicators, otherwise E(C jip ) is determined directly based on the characteristics of the aircraft mission link; (4.1.6) Calculate the task link efficiency chain efficiency value The efficiency value of the entire task link can be calculated by multiplying the efficiency values of each task profile. Assuming that the link has k links, E ej represents the efficiency of the jth link, then the efficiency of the aircraft to complete the task is calculated as:
8. The method for evaluating the effectiveness of a task chain and an application scenario according to claim 6, characterized in that: Calculate the cost chain efficiency E of the task link cost , specifically: (4.2.1) Calculate the aircraft usage cost C f ; C f =C single ×N cost That is, the product of the cost of a single aircraft and the number of aircraft required to complete the mission. C single is the cost of using a single aircraft, N cost Indicates the number of aircraft required to complete the mission; (4.2.2) Establish an index system, determine weights, and calculate the cost of aircraft mission support resources C layer by layer through the hierarchical analysis method s ; (4.2.3) Calculate the total cost of the aircraft to complete the mission, that is, the cost chain efficiency E cost The cost chain efficiency is calculated as: α∈[0,1] is a weighting coefficient that measures the importance of the aircraft usage cost and the support resource cost. f,max The maximum possible cost of using the aircraft is artificially set, so that the cost chain efficiency is between 0 and 1.
9. The method for evaluating the effectiveness of a task link and an application scenario according to claim 8, characterized in that: The cost of a single aircraft is C single It is calculated by the addition method or the similar aircraft estimation method, specifically: The summation method is to divide the aircraft into m parts, and the cost of each part is C ci , then the cost of a single aircraft is calculated as The similar aircraft estimation rule is to select several independent variables x that are sensitive to the cost of a single aircraft. q , q=1,…,Q, Q is the number of independent variables; establish a linear function relationship between the cost of a single aircraft and the parameters: y=b0+b1x1+b2x2+…+b Q x Q +e e is a random variable that follows an independent normal distribution; b0, b1, …, b Q is the coefficient; When the costs of at least Q0, Q0 ≥ Q+1 similar aircraft are known, their cost vector and parameter vector are: Then the calculated parameters are Determine the key parameter value x of the aircraft to perform the mission q (si), the cost of a single aircraft is calculated as:
10. The method for evaluating the effectiveness of a task link and an application scenario according to claim 1, characterized in that: The calculation of the efficiency of the aircraft in completing the entire mission link is specifically: Efficiency based on task links ch Calculated as: E in =β1E time +β2E acc +β3E perc , coefficient β1+β2+β3=1; Among them, the maximum allowed time of the link is T max , the maximum accuracy error of each link is ε ai,max , is the characteristic function, and its expression is:
Citation Information
Patent Citations
Method and system for obtaining satellite performance
CN105631191A
Method for rapidly evaluating capability of airplane
CN115034591A
Efficiency evaluation method for engineering guarantee system
CN116029482A
Satellite internet-oriented comprehensive effectiveness evaluation method and system
CN116257784A
Efficiency deduction evaluation method based on unmanned cluster scale and index dynamic adjustment
CN117611018A