Application scenario-oriented performance evaluation method, system, device and medium

Abstract

The present invention proposes a performance evaluation method, system, device and medium for application scenarios, which relates to the field of data processing technology. The method includes: constructing a multi-level networked evaluation index system based on an evaluation index system for implementing actions with satellites as the main body; inputting scenarios and submitting requirements; matching the specific levels of the multi-level networked evaluation index system according to specific evaluation needs, and locking the evaluation indicators suitable for specific evaluation needs; assigning weights to the multi-level networked evaluation index system according to the scenario data and demand data; dynamically updating the weights of the current evaluation system according to the current evaluation results; evaluating and calculating, and generating evaluation results. The present invention can perform specific channel evaluations for complex scenarios, and perform performance evaluations for application requirements with multiple satellites, multiple resource nodes, and multiple interaction modes, avoiding evaluation deviations caused by the fixation of the index system and weights, and can cope with a large number of complex application scenarios.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an application scenario-oriented performance evaluation method, system, device and medium. Background Art

[0002] Performance evaluation mainly involves three parts: the construction of the indicator system, the setting of the evaluation indicator weights, and the calculation of comprehensive performance. However, with the continuous development of the Internet constellation, the traditional performance evaluation method can no longer cope with the current complex application background and application process. This is because the application concept of the Internet constellation has brought fundamental changes to the traditional application method.

[0003] The characteristics of the Internet constellation are its large number, efficient inter-satellite communication and payload diversity, which enable it to form more dimensional and faster responsive application scenarios. In different application scenario assumptions, the weight of indicators should also be different to determine the important influencing factors of the application scenario, so as to calculate the application performance that is closest to reality.

[0004] Under the existing technical background, the evaluation of the effectiveness of space application forces mainly relies on the comprehensive analysis of various indicators, such as communication capability, positioning accuracy, payload diversity, response speed, etc. However, traditional evaluation methods often lack in-depth understanding and detailed analysis of application scenarios, resulting in a large deviation between the evaluation results and the actual application effects. In addition, with the rapid development of Internet constellation technology, traditional application methods are undergoing disruptive changes. Internet constellations use their large number, efficient inter-satellite communication, and payload diversity to form application scenarios with more dimensions and faster responses. This makes it impossible for traditional performance evaluation methods to fully reflect the actual effects of space applications when dealing with these complex scenarios, and their accuracy and reliability are insufficient. For example:

[0005] The application document with patent number CN112052608A discloses an integrated method for combat simulation and effectiveness evaluation. By establishing combat scenarios and capability indicators, conducting combat mission analysis and simulation operations, and completing effectiveness analysis and evaluation of simulation data, it can achieve the iterative evolution of the full-process design and evaluation of "combat plan design-simulation-data analysis and effectiveness evaluation", and provide technical support for the demand demonstration work of equipment development. This technical solution is mainly aimed at the full-process design of data analysis and effectiveness evaluation. The method reuses the evaluation solution template in the evaluation project according to the evaluation object and goal, and does not include a separate effectiveness evaluation for specific application scenarios. Today's development trend has changed to flexible and multi-dimensional task requirements, so this method may not be able to fully meet the effectiveness evaluation of current complex satellite application scenarios.

[0006] The application document with patent number CN112118038A discloses a satellite performance evaluation method, which is a performance evaluation scheme based on environmental fuzzy factors in the performance evaluation technology of satellite communication systems based on cognitive radio. In the performance evaluation of cognitive satellite systems, on the basis of combining the analytic hierarchy process and the fuzzy comprehensive evaluation method, environmental fuzzy factors are added to construct an environmental parameter system. Compared with traditional algorithms, this technical scheme has better environmental adaptability, can comprehensively evaluate the performance of satellite communication systems, and optimize the resource management efficiency of satellite communication systems, but its parameter system and evaluation system are no longer suitable for application scenario evaluation. In the face of possible application needs in reality, it is necessary to increase and update the application indicators of the original comprehensive performance evaluation method of complex satellite systems, and it is impossible to perform dynamic evaluation and adapt to today's changing and complex satellite application scenarios. Summary of the invention

[0007] In order to overcome the defects of the above-mentioned performance evaluation method and system, the present invention provides an application scenario-oriented performance evaluation method, system, device and medium that can cope with a large number of complex application scenarios.

[0008] As for the performance evaluation method for application scenarios, the present invention provides a performance evaluation method for application scenarios to solve the technical problem, which includes the following steps:

[0009] Construct an evaluation indicator system for satellite-based operations;

[0010] Based on the evaluation index system for implementing actions with satellites as the main body, a multi-level evaluation index system is constructed, and based on the multi-level evaluation index system, a multi-level networked evaluation index system is constructed;

[0011] Input scenarios, submit requirements, set application processes and arrange scenarios, and manage scenario operation scheduling processes by setting the interaction relationship between nodes;

[0012] According to specific evaluation needs, the specific levels of the multi-level networked evaluation indicator system are matched to lock in evaluation indicators suitable for specific evaluation needs;

[0013] According to the scenario data and demand data, weights are assigned to the multi-level networked evaluation index system; and the weights of the current evaluation system are dynamically updated according to the current evaluation results;

[0014] Evaluate the calculation and generate evaluation results.

[0015] As an improvement of the effectiveness evaluation method for application scenarios, the evaluation index system for implementing actions with satellites as the main body includes:

[0016] Classify comprehensive effectiveness indicators based on task requirements;

[0017] Collect and analyze data on variables relevant to effectiveness evaluation;

[0018] Extracting key performance indicators and the correlation between the key performance indicators based on the variable data according to specific task requirements;

[0019] An evaluation index system for the actions implemented with the satellite as the main body is formed based on the key performance indicators and the correlation between the key performance indicators.

[0020] As an improvement of the performance evaluation method for application scenarios, the multi-level evaluation index system includes a comprehensive performance layer, a task index layer, a specific implementation layer and a measurement index layer.

[0021] As an improvement of the performance evaluation method for application scenarios, the multi-level networked evaluation index system meets the demand inputs at different levels.

[0022] As an improvement to the performance evaluation method for application scenarios, each indicator of the multi-level networked evaluation indicator system is added with an index.

[0023] As an improvement of the performance evaluation method for application scenarios, the interaction mode between the nodes can be selectively set according to actual needs.

[0024] As an improvement of the performance evaluation method for application scenarios, the weighting of the multi-level networked evaluation index system according to the scenario data and demand data includes:

[0025] Combine the data information transmission relationship and control relationship between equipment platforms with the scale, divide different data information relationships and control relationships into different levels of importance, assign different registration scales, and form a scaling criterion.

[0026] Compared with the related art, the present invention uses a hierarchical approach to evaluate the factors of the entire index system from bottom to top, divides the comprehensive performance index into levels, and uses different methods to calculate the quantitative index values ​​and the fuzzy mathematical membership of qualitative indicators for different indicators according to the input of application requirements; some quantitative performance indicators can be obtained by analyzing the specific system performance and using the specific calculation model of the indicators, and qualitative indicators can be expressed by fuzzy mathematical membership or directly given empirical estimates by experts.

[0027] At the same time, a dynamically adjusted weighted indicator system is established, which pays more attention to locking on a single target than in normal conditions. By dynamically adjusting the weighted values ​​of multiple factors, it can accurately assess application needs.

[0028] Scenario scenario editing for satellite interference, surveillance, and space action provides configurable scenario processes and interaction rule settings. By analyzing the satellite's set parameters, a deduction trigger mechanism is set according to factors such as spatial position relationship, action duration, and number of interactions, and evaluation indicators are calculated based on the deduction results.

[0029] The present invention can perform specific channel evaluation for complex scenarios, and conduct performance evaluation for application requirements of multiple satellites, multiple resource nodes, and multiple interaction modes, thereby avoiding evaluation deviations caused by the fixation of the indicator system and weights. Under this mechanism, by improving the comprehensive indicator system and the index triggering of multi-level indicators, a large number of complex application scenarios can be coped with, providing information support for scenario deduction.

[0030] As for the performance evaluation system for application scenarios, the present invention is to solve the technical problem. The performance evaluation system for application scenarios includes:

[0031] An evaluation index system module is used to construct an evaluation index system for implementing actions with satellites as the main body, to construct a multi-level evaluation index system based on the evaluation index system for implementing actions with satellites as the main body, and to construct a multi-level networked evaluation index system based on the multi-level evaluation index system;

[0032] The scenario input module is used to input scenarios, submit requirements, set application processes and arrange scenarios, and manage the scenario operation scheduling process by setting the interaction relationship between nodes;

[0033] A dynamic weighting module is used to assign weights to the multi-level networked evaluation index system according to the scenario data and demand data; and dynamically update the weight of the current evaluation system according to the current evaluation results;

[0034] The evaluation module is used to evaluate the calculation and generate the evaluation results.

[0035] Compared with the related art, the application scenario-oriented performance evaluation system of the present invention implements the above process of the application scenario-oriented performance evaluation method, and its beneficial effects are the same as the beneficial effects of the application scenario-oriented performance evaluation method of the present invention, which will not be repeated here.

[0036] As for the performance evaluation device for application scenarios, the present invention is to solve the technical problem. The performance evaluation device for application scenarios includes:

[0037] A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the above-mentioned application scenario-oriented performance evaluation method when executed by the processor.

[0038] Compared with the related art, the application scenario-oriented performance evaluation device of the present invention implements the process of the above-mentioned application scenario-oriented performance evaluation method, and its beneficial effects are the same as the beneficial effects of the application scenario-oriented performance evaluation method of the present invention, which will not be repeated here.

[0039] As for computer storage media, the present invention stores a computer program on a computer storage medium for solving the technical problem, and when the computer program is executed by a processor, the steps of the above-mentioned application scenario-oriented performance evaluation method are implemented.

[0040] Compared with the related art, the computer storage medium of the present invention implements the process of the above-mentioned performance evaluation method for application scenarios, and its beneficial effects are the same as the beneficial effects of the performance evaluation method for application scenarios of the present invention, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a flow chart of an application scenario-oriented performance evaluation method according to an embodiment of the present invention;

[0042] Figure 2 Another flow chart of the application scenario-oriented performance evaluation method according to an embodiment of the present invention;

[0043] Figure 3 A schematic diagram of a multi-level networked evaluation index system according to an embodiment of the present invention;

[0044] Figure 4 A schematic diagram of simulation results of a satellite interference simulation for target coverage time according to an embodiment of the present invention;

[0045] Figure 5 It is a schematic diagram of simulation results of total earth coverage of a satellite monitoring simulation according to an embodiment of the present invention. DETAILED DESCRIPTION

[0046] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined purpose, the present invention is described in detail below in conjunction with the accompanying drawings and preferred embodiments.

[0047] The description of the method flow in the specification of the present invention and the steps of the flowchart in the drawings of the specification of the present invention do not have to be strictly executed according to the step numbers, and the method steps can be executed in a different order. Moreover, some steps can be omitted, multiple steps can be combined into one step, and / or one step can be decomposed into multiple steps.

[0048] In view of the defects in the related technologies, the embodiments of the present invention provide a performance evaluation method, system, device and medium for application scenarios, propose a hierarchical index system, establish a new index quantification method, which can adapt to flexible and changeable task scenarios, and update the index weights through evaluation result feedback to improve the index system; the present invention matches a specific index system according to the performance evaluation requirements of different application scenarios, selects different weight division levels according to task requirements, conducts comprehensive hierarchical performance evaluation, and forms an evaluation result.

[0049] The first embodiment of the present invention provides an application scenario-oriented performance evaluation method, see Figure 1-2 The flow chart of the performance evaluation method for application scenarios in an embodiment of the present invention is as follows: Figure 1-2 As shown, the specific steps include:

[0050] S100, construct an evaluation index system for satellite-based operations. In this step, first classify the comprehensive performance indicators based on mission requirements, then collect and analyze variable data related to performance evaluation, and then extract key performance indicators and the correlation between these key performance indicators based on variable data according to specific mission requirements, and finally form evaluation indicators.

[0051] Specifically, the comprehensive performance index is the performance evaluation index of most current satellite systems. These performance indicators have been applied and verified in actual satellite systems, so they are highly practical and reliable. This ensures that the evaluation results are closer to actual application needs and can fully reflect the performance of space applications.

[0052] In the specific implementation process, first of all, it is necessary to clarify the mission requirements and classify the comprehensive effectiveness indicators according to the mission requirements. The basis for classification can include application objects, application scenarios, resource attributes, etc. For space applications, mission requirements may include interference, monitoring, satellite space functions, communications, reconnaissance, navigation, combat support, etc. The purpose of classification is to better organize and analyze these indicators so as to more accurately evaluate the effectiveness of space applications. In this way, a set of targeted comprehensive indicator systems can be formed. According to the mission requirements, several effectiveness indicators and the correlation between these indicators are extracted. These indicators should be directly related to the mission requirements and can reflect the key performance parameters of application effectiveness. At the same time, it is necessary to analyze the correlation between these indicators and understand how they affect each other. Finally, the effectiveness indicators and correlations obtained according to the above steps can constitute a complete evaluation indicator system. This system will be used in subsequent space application effectiveness evaluation work to help decision makers better understand the performance and effects of applications.

[0053] S200, construct a multi-level evaluation indicator system based on the evaluation indicator system for implementing actions with satellites as the main body, and construct a multi-level networked evaluation indicator system based on the multi-level evaluation indicator system; the multi-level networked evaluation indicator system meets the demand inputs at different levels.

[0054] Specifically, after building a preliminary evaluation indicator system, this step needs to be divided into levels according to certain standards. Through hierarchical division, the complex indicator system can be structured. For example, see Figure 3 ,The multi-level evaluation index system includes four levels including comprehensive ,effectiveness layer, task index layer, specific implementation layer and ,measurement index layer.

[0055] After dividing the levels, you need to add an index to each indicator. The index can be an identifier used to quickly locate and find a specific indicator. The purpose of adding an index is to better meet the needs of the evaluation work. When new requirements are input, the relevant indicators can be quickly located through the index for targeted evaluation and analysis.

[0056] When evaluating the effectiveness of space applications, it is necessary to have a deep understanding of the capabilities represented by each indicator and the mutual influence relationship between them. Designing a multi-level structure based on the evaluation indicators and mutual influence relationship can better organize these indicators and make them more consistent with the complexity and diversity of actual applications. For example, some indicators may be key performance parameters at the system level, but may only serve as auxiliary indicators at the application level. Through multi-level structure design, this hierarchical relationship can be more accurately reflected.

[0057] On the basis of the multi-level structure, a networked evaluation index system is constructed, which connects the indicators of each level to form a complete evaluation network. Through this networked evaluation index system, the overall effectiveness of space applications and the performance of each level can be fully understood.

[0058] From another perspective, the above multiple levels can also be understood as different levels from macro to micro. For example, the macro level is used to describe the overall goal of the entire system or project. These indicators are usually abstract and macro, and need to be concretized and quantified through indicators at other levels. From macro to micro, the levels are refined step by step until the indicators are highly operational and can be directly measured through specific data and standards.

[0059] For example, the evaluation index system can be found in Figure 3The embodiment of the present invention is based on the performance evaluation indicators of most satellite systems at present, and has created an indicator system and quantification method for implementing interference actions with satellites as the main body. The solid line frame is an indicator system specifically formed for satellite interference tasks, satellite monitoring tasks, and satellite space action tasks.

[0060] Taking the satellite jamming mission as an example, the miss scan rate u is the ratio of the total time that the target node is not selected by the satellite node beam scanned in a whole time period to the length of the whole period. The miss scan rate can reflect the satellite's ability to continuously lock the target during the mission and can be used to evaluate the mission efficiency. The miss scan rate u is calculated as follows:

[0061]

[0062] Where n is the number of time periods during which the target is not covered by the beam in the entire time period, Indicates The duration of a period, T E Indicates the end time of the entire time period, T S Indicates the start time of the entire time period. Figure 4 , Figure 4 The simulation result of the target coverage time for a satellite interference simulation is obtained. The generated parameters are used to calculate the missed scan rate of the satellite system established this time, and then the performance is evaluated.

[0063] Another example is the satellite low-orbit monitoring indicator. The average monitoring rate f is the ratio of the coverage area of ​​all satellites at a certain moment to the total area of ​​the earth. The data is counted every minute within 24 hours and the average is taken. The average monitoring rate can be reflected in the monitoring characteristics of different satellites during the satellite's mission of monitoring missiles, aircraft and other equipment. It is used to evaluate the quality of satellite selection for target monitoring in such scenario simulations. Please refer to Figure 5 , Figure 5 This is the simulation result of the total coverage of the earth for a satellite monitoring simulation. The average monitoring rate is calculated using the single satellite coverage rate per minute to evaluate the performance.

[0064] S300, input the scenario and submit the requirements. In this step, the application process is set and the scenario is arranged, and the scenario operation scheduling process is managed by setting the interaction relationship between each node. It is necessary to clarify the specific process and scenario setting of the application, which involves determining the various parts of the application and the relationship between them to ensure that the evaluation is consistent with the actual application scenario; in order to ensure the accuracy and effectiveness of the evaluation, it is necessary to set the interaction relationship between each node. The interaction relationship determines the operation order and logic of the scenario, so as to better simulate the situation in the actual application.

[0065] The interaction mode between nodes can be set according to actual needs, that is, the interaction mode between nodes can be adjusted according to specific evaluation requirements to ensure that the evaluation is closer to the actual application scenario.

[0066] During the evaluation process, different scenarios can be fine-tuned or modified. The changes in the evaluation parameters of the finely modified scenarios can be recorded and compared to better understand the impact of parameter changes on the evaluation results.

[0067] Specifically, it includes the following steps: scenario definition, task setting, task planning, and simulation implementation.

[0068] For example, taking the satellite jamming mission as an example, a satellite suitable for performing the jamming mission is selected from a large number of low-orbit satellites. After determining the satellite sensors and capability payloads (to be used to perform the jamming mission), the target high-orbit satellite for the jamming mission and the ground terminal nodes related to it are selected. After determining all related satellites, ground stations and other nodes, the interaction relationship is set, and an appropriate trigger mechanism is selected to start the jamming mission. For example, the trigger mechanism of the satellite jamming mission can be set to trigger the jamming when the selected low-orbit satellite is about to reach the sub-satellite point of the target high-orbit satellite, and then the scenario assumptions are started:

[0069] After the interference task is triggered, the following steps will be performed:

[0070] Step 1: The satellite receives the downlink signal from the target high-orbit satellite: The satellite receives the signal from the target high-orbit satellite;

[0071] Step 2: The satellite analyzes the signal and sends the analysis results to the ground station for processing: The satellite analyzes the received signal and sends the analysis results to the ground station for further processing;

[0072] Step 3: The satellite demodulates and stores the key signals and sends the data results to the ground station: confirm whether there is information data transmitted by the key target in the demodulated data, and send it to the satellite through the ground measurement and control station;

[0073] Step 4: The satellite sends an uplink interference signal to make the ground station terminal offline: If it is confirmed that there is important information, the satellite will send an uplink interference signal to make the ground station terminal unable to work normally.

[0074] Next, the front end returns the parameters based on the scenario. Based on the scenario, the front end will edit and adjust the corresponding parameters, and then return these parameters for subsequent evaluation and analysis, completing the input scenario and submitting the requirements.

[0075] S400, according to the specific evaluation needs, matches the specific level of the indicator system and locks in the evaluation indicators suitable for specific evaluation needs.

[0076] In this step, it is necessary to clarify the purpose and needs of the evaluation, and determine what specific data needs to be collected to meet these needs; after clarifying the required data, match these data with the constructed evaluation indicator system. The matching level can cover the scope and characteristics of the required data, and then lock in specific evaluation indicators. Specific evaluation indicators can most accurately reflect the evaluation needs and provide the required data. These specific evaluation indicators will become the basis for subsequent evaluation work, ensuring the pertinence and accuracy of the evaluation work, so that the evaluation results can better reflect the actual needs and situations.

[0077] S500, assign weights to the evaluation index system according to the scenario data and the demand data; and dynamically update the weights of the current evaluation system according to the current evaluation results.

[0078] Specifically, this step empowers the evaluation index system according to the scenario assumptions in the simulation phase and the result data provided by the simulation implementation. At the same time, with the assistance of experts in related fields and past experience, the data information transmission relationship and the control relationship between equipment platforms are combined with the scale, and different data information relationships and control relationships are divided into different levels of importance, and different registration scales are assigned to form a scale criterion. The scale criterion will serve as the basis for judging the importance of equipment platforms or equipment systems. Each evaluation result will serve as the basis for the next empowerment, and the weight of the evaluation index will be dynamically updated.

[0079] For example, taking the satellite interference scenario as an example, performance indicators such as timeliness, coverage, target recognition capability and anti-interference capability play an important role in the mission process. According to the target of the application scenario - one or more satellites, the corresponding satellite interference scenario performance indicator system is matched, and combined with the calculation method, the contribution of this indicator system to the satellite interference scenario can be obtained, thereby quantitatively evaluating the rationality of the selected equipment.

[0080] S600, evaluation calculation, generating evaluation results.

[0081] In this step, quantitative indicators are directly calculated based on the calculation model. Qualitative indicators need to determine the degree of membership of the application scenario relative to the indicator system, that is, the fuzzy vector. According to the input of application requirements, different methods are used to calculate the fuzzy vector for different indicators.

[0082] According to the characteristics of the indicator, the appropriate normalization model is selected to normalize the indicator value to obtain the quantitative value of the indicator. At the same time, according to the relationship between the indicators at the same level in the indicator system, the contribution of each indicator to the upper level indicator is obtained to determine the weight of the indicator.

[0083] According to the physical meaning of the indicators and their mutual relationships, the corresponding indicator aggregation model is selected to realize the integration of indicators layer by layer and level by level, and the adaptive weighted performance evaluation matrix is ​​selected and constructed to provide a mathematical reference for the final performance solution.

[0084] The final comprehensive analysis and evaluation is conducted from a comprehensive and systematic perspective, and the results of the comprehensive evaluation can be used as a digital representation to measure the effectiveness of the equipment system. The generated evaluation results can affect the matching logic of the indicators, and the evaluation indicator weight matrix can be fine-tuned according to different mission requirements to meet multi-scenario application modes. By dynamically adjusting the quantitative value of the weighted indicator, the adjusted satellite comprehensive effectiveness indicator value is obtained.

[0085] The performance evaluation method for application scenarios in the embodiment of the present invention evaluates the factors of the entire index system from bottom to top in a hierarchical manner, divides the comprehensive performance index into levels, and adopts different methods to calculate the quantitative index values ​​and the fuzzy mathematical membership of the qualitative index for different indicators according to the input of application requirements. Some quantitative performance indicators can be obtained by analyzing the specific system performance and using the specific calculation model of the indicators, and the qualitative indicators can be expressed by fuzzy mathematical membership or directly given by experts. Empirical estimates.

[0086] At the same time, a dynamically adjusted weighted indicator system is established. For example, taking the satellite interference scenario as an example, indicators such as timeliness (the time from when the satellite receives the reconnaissance demand to when the intelligence processing is completed and transmitted), coverage, target recognition capability (recognition accuracy, control and defense capability), and anti-interference capability (number of satellites, adaptability after being attacked) can constitute the system. In its normal state, the coverage indicator has little effect, so the weighted quantitative indicator is low. When the application demand is transformed into a large-scale satellite interference scenario, the coverage of multiple targets will become the main demand, so the weight of the coverage indicator will increase. Compared with the normal state, which focuses more on locking a single target, the dynamic adjustment of the weighted values ​​of multiple factors can accurately assess the application needs.

[0087] For scenario editing of satellite interference, surveillance, and space action, configurable scenario flow and interaction rule settings are provided. By analyzing the satellite's setting parameters, the simulation trigger mechanism is set according to factors such as spatial position relationship, action duration, and number of interactions, and the evaluation indicators are calculated based on the simulation results.

[0088] Compared with traditional evaluation technologies, the present invention can perform specific channel evaluation in complex scenarios, and conduct performance evaluation for application requirements of multiple satellites, multiple resource nodes, and multiple interaction modes, avoiding evaluation bias caused by the fixation of the indicator system and weights. Under this mechanism, by improving the comprehensive indicator system and the index triggering of multi-level indicators, it can cope with a large number of complex application scenarios and provide information support for scenario deduction.

[0089] The second embodiment of the present invention provides an application scenario-oriented performance evaluation system. The application scenario-oriented performance evaluation system of the present invention for solving the technical problem includes:

[0090] An evaluation index system module is used to construct an evaluation index system for implementing actions with satellites as the main body, to construct a multi-level evaluation index system based on the evaluation index system for implementing actions with satellites as the main body, and to construct a multi-level networked evaluation index system based on the multi-level evaluation index system;

[0091] The scenario input module is used to input scenarios, submit requirements, set application processes and arrange scenarios, and manage the scenario operation scheduling process by setting the interaction relationship between nodes;

[0092] A dynamic weighting module is used to assign weights to the multi-level networked evaluation index system according to the scenario data and demand data; and dynamically update the weight of the current evaluation system according to the current evaluation results;

[0093] The evaluation module is used to evaluate the calculation and generate the evaluation results.

[0094] Compared with the related art, the application scenario-oriented performance evaluation system of the present invention implements the above process of the application scenario-oriented performance evaluation method, and its beneficial effects are the same as the beneficial effects of the application scenario-oriented performance evaluation method of the present invention, which will not be repeated here.

[0095] The third embodiment of the present invention provides an application scenario-oriented performance evaluation device. The application scenario-oriented performance evaluation device of the present invention for solving the technical problem includes:

[0096] A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the above-mentioned application scenario-oriented performance evaluation method when executed by the processor.

[0097] Compared with the related art, the application scenario-oriented performance evaluation device of the present invention implements the process of the above-mentioned application scenario-oriented performance evaluation method, and its beneficial effects are the same as the beneficial effects of the application scenario-oriented performance evaluation method of the present invention, which will not be repeated here.

[0098] A fourth embodiment of the present invention provides a computer storage medium. The present invention is to solve the above-mentioned technical problem. The computer storage medium stores a computer program. When the computer program is executed by a processor, the steps of the above-mentioned application scenario-oriented performance evaluation method are implemented.

[0099] Compared with the related art, the computer storage medium of the present invention implements the process of the above-mentioned performance evaluation method for application scenarios, and its beneficial effects are the same as the beneficial effects of the performance evaluation method for application scenarios of the present invention, which will not be repeated here.

[0100] Through the description of the specific implementation methods, a deeper and more specific understanding of the technical means and effects adopted by the present invention to achieve the predetermined purpose should be obtained. However, the accompanying drawings are only for reference and illustration purposes and are not intended to limit the present invention.

Claims

1. A performance evaluation method for application scenarios, characterized in that: The steps include: Constructing an evaluation index system for implementing actions with satellites as the main body; the construction of the evaluation index system for implementing actions with satellites as the main body includes: classifying comprehensive performance indicators based on mission requirements; collecting and analyzing variable data related to performance evaluation; refining key performance indicators and the correlation between the key performance indicators based on the variable data according to specific mission requirements; constructing the evaluation index system for implementing actions with satellites as the main body based on the key performance indicators and the correlation between the key performance indicators; Based on the evaluation index system for implementing actions with satellites as the main body, a multi-level evaluation index system is constructed, and based on the multi-level evaluation index system, a multi-level networked evaluation index system is constructed; the multi-level evaluation index system includes a comprehensive effectiveness layer, a task index layer, a specific implementation layer and a measurement index layer, forming an index system composed of satellite interference tasks, satellite monitoring tasks, and satellite space action tasks; the multi-level networked evaluation index system connects the indicators of each level to each other; the multi-level networked evaluation index system meets the demand input at different levels; each indicator of the multi-level networked evaluation index system is added with an index; wherein the measurement index layer corresponding to the satellite interference task is configured as the scan leakage rate shown in the following formula : Where n is the number of time periods during which the target is not covered by the beam in the entire time period, Indicates The duration of a period, T E Indicates the end time of the entire time period, T S Indicates the start time of the entire time period; Input scenarios, submit requirements, set application processes and arrange scenarios, and manage scenario operation scheduling processes by setting the interaction relationship between nodes; According to specific evaluation needs, the specific levels of the multi-level networked evaluation indicator system are matched to lock in evaluation indicators suitable for specific evaluation needs; According to the scenario data and demand data, weights are assigned to the multi-level networked evaluation index system; the weights of the current evaluation system are dynamically updated according to the current evaluation results; specifically, the data information transmission relationship and the control relationship between the equipment platforms are combined with the scale, different data information transmission relationships and control relationships are divided into different levels of importance, different registration scales are assigned, and a scale criterion is formed; the scale criterion is used as the basis for judgment; each evaluation result will be used as the basis for the next weighting, and the weights of the evaluation indicators will be dynamically updated; Evaluate the calculation and generate evaluation results.

2. The method for evaluating the performance of an application scenario according to claim 1, characterized in that: The interaction mode between the nodes can be selectively set according to actual needs.

3. A performance evaluation system for application scenarios, characterized in that: include: An evaluation index system module is used to construct an evaluation index system for implementing actions with satellites as the main body, to construct a multi-level evaluation index system based on the evaluation index system for implementing actions with satellites as the main body, and to construct a multi-level networked evaluation index system based on the multi-level evaluation index system; The construction of the evaluation index system for the satellite-based action includes: classifying the comprehensive performance index based on the mission requirements; collecting and analyzing the variable data related to the performance evaluation; refining the key performance index and the correlation between the key performance indexes based on the variable data according to the specific mission requirements; and constructing the evaluation index system for the satellite-based action based on the key performance index and the correlation between the key performance indexes. The multi-level evaluation index system includes a comprehensive effectiveness layer, a task index layer, a specific implementation layer and a measurement index layer, forming an index system composed of satellite interference tasks, satellite monitoring tasks and satellite space action tasks; the multi-level networked evaluation index system interconnects the indicators of each level; the multi-level networked evaluation index system meets the demand inputs at different levels; each indicator of the multi-level networked evaluation index system is added with an index; Among them, the measurement indicator layer corresponding to the satellite interference task is configured as the missed scan rate shown in the following formula: : Where n is the number of time periods during which the target is not covered by the beam in the entire time period, Indicates The duration of a period, T E Indicates the end time of the entire time period, T S Indicates the start time of the entire time period; The scenario input module is used to input scenarios, submit requirements, set application processes and arrange scenarios, and manage the scenario operation scheduling process by setting the interaction relationship between nodes; A dynamic weighting module is used to assign weights to the multi-level networked evaluation index system according to scenario data and demand data; dynamically update the weight of the current evaluation system according to the current evaluation results; specifically includes: combining the data information transmission relationship and the control relationship between equipment platforms with the scale, dividing different data information relationships and control relationships into different levels of importance, assigning different registration scales, and forming a scale criterion; the scale criterion is used as a basis for judgment; each evaluation result will be used as the basis for the next weighting, and the weight of the evaluation index will be dynamically updated; The evaluation module is used to evaluate the calculation and generate the evaluation results.

4. A performance evaluation device for application scenarios, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the performance evaluation method for application scenarios as described in any one of claims 1 to 2 are implemented.

5. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the performance evaluation method for application scenarios as described in any one of claims 1 to 2 are implemented.

Images