Efficiency evaluation method for multi-scene multi-level complex modal heterogeneous equipment
By constructing a multi-layer tree structure performance evaluation index system and dynamic adjustment method model for indicator weights, the flexibility and automation problems of performance evaluation of complex modal heterogeneous equipment are solved, and more efficient and flexible evaluation and resource management are achieved.
Patent Information
- Application Number
- CN202510147058.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-11
- Publication Date
- 2025-03-14
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing technology is difficult to adapt to changes in complex modal heterogeneous equipment, traditional efficiency evaluation methods lack flexibility, are difficult to adapt to different task scenarios, and the automation level is low, resulting in untimely and accurate evaluation results, affecting the quality of decision-making.
A multi-layer tree structure performance evaluation index system is adopted, based on the structure of "objective-activity-ability-indicator", a dynamic adjustment method model for indicator weights is defined, and measurable evaluation indicators are constructed to automate the evaluation configuration and execution process.
It improves the adaptability and effectiveness of the performance evaluation of complex modal heterogeneous equipment, improves the level of resource utilization, realizes the re-executability analysis after task failure and closed-loop feedback of evaluation results, and promotes the optimization of equipment usage strategies and the efficiency of resource allocation.
Smart Images

Figure CN119623871A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of aerospace measurement, control and communication equipment, and is applied to the performance evaluation process of complex modal heterogeneous equipment, and specifically to a multi-scenario and multi-level complex modal heterogeneous equipment performance evaluation method. Background Art
[0002] With the rapid advancement of space technology at home and abroad, the frequency of rocket launches and the number of space targets in orbit have increased significantly. This trend has brought about a substantial increase in demand for measurement and control data transmission, space-ground communications, etc., making the monitoring and management tasks of various space targets in orbit more complex and arduous. At the same time, the space-ground based equipment that undertakes these tasks also presents the characteristics of multimodal complexity and diversified mission scenarios. Faced with different mission scenarios and requirements with different priorities, coupled with the heterogeneity of equipment forms and the diversity of usage strategies, the requirements for performance evaluation strategies, resource scheduling methods, usage patterns and evaluation systems have also increased accordingly.
[0003] In the current context, the demand for diversified missions is growing, the number of on-orbit space targets is rising sharply, and the capabilities of complex modal heterogeneous equipment are also constantly improving. However, traditional performance evaluation and analysis methods for specific functional equipment and single mission scenarios are gradually showing their limitations. Traditional evaluation methods are difficult to adapt to the changes in complex modal heterogeneous equipment, and can only analyze limited specific equipment, lacking flexibility. When it is necessary to adjust to different mission scenarios, traditional methods often show the problem of weak migration capabilities, which means that each change requires a lot of manpower and time to adjust.
[0004] In addition, the existing performance evaluation process has a low level of automation. From data collection and aggregation to indicator statistical analysis, to performance aggregation calculation and report document generation, each link has a high degree of manual participation, and an effective full-process automatic processing process has not yet been formed. This inefficient evaluation method not only increases the workload, but also may lead to evaluation results that are not timely and accurate, affecting the quality of decision-making.
[0005] More importantly, the current performance evaluation mechanism fails to establish an effective closed-loop feedback system with equipment scheduling and use. This hinders the continuous improvement of the efficiency of complex modal heterogeneous equipment scheduling and use, because the scheduling strategy is not optimized in a timely manner based on the evaluation results. Due to the lack of an effective evaluation and feedback mechanism, it is difficult to find the weak links in the use of equipment, which is not conducive to the continuous optimization of resource utilization levels, nor is it conducive to coping with the increasingly fierce competition in the space field.
[0006] It can be seen that the current performance evaluation of complex modal heterogeneous equipment in the field of aerospace measurement, control, communication and space situational awareness has obvious limitations and effectiveness problems. In order to adapt to the rapid development of space technology and ensure my country's competitiveness in this field, a new performance evaluation method is urgently needed to overcome the shortcomings of existing methods and provide a more comprehensive, flexible and efficient evaluation solution for complex modal heterogeneous equipment. Therefore, it has become one of the core research points of concern to technical personnel in this field. Summary of the invention
[0007] The purpose of the present invention is to solve the problem of the lack of effectiveness evaluation means for complex modal heterogeneous equipment. Therefore, a multi-scenario and multi-level complex modal heterogeneous equipment effectiveness evaluation method is proposed. According to the structure of "goal-activity-capability-indicator", the present invention constructs and implements an equipment effectiveness evaluation index system, thereby improving the adaptability and effectiveness of the effectiveness evaluation of complex modal heterogeneous equipment, and helping to improve the resource utilization level of complex modal heterogeneous equipment.
[0008] The present invention adopts the following technical solutions to achieve the purpose: A multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method, the method comprising an evaluation configuration process and an evaluation execution process; Evaluation configuration process: For complex modal heterogeneous equipment, establish an effectiveness evaluation index system with a multi-layer tree structure of "goal-activity-capability-indicator"; based on the effectiveness evaluation index system, define the indicator weight dynamic adjustment method model, dynamically adjust the weights in the effectiveness evaluation index system, and then construct the corresponding measurable evaluation indicators of complex modal heterogeneous equipment under the effectiveness evaluation index system to complete the evaluation configuration; Evaluation execution process: When the complex modal heterogeneous equipment completes the planned task, the corresponding task-related data is obtained and a single task evaluation is carried out; based on the task-related data, in accordance with the hierarchical structure of the established performance evaluation index system, the measurable evaluation indicators of the complex modal heterogeneous equipment are calculated and progressively obtained layer by layer to obtain the corresponding comprehensive performance results and complete the evaluation execution.
[0009] Furthermore, in the established performance evaluation index system, the target layer includes the comprehensive performance of the complex modal heterogeneous equipment that needs to perform performance evaluation, which is used to determine the types of multiple mission scenarios that can be executed by the complex modal heterogeneous equipment and the corresponding set of measurable evaluation indicators; The activity layer includes the types of mission scenarios that the complex modal heterogeneous equipment can support, which is used to determine the relative weight between the capability layer and the indicator layer, and further determine the set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment based on the target layer; The capability layer includes the capability dimensions of the complex modal heterogeneous equipment, and each capability dimension is associated with one or more measurable evaluation indicators in the indicator layer; The indicator layer includes a set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment. The measurable evaluation indicators in the set are calculated based on the task-related data generated after the complex modal heterogeneous equipment completes the planned task.
[0010] Preferably, on the basis of the target layer, according to the evaluation purpose of complex modal heterogeneous equipment in the preset task scenario, combined with the weight data used in the historical performance evaluation process, the weights of the capability dimensions in the capability layer and the weights of the measurable evaluation indicators associated with the capability dimensions are dynamically adjusted through the indicator weight dynamic adjustment method model.
[0011] Specifically, the definition of the indicator weight dynamic adjustment method model is as follows: In the performance evaluation index system of complex modal heterogeneous equipment, the capability layer has Ability Dimensions , No. Ability Dimensions Include Measurable evaluation indicators ,in , ; Execute in one task scenario After the performance evaluation, the weights are set according to the evaluation purpose. The weights of capability dimensions corresponding to the secondary performance evaluation and measurable evaluation indicator weights ,in , Representative The ordinal number of the secondary performance evaluation is used to define the dynamic adjustment method model of the index weight of complex modal heterogeneous equipment in this type of mission scenario. ; Dynamic adjustment method model of indicator weight The input is The total weight of the sub-performance evaluation, i.e. , the output is The adaptively adjusted total weight of the sub-performance evaluation is ; Therefore, the indicator weight dynamic adjustment method model It can be defined as:
[0012] Dynamically adjust the weight of this indicator Once the corresponding description attributes are added, the definition process is complete.
[0013] Specifically, the indicator weight dynamic adjustment method model The description attributes include name , Supported complex modal heterogeneous equipment types and applicable mission scenario types .
[0014] Furthermore, in the evaluation configuration process, based on the usage characteristics of different mission scenarios in the effectiveness evaluation index system, measurable evaluation indicators corresponding to complex modal heterogeneous equipment in different mission scenarios are constructed; during construction, measurable evaluation indicators are defined as follows: Measurable evaluation indicators are obtained by obtaining task-related data of complex modal heterogeneous equipment and calculating and normalizing them according to the time range required for performance evaluation and business data connection information; measurable evaluation indicators output their quantitative results in the indicator layer of the performance evaluation indicator system. And the normalized results ; Normalized results The preferred range of .
[0015] Preferably, the measurable evaluation indicator also includes a calculation process log and abnormal information for recording feedback, and a corresponding auxiliary numerical result generated and output; the measurable evaluation indicator also has an indicator description attribute.
[0016] Specifically, during the evaluation and execution process, the basic data of task execution and basic evaluation indicators of complex modal heterogeneous equipment are obtained and integrated into task-related data. After the comprehensive effectiveness results are calculated layer by layer according to the hierarchical structure of the effectiveness evaluation indicator system, they are fed back to the equipment resource scheduling system. In the progressive calculation of the comprehensive performance results, the measurable evaluation indicators in the indicator layer are calculated first, and then the capability dimensions in the capability layer are calculated based on the weight configuration data in the indicator layer. Finally, the comprehensive performance results are calculated based on the calculation results of the capability layer and their corresponding weights.
[0017] Preferably, during the evaluation execution process, when the planned task execution of complex modal heterogeneous equipment fails, a rescheduling evaluation of the failed task is carried out based on the completed evaluation configuration, and after the conclusion of the re-executability of the failed task is obtained, feedback is given to the equipment resource scheduling system.
[0018] Preferably, the process of rescheduling evaluation of failed tasks is as follows: Obtain the total number of complex modal heterogeneous equipment required in the relevant requirement information of the failed task , the earliest start time of the failed task and the latest start time ; then the current time of the failed task rescheduling evaluation until the latest start time Within the time range of ,in Indicates Equipment in The start time of the remaining available time slots, Indicates Equipment in The end time of the remaining available time slots, and , For the The number of remaining available time slots for each device; The remaining idle time period set Availability Defined as the required time for the failed task There is a time intersection and the constraints are met , as follows:
[0019] Make failed tasks re-executable It is defined as the total number of remaining available time slots in the time range from the current time to the latest start time of the failed task rescheduling evaluation, as follows:
[0020] Through the above formula, the re-executability of failed tasks The higher the calculated value of, the higher the possibility that the failed task can be executed again; When the calculated value is greater than 0, the relevant demand information of the failed task and the re-executability of the failed task Feedback is sent to the equipment resource scheduling system for rescheduling.
[0021] In summary, due to the adoption of this technical solution, the beneficial effects of the present invention are as follows: The method of the present invention constructs an evaluation system based on the "goal-activity-capability-indicator" structure, which aims to comprehensively and systematically evaluate the performance of different types of equipment, including surveillance equipment, measurement and control equipment, digital transmission equipment and integrated measurement and control and digital transmission equipment, when performing diverse tasks such as rocket launch, target monitoring, measurement and control digital transmission communication and simulation training.
[0022] By adopting an innovative evaluation method, the present invention can provide a more adaptive and effective performance evaluation for specific mission requirements. This not only improves the understanding of equipment performance, but also promotes the optimization of resource allocation and use. When faced with complex and changing mission environments, this evaluation method can ensure that all relevant parties can obtain accurate and timely feedback to guide subsequent actions.
[0023] The present invention also implements a closed-loop mechanism for re-executability analysis and evaluation result feedback after mission failure. This feature is of great significance for improving equipment use strategies and increasing mission success rates. When a mission is not completed as expected, the method can quickly locate the problem and provide decision makers with specific suggestions on whether and how to re-execute the mission. In this way, the negative impact caused by mission failure can be effectively reduced, the learning process can be accelerated, and the continuous improvement of overall efficiency can be promoted.
[0024] In summary, this invention enhances the performance of complex modal heterogeneous equipment in various application scenarios by introducing a new performance evaluation framework. It provides users with a more accurate means of equipment performance evaluation, thereby improving resource utilization efficiency, and also lays a solid foundation for achieving higher levels of automation and intelligent management. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 is a schematic diagram of the overall process of the performance evaluation method of the present invention; Figure 2 It is a structural schematic diagram of the performance evaluation index system in the method of the present invention; Figure 3 It is a schematic diagram of the actual application level of the performance evaluation index system of the method of the present invention. DETAILED DESCRIPTION
[0026] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0027] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0028] Example A multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method, which can be viewed simultaneously Figure 1 The method includes an evaluation configuration process and an evaluation execution process. This embodiment will introduce these two processes in detail and by way of example.
[0029] Step S11: Construct a multi-scenario and multi-level load modal state performance evaluation index system.
[0030] This step establishes a performance evaluation index system with a multi-layer tree structure of "goal-activity-capability-indicator" for complex modal heterogeneous equipment.
[0031] You can refer to Figure 2 A schematic diagram of the structure of the performance evaluation index system is provided, wherein the target layer includes the comprehensive performance of the complex modal heterogeneous equipment that needs to perform performance evaluation, which is used to determine the various task scenario types that can be executed by the complex modal heterogeneous equipment and the corresponding set of measurable evaluation indicators; in this embodiment, the equipment types supported by the target layer include monitoring equipment, measurement and control equipment, digital transmission equipment, and measurement, control and digital transmission integrated equipment.
[0032] The activity layer includes the types of mission scenarios that the complex modal heterogeneous equipment can support, which is used to determine the relative weight between the capability layer and the indicator layer, and to further determine the set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment based on the target layer; the mission scenario types in this embodiment include rocket launch, target monitoring, measurement and control data transmission and communication, and simulation training.
[0033] The capability layer includes the capability dimensions of the complex modal heterogeneous equipment, and each capability dimension is associated with one or more measurable evaluation indicators in the indicator layer; in this embodiment, the capability dimensions of the capability layer include task execution capability, resource utilization capability, dynamic adjustment capability, and user credibility, etc. The effectiveness of the capability layer can be obtained by the aggregation calculation of the measurable evaluation indicators in the indicator layer in subsequent calculations.
[0034] The indicator layer includes a set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment. The measurable evaluation indicators in the set are calculated based on the task-related data generated after the complex modal heterogeneous equipment completes the planned task. The actual application of the above four levels of the performance evaluation indicator system in this embodiment can be found in Figure 3 As shown in the figure, the indicator layer here includes: average application response time, demand satisfaction rate, average task completion time, task completion rate, average equipment utilization rate, equipment resource idle rate, automation operation success rate, resource dynamic adjustment time, resource dynamic adjustment cost, demand cancellation ratio and demand adjustment ratio, a total of 11 indicators.
[0035] Step S12: Complete the definition and implementation of the indicator weight dynamic adjustment method model.
[0036] This step is based on the aforementioned performance evaluation index system, defines an index weight dynamic adjustment method model, and dynamically adjusts the weights in the performance evaluation index system.
[0037] In this embodiment, the performance evaluation index system has Ability Dimensions , including measurable evaluation indicators, a total of Second performance evaluation; at the same time, this embodiment dynamically adjusts the indicator weight method model Defined as the average of historical indicator weights, that is , ,in .
[0038] Dynamic adjustment method model of indicator weight The description attributes of the method are designed to support its engineering use. An example of a description attribute definition is as follows: name = "Average Adjustment Method"; Supported complex modal heterogeneous equipment types = "space target monitoring equipment, measurement and control equipment, data transmission equipment, measurement and control and data transmission integrated equipment"; Applicable task scenario types =“Rocket launch, target monitoring, measurement and control, digital transmission and communication, simulation training”, etc.
[0039] In this embodiment In the performance evaluation, the task execution ability The weights are , when the performance evaluation is performed again, the method model is dynamically adjusted according to the indicator weight Definition, mission execution capability Weight ; The weight adjustment functions of other task execution capabilities and measurable evaluation indicators are the same, and can also be adjusted manually according to needs during actual operation. In the process of actual application of the method, the indicator weight dynamic adjustment method model It is not limited to the average of historical indicator weights, and can also be defined and implemented in other application methods.
[0040] Step S13: Complete the definition and implementation of measurable evaluation indicators.
[0041] This step aims to construct measurable evaluation indicators corresponding to complex modal heterogeneous equipment under the performance evaluation index system.
[0042] In this embodiment, the demand satisfaction rate is taken as an example, which is defined as the ratio of the number of satisfied demands to the total number of demands; and the input of this indicator is the demand status information, and the output is the quantitative result corresponding to the indicator. And the normalized results The corresponding calculation process log is "The execution time of demand satisfaction rate is 2024-10-30 19:39:20, the calculation time is 25ms, the indicator calculation result is 0.9523 and its normalized result is 95.23", and the corresponding auxiliary numerical results are generated and output at the same time, including the number of demand satisfaction The total demand quantity is . The indicator description attributes of this indicator include: the name is "demand satisfaction rate"; the indicator result dimension is "%"; the supported complex modal heterogeneous equipment types are "surveillance equipment, measurement and control equipment, digital transmission equipment, measurement and control digital transmission integrated equipment"; the supported mission scenario types are "rocket launch, target monitoring, measurement and control digital transmission communication, simulation training".
[0043] The above is an exemplary content of the evaluation configuration process. Next, the exemplary content of the evaluation execution process is introduced.
[0044] Step S21: Obtain equipment mission-related data and conduct single mission evaluation.
[0045] This step aims to obtain the corresponding task-related data and carry out single task evaluation after the complex modal heterogeneous equipment completes the planned task.
[0046] In this embodiment, basic task execution data and basic task evaluation indicators of complex modal heterogeneous equipment are obtained and integrated into task-related data; the basic task execution data include requirement number, equipment number, target number, task type, task priority, task start time, task end time, task execution status and requirement-related information, etc.; based on the basic task execution data, corresponding basic task evaluation indicators can be calculated, such as task requirement response time, task execution duration, etc.
[0047] Step S22: Calculate layer by layer according to the index system hierarchy to obtain the comprehensive effectiveness of the equipment.
[0048] In this embodiment, according to the hierarchical structure of the performance evaluation index system, the comprehensive performance result is obtained by progressive calculation layer by layer. The specific method of progressive calculation layer by layer is: first, the calculation of the measurable evaluation index in the index layer is completed, and then the calculation of the capability dimension in the capability layer is completed according to the weight configuration data in the index layer, and finally, the calculation of the comprehensive performance result is completed according to the calculation result of the capability layer and its corresponding weight.
[0049] Finally, as a preferred embodiment of this invention, when a planned task of a complex modal heterogeneous equipment fails to execute during the evaluation execution process, a rescheduling evaluation of the failed task is carried out based on the completed evaluation configuration, and after the conclusion of the re-executability of the failed task is obtained, feedback is given to the equipment resource scheduling system.
[0050] Step S23: For a single task that has failed in execution, calculate the re-executability index of the failed task.
[0051] The specific process of the preferred failed task rescheduling evaluation in this embodiment is as follows: Obtain the total number of complex modal heterogeneous equipment required in the relevant requirement information of the failed task , the earliest start time of the failed task and the latest start time ; then the current time of the failed task rescheduling evaluation until the latest start time Within the time range of ,in Indicates Equipment in The start time of the remaining available time slots, Indicates Equipment in The end time of the remaining available time slots, and , For the The number of remaining available time slots for each device; The remaining idle time period set Availability Defined as the required time of the failed task There is a time intersection and the constraints are met , as follows:
[0052] Make failed tasks re-executable It is defined as the total number of remaining available time slots in the time range from the current time to the latest start time of the failed task rescheduling evaluation, as follows:
[0053] Through the above formula, the re-executability of failed tasks The higher the calculated value of, the higher the possibility that the failed task can be executed again; When the calculated value is greater than 0, the relevant demand information of the failed task and the re-executability of the failed task Feedback is sent to the equipment resource scheduling system for rescheduling.
[0054] The following is an example of the evaluation of the rescheduling of failed tasks: If the total number of complex modal heterogeneous equipment required in the relevant requirement information of the failed task , the earliest start time of the failed task The latest start time is "2024-10-30 10:00:00" is "2024-10-31 12:00:00"; and at the same time, the constraint conditions in this example of this embodiment are determined Minimum duration constraint.
[0055] Within the time range from the current time of the failed task rescheduling evaluation to the latest start time, the remaining idle time period set of the complex modality heterogeneous equipment set in the example of this embodiment is {["2024-10-31 09:10:00", "2024-10-31 20:00:00"], ["2024-10-31 11:20:00", "2024-10-31 11:28:30"]}, and its minimum duration constraint is 8 minutes.
[0056] At this time, for the two remaining time periods, the availability will meet all constraints, that is, the required time of the failed task There is a time intersection and the shortest duration constraint is satisfied. , , then the failed task can be re-executed , that is, the current failed task can be executed again within the task requirement time.
[0057] Step S24: Feedback the failed task related information and re-executability results to the equipment resource scheduling system.
[0058] when When the calculated value is greater than 0, the relevant demand information of the failed task and the re-executability of the failed task Feedback is sent to the equipment resource scheduling system for rescheduling.
[0059] In this embodiment, the failed task of the example failed task can be re-executable , the content fed back to the equipment resource scheduling system may include the requirement number, equipment number, target number, task type, task priority, and re-executability of failed tasks. wait.
Claims
1. A multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method, characterized by: The method includes an assessment configuration process and an assessment execution process; Evaluation configuration process: For complex modal heterogeneous equipment, establish an effectiveness evaluation index system with a multi-layer tree structure of "goal-activity-capability-indicator"; based on the effectiveness evaluation index system, define the indicator weight dynamic adjustment method model, dynamically adjust the weights in the effectiveness evaluation index system, and then construct the corresponding measurable evaluation indicators of complex modal heterogeneous equipment under the effectiveness evaluation index system to complete the evaluation configuration; Evaluation execution process: When complex modal heterogeneous equipment completes the planned task, obtain the corresponding task-related data and carry out single task evaluation; Based on the task-related data and in accordance with the hierarchical structure of the established performance evaluation index system, the measurable evaluation indicators of the complex modal heterogeneous equipment are calculated and progressively applied layer by layer to obtain the corresponding comprehensive performance results and complete the evaluation execution.
2. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 1 is characterized by: In the established performance evaluation index system, the target layer includes the comprehensive performance of the complex modal heterogeneous equipment that needs to perform performance evaluation, which is used to determine the types of multiple mission scenarios that the complex modal heterogeneous equipment can perform and the corresponding measurable evaluation index set; The activity layer includes the types of mission scenarios that the complex modal heterogeneous equipment can support, which is used to determine the relative weight between the capability layer and the indicator layer, and further determine the set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment based on the target layer; The capability layer includes the capability dimensions of the complex modal heterogeneous equipment, and each capability dimension is associated with one or more measurable evaluation indicators in the indicator layer; The indicator layer includes a set of measurable evaluation indicators corresponding to the complex modal heterogeneous equipment. The measurable evaluation indicators in the set are calculated based on the task-related data generated after the complex modal heterogeneous equipment completes the planned task.
3. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 2 is characterized by: On the basis of the target layer, according to the evaluation purpose of complex modal heterogeneous equipment in the preset mission scenario and combined with the weight data used in the historical performance evaluation process, the weights of the capability dimensions in the capability layer and the weights of the measurable evaluation indicators associated with the capability dimensions are dynamically adjusted through the indicator weight dynamic adjustment method model.
4. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 2 is characterized in that: The definition of the indicator weight dynamic adjustment method model is as follows: In the performance evaluation index system of complex modal heterogeneous equipment, the capability layer has Ability Dimensions , No. Ability Dimensions Include Measurable evaluation indicators ,in , ; Execute in one task scenario After the performance evaluation, the weights are set according to the evaluation purpose, and a total of The weights of capability dimensions corresponding to the secondary performance evaluation and measurable evaluation indicator weights ,in , Representative The ordinal number of the secondary performance evaluation is used to define the dynamic adjustment method model of the index weight of complex modal heterogeneous equipment in this type of mission scenario. ; Dynamic adjustment method model of indicator weight The input is The total weight of the sub-performance evaluation, i.e. , the output is The adaptively adjusted total weight of the sub-performance evaluation is ; Therefore, the indicator weight dynamic adjustment method model It can be defined as: Dynamically adjust the weight of this indicator Once the corresponding description attributes are added, the definition process is complete.
5. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 4 is characterized by: Dynamic adjustment method model of indicator weight The description attributes include name , Supported complex modal heterogeneous equipment types and applicable mission scenario types .
6. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 1 is characterized by: In the evaluation configuration process, based on the usage characteristics of different mission scenarios in the effectiveness evaluation index system, the measurable evaluation indicators corresponding to complex modal heterogeneous equipment in different mission scenarios are constructed; during construction, the measurable evaluation indicators are defined as follows: Measurable evaluation indicators are obtained by obtaining task-related data of complex modal heterogeneous equipment and calculating and normalizing them according to the time range required for performance evaluation and business data connection information; measurable evaluation indicators output their quantitative results in the indicator layer of the performance evaluation indicator system. And the normalized results .
7. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 6 is characterized by: Measurable evaluation indicators also include calculation process logs and exception information for recording feedback, as well as corresponding auxiliary numerical results generated and output; measurable evaluation indicators also have indicator description attributes.
8. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 2 is characterized by: During the evaluation and execution process, the basic task execution data and task basic evaluation indicators of complex modal heterogeneous equipment are obtained and integrated into task-related data. After the comprehensive effectiveness results are calculated layer by layer according to the hierarchical structure of the effectiveness evaluation indicator system, they are fed back to the equipment resource scheduling system. In the progressive calculation of the comprehensive performance results, the measurable evaluation indicators in the indicator layer are calculated first, and then the capability dimensions in the capability layer are calculated based on the weight configuration data in the indicator layer. Finally, the comprehensive performance results are calculated based on the calculation results of the capability layer and their corresponding weights.
9. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 1 is characterized by: During the evaluation execution process, when the planned task execution of complex modal heterogeneous equipment fails, the failed task rescheduling evaluation is carried out based on the completed evaluation configuration. After the conclusion of the re-executability of the failed task is obtained, it is fed back to the equipment resource scheduling system.
10. The multi-scenario, multi-level, complex modal, heterogeneous equipment effectiveness evaluation method according to claim 9 is characterized in that: The process of rescheduling evaluation of failed tasks is as follows: Obtain the total number of complex modal heterogeneous equipment required in the relevant requirement information of the failed task , the earliest start time of the failed task and the latest start time ; then the current time of the failed task rescheduling evaluation until the latest start time Within the time range of ,in Indicates Equipment in The start time of the remaining available time slots, Indicates Equipment in The end time of the remaining available time slots, and , For the The number of remaining available time slots for each device; The remaining idle time period set Availability Defined as the required time of the failed task There is a time intersection and the constraints are met , as follows: Make failed tasks re-executable It is defined as the total number of remaining available time slots in the time range from the current time to the latest start time of the failed task rescheduling evaluation, as follows: Through the above formula, the re-executability of failed tasks The higher the calculated value of, the higher the possibility that the failed task can be executed again; When the calculated value is greater than 0, the relevant demand information of the failed task and the re-executability of the failed task Feedback is sent to the equipment resource scheduling system for rescheduling.
Citation Information
Patent Citations
Satellite internet-oriented comprehensive effectiveness evaluation method and system
CN116257784A
Application scene-oriented efficiency evaluation method, system and device and medium
CN118153980A
Cited By
Equipment system performance evaluation method and device oriented to multi-source heterogeneous data
CN120278389A