Spacecraft system evaluation system and evaluation method

Abstract

The present invention relates to a spacecraft system evaluation system and evaluation method. The spacecraft system evaluation system includes: an evaluation scheme management module, an evaluation index construction module, an evaluation data processing module, an evaluation index calculation module and an evaluation result generation module. The present invention, in combination with the basic theory of spacecraft evaluation, builds an evaluation system framework that can be flexibly configured to achieve accurate evaluation of system capabilities and effectiveness. It can build an evaluation index system of capabilities, effectiveness and other types based on the demonstration and R&D needs of the system, and carry out multi-dimensional evaluation of the system by combining multi-source heterogeneous data such as system data, spacecraft performance data, process data, environmental data and simulation result data, and provides autonomous and flexible configuration of evaluation indicators, evaluation data, evaluation models, evaluation result display forms, evaluation reports and other contents, providing reasonable, scientific and effective data support for spacecraft evaluation demonstration.

Description

Technical Field

[0001] The present invention relates to the technical field of spacecraft system evaluation, and in particular to a spacecraft system evaluation system and evaluation method. Background Art

[0002] At present, the system capability or effectiveness evaluation framework mainly starts from the capabilities and task requirements, constructs a universal evaluation index system architecture, and then selects some relatively mature comprehensive evaluation methods that can adapt to the evaluation index system for evaluation and calculation.

[0003] However, the system is not the superposition of units, platforms and systems. It takes into account the specific functions formed by the mutual relationship and interaction between the various components of any spacecraft system. Therefore, the construction of the evaluation index system needs to have the characteristics of diversity, specificity, measurability, and sufficient refinement. At the same time, different indicator calculation evaluations should construct appropriate indicator calculation methods in typical scenarios, and flexibly configure different comprehensive calculation models according to the attributes of the indicators, value ranges and other information, so as to obtain more effective and highly interpretable evaluation calculation results.

[0004] Therefore, building a spacecraft system evaluation system and evaluation method is an urgent problem to be solved. Summary of the invention

[0005] In order to solve the technical problems existing in the above-mentioned prior art, the purpose of the present invention is to provide a spacecraft system evaluation system and evaluation method, which provide autonomous and flexible configuration of evaluation indicators, evaluation data, evaluation models, evaluation result display forms, evaluation reports and other contents, and provide reasonable, scientific and effective data support for spacecraft evaluation and demonstration.

[0006] To achieve the above-mentioned object of the invention, the present invention provides a spacecraft system evaluation system, comprising:

[0007] An evaluation scheme management module is used to build an evaluation system framework based on evaluation requirements. The evaluation system framework includes the functions of creating new evaluation schemes, mission task analysis, and scenario analysis, as well as maintaining and managing evaluation schemes, mission tasks, and scenarios.

[0008] An evaluation indicator construction module is used to create an evaluation indicator system for the evaluation system framework and construct the required evaluation data based on the evaluation requirements of the evaluation plan, mission tasks and task scenarios;

[0009] An evaluation data processing module, for obtaining the evaluation data through a database and / or an imported or stored file based on the required evaluation data;

[0010] Evaluation index calculation module, used to calculate and analyze the capability contribution rate, efficiency contribution rate, system contribution rate and sensitivity of the spacecraft system based on the evaluation data and evaluation index system;

[0011] The evaluation result generation module is used to display and export the evaluation calculation results obtained through calculation and analysis.

[0012] According to a technical solution of the present invention, based on the evaluation requirements, the newly created evaluation solution package solution name, evaluation type, and evaluation object, the evaluation solution management module is also used to:

[0013] Add, delete, modify and review the evaluation plan;

[0014] Complete mission analysis and scenario analysis according to different assessment types;

[0015] Add, delete, modify, review, and maintain mission tasks, scenarios, and scenarios;

[0016] Among them, the evaluation types include capability evaluation, effectiveness evaluation, and system contribution rate evaluation.

[0017] According to a technical solution of the present invention, the evaluation index construction module is also used for:

[0018] According to the evaluation purpose, evaluation object, and evaluation requirements of the task scenario, the effectiveness indicators and system capability indicators are visually constructed based on the evaluation indicator system template, and the attributes, dimensions, criteria, and calculation methods of the evaluation indicators are edited;

[0019] Carry out addition, deletion, modification, and query, classification and grading management, and list management of the indicator system and indicator criteria templates, establish a mapping matrix of performance indicators and capability indicators, and set the good, medium, and poor support relationship of indicator mapping;

[0020] The evaluation index construction results can be saved as a template or exported as an external file to provide input for simulation test factor design and simulation data collection.

[0021] According to a technical solution of the present invention, the evaluation data processing module is also used for:

[0022] Import and store original assessment data through databases and files, and add, delete, modify and review assessment data;

[0023] Supports indicator calculation through data analysis, legality check and data cleaning functions, and provides data analysis model management, analysis data table alias setting, and analysis log management functions;

[0024] Based on the imported data, the evaluation data is screened to build the evaluation sample data structure, and the associated tables in the sample data structure are added, deleted, modified and consulted.

[0025] According to a technical solution of the present invention, the evaluation index calculation module is also used for:

[0026] Selection, deletion, modification, query and list management of various comprehensive evaluation methods for calculating capability or effectiveness indicator systems;

[0027] Create indicator algorithms to calculate performance or capability indicators, and add, delete, modify, and review indicator algorithms;

[0028] Rapid batch calculation of mission effectiveness, system capability, system contribution rate and sensitivity.

[0029] According to a technical solution of the present invention, the evaluation result generation module is used to:

[0030] Visually configure the display scheme of the evaluation results, and dynamically display the evaluation results of task effectiveness, system capability, and system contribution rate in the form of bar charts or pie charts;

[0031] Comparative analysis and sensitivity analysis of the evaluation results under different scenarios and assumptions, and traceability analysis of the evaluation results;

[0032] Generate assessment documentation reports based on predefined templates.

[0033] According to another aspect of the present invention, there is provided a spacecraft evaluation method using a spacecraft system evaluation system as described in any one of the above technical solutions, comprising the following steps:

[0034] Step S10: construct an evaluation system framework based on evaluation requirements, wherein the evaluation system framework includes functions of creating new evaluation plans, mission task analysis, scenario analysis, and maintaining and managing evaluation plans, mission tasks, and scenarios;

[0035] Step S20: Based on the evaluation requirements of the evaluation scheme, mission tasks and task scenarios, an evaluation indicator system of the evaluation system framework is created to construct the required evaluation data;

[0036] Step S30: based on the required evaluation data, obtaining the evaluation data through a database and / or an imported or stored file;

[0037] Step S40, calculating and analyzing the capability contribution rate, efficiency contribution rate, system contribution rate, and sensitivity of the spacecraft system based on the evaluation data and the evaluation index system;

[0038] Step S50: display and export the evaluation calculation results obtained by calculation and analysis.

[0039] According to a technical solution of the present invention, in step S40, the calculation of the efficiency contribution rate includes:

[0040] The task effectiveness value is E mn-tmk , where m represents a typical task, n represents a spacecraft, and tmk represents the kth system performance index under m typical tasks. The contribution rate of the index item tmk is calculated as

[0041]

[0042] Among them, 1 and 2 represent different spacecraft, E m1-tmk represents the calculation result of the index tmk when there is spacecraft 1 in the spacecraft system, E m2-tmk Represents the calculation result of the indicator tmk when there is spacecraft 2 in the spacecraft system.

[0043] According to a technical solution of the present invention, in step S40, a bottom-up aggregation calculation method is adopted to obtain the capability contribution rate, including:

[0044] Remember E mn-cijk The weight is ω mn-cijk , m represents a typical mission, n represents a spacecraft; cijk represents indicators of different levels of capability, and the weight of the upper indicator is the sum of the weights of the lower indicators, then:

[0045]

[0046]

[0047] E ′ It is the normalized index value of ability satisfaction.

[0048] Compared with the prior art, the present invention has the following beneficial effects:

[0049] The present invention proposes a spacecraft system evaluation system and evaluation method. In combination with the basic theory of spacecraft evaluation, a flexibly configurable evaluation system framework is established to achieve accurate evaluation of system capabilities and effectiveness. Based on the demonstration and R&D needs of the system, an evaluation index system of capabilities, effectiveness and other types can be constructed. In combination with multi-source heterogeneous data such as system data, spacecraft performance data, process data, environmental data and simulation result data, a multi-dimensional evaluation of the system is carried out. Evaluation indicators, evaluation data, evaluation models, evaluation result display forms, evaluation reports and other contents can be independently and flexibly configured, thereby providing reasonable, scientific and effective data support for spacecraft evaluation demonstration.

[0050] The use of built-in calculation operators and external import operators can realize the rapid calculation and visual display of most indicators, improving the timeliness and intuitiveness of calculations; the use of file import, database import and other methods to collect data avoids the problem of multi-source heterogeneity of data; the use of multiple indicator aggregation calculation models provides a rich calculation method for system evaluation. The present invention plays an important supporting role in realizing the standardization and quantification of spacecraft system mission effectiveness evaluation, and can provide a reliable basis for accurately grasping the direction and focus of subsequent development in the field of satellite remote sensing, as well as planning the development of related means and technologies. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0052] Figure 1 A schematic diagram schematically shows the structure of a spacecraft system evaluation system provided according to one embodiment of the present invention;

[0053] Figure 2 A diagram schematically showing an implementation path of the evaluation scheme management provided by an embodiment of the present invention;

[0054] Figure 3 A diagram schematically showing an implementation path for constructing an evaluation indicator provided by an embodiment of the present invention;

[0055] Figure 4 A diagram schematically showing an implementation approach for evaluation data processing provided by an embodiment of the present invention;

[0056] Figure 5 A diagram schematically showing an implementation path for calculating evaluation indicators provided by an embodiment of the present invention;

[0057] Figure 6 A diagram schematically showing an implementation path for generating an evaluation report provided by an embodiment of the present invention;

[0058] Figure 7 The flowchart schematically shows a method for evaluating a spacecraft system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0059] The description of the embodiments of this specification should be combined with the corresponding drawings, which should be considered as part of the complete specification. In the drawings, the shape or thickness of the embodiments may be enlarged and indicated for simplification or convenience. Furthermore, the parts of each structure in the drawings will be described separately. It is worth noting that the elements not shown in the drawings or not described in words are in a form known to ordinary technicians in the relevant technical field.

[0060] The description of the embodiments herein and any reference to directions and orientations are only for the convenience of description and are not to be construed as any limitation on the scope of protection of the present invention. The following description of the preferred embodiments may involve combinations of features, which may exist independently or in combination, and the present invention is not particularly limited to the preferred embodiments. The scope of the present invention is defined by the claims.

[0061] like Figure 2 As shown, the embodiment of the present invention provides a schematic diagram of the evaluation scheme management implementation path system of the spacecraft system evaluation system, which includes a client and a server. The client is connected to the server, wherein the client is a device that can be used to input data, such as a computer (PC), a mobile phone, a tablet computer and other smart devices, and the client is used to send a processing request and target data to be processed to the server of the spacecraft system evaluation system; the server of the spacecraft system evaluation system is used to manage the evaluation scheme request, obtain the evaluation scheme to be created, and the evaluation scheme is used to characterize at least one of the evaluation background, evaluation purpose, and evaluation object of the execution spacecraft; create an evaluation index system based on the evaluation scheme, and perform a calculation data demand analysis on the evaluation index system to obtain evaluation data; collect and process the evaluation data; use the evaluation index calculation model to calculate the evaluation index system and the evaluation data to obtain the evaluation result; visualize the evaluation result, and derive and generate an evaluation report, and return the report to the client.

[0062] like Figure 1 As shown, a spacecraft system evaluation system of the present invention comprises:

[0063] The evaluation scheme management module 10 is used to build an evaluation system framework based on the evaluation requirements. The evaluation system framework includes the functions of creating a new evaluation scheme, mission task analysis, scenario analysis, and maintaining and managing the evaluation scheme, mission task, and scenario.

[0064] An evaluation indicator construction module 20 is used to create an evaluation indicator system of the evaluation system framework and construct required evaluation data based on the evaluation requirements of the evaluation scheme, mission tasks and task scenarios;

[0065] An evaluation data processing module 30, for obtaining the evaluation data through a database and / or an imported or stored file based on the required evaluation data;

[0066] An evaluation index calculation module 40 is used to calculate and analyze the capability contribution rate, efficiency contribution rate, system contribution rate, and sensitivity of the spacecraft system based on the evaluation data and the evaluation index system;

[0067] The evaluation result generation module 50 is used to display and export the evaluation calculation results obtained by calculation and analysis.

[0068] The present invention, in combination with the basic theory for spacecraft evaluation, has built a flexibly configurable evaluation system framework to achieve accurate evaluation of system capabilities and effectiveness. Based on the demonstration and R&D needs of the system, it can construct an evaluation index system of capabilities, effectiveness and other types, and carry out multi-dimensional evaluation of the system by combining multi-source heterogeneous data such as system data, spacecraft performance data, process data, environmental data and simulation result data. It provides autonomous and flexible configuration of evaluation indicators, evaluation data, evaluation models, evaluation result display forms, evaluation reports and other contents, thus providing reasonable, scientific and effective data support for spacecraft evaluation demonstration.

[0069] The use of built-in evaluation index calculation operators (built-in evaluation index calculation formulas) and external import operators (external import evaluation index calculation formulas) can realize the rapid calculation and visual display of most indicators, improving the timeliness and intuitiveness of the calculation; the use of file import, database import and other methods to collect data avoids the problem of multi-source heterogeneity of data; the use of multiple index aggregation calculation models provides a rich calculation method for system evaluation. This invention plays an important supporting role in realizing the standardization and quantification of spacecraft system mission effectiveness evaluation, and can provide a reliable basis for accurately grasping the direction and focus of subsequent development in the field of satellite remote sensing, as well as planning the development of related means and technologies.

[0070] In addition, the spacecraft system evaluation system of the present application has strong applicability and is not only suitable for the evaluation of spacecraft systems, but also for the evaluation of other equipment systems.

[0071] For the evaluation plan, the evaluation plan is created based on the acquired evaluation background, purpose, evaluation object and other demand information, and the evaluation plan name, evaluation object, evaluation time, evaluation background and purpose and other information are edited. The evaluation plan management module 10 is used for the management of the evaluation plan.

[0072] The evaluation scheme management module 10 includes the following functions:

[0073] Maintain and manage the evaluation plans by adding, deleting, modifying, checking, list management, importing, and exporting;

[0074] Complete mission analysis and scenario analysis according to different assessment types;

[0075] Add, delete, modify, review, and maintain mission tasks, scenarios, and scenarios;

[0076] Among them, the evaluation types include capability evaluation, effectiveness evaluation, and system contribution rate evaluation.

[0077] Mission analysis provides mission creation and management functions based on the evaluation purpose and characteristics of the evaluation object, and provides a graphical interface to support editing of mission attributes.

[0078] Scenario analysis provides scenario creation and management functions. It can refer to the imported external simulation scenario files to set the scenario name, background, system composition, and scenario-related mission tasks. It also supports setting different scenario situations according to the evaluation purpose (for example, having an evaluated spacecraft type and not having an evaluated spacecraft type are considered different scenario situations, and the number and indicators of evaluated spacecraft types are different can also be considered different scenario situations), providing a basis for simulation scenario design.

[0079] In one embodiment of the present invention, preferably, the evaluation index construction module 20 is also used for:

[0080] According to the evaluation purpose, evaluation object, and evaluation requirements of the task scenario, the effectiveness indicators and system capability indicators are visually constructed based on the evaluation indicator system template, and the attributes, dimensions, criteria, and calculation methods of the evaluation indicators are edited;

[0081] Carry out addition, deletion, modification, and query, classification and grading management, and list management of the indicator system and indicator criteria templates, establish a mapping matrix of performance indicators and capability indicators, and set the good, medium, and poor support relationship of indicator mapping;

[0082] The evaluation index construction results can be saved as a template or exported as an external file to provide input for simulation test factor design and simulation data collection.

[0083] Evaluation indicators are created based on evaluation requirements such as evaluation purpose, evaluation object, and task scenario. First, it provides the function of importing evaluation indicator templates and loading them into the template library to provide a basis for the reuse of evaluation indicators. Secondly, it provides the function of creating task effectiveness indicators for mission tasks in typical scenarios. Thirdly, based on the evaluation indicator system template, it provides a graphical and hierarchical construction of system capability evaluation indicators.

[0084] Evaluation indicator editing targets performance indicators and capability indicators, and supports editing of the name, attribute, dimension, value range, indicator calculation method, and other contents of the evaluation indicators. It also supports setting the evaluation criteria of indicators by setting common criterion functions, custom criterion functions, and uploading criterion function scripts.

[0085] The evaluation indicator mapping provides a graphical interface for setting the mapping relationship between the performance indicators and the capability indicators for the task effectiveness indicators and the system capability indicators, and supports setting the value range of the system capability indicators according to the excellent, medium and poor grades of the performance indicators.

[0086] The indicator system outputs the constructed performance indicators and capability indicators, which can be saved in the database, saved as an indicator template, or exported as a disk file.

[0087] In one embodiment of the present invention, preferably, the evaluation data processing module 30 is further used for:

[0088] Import and store original assessment data through databases and files, and add, delete, modify and review assessment data;

[0089] Supports indicator calculation through data analysis, legality check and data cleaning functions, and provides data analysis model management, analysis data table alias setting, and analysis log management functions;

[0090] Based on the imported data, the evaluation data is screened to build the evaluation sample data structure, and the associated tables in the sample data structure are added, deleted, modified and consulted.

[0091] File import supports importing simulation data stored in disk files and can parse the data format in the file.

[0092] Database import supports setting data source type and data source interface, such as data source name, data source ID and port, database type, name, account and password, data analysis model and other information, and can import simulation data from relational or non-relational databases.

[0093] The evaluation data verification is based on the dynamically loaded parsing model, which performs data format analysis on the original data and can generate data analysis logs. It can replay and display the data analysis process by retrieving information such as data classification, analysis method, and analysis time. It supports cleaning operations such as outlier processing, missing value processing, and normalization processing on the original data. It supports checking the compliance and correctness of the data to ensure that the simulation data can meet the calculation requirements of the evaluation indicators.

[0094] The sample structure construction obtains appropriate sample data for evaluation purposes, provides sample database tables and table structure construction functions, and supports setting aliases for sample database tables and table fields, so that the indicator calculation model can be transparent to heterogeneous simulation data sources.

[0095] Sample data screening provides a graphical interface that supports users to edit SQL statements for sample data screening, supports multi-table association queries, and can execute SQL statements to import data from the simulation database into the sample database table.

[0096] Sample data display and output The function of displaying evaluation data in tabular form can also export the displayed content in various forms.

[0097] In one embodiment of the present invention, preferably, the evaluation index calculation module 40 is also used for:

[0098] Selection, deletion, modification, query and list management of various comprehensive evaluation methods for calculating capability or effectiveness indicator systems;

[0099] Create indicator algorithms to calculate performance or capability indicators, and add, delete, modify, and review indicator algorithms;

[0100] Rapid batch calculation of mission effectiveness, system capability, system contribution rate and sensitivity.

[0101] The capability and efficiency index calculation function provides the function of importing external operators and can be managed in a unified manner with the existing operators of the software. Based on the operator library, the indicator calculation model can be constructed for the efficiency index or capability index items by using graphical drag and drop or Python scripts, and the calculation model can be dynamically associated with the simulation data in different scenarios and different assumptions, so as to calculate the efficiency index or capability index one by one or in batches.

[0102] Calculation of efficiency and capability contribution rate: including indicator contribution rate calculation, indicator weight configuration and system contribution rate aggregation calculation.

[0103] Sensitivity calculation: Based on the contribution rate calculation results of mission effectiveness and system capability, the function of calculating the sensitivity of the number of evaluated spacecraft and spacecraft technical indicators is provided. The calculation results can provide a basis for determining spacecraft indicators and making decisions on the number of spacecraft to be purchased.

[0104] In one embodiment of the present invention, preferably, the evaluation result generating module 50 is used to:

[0105] Visually configure the display scheme of the evaluation results, and dynamically display the evaluation results of task effectiveness, system capability, and system contribution rate in the form of bar charts or pie charts;

[0106] Comparative analysis and sensitivity analysis of the evaluation results under different scenarios and assumptions, and traceability analysis of the evaluation results;

[0107] Generate assessment documentation reports based on predefined templates.

[0108] Evaluation result display scheme configuration Based on evaluation requirements such as evaluation purpose and evaluation object, the evaluation result display scheme can be customized through the visual configuration function of display content and display page style to meet diverse data display needs.

[0109] The evaluation results are displayed in various forms such as pie charts, tree diagrams, scatter plots, radar charts, etc., supporting the display of system capabilities, task effectiveness, capability system contribution rate, effectiveness system contribution rate, as well as comprehensive comparison of evaluation results and sensitivity analysis.

[0110] Backtracking analysis of evaluation results For any evaluation result, reverse backtracking is supported, and a mapping chain of evaluation results, evaluation indicators, evaluation data, and calculation models can be established to improve the credibility of the evaluation results.

[0111] The evaluation report generation provides the evaluation report template configuration function, which supports users to configure the output content and document format of the report. It also supports users to automatically generate and output evaluation document reports based on predefined evaluation report templates.

[0112] like Figure 7 As shown, according to another aspect of the present invention, there is provided a spacecraft evaluation method using a spacecraft system evaluation system as described in any one of the above technical solutions, comprising the following steps:

[0113] Step S10: Building an evaluation system framework based on evaluation requirements. The evaluation system framework includes the functions of creating new evaluation plans, mission task analysis, and scenario analysis, as well as maintaining and managing evaluation plans, mission tasks, and scenarios. The specific process is as follows: Figure 2 As shown;

[0114] Step S20: Based on the evaluation requirements of the evaluation plan, mission tasks and task scenarios, an evaluation indicator system of the evaluation system framework is created to construct the required evaluation data. The specific process is as follows: Figure 3 As shown;

[0115] Step S30: Based on the required evaluation data, the evaluation data is obtained through a database and / or an imported or stored file. The specific process is as follows: Figure 4 As shown;

[0116] Step S40: Based on the evaluation data and the evaluation index system, the capability contribution rate, efficiency contribution rate, system contribution rate and sensitivity of the spacecraft system are calculated and analyzed. The specific process is as follows: Figure 5 As shown;

[0117] According to a technical solution of the present invention, in step S40, the calculation of the efficiency contribution rate includes:

[0118] The task effectiveness value is E mn-tmk, where m represents a typical task, n represents a spacecraft, and tmk represents the kth system performance index under m typical tasks. The contribution rate of the index item tmk is calculated as

[0119]

[0120] Among them, 1 and 2 represent different spacecraft, E m1-tmk represents the calculation result of the index tmk when there is spacecraft 1 in the spacecraft system, E m2-tmk Represents the calculation result of the indicator tmk when there is spacecraft 2 in the spacecraft system.

[0121] According to a technical solution of the present invention, in step S40, a bottom-up aggregation calculation method is adopted to obtain the capability contribution rate, including:

[0122] Remember E mn-cijk The weight is ω mn-cijk , m represents a typical mission, n represents a spacecraft; cijk represents indicators of different levels of capability, and the weight of the upper indicator is the sum of the weights of the lower indicators, then:

[0123]

[0124]

[0125] E ′ is the normalized value of the ability satisfaction index. For example, if the ability satisfaction is "excellent", then E ′ The value is 1, and the ability satisfaction is "good", then E ′ The value is 0.8, and the ability satisfaction is "medium", then E ′ The value is 0.6, and the ability satisfaction is "poor", then E ′ The value is 0.2.

[0126] Step S50: Display and report the evaluation results obtained by the calculation and analysis. The specific process is as follows: Figure 6 shown.

[0127] According to one aspect of the present invention, there is provided an electronic device, comprising: one or more processors, one or more memories, and one or more computer programs; wherein the processor is connected to the memory, and the one or more computer programs are stored in the memory, and when the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device performs a spacecraft system assessment method as described in any one of the above technical solutions.

[0128] According to one aspect of the present invention, a computer-readable storage medium is provided for storing computer instructions. When the computer instructions are executed by a processor, a spacecraft system evaluation method as described in any one of the above technical solutions is implemented.

[0129] Computer-readable storage media may include any medium capable of storing or transmitting information. Examples of computer-readable storage media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. Code segments may be downloaded via computer networks such as the Internet, intranets, etc.

[0130] A spacecraft system evaluation system and evaluation method of the present invention, the spacecraft system evaluation system includes: an evaluation scheme management module, which is used to build an evaluation system framework based on evaluation requirements, the evaluation system framework includes the functions of creating a new evaluation scheme, mission task analysis, scenario analysis, and maintaining and managing the evaluation scheme, mission task, and scenario; an evaluation indicator construction module, which is used to create an evaluation indicator system of the evaluation system framework based on the evaluation requirements of the evaluation scheme, mission task, and mission scenario, and construct the required evaluation data; an evaluation data processing module, which is used to obtain the evaluation data through a database and / or an imported or stored file based on the required evaluation data; an evaluation indicator calculation module, which is used to calculate and analyze the capability contribution rate, efficiency contribution rate, system contribution rate, and sensitivity of the spacecraft system based on the evaluation data and the evaluation indicator system; and an evaluation result generation module, which is used to display and export the evaluation calculation results obtained by the calculation analysis. By combining the basic theories for spacecraft evaluation, a flexibly configurable evaluation system framework has been established to achieve accurate evaluation of system capabilities and effectiveness. Based on the system's demonstration and R&D needs, an evaluation index system of capabilities, effectiveness and other types can be constructed. By combining multi-source heterogeneous data such as system data, spacecraft performance data, process data, environmental data and simulation result data, a multi-dimensional evaluation of the system can be carried out. The framework provides autonomous and flexible configuration of evaluation indicators, evaluation data, evaluation models, evaluation result presentation forms, evaluation reports and other contents, providing reasonable, scientific and effective data support for spacecraft evaluation and demonstration.

[0131] Furthermore, the use of built-in calculation operators and external import operators can realize the rapid calculation and visual display of most indicators, improving the timeliness and intuitiveness of calculations; the use of multiple methods such as file import and database import to collect data avoids the problem of multi-source heterogeneity of data; the use of multiple indicator aggregation calculation models provides a rich calculation method for system evaluation. This invention plays an important supporting role in realizing the standardization and quantification of spacecraft system mission effectiveness evaluation, and can provide a reliable basis for accurately grasping the direction and focus of subsequent development in the field of satellite remote sensing, as well as planning the development of related means and technologies.

[0132] In addition, it should be noted that the present invention can be provided as a method, an apparatus or a computer program product. Therefore, the embodiments of the present invention can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the embodiments of the present invention can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0133] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0134] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0135] It should also be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0136] Finally, it should be noted that the above is a preferred embodiment of the present invention. It should be pointed out that although the preferred embodiment of the present invention has been described, for those skilled in the art, once the basic creative concept of the present invention is known, several improvements and modifications can be made without departing from the principles of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention. Therefore, the attached claims are intended to be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the present invention.

Claims

1. A spacecraft system evaluation system, characterized in that: include: An evaluation scheme management module (10) is used to construct an evaluation system framework based on evaluation requirements, wherein the evaluation system framework includes functions of creating new evaluation schemes, mission task analysis, and scenario analysis, as well as maintaining and managing evaluation schemes, mission tasks, and scenarios; An evaluation indicator construction module (20) is used to create an evaluation indicator system of the evaluation system framework and construct required evaluation data based on the evaluation plan, mission tasks and evaluation requirements of the task scenario; An evaluation data processing module (30) is used to obtain the evaluation data through a database and / or an imported or stored file based on the required evaluation data; An evaluation index calculation module (40) is used to calculate and analyze the capability contribution rate, efficiency contribution rate, system contribution rate, and sensitivity of the spacecraft system based on the evaluation data and the evaluation index system, wherein the calculation of the efficiency contribution rate includes: The task effectiveness value is E mn-tmk , where m represents a typical task, n represents a spacecraft, and tmk represents the kth system performance index under m typical tasks. The contribution rate of the index item tmk is calculated as Among them, 1 and 2 represent different spacecraft, E m1-tmk represents the calculation result of the index tmk when there is spacecraft 1 in the spacecraft system, E m2-tmk It represents the calculation result of the index tmk when there is spacecraft 2 in the spacecraft system; The capacity contribution rate is obtained by using a bottom-up aggregation calculation method, including: Remember E mn-cijk The weight is ω mn-cijk , m represents a typical mission, n represents a spacecraft; cijk represents indicators of different levels of capability, and the weight of the upper indicator is the sum of the weights of the lower indicators, then: E ′ The normalized index value of ability satisfaction; The normalized index values ​​of ability satisfaction are "excellent" 1, "good" 0.8, "average" 0.6, and "poor" 0.2; The evaluation result generation module (50) is used to display and export the evaluation calculation results obtained by calculation and analysis.

2. The spacecraft system evaluation system according to claim 1, characterized in that: Based on the evaluation requirements, the newly created evaluation plan package includes the name of the plan, the evaluation type, and the evaluation object. The evaluation plan management module (10) is also used to: Add, delete, modify and review the evaluation plan; Complete mission analysis and scenario analysis according to different assessment types; Add, delete, modify, review, and maintain mission tasks, scenarios, and scenarios; Among them, the evaluation types include capability evaluation, effectiveness evaluation, and system contribution rate evaluation.

3. The spacecraft system evaluation system according to claim 1, characterized in that: The evaluation index building module (20) is also used for: According to the evaluation purpose, evaluation object, and evaluation requirements of the task scenario, the effectiveness indicators and system capability indicators are visually constructed based on the evaluation indicator system template, and the attributes, dimensions, criteria, and calculation methods of the evaluation indicators are edited; Carry out addition, deletion, modification, and query, classification and grading management, and list management of the indicator system and indicator criteria templates, establish a mapping matrix of performance indicators and capability indicators, and set the good, medium, and poor support relationship of indicator mapping; The evaluation index construction results can be saved as a template or exported as an external file to provide input for simulation test factor design and simulation data collection.

4. The spacecraft system evaluation system according to claim 3, characterized in that: The evaluation data processing module (30) is also used for: Import and store original assessment data through databases and files, and add, delete, modify and review assessment data; Supports indicator calculation through data analysis, legality check and data cleaning functions, and provides data analysis model management, analysis data table alias setting, and analysis log management functions; Based on the imported data, the evaluation data is screened to build the evaluation sample data structure, and the associated tables in the sample data structure are added, deleted, modified and consulted.

5. The spacecraft system evaluation system according to claim 1, characterized in that: The evaluation index calculation module (40) is also used for: Selection, deletion, modification, query and list management of various comprehensive evaluation methods for calculating capability or effectiveness indicator systems; Create indicator algorithms to calculate performance or capability indicators, and add, delete, modify, and review indicator algorithms; Rapid batch calculation of mission effectiveness, system capability, system contribution rate and sensitivity.

6. The spacecraft system evaluation system according to claim 1, characterized in that: The evaluation result generating module (50) is used for: Visually configure the display scheme of the evaluation results, and dynamically display the evaluation results of task effectiveness, system capability, and system contribution rate in the form of bar charts or pie charts; Comparative analysis and sensitivity analysis of the evaluation results under different scenarios and assumptions, and traceability analysis of the evaluation results; Generate assessment documentation reports based on predefined templates.

7. A spacecraft system evaluation method implemented by using the spacecraft system evaluation system according to any one of claims 1 to 6, comprising the following steps: Step S10: construct an evaluation system framework based on evaluation requirements, wherein the evaluation system framework includes functions of creating new evaluation plans, mission task analysis, scenario analysis, and maintaining and managing evaluation plans, mission tasks, and scenarios; Step S20: Based on the evaluation requirements of the evaluation scheme, mission tasks and task scenarios, an evaluation indicator system of the evaluation system framework is created to construct the required evaluation data; Step S30: based on the required evaluation data, obtaining the evaluation data through a database and / or an imported or stored file; Step S40, calculating and analyzing the capability contribution rate, efficiency contribution rate, system contribution rate, and sensitivity of the spacecraft system based on the evaluation data and the evaluation index system; Step S50: display and export the evaluation calculation results obtained by calculation and analysis.

Images