Evaluation method and device of information system, computer equipment and storage medium

Abstract

The invention relates to an evaluation method and device of an information system, computer equipment, a storage medium and a computer program product. The method comprises the following steps: carrying out demand analysis on technical system and interoperability evaluation on an information system, obtaining a technical system and interoperability evaluation model of a corresponding system, pre-classifying data of a to-be-evaluated object in the model to obtain credible data and non-credible data, and carrying out evaluation on the credible data and the non-credible data; taking the credible part of the to-be-evaluated object as a first evaluation result of the to-be-evaluated object, and inputting the non-credible part of the to-be-evaluated object into an evaluation index of a pre-constructed technical system and an evaluation index of pre-constructed interconnection and interoperability to obtain a second evaluation result of the to-be-evaluated object, according to the first evaluation result and the second evaluation result, the evaluation result of the information system of the to-be-evaluated object is obtained, according to the method, the information system is evaluated from the perspective of a technical system and interconnection, interworking and interoperation, the evaluation result of the information system is obtained, and the comprehensive evaluation result is obtained.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an information system evaluation method, apparatus, computer equipment, storage medium and computer program product. Background Art

[0002] Broadly speaking, interoperability includes technical interoperability and operational interoperability. Technical interoperability refers to the ability of communication electronic systems, equipment or users to directly exchange information or provide services, while operational interoperability refers to the ability of systems, equipment or forces to provide or receive services from other systems, equipment or forces and to use such exchange services to enable them to work effectively together.

[0003] Among the existing methods, an evaluation method for information system interoperability is proposed. This method constructs a reference model of a technical architecture based on a public technical foundation, and uses this model to evaluate the interoperability of information systems. However, with the development of science and technology, the connotation of information systems is becoming more and more rich. The existing methods for evaluating the interoperability of information systems provide less reference for evaluators and the evaluation results are incomplete. Summary of the invention

[0004] Based on this, it is necessary to provide an information system evaluation method, device, computer equipment, computer-readable storage medium and computer program product that can improve the evaluation effect in response to the above technical problems.

[0005] In a first aspect, the present application provides an information system evaluation method. The method comprises:

[0006] Conduct demand analysis on the technical system and interoperability evaluation of information systems, and obtain the technical system and interoperability evaluation model of the corresponding system;

[0007] Acquiring data of an object to be evaluated in the information system based on the evaluation model;

[0008] Pre-classifying the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0009] If the data type of the object to be evaluated is trusted data, taking the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated;

[0010] If the data type of the object to be evaluated is non-trusted data, the object to be evaluated is tested based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, respectively, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability;

[0011] An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result and the second evaluation result.

[0012] In one embodiment, a method for constructing an evaluation index of a technology system includes:

[0013] Based on the top-level requirement document of the object to be evaluated, obtain the initial evaluation indicators of the technical system;

[0014] According to the corresponding stage of the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, the initial evaluation indicators of the technical system are constructed to obtain the evaluation indicators of the technical system.

[0015] In one embodiment, a method for constructing an evaluation index of interconnection and interoperability includes:

[0016] Based on the top-level requirement document of the object to be evaluated, obtaining node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators;

[0017] Obtaining interconnection evaluation indicators according to the node interconnectivity evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan;

[0018] Obtaining interoperability evaluation indicators according to the information interoperability evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan;

[0019] Obtaining interoperability evaluation indicators according to the equipment interoperability evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan;

[0020] The interconnection, intercommunication and interoperability evaluation indicators are constructed according to the interconnection evaluation indicator, the intercommunication evaluation indicator and the interoperability evaluation indicator.

[0021] In one embodiment, the second evaluation result includes an evaluation result of the object to be evaluated in terms of the technical system, and the object to be evaluated is tested based on the evaluation indicators of the pre-constructed technical system to obtain the second evaluation result of the object to be evaluated, including:

[0022] Based on the pre-constructed technical system evaluation indicators, the object to be evaluated is tested to obtain an intermediate evaluation result of the technical system of the object to be evaluated;

[0023] If the intermediate evaluation results of the technical system are comprehensive, the intermediate evaluation results of the technical system shall be determined as the evaluation results of the technical system of the object to be evaluated;

[0024] If the intermediate evaluation results of the technical system are not comprehensive, the initial evaluation indicators of the technical system are repeatedly constructed to obtain new evaluation indicators of the technical system until the intermediate evaluation results of the technical system are comprehensive.

[0025] In one embodiment, the second evaluation result includes an evaluation result of the interconnection and interoperability of the object to be evaluated, and the object to be evaluated is tested based on the pre-built interconnection and interoperability evaluation indicators to obtain the second evaluation result of the object to be evaluated, including:

[0026] Based on the pre-constructed interconnection and interoperability evaluation indicators, the object to be evaluated is tested to obtain an intermediate evaluation result of the interconnection and interoperability of the object to be evaluated;

[0027] If the intermediate evaluation result of interconnection and interoperability covers all aspects, the intermediate evaluation result of interconnection and interoperability is determined as the evaluation result of the interconnection and interoperability of the object to be evaluated;

[0028] If the intermediate evaluation result of the interconnection and interoperability is not comprehensive, the initial evaluation index of the interconnection and interoperability is repeatedly constructed to obtain new evaluation index of the interconnection and interoperability, until the intermediate evaluation result of the interconnection and interoperability is comprehensive.

[0029] In one embodiment, obtaining the evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result includes:

[0030] Obtaining a third evaluation result of the object to be evaluated according to the expert evaluation opinion;

[0031] An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result, the second evaluation result and the third evaluation result.

[0032] In a second aspect, the present application also provides an evaluation device for an information system. The device comprises:

[0033] The pre-processing module is used to analyze the needs of the technical system and interoperability evaluation of the information system and obtain the technical system and interoperability evaluation model of the corresponding system;

[0034] An acquisition module, used for acquiring data of an object to be evaluated in the information system based on the evaluation model;

[0035] A classification module, used for pre-classifying the evaluation data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0036] A first evaluation module, configured to use the accepted part of the object to be evaluated as a first evaluation result of the object to be evaluated if the data type of the object to be evaluated is accepted data;

[0037] A second evaluation module is used for testing the object to be evaluated based on a pre-built technical system evaluation index and a pre-built interconnection and interoperability evaluation index, respectively, if the data type of the object to be evaluated is untrusted data, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes an evaluation result of the object to be evaluated in terms of the technical system and an evaluation result of the object to be evaluated in terms of interconnection and interoperability;

[0038] A processing module is used to obtain an evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result.

[0039] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0040] Conduct demand analysis on the technical system and interoperability evaluation of information systems, and obtain the technical system and interoperability evaluation model of the corresponding system;

[0041] Acquiring data of an object to be evaluated in the information system based on the evaluation model;

[0042] Pre-classifying the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0043] If the data type of the object to be evaluated is trusted data, taking the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated;

[0044] If the data type of the object to be evaluated is non-trusted data, the object to be evaluated is tested based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, respectively, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability;

[0045] An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result and the second evaluation result.

[0046] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0047] Conduct demand analysis on the technical system and interoperability evaluation of information systems, and obtain the technical system and interoperability evaluation model of the corresponding system;

[0048] Acquiring data of an object to be evaluated in the information system based on the evaluation model;

[0049] Pre-classifying the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0050] If the data type of the object to be evaluated is trusted data, taking the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated;

[0051] If the data type of the object to be evaluated is non-trusted data, the object to be evaluated is tested based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, respectively, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability;

[0052] An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result and the second evaluation result.

[0053] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0054] Conduct demand analysis on the technical system and interoperability evaluation of information systems, and obtain the technical system and interoperability evaluation model of the corresponding system;

[0055] Acquiring data of an object to be evaluated in the information system based on the evaluation model;

[0056] Pre-classifying the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0057] If the data type of the object to be evaluated is trusted data, taking the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated;

[0058] If the data type of the object to be evaluated is non-trusted data, the object to be evaluated is tested based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, respectively, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability;

[0059] An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result and the second evaluation result.

[0060] The above-mentioned information system evaluation method, device, computer equipment, storage medium and computer program product conduct a demand analysis of the technical system and interoperability evaluation of the information system, obtain the technical system and interoperability evaluation model of the corresponding system, obtain the corresponding evaluation data in the information system based on the evaluation model, classify the evaluation data, and obtain the data type of the evaluation data, wherein the data type of the evaluation data includes: trusted data and untrusted data. If the data type of the object to be evaluated is trusted data, the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, and the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, which not only reduces the workload of professional evaluation technicians, but also reduces the evaluation cost of the entire evaluation process, thereby achieving the purpose of reducing costs and increasing efficiency. If the data type of the object to be evaluated is non-trusted data, then the object to be evaluated is tested based on the pre-constructed technical system evaluation indicators and the pre-constructed interconnection and interoperability evaluation indicators, and the second evaluation result of the object to be evaluated is obtained. It is worth noting that the evaluation of the information system from the perspective of the technical system not only enriches the content of the evaluation but also broadens the dimension of the evaluation. Compared with the existing interoperability evaluation method, the evaluation of the information system from the perspective of interconnection and interoperability is more reasonable and complete. The information system to be evaluated is comprehensively evaluated by combining the first evaluation result and the second evaluation result to obtain the final technical system and interoperability evaluation result of the information system. This method, on the one hand, takes the trusted part of the object to be evaluated as the first evaluation result, which reduces the evaluation cost and improves the evaluation efficiency. On the other hand, the information system is evaluated from the two aspects of technical system and interconnection and interoperability to obtain the final evaluation result of the information system, enriching the content of the evaluation result and broadening the dimension of the evaluation result. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 An application environment diagram of an information system evaluation method in one embodiment;

[0062] Figure 2 is a flow chart of an information system evaluation method in one embodiment;

[0063] Figure 3 A schematic diagram of evaluation indicators of a technical system in one embodiment;

[0064] Figure 4 A schematic diagram of evaluation indicators of interconnection and interoperability in one embodiment;

[0065] Figure 5 A schematic diagram of a flow chart of an evaluation method for interconnection, intercommunication and interoperability of information systems in one embodiment;

[0066] Figure 6 is a structural block diagram of an evaluation device of an information system in one embodiment;

[0067] Figure 7 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0068] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0069] The information system evaluation method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the evaluation server 102 communicates with the client server 104. The data storage system can store data that the evaluation server 102 needs to process. The data storage system can be integrated on the evaluation server 102, or placed on the cloud or other network servers.

[0070] The evaluation server 102 performs a demand analysis on the technical system and interoperability evaluation of the information system, obtains the technical system and interoperability evaluation model of the corresponding system, obtains the data of the object to be evaluated in the information system from the client server 104, and pre-classifies the data of the object to be evaluated based on the evaluation model to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data. If the data type of the object to be evaluated is trusted data, the evaluation server 102 uses the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated. If the data type of the object to be evaluated is untrusted data, the evaluation server 102 tests the object to be evaluated based on the pre-built technical system evaluation index and the pre-built interconnection and interoperability evaluation index, respectively, to obtain the second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability. The evaluation server 102 obtains the evaluation result of the information system of the object to be evaluated based on the first evaluation result and the second evaluation result.

[0071] The evaluation server 102 and the client server 104 may be implemented as independent servers or a server cluster consisting of multiple servers.

[0072] In one embodiment, Figure 2 As shown in the figure, an information system evaluation method is provided. Figure 1 The following is an example of the evaluation server in the example, including:

[0073] S202, conducting a demand analysis on the technical system and interoperability evaluation of the information system, and obtaining a technical system and interoperability evaluation model of the corresponding system.

[0074] Among them, based on the top-level document requirements of the project to be evaluated, a needs analysis of the technical system and interoperability evaluation of the information system can be conducted to determine the preliminary evaluation scope of the object to be evaluated in the information system.

[0075] Specifically, the needs analysis of the technical system and interoperability evaluation of the information system is carried out, the scope of the technical system evaluation and the scope of the interoperability evaluation in the information system are determined, and the above two scopes are combined to obtain the technical system and interoperability evaluation model. According to the evaluation model, the data of the object to be evaluated in the information system can be obtained according to the evaluation scope.

[0076] S204, acquiring data of the object to be evaluated in the information system based on the evaluation model.

[0077] Among them, the information system can be the system involved in the process of completing information transmission. With the development of science and technology, the connotation of information systems is becoming more and more rich. For example, the communication information system includes multiple systems or products under the information system. When evaluating the information system, it is often necessary to evaluate the interoperability of the information system. It is generally believed that interoperability is an important evaluation indicator in the information system. The higher the corresponding level of interoperability of a system or product, the higher the level of intelligence of the system or product, which is of great significance for the communication between complex information systems.

[0078] Specifically, the object to be evaluated in the information system may be a specific system or product. For example, the object to be evaluated may be an antenna in a communication system. Correspondingly, the data of the object to be evaluated may be antenna gain, antenna radiation direction, antenna design circuit composition, etc.

[0079] The data of the evaluation object in the information system can be obtained from the customer's system. Specifically, the data of the object to be evaluated is obtained from the customer's system according to the customer's customized evaluation requirements.

[0080] S206, pre-classifying the data of the object to be evaluated to obtain a data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data.

[0081] Among them, the accepted data means that the data has been demonstrated through experiments and the results or conclusions have been obtained. If the data of the object to be evaluated of the information system is the accepted data, the accepted part of the object to be evaluated can be directly used as the evaluation result of the object to be evaluated.

[0082] Untrusted data refers to the data of the object to be evaluated that has not been verified through experiments. If the data of the object to be evaluated of the information system is untrusted data, the untrusted data of the object to be evaluated can be evaluated according to the pre-constructed evaluation indicators of the technical system and the evaluation indicators of interconnection and interoperability to obtain the evaluation result of the object to be evaluated.

[0083] S208: If the data type of the object to be evaluated is trusted data, the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated.

[0084] Among them, the adopted parts of the object to be evaluated can be classified according to the levels of the mathematical model of the technical system and the mathematical model of interconnection and interoperability to obtain evaluation results of different types of adopted parts, and then the evaluation results of the adopted parts are combined to obtain the first evaluation result of the object to be evaluated.

[0085] Specifically, the mathematical model of the technical system and the mathematical model of interconnection and interoperability include: conceptual model, logical model and physical model. The conceptual model ignores data details and only uses concepts to describe the concept and structure of data. The logical model emphasizes semantic definition, non-overlapping and integrity, and more vivid data expression. The physical model often considers performance issues and contains all necessary information for implementation. Based on the level of the mathematical model, the adopted parts of the object to be evaluated are classified, and the results of the classification are combined to obtain the first evaluation result of the object to be evaluated.

[0086] S210, if the data type of the object to be evaluated is non-trusted data, then based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, the object to be evaluated is tested respectively to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability.

[0087] Among them, untrusted data refers to the data of the object to be evaluated that has not been verified through experiments. If the data of the object to be evaluated of the information system is untrusted data, the untrusted data of the object to be evaluated can be evaluated according to the pre-constructed evaluation indicators of the technical system and the evaluation indicators of interconnection and interoperability to obtain the evaluation result of the object to be evaluated.

[0088] Among them, the technical system refers to the knowledge environment in which a series of problem-solving activities are located or the technical environment in which innovation is located. The technical system can also be a manifestation of the overall technology. In traditional methods, the technical system is often used as a document review standard involved in interoperability evaluation. For example, for a product that has completed interoperability evaluation, the evaluation results of the product are reviewed through the technical system. This method makes the technical system only an accessory under interoperability, making the evaluation results obtained by the interoperability evaluation method incomplete and unable to provide a comprehensive reference for professional evaluation technicians.

[0089] The evaluation indicators of the technical system are generally obtained by pre-construction. After the evaluation indicators of the technical system are constructed, the evaluation object is evaluated by the evaluation indicators of the technical system to obtain the evaluation result of the evaluation object in the technical system.

[0090] Among them, the object to be evaluated can be pre-evaluated according to the evaluation indicators of the constructed technical system, and whether it meets the standards can be judged according to the result coverage of the pre-evaluation results. The coverage of the pre-evaluation results meets the standards, which means that all the evaluation indicators of the technical characteristics are used, or the main evaluation indicators are used, that is, there is a phenomenon that no evaluation indicators or the main evaluation indicators are not used for evaluation. If the standards are met, the pre-evaluation results will be determined as the evaluation results of the object to be evaluated in the technical system. If the standards are not met, the evaluation indicators of the technical system will be reconstructed until the result coverage of the pre-evaluation results meets the standards.

[0091] Among them, interconnectivity, interoperability and interoperability refer to the interconnectivity, interoperability and interoperability between the objects to be evaluated. Among them, interconnectivity means that there is a physical connection line between the objects to be evaluated. It should be noted that the existence of a physical connection line does not necessarily mean that there is data exchange. Interoperability means that there is data exchange between the objects to be evaluated. Interoperability is based on interconnectivity. Interoperability means that the object to be evaluated has the ability to transparently access the resources of another object to be evaluated or other information systems after actual use or design completion. Interoperability is based on interconnectivity and interoperability.

[0092] The evaluation indicators of interconnection and interoperability are generally obtained by pre-construction. After the evaluation indicators of interconnection and interoperability are constructed, the evaluation object to be evaluated is evaluated by using the evaluation indicators of interconnection and interoperability to obtain the evaluation result of the interconnection and interoperability of the object to be evaluated.

[0093] Among them, the object to be evaluated can be pre-evaluated according to the constructed interconnection and interoperability evaluation indicators, and whether it meets the standards can be judged according to the result coverage of the pre-evaluation results. The coverage of the pre-evaluation results meeting the standards means that all the evaluation indicators of interconnection and interoperability are used, or the main evaluation indicators are used, that is, there is a phenomenon that no evaluation indicators or the main evaluation indicators are not used for evaluation. If the standards are met, the pre-evaluation results will be determined as the evaluation results of the interconnection and interoperability of the object to be evaluated. If the standards are not met, the interconnection and interoperability evaluation indicators will be reconstructed until the result coverage of the pre-evaluation results meets the standards.

[0094] S212: Obtain an evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result.

[0095] Among them, according to the evaluation results of technical system and interconnection and interoperability in the first evaluation results and the second evaluation results, it can be clarified which aspects of the systems and products are different. Large systems can use the evaluation results as design guidance to improve the interconnection and interoperability between related components.

[0096] In the above-mentioned information system evaluation method, the above-mentioned information system evaluation method, device, computer equipment, storage medium and computer program product perform a demand analysis on the technical system and interoperability evaluation of the information system, obtain the technical system and interoperability evaluation model of the corresponding system, obtain the corresponding evaluation data in the information system based on the evaluation model, classify the evaluation data, and obtain the data type of the evaluation data, wherein the data type of the evaluation data includes: trusted data and untrusted data. If the data type of the object to be evaluated is trusted data, the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, and the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, which not only reduces the workload of professional evaluation technicians, but also reduces the evaluation cost of the entire evaluation process, thereby achieving the purpose of reducing costs and increasing efficiency. If the data type of the object to be evaluated is non-trusted data, then the object to be evaluated is tested based on the pre-constructed technical system evaluation indicators and the pre-constructed interconnection and interoperability evaluation indicators, and the second evaluation result of the object to be evaluated is obtained. It is worth noting that the evaluation of the information system from the perspective of the technical system not only enriches the content of the evaluation but also broadens the dimension of the evaluation. Compared with the existing interoperability evaluation method, the evaluation of the information system from the perspective of interconnection and interoperability is more reasonable and complete. The information system to be evaluated is comprehensively evaluated by combining the first evaluation result and the second evaluation result to obtain the final technical system and interoperability evaluation result of the information system. This method, on the one hand, takes the trusted part of the object to be evaluated as the first evaluation result, which reduces the evaluation cost and improves the evaluation efficiency. On the other hand, the information system is evaluated from the two aspects of technical system and interconnection and interoperability to obtain the final evaluation result of the information system, enriching the content of the evaluation result and broadening the dimension of the evaluation result.

[0097] Establishing a correct and scientific technical system and interconnection and interoperability evaluation indicator system is the premise and key to effective evaluation. Therefore, before designing the technical system and interconnection and interoperability evaluation scheme, in one embodiment, the method of constructing the evaluation indicator of the technical system includes: obtaining the initial evaluation indicator of the technical system based on the top-level requirement document of the object to be evaluated; constructing the initial evaluation indicator of the technical system according to the corresponding stage of the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, and obtaining the evaluation indicator of the technical system.

[0098] Among them, the top-level requirement document of the object to be evaluated is the design specification of the object to be evaluated, or the industry standard. The top-level requirement document is generally a conceptual type document. In some cases, the top-level requirement document also contains the numerical range of the main parameters.

[0099] For the system or product to be evaluated, the technical system runs through the entire life cycle of the system or product from design to scrapping. The documents involved in the technical system are usually divided into: top-level requirements documents, capability requirements documents and evaluation plans. Among them, the capability requirements documents include the initial capability documents, capability development documents, and capability production documents. The evaluation plan includes the information assurance plan and the overall test and evaluation plan.

[0100] Specifically, based on the top-level requirement document of the object to be evaluated, the initial evaluation indicators of the technical system are obtained, and the technical system applicable to the object to be evaluated is screened according to the stage corresponding to the life cycle of the object to be evaluated, so as to obtain the target document or target plan of the technical system, wherein the target document includes at least one of the capability initial document, capability development document, and capability production document, and the target plan includes at least one of the information assurance plan and the overall test and evaluation plan. Based on at least one of the target documents or target plans in the technical system, the initial evaluation indicators of the technical system are constructed to obtain the evaluation indicators of the technical system.

[0101] Among them, Figure 3 The schematic diagram of the evaluation indicators of the technical system shown in the figure includes: architecture, network access, time and space benchmark, information sharing, security and confidentiality, and spectrum utilization.

[0102] The architecture may be an evaluation indicator of the architecture of the object to be evaluated, and the architecture is determined according to the top-level requirement document.

[0103] Network access refers to the network access assessment indicators of the object to be evaluated, specifically including: network access integrity, network access accuracy, network access stability and standard consistency compliance.

[0104] The space-time benchmark refers to the space-time benchmark evaluation indicators of the object to be evaluated, specifically including: time benchmark compliance, space benchmark compliance and standard consistency compliance.

[0105] Information sharing refers to the information sharing evaluation indicators of the object to be evaluated, including: rationality of data model, rationality of information exchange, rationality of information service and consistency of standards.

[0106] Security and confidentiality refer to the security and confidentiality assessment indicators of the object to be assessed, specifically including: information security or technical rationality, autonomous controllability, and consistency with standards.

[0107] Spectrum usage refers to the evaluation indicators used to evaluate the object to be evaluated, including: compliance with pre-selected frequency bands, electromagnetic compatibility, and standard consistency compliance.

[0108] Among them, standard consistency compliance represents whether the evaluation indicators of the technical system conform to the corresponding documents of the current technical system. Specifically, the standard consistency compliance in the architecture is determined based on the top-level requirement document.

[0109] Among them, in the process of constructing technical system evaluation indicators, the most important thing is to design a technical system evaluation plan in combination with the technical system evaluation indicators and different relevant documents throughout the life cycle. This not only provides a guiding basis for the evaluation of various systems / products, but also affects the overall evaluation effect and efficiency.

[0110] In this embodiment, initial evaluation indicators of the technical system are constructed based on the corresponding stages of the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, to provide a guiding basis for the evaluation of the object to be evaluated, thereby improving the overall evaluation effect and efficiency.

[0111] Establishing a correct and scientific technical system and interconnection and interoperability evaluation index system is the premise and key to effective evaluation. Therefore, before the technical system and interconnection and interoperability evaluation scheme are designed, in one embodiment, a method for constructing interconnection and interoperability evaluation indicators includes: obtaining node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators based on the top-level requirement document of the object to be evaluated; obtaining interconnection evaluation indicators according to the node interconnectivity evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan; obtaining intercommunication evaluation indicators according to the information intercommunication evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan; obtaining interoperability evaluation indicators according to the equipment interoperability evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan; constructing interconnection and interoperability evaluation indicators according to the interconnection evaluation indicators, intercommunication evaluation indicators and interoperability evaluation indicators.

[0112] Among them, the top-level requirement document of the object to be evaluated is the design specification of the object to be evaluated, or the industry standard. The top-level requirement document is generally a conceptual type document. In some cases, the top-level requirement document also contains the numerical range of the main parameters.

[0113] Based on the top-level requirement document of the object to be evaluated, the node connectivity evaluation index, information interoperability evaluation index and equipment interoperability evaluation index are obtained.

[0114] Among them, Figure 4 The schematic diagram of the evaluation indicators of interconnectivity and interoperability shown in the figure shows that the node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators belong to the first-level indicators, and specific second-level and third-level evaluation indicators are also divided under the first-level indicators. The second-level and third-level evaluation indicators are obtained according to the capability requirement documents and evaluation plans.

[0115] Among them, the secondary indicators for node interconnectivity evaluation indicators may include communication transmission capability, dynamic networking and access capability, and anti-interference and anti-destruction capability. The secondary indicators for information interoperability may include information sending capability, information receiving capability, and information processing capability. The secondary indicators for equipment interoperability may include interoperability success rate, interoperability time, interoperability timeliness, interoperability task scheduling capability, spectrum network resource consumption, and recovery and assurance.

[0116] The three-level indicators for communication transmission capability may include: transmission delay, transmission bandwidth, transmission distance and packet loss rate; the three-level indicators for dynamic networking and access capability may include: networking time and network access time; the three-level indicators for anti-interference and anti-destruction capability may include: communication link stability, communication failure recovery time, communication link redundancy backup and degraded communication efficiency. The three-level indicators for information sending capability may include: information sending standards, policies and regulations, security policies and operating procedures; the three-level indicators for information receiving capability may include: policies and regulations and security policies; the three-level indicators for information processing capability may include: information processing standards, policies and regulations, security policies and operating regulations.

[0117] Specifically, the evaluation indicators of interconnectivity are obtained according to the evaluation indicators of node interconnectivity, the capability requirement documents of the object to be evaluated, and the evaluation plan. The evaluation indicators of intercommunication are obtained according to the evaluation indicators of information interoperability, the capability requirement documents of the object to be evaluated, and the evaluation plan. The evaluation indicators of interoperability are obtained according to the evaluation indicators of equipment interoperability, the capability requirement documents of the object to be evaluated, and the evaluation plan.

[0118] Among them, the capability requirement documents include initial capability documents, capability development documents, and capability production documents; the assessment plan includes the information assurance plan and the overall test and evaluation plan.

[0119] Based on the evaluation indicators of interconnection, intercommunication and interoperability, the evaluation indicators of interconnection, intercommunication and interoperability are constructed.

[0120] In this embodiment, by grading the interconnection, intercommunication and interoperability indicators, first-level indicators, second-level indicators and third-level indicators are obtained, so that the subsequent process can better evaluate the evaluation object according to the evaluation indicators, thereby improving the evaluation effect.

[0121] In one embodiment, the evaluation method of an information system further includes: based on pre-constructed evaluation indicators of a technical system, testing the object to be evaluated to obtain an intermediate evaluation result of the technical system of the object to be evaluated; if the intermediate evaluation result of the technical system covers all aspects, the intermediate evaluation result of the technical system is determined as the evaluation result of the technical system of the object to be evaluated; if the intermediate evaluation result of the technical system does not cover all aspects, repeatedly constructing the initial evaluation indicators of the technical system to obtain new evaluation indicators of the technical system, until the intermediate evaluation result of the technical system covers all aspects.

[0122] Among them, testing the object to be evaluated refers to testing non-reliable data based on the evaluation indicators of the technical system. Specifically, the content of the test can be a certain life cycle of the object to be evaluated, for example, the development cycle of a software.

[0123] The test plan can be part of the technical system evaluation plan, which includes: the object to be evaluated, the life cycle of the object to be evaluated, and the test content of the object to be evaluated. Specifically, based on the pre-constructed technical system evaluation indicators and the technical system evaluation plan, the object to be evaluated is tested to obtain the intermediate evaluation results of the technical system of the object to be evaluated.

[0124] The intermediate evaluation result is a part of the test content, wherein the test content can be divided in advance to obtain multiple test contents. Specifically, it is judged whether the indicators contained in the intermediate evaluation result corresponding to a certain test content are fully covered. If the intermediate evaluation result of the technical system is fully covered, the intermediate evaluation result of the technical system is determined as the evaluation result of the object to be evaluated in the technical system; if the intermediate evaluation result of the technical system is not fully covered, the initial evaluation indicators of the technical system are repeatedly constructed to obtain new evaluation indicators of the technical system, until the intermediate evaluation result of the technical system is fully covered.

[0125] Among them, the basis for judgment can be whether the evaluation indicators of the comparative test content and the technical system are completely matched, or whether the degree of matching is greater than the preset threshold. If the degree of matching is greater than the preset threshold, the intermediate evaluation results of the technical system are considered to be comprehensive; if the degree of matching is less than or equal to the preset threshold, the intermediate evaluation results of the technical system are considered to be incomplete.

[0126] In this embodiment, by comparing whether the test content in the technical system evaluation plan matches the evaluation indicators of the technical system, the situation where test content is omitted and the evaluation results are unreliable can be reduced, thereby improving the evaluation effect.

[0127] In one embodiment, the evaluation method of the information system also includes: based on the pre-constructed interconnection and interoperability evaluation indicators, testing the object to be evaluated to obtain an intermediate evaluation result of the interconnection and interoperability of the object to be evaluated; if the intermediate evaluation result of the interconnection and interoperability covers all aspects, then the intermediate evaluation result of the interconnection and interoperability is determined as the evaluation result of the interconnection and interoperability of the object to be evaluated; if the intermediate evaluation result of the interconnection and interoperability does not cover all aspects, then repeatedly constructing the initial evaluation indicators of the interconnection and interoperability to obtain new evaluation indicators of the interconnection and interoperability until the intermediate evaluation result of the interconnection and interoperability covers all aspects.

[0128] Among them, testing the object to be evaluated refers to testing non-trusted data based on the evaluation indicators of interconnection and interoperability. Specifically, the content of the test can be a certain life cycle of the object to be evaluated, for example, the development cycle of a software.

[0129] The test plan can be part of the interconnection and interoperability evaluation plan, which includes: the object to be evaluated, the life cycle of the object to be evaluated, and the test content of the object to be evaluated. Specifically, based on the pre-built interconnection and interoperability evaluation indicators and the interconnection and interoperability evaluation plan, the object to be evaluated is tested to obtain the intermediate evaluation results of the interconnection and interoperability of the object to be evaluated.

[0130] The intermediate evaluation result is a part of the test content, wherein the test content can be divided in advance to obtain multiple test contents. Specifically, it is judged whether the indicators contained in the intermediate evaluation result corresponding to a certain test content are fully covered. If the intermediate evaluation result of interconnection and interoperability is fully covered, the intermediate evaluation result of interconnection and interoperability is determined as the evaluation result of interconnection and interoperability of the object to be evaluated; if the intermediate evaluation result of interconnection and interoperability is not fully covered, the initial evaluation indicators of interconnection and interoperability are repeatedly constructed to obtain new evaluation indicators of interconnection and interoperability, until the intermediate evaluation result of interconnection and interoperability is fully covered.

[0131] Among them, the basis for judgment can be whether the comparison test content and the evaluation indicators of interconnection and interoperability are completely matched, or whether the degree of matching is greater than a preset threshold. If the degree of matching is greater than the preset threshold, it is considered that the intermediate evaluation results of interconnection and interoperability are comprehensive; if the degree of matching is less than or equal to the preset threshold, it is considered that the intermediate evaluation results of interconnection and interoperability are not comprehensive.

[0132] Specifically, node interconnectivity is the foundation, while interoperability is the highest level requirement of the system / product. When designing an interconnectivity and interoperability evaluation plan, there are two main design contents: 1. Technical performance evaluation, which explains whether the system or product achieves the technical indicators specified in the top-level file for node interconnectivity, information interoperability, and equipment interoperability, that is, the first-level indicators corresponding to node interconnectivity, information interoperability, and equipment interoperability. 2. Explain the system or product's ability to meet the requirements of the use mission and interoperability level and achieve interoperability under specific tasks.

[0133] In this embodiment, by comparing whether the test content in the interconnection interoperability evaluation scheme matches the evaluation indicators of interconnection interoperability, the situation where test content is omitted and the evaluation results are unreliable can be reduced, thereby improving the evaluation effect.

[0134] In one embodiment, an evaluation result of the information system of the object to be evaluated is obtained based on the first evaluation result and the second evaluation result, including: obtaining a third evaluation result of the object to be evaluated based on the expert evaluation opinion, and obtaining the evaluation result of the information system of the object to be evaluated based on the first evaluation result, the second evaluation result and the third evaluation result.

[0135] Among them, if the data to be evaluated is unreliable data, experiments are generally required. Due to various reasons, the experiments are inconvenient to conduct, or the results of the experiments cannot be obtained, or the results of the experiments are unqualified. At this time, it is necessary to evaluate the plan of the object to be evaluated or the indicators of the object to be evaluated according to experts to obtain a third evaluation result, and then obtain the evaluation result of the information system of the object to be evaluated based on the first evaluation result, the second evaluation result and the third evaluation result.

[0136] In this embodiment, by taking the object to be evaluated given by the experts' meeting review as the third evaluation result, and obtaining the evaluation result of the information system of the object to be evaluated based on the third evaluation result and the first evaluation result, the evaluation work of the object to be evaluated can also be completed even when it is inconvenient to conduct experiments, thereby improving the evaluation efficiency and evaluation effect.

[0137] In one embodiment, Figure 5 As shown in the figure, an evaluation method for interconnection and interoperability of information systems is provided. Based on the existing interoperability level evaluation method, this method makes a detailed division of the technical system evaluation content and the interconnection and interoperability evaluation content, and puts the perfect technical system and interoperability on an equal footing. It fully considers the existing data and information of the information system, returns to the core demands of reducing the cost of interconnection and interoperability evaluation and improving the efficiency of interconnection and interoperability evaluation, and proposes a complete interconnection and interoperability evaluation plan. Including:

[0138] S502, based on the top-level requirement document of the object to be evaluated, the initial evaluation indicators of the technical system are obtained, and according to the corresponding stage of the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, the initial evaluation indicators of the technical system are constructed to obtain the evaluation indicators of the technical system.

[0139] S504, based on the top-level requirement document of the object to be evaluated, the capability requirement document of the object to be evaluated and the evaluation plan, obtain the evaluation indicators of interconnection, intercommunication and interoperability, and construct the evaluation indicators of interconnection, intercommunication and interoperability according to the evaluation indicators of interconnection, intercommunication and interoperability.

[0140] Among them, based on the top-level requirement document of the object to be evaluated, the node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators are obtained; according to the node interconnectivity evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan, the interconnection evaluation indicators are obtained; according to the information interoperability evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan, the intercommunication evaluation indicators are obtained; according to the equipment interoperability evaluation indicators, the capability requirement document of the object to be evaluated and the evaluation plan, the interoperability evaluation indicators are obtained; according to the interconnection evaluation indicators, intercommunication evaluation indicators and interoperability evaluation indicators, the interconnection, interoperability and interoperability evaluation indicators are constructed.

[0141] S506, conduct a demand analysis for the technical system and interoperability evaluation of the information system, obtain the technical system and interoperability evaluation model of the corresponding system, obtain the data of the object to be evaluated in the information system based on the evaluation model, and pre-classify the data of the object to be evaluated to obtain the data type of the object to be evaluated.

[0142] The data types of the objects to be evaluated include credible data and uncredible data.

[0143] Among them, the data collection methods for technical systems and interconnection and interoperability mainly include the following four: 1. Document review: This method mainly corresponds to the collection and acceptance of existing information and the verification and review of the interconnection and interoperability related content in the system / product design implementation documents; 2. Tool testing: Use interface, signal and other test tools and protocol testing technology and other methods to test and verify the compliance of technical indicators in the interconnection and interoperability standards and specifications of the system / product; 3. Performance verification: Use laboratories, simulation test platforms and other technical test environments to test and verify the compliance of the three first-level evaluation indicators of node interconnectivity, information interoperability and equipment interoperability. It is worth noting that, if necessary, an outdoor test environment can be used and the corresponding information communication link can be built for indicator verification; 4. Other targeted data collection methods.

[0144] S508: If the data type to be evaluated is credible data, the credible part of the object to be evaluated is used as the first evaluation result of the object to be evaluated.

[0145] S510, if the data type to be evaluated is untrusted data, then based on the pre-constructed technical system evaluation indicators and the pre-constructed interconnection and interoperability evaluation indicators, the object to be evaluated is tested respectively to obtain an evaluation result of the intermediate system of the object to be evaluated.

[0146] Among them, the intermediate evaluation results of the technical system are determined as the evaluation results of the technical system of the object to be evaluated.

[0147] S512, determine whether the intermediate evaluation results of the technical system are comprehensive. If so, execute S518; if not, return to S502.

[0148] S514: If the data type to be evaluated is untrusted data, based on the pre-built interconnection and interoperability evaluation indicators, the object to be evaluated is tested to obtain an intermediate evaluation result of the interconnection and interoperability of the object to be evaluated.

[0149] Among them, the intermediate evaluation result of interconnection and interoperability is determined as the evaluation result of interconnection and interoperability of the object to be evaluated.

[0150] S516, determine whether the intermediate evaluation results of the technical system are comprehensive. If so, execute S518; if not, return to S504.

[0151] The assessment can also be centered on the functionality and connectivity of the system / product, and conduct an architecture-based technical system and interconnection and interoperability assessment, which mainly includes the following five aspects:

[0152] (1) Functional analysis

[0153] Use system engineering and architecture methods to complete demand analysis, function mapping, process analysis, etc., to analyze and answer questions such as whether the system / product is correct and whether it has the ability to provide the expected mission.

[0154] (2) Connectivity check

[0155] The architecture approach is used to complete the static technical system and interconnection and interoperability assessment. The core is to analyze the physical and logical interfaces and mappings of the system / product, and to address four aspects: whether the connectivity is correct, whether the connectivity and interface content are correct, whether the logical interface connectivity is correct, and whether the standard is adopted.

[0156] (3) System / product performance and behavior metrics

[0157] The functions and performance of the technical structure and interconnection and interoperability of the system / product are measured to analyze and answer questions such as how to better provide mission capabilities, whether the operating mode is acceptable, and whether accuracy and timeliness are met, so as to conduct dynamic analysis using system engineering methods.

[0158] (4) Evaluation Management

[0159] The evaluation management of technical system and interconnection and interoperability includes parameter system / product management, test site management, experimental data management and test personnel management. The system / product evaluation index analysis based on technical system and interconnection and interoperability is completed by using system engineering and architecture methods, and the technical system and interconnection and interoperability evaluation method and data environment are established to generate the required evaluation questionnaire.

[0160] (5) Evaluation method

[0161] The specific operation process of evaluating the technical system and interconnection and interoperability of the system / product is as follows:

[0162] 1) The customer applies for an assessment, signs an assessment agreement, fills in basic system / product information, and applies for a technical system and interconnection and interoperability assessment;

[0163] 2) The assessor reviews the basic information of the system / product, clarifies the purpose of the customer assessment, and approves the technical system and interconnection and interoperability assessment;

[0164] 3) The client collects evidence on procedures, applications, infrastructure and data by providing information, filling out questionnaires or using data collection tools;

[0165] 4) The assessor conducts an assessment based on the collected system / product assessment evidence, against the assessment indicator system and related models, and provides the technical system and interconnection and interoperability assessment outline of the system / product. If it is a multi-system assessment, an interoperability matrix between systems is also required;

[0166] 5) Generate evaluation results based on the technical system and interconnection and interoperability evaluation profile and interoperability matrix of the system / product and return them to the customer to complete the technical system and interconnection and interoperability evaluation.

[0167] S518, obtaining a third evaluation result of the object to be evaluated based on the expert evaluation opinions.

[0168] S520: Obtain an evaluation result of the information system of the object to be evaluated according to the first evaluation result, the second evaluation result and the third evaluation result.

[0169] Among them, based on the evaluation results of the information system of the object to be evaluated, it can be clarified which aspects of the system / product have deficiencies and need to be improved. Large-scale system systems can use the evaluation results as a design guide to improve the interconnection, interoperability and interoperability between related components.

[0170] In this embodiment, the evaluation method, apparatus, computer equipment, storage medium and computer program product of the above-mentioned information system perform a demand analysis on the technical system and interoperability evaluation of the information system, obtain the technical system and interoperability evaluation model of the corresponding system, obtain the corresponding evaluation data in the information system based on the evaluation model, classify the evaluation data, and obtain the data type of the evaluation data, wherein the data type of the evaluation data includes: trusted data and untrusted data. If the data type of the object to be evaluated is trusted data, the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, and the trusted part of the object to be evaluated is used as the first evaluation result of the object to be evaluated, which not only reduces the workload of professional evaluation technicians, but also reduces the evaluation cost of the entire evaluation process, thereby achieving the purpose of reducing costs and increasing efficiency. If the data type of the object to be evaluated is non-trusted data, then the object to be evaluated is tested based on the pre-constructed technical system evaluation indicators and the pre-constructed interconnection and interoperability evaluation indicators to obtain the second evaluation result of the object to be evaluated. It is worth noting that evaluating the information system from the perspective of the technical system not only enriches the content of the evaluation but also broadens the dimension of the evaluation. Compared with the existing interoperability evaluation method, evaluating the information system from the perspective of interconnection and interoperability makes the evaluation content more reasonable and complete. The information system to be evaluated is comprehensively evaluated by combining the first evaluation result and the second evaluation result to obtain the final technical system and interoperability evaluation results of the information system. On the one hand, this method takes the trusted part of the object to be evaluated as the first evaluation result, which reduces the evaluation cost and improves the evaluation efficiency. On the other hand, the information system is evaluated from the two aspects of technical system and interconnection and interoperability to obtain the final evaluation result of the information system, which enriches the content of the evaluation result and broadens the dimension of the evaluation result. This method, (1) The information system has rich connotations and contains complex system types. A set of general and detailed interconnection and interoperability evaluation methods for information systems is proposed. (2) Considering that my country has established a sound technical system at all stages of the life cycle of various systems / products, the technical system is placed on an equal footing with interoperability, a correct and scientific technical system and interconnection and interoperability evaluation indicator system are established, and a sound technical system and interconnection and interoperability evaluation scheme design method is proposed. (3) Compared with the existing interoperability level evaluation method, the proposed evaluation method can use existing data and information, thereby reducing the evaluation cost and improving the evaluation efficiency.

[0171] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0172] Based on the same inventive concept, the embodiment of the present application also provides an information system evaluation device for implementing the information system evaluation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of the evaluation device for one or more information systems provided below can refer to the limitations of the information system evaluation method above, and will not be repeated here.

[0173] In one embodiment, Figure 6 As shown, an evaluation device for an information system is provided, comprising: a preprocessing module 600, an acquisition module 602, a classification module 604, a first evaluation module 606, a second evaluation module 608 and a processing module 610, wherein:

[0174] The pre-processing module 600 is used to perform a demand analysis on the technical system and interoperability evaluation of the information system, and obtain a technical system and interoperability evaluation model of the corresponding system;

[0175] An acquisition module 602 is used to acquire data of an object to be evaluated in the information system based on the evaluation model; the data of the object to be evaluated includes trusted data and untrusted data;

[0176] A classification module 604 is used to pre-classify the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data;

[0177] A first evaluation module 606, configured to use the accepted part of the object to be evaluated as a first evaluation result of the object to be evaluated if the data type of the object to be evaluated is accepted data;

[0178] The second evaluation module 608 is used to test the object to be evaluated based on the pre-built technical system evaluation index and the pre-built interconnection and interoperability evaluation index respectively if the data type of the object to be evaluated is untrusted data, and obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability;

[0179] The processing module 610 is used to obtain an evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result.

[0180] In one of the embodiments, the evaluation device of the information system also includes: a first construction module, which is used to obtain initial evaluation indicators of the technical system based on the top-level requirement document of the object to be evaluated; constructing the initial evaluation indicators of the technical system according to the stage corresponding to the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, to obtain the evaluation indicators of the technical system.

[0181] In one of the embodiments, the first construction module is also used to conduct experiments on the object to be evaluated based on the pre-constructed evaluation indicators of the technical system to obtain an intermediate evaluation result of the technical system of the object to be evaluated; if the intermediate evaluation result of the technical system covers all aspects, the intermediate evaluation result of the technical system is determined as the evaluation result of the technical system of the object to be evaluated; if the intermediate evaluation result of the technical system does not cover all aspects, the initial evaluation indicators of the technical system are repeatedly constructed to obtain new evaluation indicators of the technical system, until the intermediate evaluation result of the technical system covers all aspects.

[0182] In one of the embodiments, the evaluation device of the information system also includes: a second construction module, which is used to obtain node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators based on the top-level requirement file of the object to be evaluated; obtain interconnection evaluation indicators according to the node interconnectivity evaluation indicators, the capability requirement file of the object to be evaluated and the evaluation plan; obtain intercommunication evaluation indicators according to the information interoperability evaluation indicators, the capability requirement file of the object to be evaluated and the evaluation plan; obtain interoperability evaluation indicators according to the equipment interoperability evaluation indicators, the capability requirement file of the object to be evaluated and the evaluation plan; and construct interconnection, interoperability and interoperability evaluation indicators based on the interconnection evaluation indicators, intercommunication evaluation indicators and interoperability evaluation indicators.

[0183] In one of the embodiments, the second construction module is also used to test the object to be evaluated based on the pre-constructed interconnection and interoperability evaluation indicators to obtain an intermediate evaluation result of the interconnection and interoperability of the object to be evaluated; if the intermediate evaluation result of the interconnection and interoperability covers all aspects, the intermediate evaluation result of the interconnection and interoperability is determined as the evaluation result of the interconnection and interoperability of the object to be evaluated; if the intermediate evaluation result of the interconnection and interoperability does not cover all aspects, the initial evaluation indicators of the interconnection and interoperability are repeatedly constructed to obtain new evaluation indicators of the interconnection and interoperability, until the intermediate evaluation result of the interconnection and interoperability covers all aspects.

[0184] In one embodiment, the processing module 610 is further used to obtain a third evaluation result of the object to be evaluated based on the expert evaluation opinion; and to obtain an evaluation result of the information system of the object to be evaluated based on the first evaluation result, the second evaluation result and the third evaluation result.

[0185] Each module in the evaluation device of the above information system can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0186] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 7 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data of the object to be evaluated. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an evaluation method of an information system is implemented.

[0187] Those skilled in the art will understand that Figure 7The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0188] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the above method steps are implemented when the processor executes the computer program.

[0189] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above method steps are implemented.

[0190] In one embodiment, a computer program product is provided, comprising a computer program, which implements the above method steps when executed by a processor.

[0191] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0192] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0193] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0194] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for evaluating an information system, characterized in that: The method comprises: Conduct demand analysis on the technical system and interoperability evaluation of information systems, and obtain the technical system and interoperability evaluation model of the corresponding system; Acquiring data of an object to be evaluated in the information system based on the evaluation model; Pre-classifying the data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data; If the data type of the object to be evaluated is trusted data, taking the trusted part of the object to be evaluated as the first evaluation result of the object to be evaluated; If the data type of the object to be evaluated is non-trusted data, the object to be evaluated is tested based on the pre-constructed evaluation indicators of the technical system and the pre-constructed evaluation indicators of interconnection and interoperability, respectively, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes the evaluation result of the object to be evaluated in the technical system and the evaluation result of the object to be evaluated in the interconnection and interoperability; An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result and the second evaluation result.

2. The method according to claim 1, characterized in that Methods for constructing evaluation indicators for the technology system include: Based on the top-level requirement document of the object to be evaluated, obtain the initial evaluation indicators of the technical system; According to the corresponding stage of the life cycle of the object to be evaluated, as well as the capability requirement document and evaluation plan of the object to be evaluated, the initial evaluation indicators of the technical system are constructed to obtain the evaluation indicators of the technical system.

3. The method according to claim 2, characterized in that The method of constructing evaluation indicators of interconnection and interoperability includes: Based on the top-level requirement document of the object to be evaluated, obtaining node interconnectivity evaluation indicators, information interoperability evaluation indicators and equipment interoperability evaluation indicators; Obtaining interconnection evaluation indicators according to the node interconnectivity evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan; Obtaining interoperability evaluation indicators according to the information interoperability evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan; Obtaining interoperability evaluation indicators according to the equipment interoperability evaluation indicators, the capability requirement document of the object to be evaluated, and the evaluation plan; The interconnection, intercommunication and interoperability evaluation indicators are constructed according to the interconnection evaluation indicator, the intercommunication evaluation indicator and the interoperability evaluation indicator.

4. The method according to claim 1, characterized in that: The second evaluation result includes the evaluation result of the object to be evaluated in the technical system. The evaluation indicator based on the pre-constructed technical system is used to test the object to be evaluated to obtain the second evaluation result of the object to be evaluated, including: Based on the pre-constructed technical system evaluation indicators, the object to be evaluated is tested to obtain an intermediate evaluation result of the technical system of the object to be evaluated; If the intermediate evaluation results of the technical system are comprehensive, the intermediate evaluation results of the technical system shall be determined as the evaluation results of the technical system of the object to be evaluated; If the intermediate evaluation results of the technical system are not comprehensive, the initial evaluation indicators of the technical system are repeatedly constructed to obtain new evaluation indicators of the technical system until the intermediate evaluation results of the technical system are comprehensive.

5. The method according to claim 4, characterized in that The second evaluation result includes an evaluation result of the interconnection and interoperability of the object to be evaluated. The object to be evaluated is tested based on the pre-built interconnection and interoperability evaluation indicators to obtain the second evaluation result of the object to be evaluated, including: Based on the pre-constructed interconnection and interoperability evaluation indicators, the object to be evaluated is tested to obtain an intermediate evaluation result of the interconnection and interoperability of the object to be evaluated; If the intermediate evaluation result of interconnection and interoperability covers all aspects, the intermediate evaluation result of interconnection and interoperability is determined as the evaluation result of the interconnection and interoperability of the object to be evaluated; If the intermediate evaluation result of the interconnection and interoperability is not comprehensive, the initial evaluation index of the interconnection and interoperability is repeatedly constructed to obtain new evaluation index of the interconnection and interoperability, until the intermediate evaluation result of the interconnection and interoperability is comprehensive.

6. The method according to claim 1, characterized in that The step of obtaining an evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result includes: Obtaining a third evaluation result of the object to be evaluated according to the expert evaluation opinion; An evaluation result of the information system of the object to be evaluated is obtained according to the first evaluation result, the second evaluation result and the third evaluation result.

7. An evaluation device for an information system, characterized in that: The device comprises: The pre-processing module is used to analyze the needs of the technical system and interoperability evaluation of the information system and obtain the technical system and interoperability evaluation model of the corresponding system; An acquisition module, used for acquiring data of an object to be evaluated in the information system based on the evaluation model; A classification module, used for pre-classifying the evaluation data of the object to be evaluated to obtain the data type of the object to be evaluated, wherein the data type of the object to be evaluated includes: trusted data and untrusted data; A first evaluation module, configured to use the accepted part of the object to be evaluated as a first evaluation result of the object to be evaluated if the data type of the object to be evaluated is accepted data; A second evaluation module is used for testing the object to be evaluated based on a pre-built technical system evaluation index and a pre-built interconnection and interoperability evaluation index, respectively, if the data type of the object to be evaluated is untrusted data, to obtain a second evaluation result of the object to be evaluated, wherein the second evaluation result includes an evaluation result of the object to be evaluated in terms of the technical system and an evaluation result of the object to be evaluated in terms of interconnection and interoperability; A processing module is used to obtain an evaluation result of the information system of the object to be evaluated according to the first evaluation result and the second evaluation result.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images