System guarantee scheme evaluation method, equipment and medium

Through the ultra-efficiency data envelope method, combined with system guarantee evaluation indicators and investment indicators, the investment return ratio of resource usage and efficiency in the existing technology was solved, and a comprehensive evaluation and optimization of the system guarantee plan was achieved. Inferior sorting guides resource conservation and optimization.

CN119005775APending Publication Date: 2024-11-22CHINA AEROSPACE STANDARDIZATION INST
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410913852.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-09
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing guarantee plan evaluation method fails to effectively consider the relationship between the nodes in the system, resulting in waste of guarantee resources and failure to reasonably plan the return on investment ratio between resource usage and efficiency during evaluation.

Method used

Using the ultra-efficiency data envelope method, by defining the system guarantee evaluation index and the comprehensive evaluation of input and output indicators, weighing the input-output ratio between resource input parameters and efficiency output parameters, and evaluating the system guarantee plan Pros and cons. Specifically, it includes using system integrity, task continuity, timeliness and deployment as output indicators, following the number of maintenance personnel and spare parts equipment as input indicators, and building an ultra-efficiency data envelope model to use the guarantee plan with the highest efficiency value. .

Benefits of technology

A comprehensive evaluation of the system guarantee plan is achieved, and the solution with the highest efficiency value is selected to guide the system tasks to ensure resource conservation, avoid resource waste, and provide support for the ranking of advantages and disadvantages.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119005775A_ABST
    Figure CN119005775A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of comprehensive guarantee, in particular to a system guarantee scheme evaluation method and device and a medium, which can provide evaluation indexes of a system level from the perspective of a system guarantee scheme, evaluate the advantages and disadvantages of the system guarantee scheme by weighing the input-output ratio between guarantee resource input type parameters and guarantee efficiency output type parameters, and improve the evaluation efficiency of the system guarantee scheme. And resource saving in a system task is effectively guided. Output indexes are determined in the aspects of system integrity, system task continuity, system guarantee timeliness, system guarantee deployability and the like, input indexes are determined in the aspects of product deployment quantity, guarantee resource deployment quantity, maintenance personnel quantity, resource scheduling time and the like, and a system guarantee scheme is evaluated through a super-efficiency data envelope method; and the guarantee scheme with the highest efficiency value is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of integrated security technology, and in particular to a system security program evaluation method, device and medium. Background Art

[0002] The evaluation of guarantee schemes is a process of judging the pros and cons of guarantee schemes based on the goals and principles of user guarantee construction, the improvement of the actual guarantee quality of users, the characteristics of guarantee schemes, and the use of scientific evaluation methods and means on the basis of making full use of guarantee scheme evaluation information. In the context of systematization, system guarantee refers to starting from the system, considering the sharing of guarantee resources between multiple product types, multiple deployment areas, and multiple systems, and providing systematic guarantee for products through comprehensive integration of a large number of independent guarantee nodes and the interconnection, intercommunication and interoperability between various levels and types of guarantee systems, thereby improving the level of mission guarantee. The current existing guarantee scheme evaluation methods often use single performance indicators such as integrity and availability as the evaluation criteria. When evaluating the system guarantee scheme, they do not consider the correlation between the nodes in the system, and do not reasonably plan the investment return ratio between the use of guarantee resources and guarantee efficiency, which may cause a great waste of guarantee resources.

[0003] It can be seen that the existing support plan evaluation methods mostly use the support effectiveness indicators of a single product as the evaluation criteria for the quality of the support plan, and do not consider factors such as mission continuity and product deployment at the system level. After the support plan is evaluated, a relatively better support plan is often selected by comparing single parameters such as integrity, availability, spare parts satisfaction rate, and spare parts utilization rate. Summary of the invention

[0004] In view of this, the present invention provides a system security plan evaluation method, device and medium, which can propose system-level evaluation indicators from the perspective of the system security plan, evaluate the advantages and disadvantages of the system security plan by weighing the input-output ratio between the security resource input parameters and the security efficiency output parameters, and effectively guide the conservation of security resources in system tasks.

[0005] To achieve the above purpose, the present invention provides a system security scheme evaluation method, which proposes system-level evaluation indicators from the perspective of the system security scheme, and evaluates the advantages and disadvantages of the system security scheme by weighing the input-output ratio between the security resource input parameters and the security efficiency output parameters, specifically:

[0006] System security evaluation indicators are defined as output indicators, and the security resource data used for evaluation in the system security plan are sorted out as input indicators. Based on the super-efficiency data envelopment method, a comprehensive evaluation is conducted on the input indicators and output indicators. Finally, the efficiency value is obtained as the evaluation result of the system security plan to judge the pros and cons of the system security plan.

[0007] Among them, system integrity, system mission continuity, system guarantee timeliness and system guarantee deployability are used as output indicators, and the number of product deployments, the number of guarantee resource deployments, the number of maintenance personnel and resource scheduling time are used as input indicators.

[0008] The process of defining the input and output indicators for the system assurance program evaluation includes the following steps:

[0009] Step 11, defining output indicators for system assurance program evaluation; the output indicators include system integrity, system mission continuity, system assurance timeliness, and system assurance deployability;

[0010] Among them, system integrity corresponds to the integrity rate;

[0011] System task continuity corresponds to the normal operation time ratio;

[0012] System guarantee timeliness corresponds to the total maintenance downtime. System guarantee timeliness refers to the timeliness of maintenance guarantee implementation on the one hand, and the timeliness of guarantee system response on the other hand;

[0013] System support deployability corresponds to personnel utilization rate, spare parts utilization rate and spare parts satisfaction rate; system support deployability refers to the ability of the support resources required to carry out tasks with users according to the specified requirements when the system implements actions according to task requirements;

[0014] Step 12, define the system support plan evaluation input indicators, specifically involving the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts mean failure interval and maintenance support costs.

[0015] Among them, the steps of comprehensively evaluating input indicators and output indicators based on the super-efficiency data envelopment method include:

[0016] Construct a system assurance scheme evaluation model based on super-efficiency data envelopment;

[0017] Compare the efficiency values ​​of multiple assurance schemes, solve the system assurance scheme evaluation model based on super-efficiency data envelopment, and obtain the optimal solution for the efficiency value of each scheme. Through efficiency analysis, it is determined which schemes are effective in data envelopment and which are invalid. The evaluation results of the effective data envelopment assurance schemes are ranked according to their efficiency values.

[0018] Among them, the system assurance scheme evaluation model based on super-efficiency data envelopment is as follows:

[0019] minθ

[0020]

[0021] Where θ is the efficiency value and is the objective function of the dual model; X p is the pth input indicator; Y q is the qth output indicator; X0 is the input column vector of the system security plan; Y0 is the output column vector of the system security plan; S - and S + is the slack variable; j , (j=1,2,…,n) is the linear combination coefficient of the jth system assurance scheme;

[0022] The j-th system assurance solution obtained according to the above formula is recorded as θ * , S *- and S *+ , based on which the validity of its super-efficiency data envelope is defined as:

[0023] ①If θ * =1, and S *- =0, S *+ = 0, then the system guarantee scheme is data envelopment effective, which means that among the n schemes, the X invested at this time p To obtain the maximum output Y q ;

[0024] ②If θ * =1, there is at least one S *- >0 or S *+ >0, the system guarantee scheme is weak data envelopment effective, which means that among the n schemes; S *- >0 means that a certain input indicator of the scheme is not fully utilized; S *+ >0 means that the output index of the scheme is not optimal, and the output can be increased while keeping the input unchanged;

[0025] ③If θ * <1, the system assurance plan is invalid for data envelopment, indicating that the system assurance plan needs to be improved.

[0026] The present invention proposes an electronic device, which includes a processor and a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the system assurance program evaluation method described in the present invention.

[0027] The present invention provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the system assurance program evaluation method described in the present invention.

[0028] Beneficial effects:

[0029] 1. The present invention is an evaluation method for system assurance plans, which takes the availability rate, normal operation time ratio, total maintenance downtime, personnel utilization rate, spare parts utilization rate, and spare parts satisfaction rate as output indicators, and takes the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts average failure interval time, and maintenance assurance costs as input indicators. The system assurance plan is evaluated by the super-efficiency data envelopment method, and the assurance plan with the highest efficiency value is selected.

[0030] 2. In the method of the present invention, the system security evaluation index is first defined as the output index, and then the security resource data used for evaluation in the system security plan is sorted out as the input index. Then, the input index and the output index are comprehensively evaluated based on the super-efficiency data envelopment method, and finally the efficiency value is obtained as the evaluation result of the system security plan to judge the pros and cons of the system security plan.

[0031] 3. In the method of the present invention, the super-efficiency data envelopment model is used to rank the pros and cons of all system support plans, and the super-efficiency data envelopment model evaluates the maintenance support plans that are all effective data envelopments. In the face of the problem of the coexistence of multiple effective decision-making units, the main connotation of the super-efficiency data envelopment is that when evaluating the system support plan, the constraint condition does not include itself, so that the production frontier composed of the effective system support plan changes accordingly, while the efficiency value of the invalid system support plan is consistent with the calculation result of the CCR model.

[0032] 4. The method of the present invention uses the availability rate, the proportion of normal operating time, the total maintenance downtime, the personnel utilization rate, the spare parts utilization rate, and the spare parts satisfaction rate as output indicators, and uses the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, the average spare parts failure interval time, and maintenance support costs as input indicators, and constructs a comprehensive system support plan evaluation index system, combines the super-efficiency data envelopment method to evaluate the system support plan, and can select the system support plan with the highest efficiency value after weighing and optimizing, providing support for the evaluation of the system support plan.

[0033] 5. In the medium of the present invention, the integrity rate, the proportion of normal operation time, the total maintenance downtime, the personnel utilization rate, the spare parts utilization rate, and the spare parts satisfaction rate are used as output indicators, and the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, the spare parts maintenance cycle, the spare parts maintenance time, the average spare parts failure interval time, and the maintenance guarantee cost are used as input indicators. The system guarantee plan is evaluated by the super-efficiency data envelopment method, and the guarantee plan with the highest efficiency value is selected. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a schematic diagram of the system assurance program evaluation index system in the method of the present invention.

[0035] Figure 2 Schematic diagram of the system assurance solution evaluation process based on super-efficiency data envelope in an embodiment of the present invention.

[0036] Figure 3 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0037] The present invention is described in detail below with reference to the accompanying drawings and embodiments.

[0038] The present invention provides a system security scheme evaluation method, which proposes system-level evaluation indicators from the perspective of the system security scheme, evaluates the pros and cons of the system security scheme by weighing the input-output ratio between the security resource input parameter and the security efficiency output parameter, and effectively guides the conservation of security resources in the system tasks. Specifically, it is through: first defining the system security evaluation index as the output index, then combing the security resource data used for evaluation in the system security scheme as the input index, and then comprehensively evaluating the input index and the output index based on the super-efficiency data envelopment method, and finally obtaining the efficiency value as the evaluation result of the system security scheme to judge the pros and cons of the system security scheme.

[0039] The method of the present invention determines output indicators based on aspects such as system integrity, system task continuity, system guarantee timeliness, and system guarantee deployment, including integrity rate, normal operation time ratio, total maintenance downtime, personnel utilization rate, spare parts utilization rate, and spare parts satisfaction rate; the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts mean failure interval time, and maintenance guarantee cost are used as input indicators, and the system guarantee scheme is evaluated by a super-efficiency data envelopment method to select the guarantee scheme with the highest efficiency value, including the following steps:

[0040] Step 1: Define the input and output indicators for the system assurance program evaluation and build a system assurance program evaluation indicator system. Figure 1 shown.

[0041] The process of defining input and output indicators for system assurance program evaluation includes the following steps:

[0042] Step 11: Define the system assurance program evaluation output indicators.

[0043] In this embodiment, the output indicators involve system integrity, system mission continuity, system guarantee timeliness and system guarantee deployability.

[0044] Among them, system integrity corresponds to the integrity rate. Integrity refers to the ability of a product to start performing predetermined tasks at any time under different usage conditions. For the system, system integrity actually reflects the system's ability to be dispatched and put into mission at any time.

[0045] The system mission continuity corresponds to the percentage of normal operating time. Mission continuity refers to the ability of the product to maintain the task level and duration required to achieve the task, that is, the ability of the product to continuously implement actions according to the specified mission capability, usually measured in terms of continuous mission time days, hours or mileage; for the system, system mission continuity refers to the ability of the system to continuously implement mission actions according to the specified mission capability, usually measured in terms of continuous mission time days, hours or mileage.

[0046] The timeliness of system support corresponds to the total maintenance downtime. On the one hand, the timeliness of system support refers to the timeliness of maintenance support implementation, and on the other hand, it refers to the timeliness of the response of the support system. When the system performs tasks, it needs the support of the task information system, and the system support work also needs the support of the support information system. This includes requirements at several levels: one is the response speed of the support system, which involves the network supply speed of the support system; the second is the integration degree of most product support information, which involves the standardization and informatization level of support resources, and ensures the standardization and unification of resource coding.

[0047] System support deployability corresponds to personnel utilization rate, spare parts utilization rate and spare parts satisfaction rate; system support deployability refers to the ability of the required support resources to carry out tasks with users according to the specified requirements when the system implements actions (redeployment, maintenance and movement) according to mission requirements. It is a function of variables such as the number of system products supported under mission conditions, the scale of the system support system, and the duration of the system mission. The scale of the support system mainly depends on the number of necessary support equipment, equipment, supplies and support personnel, involving the size, weight, packaging characteristics and transportation capacity of support resources. Good support mobility can also improve product deployment. The specific system support plan output indicators are shown in Table 1.

[0048] Table 1 System assurance program output indicators

[0049]

[0050] Step 12: Define the evaluation input indicators for the system support plan, which specifically involve the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts provided with the product, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts mean time between failures, and maintenance support costs.

[0051] In this embodiment, the investment indicators are divided into indicator parameters that affect system support deployment, system support timeliness, and support economy, including four categories: personnel, spare parts, maintenance, and expenses.

[0052] Among them, the personnel are divided into follow-up maintenance personnel and fixed-point maintenance personnel. The number of follow-up maintenance personnel refers to the number of personnel who can support the product for maintenance anytime and anywhere during the product's mission execution. The number of fixed-point maintenance personnel refers to the number of personnel who can support the product for fixed-point maintenance after the product arrives at the guarantee point.

[0053] Spare parts are divided into product spare parts and fixed-point spare parts. The number of product spare parts is the number of spare parts that can support replacement and maintenance activities anytime and anywhere during the product's mission execution. The number of fixed-point spare parts is the number of spare parts that can support fixed-point replacement and maintenance activities when the product arrives at the maintenance point for maintenance.

[0054] Maintenance includes spare parts maintenance cycle, spare parts maintenance time, and spare parts mean time between failures. It is a maintenance factor in the input indicators that affects the quality of the system assurance plan.

[0055] Cost is the total cost of system maintenance and protection, and is also one of the important factors affecting the quality of system protection plans.

[0056] The system assurance program investment indicators are shown in Table 2.

[0057] Table 2 System security plan investment indicators

[0058]

[0059] Step 2: Evaluate the system assurance solution evaluation model based on the super-efficiency data envelopment. The evaluation process is as follows: Figure 2 As shown, the following steps are included:

[0060] Step 21, input the system support plan evaluation parameter data into the super-efficiency data envelopment model. For the entire system, its support plan covers manpower and personnel, supply support, technical data, support facilities, training and training support, support equipment, computer resource support, packaging, loading and unloading, storage and transportation and other types of support resources. Among them, the support elements that directly affect the effectiveness of the system support plan are the input indicators of the system support plan evaluation mentioned in step 1. At the same time, in view of the characteristics of the system support plan, the quality of the support plan cannot be evaluated by a simple single product performance indicator in the system, so it is necessary to introduce the output indicators of the system support plan evaluation mentioned in step 1 to evaluate the quality of the system support plan. Therefore, the input indicators and output indicators of the system support plan evaluation are used as the input of the system support plan evaluation model to support the calculation of the system support plan evaluation model.

[0061] Step 22, solving and calculating the system scheme evaluation model based on the super efficiency data envelopment, the model calculation process is as follows;

[0062] Assume there are n DMU solutions j , (j=1,2,…,n), construct the evaluation model CCR (Charnes, Cooper and Rhodes):

[0063] minθ

[0064]

[0065] Where θ is the efficiency value and is the objective function of the dual model; X p is the pth input indicator; Y q is the qth output indicator; X0 is the input column vector of the system security plan; Y0 is the output column vector of the system security plan; S - and S + is the slack variable; j , (j=1,2,…,n) is the linear combination coefficient of the jth system assurance scheme.

[0066] The j-th system assurance solution obtained according to the above formula is recorded as θ * , S *- and S *+ , based on which the effectiveness of its super-efficiency data envelope is defined as: ① If θ * =1, and S *- =0, S *+ = 0, then the system guarantee scheme is data envelopment effective, which means that among the n schemes, the X invested at this time p To obtain the maximum output Y q ②If θ * =1, there is at least one S *- >0 or S *+ >0, the system guarantee scheme is weak data envelopment effective, which means that among the n schemes, the scheme can be improved by reducing input or increasing output; S *- >0 means that a certain input indicator of the scheme is not fully utilized; S *+ >0 means that the output index of the scheme is not optimal, and the output can be increased while keeping the input unchanged. ③ If θ * <1, the system assurance plan is invalid for data envelopment, which indicates that the system assurance plan needs to be improved. The plan can be made effective by reducing the investment in follow-up / fixed-point maintenance personnel, follow-up products / fixed-point spare parts, optimizing spare parts maintenance strategies to reduce maintenance time or reduce maintenance assurance costs, etc.

[0067] The super-efficiency data envelopment model evaluates the maintenance support schemes that are all effective in data envelopment. In the face of the coexistence of multiple effective decision-making units, the main connotation of the super-efficiency data envelopment is that when evaluating the system support scheme, the constraint conditions do not include themselves, so that the production frontier composed of effective system support schemes changes accordingly, while the efficiency value of the invalid system support scheme is consistent with the calculation result of the CCR model. Therefore, the super-efficiency data envelopment model can rank the advantages and disadvantages of all system support schemes.

[0068] Step 23: Output the system assurance plan efficiency value:

[0069] Compare the efficiency values ​​of multiple guarantee schemes, solve the model through software, and obtain the optimal solution θ of the efficiency value of each scheme * Through efficiency analysis, we can find out which schemes are effective for data envelopment and which schemes are invalid for data envelopment. And we can rank the schemes according to their efficiency values ​​based on the evaluation results of effective data envelopment guarantee schemes.

[0070] A specific application example of the system assurance solution evaluation model based on super-efficiency data envelopment is carried out to verify the effect of the method of the present invention:

[0071] The parameter input of the system guarantee plan indicator is set. By constructing an evaluation indicator system, the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts mean failure interval time, and maintenance guarantee cost are used as input indicators, and the intact rate, normal operation time ratio, total maintenance downtime, personnel utilization rate, spare parts utilization rate, and spare parts satisfaction rate are used as output indicators. There are three guarantee plans to choose from. The corresponding data of each plan are shown in Table 3.

[0072] Table 3 System assurance program indicator parameters

[0073]

[0074] Taking the system assurance scheme index parameters as input, the super-efficiency data envelopment model corresponding to scheme 1 of the demand solution calculation is:

[0075]

[0076] By solving the model with software, the optimal solution of efficiency value of scheme 1 is obtained as: λ2=1.1429,λ3=1.0222. Similarly, the efficiency values ​​of other schemes can be obtained through calculation, among which the optimal solution of the efficiency value of scheme 2 is: λ1=0.7233,λ3=0,the optimal solution of efficiency value of scheme 3 is: λ1=0.411,λ2=0.

[0077] The system assurance scheme is evaluated based on the optimal solution of efficiency value. From the efficiency analysis results, it can be seen that the optimal solution of efficiency value of scheme 1, 2, and 3 is All are greater than 1, so the three system assurance schemes are all data envelopment effective, and the evaluation results of the three data envelopment effective assurance schemes are ranked as follows: Scheme 1>Scheme 2>Scheme 3, where ">" means "better than". Therefore, the result shows that the optimal system assurance scheme is Scheme 1.

[0078] It can be seen that the index system constructed by the present invention for evaluating system security solutions is different from the security efficiency index of a single product considered in the evaluation of conventional security solutions, based on the characteristics of the system composition and the characteristics of the system security solution. The system security evaluation input index and output index support the evaluation of the system security solution from a comprehensive perspective. Based on the data-driven super-efficiency data envelopment mathematical model, the present invention comprehensively considers the comprehensive index of the system security solution evaluation, makes full use of the data of various security elements of the system security solution, and realizes the evaluation of the system security solution.

[0079] The embodiment of the present application also provides an electronic device, Figure 3 The structure of the electronic device provided by the embodiment of the present invention is shown. For example, the electronic device 30 may include a processor 31, a memory 32 and a transmission device 33. The processor 31 is used to execute the system assurance solution evaluation method mentioned in the above embodiment, wherein the processor and the memory may be connected by a bus or other means, taking the bus connection as an example. The transmission device may be connected to the processor and the memory by wire or wirelessly. The memory, as a non-transient computer-readable storage medium, may be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the system assurance solution evaluation method in the embodiment of the present application. The processor executes various functional applications and data processing of the processor by running the non-transient software programs, instructions and modules stored in the memory, that is, the system assurance solution evaluation method in the above method embodiment is implemented. The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required by at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The one or more modules are stored in the memory, and when executed by the processor, the system assurance program evaluation method in the embodiment is executed.

[0080] As another aspect, the present application also provides a computer-readable storage medium, which may be a computer-readable storage medium included in the device described in the above embodiment; or a computer-readable storage medium that exists independently and is not assembled into a device. The computer-readable storage medium may be a tangible storage medium, such as a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a floppy disk, a hard disk, a removable storage disk, a CD-ROM, or any other form of storage medium known in the technical field. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the system assurance program evaluation method described in the present application.

[0081] In summary, the above are only preferred embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A system assurance program evaluation method, characterized in that: From the perspective of system security solutions, we propose system-level evaluation indicators. By weighing the input-output ratio between security resource input parameters and security efficiency output parameters, we evaluate the pros and cons of system security solutions. Specifically, System security evaluation indicators are defined as output indicators, and the security resource data used for evaluation in the system security plan are sorted out as input indicators. Based on the super-efficiency data envelopment method, a comprehensive evaluation is conducted on the input indicators and output indicators. Finally, the efficiency value is obtained as the evaluation result of the system security plan to judge the pros and cons of the system security plan.

2. The method according to claim 1, characterized in that The output indicators are system integrity, system mission continuity, system guarantee timeliness and system guarantee deployability, and the input indicators are the number of product deployments, the number of guarantee resource deployments, the number of maintenance personnel and resource scheduling time.

3. The method according to claim 2, characterized in that ,The process of defining the input and output indicators of the ,system assurance program evaluation includes the following steps: Step 11, defining output indicators for system assurance program evaluation; the output indicators include system integrity, system mission continuity, system assurance timeliness, and system assurance deployability; Among them, system integrity corresponds to the integrity rate; System task continuity corresponds to the normal operation time ratio; System guarantee timeliness corresponds to the total maintenance downtime. System guarantee timeliness refers to the timeliness of maintenance guarantee implementation on the one hand, and the timeliness of guarantee system response on the other hand; System support deployability corresponds to personnel utilization rate, spare parts utilization rate and spare parts satisfaction rate; system support deployability refers to the ability of the support resources required to carry out tasks with users according to the specified requirements when the system implements actions according to task requirements; Step 12, define the system support plan evaluation input indicators, specifically involving the number of follow-up maintenance personnel, the number of fixed-point maintenance personnel, the number of spare parts equipped with products, the number of fixed-point spare parts, spare parts maintenance cycle, spare parts maintenance time, spare parts mean failure interval and maintenance support costs.

4. The method according to any one of claims 1 to 3, characterized in that ,The steps of comprehensively evaluating the input and output indicators based on ,superefficiency data envelopment method include: Construct a system assurance scheme evaluation model based on super-efficiency data envelopment; Compare the efficiency values ​​of multiple assurance schemes, solve the system assurance scheme evaluation model based on super-efficiency data envelopment, and obtain the optimal solution for the efficiency value of each scheme. Through efficiency analysis, it is determined which schemes are effective in data envelopment and which are invalid. The evaluation results of the effective data envelopment assurance schemes are ranked according to their efficiency values.

5. The method according to claim 4, characterized in that The system assurance scheme evaluation model based on super-efficiency data envelopment is as follows: minθ Where θ is the efficiency value and is the objective function of the dual model; X p is the pth input indicator; Y q is the qth output indicator; X0 is the input column vector of the system security plan; Y0 is the output column vector of the system security plan; S - and S + is the slack variable; j , (j=1,2,…,n) is the linear combination coefficient of the jth system security solution; the jth system security solution result obtained according to the above formula is recorded as θ * , S *- and S *+ , based on which the validity of its super-efficiency data envelope is defined as: ①If θ * =1, and S *- =0, S *+ = 0, then the system guarantee scheme is data envelopment effective, which means that among the n schemes, the X invested at this time p To obtain the maximum output Y q ; ②If θ * =1, there is at least one S *- >0 or S *+ >0, the system guarantee scheme is weak data envelopment effective, which means that among the n schemes; S *- >0 means that a certain input indicator of the scheme is not fully utilized; S *+ >0 means that the output index of the scheme is not optimal, and the output can be increased while keeping the input unchanged; ③If θ * <1, the system assurance plan is invalid for data envelopment, indicating that the system assurance plan needs to be improved.

6. An electronic device, characterized in that: The electronic device includes a processor and a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the system assurance program evaluation method described in any one of claims 1-5 above.

7. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and the computer program is used to execute the system assurance program evaluation method described in any one of claims 1 to 5.