Industrial software application effect evaluation method and device, equipment and medium

By constructing industrial software application effectiveness evaluation methods, obtaining evaluation indicators of functional points, and using user surveys and data collection to build an effect matrix and calculate weights, the problem that the existing technology cannot evaluate the actual application effectiveness of industrial software is solved, and the correct implementation is achieved. Comprehensive evaluation of domestic software and enhance their application confidence.

CN119026974APending Publication Date: 2024-11-26AEROSPACE SOFTWARE TECH (BEIJING) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410945150.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing software maturity evaluation methods such as CMMI and SPICE mainly focus on the ability maturity of the software development and maintenance process, but fail to directly evaluate the effectiveness of industrial software in actual applications and cannot fully reflect its production efficiency, cost control, and quality. Impact of improvement and other aspects.

Method used

A method for evaluating the effectiveness of industrial software applications is proposed. By obtaining multiple functional points of the software to be evaluated, the evaluation indicators are obtained based on the pre-constructed evaluation model, and evaluation methods such as user surveys and data collection are used to construct the effectiveness evaluation matrix, and through hierarchical analysis Method or entropy weight method determines weight information and calculates the evaluation results of industrial software application effectiveness.

Benefits of technology

A comprehensive assessment of industrial software from multiple angles has been achieved, scientific basis is provided, users' confidence in domestic industrial software, and their wide application in the development of complex products has been improved, which has solved the problem of not supporting the maturity of domestic software and is difficult to use. , the question of not daring to use it.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119026974A_ABST
    Figure CN119026974A_ABST
Patent Text Reader

Abstract

The invention relates to an industrial software application effect evaluation method and device, equipment and a medium, and the method comprises the steps: obtaining to-be-evaluated industrial software, analyzing the to-be-evaluated industrial software, obtaining a plurality of function points of the to-be-evaluated industrial software, processing each function point based on a pre-constructed industrial software application effect evaluation model, and obtaining an evaluation result of the industrial software application effect. Obtaining an evaluation index of each function point, determining an evaluation mode corresponding to the evaluation index of each function point, performing evaluation according to the evaluation mode to obtain an evaluation result of each function point, and constructing an industrial software application effect evaluation matrix based on the evaluation results of all the function points, and calculating based on the industrial software application effect evaluation matrix through a preset evaluation algorithm to obtain an industrial software application effect evaluation result. Therefore, the industrial software can be comprehensively evaluated from multiple angles, and evaluation data support is provided for popularization, application and industrialization of the industrial software.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of software testing technology, and in particular to an industrial software application effectiveness evaluation method, device, equipment and medium. Background Art

[0002] At present, the demand for the use of domestic industrial software is becoming increasingly urgent. However, due to its lack of maturity, poor usability, and fear of use, foreign industrial software is still widely used in the development of complex products. With the rapid development of the manufacturing industry and the improvement of the level of informatization, domestic industrial software is being used more and more widely in enterprise production and management. At the same time, the evaluation of the application effectiveness of domestic industrial software has gradually become an important topic. Evaluating the application effectiveness of domestic industrial software can help domestic industrial software manufacturers discover software application problems early, so as to develop industrial software that better meets application needs. At the same time, it can help actual application companies understand the actual impact of industrial software in production, management, innovation, etc., and provide a basis for further improving the use value of software.

[0003] In the relevant technologies, there is no method specifically for evaluating the application effectiveness of industrial software. The maturity of software is still mainly evaluated based on CMMI (Capability Maturity Model Integration) and SPICE (Software Process Improvement Capability Determination).

[0004] However, methods such as CMMI and SPICE are mainly used to evaluate and improve the capabilities and maturity of software development and maintenance processes, and do not directly focus on the actual application effectiveness of software. Such methods mainly focus on the management and capabilities of software processes, including process improvement, management practices, etc., rather than the impact and effect of software in actual application and management, including production efficiency improvement, cost reduction, quality improvement, etc. Therefore, it is necessary to propose a new industrial software application effectiveness evaluation method, from the dimensions of industrial software's actual contribution to business goals and user experience, as well as its impact on production processes, product quality, cost control, etc., to form a new evaluation method and indicator system to better evaluate the actual application value and impact of industrial software. Summary of the invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an industrial software application effectiveness evaluation method, device, equipment and medium.

[0006] The present disclosure provides an industrial software application effectiveness evaluation method, comprising:

[0007] Acquire the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated;

[0008] Process each of the functional points based on a pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each of the functional points;

[0009] Determine the evaluation method corresponding to the evaluation indicator of each function point, and evaluate according to the evaluation method to obtain the evaluation result of each function point;

[0010] Construct an industrial software application effectiveness evaluation matrix based on the evaluation results of all the functional points mentioned above;

[0011] The industrial software application effectiveness evaluation result is obtained by calculating based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm.

[0012] In an optional embodiment of the present disclosure, the determining of the evaluation method corresponding to the evaluation index of each of the function points includes:

[0013] The evaluation indicators for each of the functional points are obtained as functional completeness, functional appropriateness, functional substitutability and functional superiority, and the corresponding evaluation method is determined to be a user survey evaluation method;

[0014] Obtaining the evaluation index of each of the functional points as functional correctness, and determining the corresponding evaluation method as the data collection evaluation method;

[0015] Obtaining the evaluation indicators of each of the function points as time efficiency, resource utilization and capacity, and determining the corresponding evaluation method as the data collection evaluation method;

[0016] Obtaining the evaluation index of each of the functional points as coexistence, and determining the corresponding evaluation method as the user survey evaluation method;

[0017] Obtaining the evaluation index of each of the functional points as interoperability, and determining the corresponding evaluation method as the data collection evaluation method;

[0018] Obtaining the evaluation indicators of each of the functional points as understandability, learnability, user error prevention, error correction efficiency and user interface aesthetics, and determining the corresponding evaluation method as the user survey evaluation method;

[0019] Obtaining the evaluation indicators of each of the functional points as availability, fault tolerance and recoverability, and determining the corresponding evaluation method as the data collection evaluation method;

[0020] Obtaining the evaluation indicators of each of the functional points as confidentiality, integrity and non-repudiation, and determining the corresponding evaluation method as the data collection evaluation method;

[0021] Obtaining the evaluation indicators of each of the functional points as reusability and modifiability, and determining the corresponding evaluation method as the user survey evaluation method;

[0022] Obtaining the evaluation indicators of each of the functional points as adaptability and ease of installation, and determining the corresponding evaluation method as the data collection evaluation method;

[0023] The evaluation indicators for each of the functional points are obtained as functional satisfaction and probability of selection and use, and the corresponding evaluation method is determined to be the user survey evaluation method.

[0024] In an optional embodiment of the present disclosure, the evaluation is performed according to the evaluation method to obtain the evaluation result of each function point, including:

[0025] Based on the user survey evaluation method, the evaluation is performed to obtain the important function coverage, the important function ratio, the secondary function coverage and the secondary function ratio for calculation, and the functional integrity evaluation result of each function point is obtained;

[0026] Based on the data collection and evaluation method, the evaluation is performed to obtain the number of qualified results of the access function and the total number of accesses for calculation, and the functional correctness evaluation result of each of the functional points is obtained;

[0027] Conduct an evaluation based on the user survey evaluation method, obtain the results of executing the target work tasks, target software functions, execution time and execution resources, and determine the functional suitability evaluation results, functional substitutability evaluation results and functional superiority evaluation results of each of the functional points;

[0028] Based on the data collection and evaluation method, the amount of data generated by communicating with the user after obtaining the function response and the total time from the function being accessed to obtaining the response are calculated to obtain the time efficiency evaluation result of each function point;

[0029] Based on the data collection and evaluation method, the resource occupancy and total resource amount are obtained for calculation to obtain the resource utilization evaluation result of each function point;

[0030] Based on the data collection and evaluation method, the total number of users accessing at the same time and the total number of users are obtained for calculation to obtain the capacity evaluation result of each function point;

[0031] Performing an evaluation based on the user survey evaluation method, obtaining information on simultaneously running software, and determining a coexistence evaluation result for each of the function points;

[0032] Based on the data collection and evaluation method, the evaluation is performed, the processing data format and the preset data standard are obtained for judgment, and the interoperability evaluation result of each function point is obtained;

[0033] Conduct an evaluation based on the user survey evaluation method, obtain function usage information, user manual information, error prompt information, error correction time and interface information, and determine the understandability evaluation result, learnability evaluation result, user error prevention evaluation result, error correction efficiency evaluation result and user interface aesthetics evaluation result of each function point;

[0034] Based on the data collection and evaluation method, the evaluation is performed, the number of invalid responses and the number of accesses are obtained for calculation, the availability evaluation result of each function point is obtained, and the exception handling mechanism information is obtained to determine the fault tolerance evaluation result of each function point, and the exception storage data information is obtained to determine the recoverability evaluation result of each function point;

[0035] Performing an assessment based on the data collection and assessment method, obtaining access control mechanism information, determining a confidentiality assessment result for each of the function points, obtaining unauthorized access prevention information, determining an integrity assessment result for each of the function points, and obtaining log information to determine a non-repudiation assessment result for each of the function points;

[0036] Conducting an evaluation based on the user survey evaluation method, obtaining software application domain scope information, determining the reusability evaluation result of each of the function points, and obtaining development document quality information, determining the modifiability evaluation result of each of the function points;

[0037] Performing an evaluation based on the data collection and evaluation method, obtaining software and hardware environment operation information, determining the adaptability evaluation result of each of the functional points, and obtaining installation document information, determining the ease of installation evaluation result of each of the functional points;

[0038] An evaluation is performed based on the user survey evaluation method to obtain function usage information, determine a function satisfaction evaluation result for each function point, and obtain software selection information to determine a selection usage probability evaluation result for each function point.

[0039] In an optional embodiment of the present disclosure, the calculation based on the industrial software application effectiveness evaluation matrix by a preset evaluation algorithm to obtain the industrial software application effectiveness evaluation result includes:

[0040] Determine the number of functions of the industrial software to be evaluated based on the industrial software application effectiveness evaluation matrix, and determine the weight information of the evaluation result of each function point based on the evaluation algorithm;

[0041] The industrial software application effectiveness evaluation result is obtained by performing calculation based on the weight information of the evaluation result of each functional point and the number of functions.

[0042] In an optional embodiment of the present disclosure, the industrial software application effectiveness evaluation method further includes:

[0043] Obtaining the software type of the industrial software to be evaluated, and obtaining the number of software of the software type;

[0044] When the software quantity is less than or equal to a preset quantity threshold, the weight information of the evaluation result of each function point determined based on the evaluation algorithm includes:

[0045] Determine the weight information of the evaluation result of each function point based on the hierarchical analysis algorithm;

[0046] When the software quantity is greater than the quantity threshold, the weight information of the evaluation result of each function point determined based on the evaluation algorithm includes:

[0047] The weight information of the evaluation result of each of the function points is determined based on the entropy weight algorithm.

[0048] In an optional embodiment of the present disclosure, the step of determining the weight information of the evaluation result of each function point based on the hierarchical analysis algorithm includes:

[0049] Obtaining a comparison result between each evaluation result of each of the functional points and other evaluation results, and determining a numerical value corresponding to each of the comparison results;

[0050] Calculation is performed based on the numerical value corresponding to each of the comparison results to determine weight information of the evaluation result of each of the function points.

[0051] In an optional embodiment of the present disclosure, the step of determining the weight information of the evaluation result of each function point based on the entropy weight algorithm includes:

[0052] Normalizing the evaluation result of each function point to obtain a normalized value of the evaluation result of each function point;

[0053] Calculate the entropy value of the evaluation result of each function point based on the normalized value of the evaluation result of each function point;

[0054] Calculate the information entropy redundancy of the evaluation result of each function point based on the entropy value of the evaluation result of each function point;

[0055] The weight information of the evaluation result of each of the function points is calculated based on the information entropy redundancy of the evaluation result of each of the function points.

[0056] The present disclosure provides an industrial software application effectiveness evaluation device, comprising:

[0057] An acquisition and analysis module is used to acquire the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated;

[0058] A processing module, used to process each of the function points based on a pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each of the function points;

[0059] A determination module, used to determine the evaluation method corresponding to the evaluation index of each function point;

[0060] An evaluation module, used to perform evaluation according to the evaluation method to obtain evaluation results of each function point;

[0061] A construction module, used for constructing an industrial software application effectiveness evaluation matrix based on the evaluation results of all the functional points;

[0062] The calculation module is used to perform calculations based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result.

[0063] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0064] By proposing an industrial software application effectiveness evaluation method, the method includes: obtaining the industrial software to be evaluated, analyzing the industrial software to be evaluated, obtaining multiple functional points of the industrial software to be evaluated, processing each functional point based on the pre-built industrial software application effectiveness evaluation model, obtaining the evaluation index of each functional point, determining the evaluation method corresponding to the evaluation index of each functional point, and evaluating according to the evaluation method to obtain the evaluation result of each functional point, constructing an industrial software application effectiveness evaluation matrix based on the evaluation results of all functional points, and calculating based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm to obtain the industrial software application effectiveness evaluation result. Therefore, it is possible to comprehensively evaluate industrial software from multiple angles, provide a scientific basis for enterprises to select and use domestic industrial software, enhance users' confidence in domestic industrial software, and promote the widespread application of domestic industrial software in the development of complex products. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0066] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0067] Figure 1 An example flow chart of an industrial software application effectiveness evaluation method provided in an embodiment of the present disclosure;

[0068] Figure 2 A flowchart of another industrial software application effectiveness evaluation method provided by the embodiment of the present disclosure;

[0069] Figure 3 This is a structural example diagram of an industrial software application effectiveness evaluation device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0070] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0071] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0072] Based on the above background description, the software maturity is evaluated according to CMMI and SPICE. The Capability Maturity Model Integration CMMI is a software development capability maturity model proposed by the Software Engineering Institute (SEI) of the United States. It helps organizations evaluate and improve their software development processes and capabilities by defining five maturity levels (initial, manageable, defined, quantitatively managed, and optimized). The purpose is to help software companies manage and improve software engineering processes, enhance development and improvement capabilities, and thus develop high-quality software on time and within budget. CMMI's main focus is on four aspects: cost-effectiveness, clear focus, process concentration, and flexibility.

[0073] Software Process Improvement and Capability Determination SPICE is an assessment model for software process improvement and capability determination, designed to help organizations assess and improve the maturity of their software development and maintenance processes. The SPICE model is based on the ISO / IEC 15504 standard jointly issued by the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC), and is also known as the Software Process Assessment (SPA) model. The SPICE model covers key areas in software engineering and can be used to assess all aspects of software development and maintenance processes, including planning management, software development, software maintenance, configuration management, process management, etc. It aims to provide a comprehensive and systematic approach to help organizations understand the maturity level of their software processes and provide guidance for improving software processes. The SPICE model also adopts a hierarchical assessment method to divide software processes into different maturity levels and process capability levels.

[0074] However, methods such as CMMI and SPICE are mainly used to evaluate and improve the capabilities and maturity of software development and maintenance processes, and do not directly focus on the actual application results of the software.

[0075] In response to the above problems, the present invention proposes a method for evaluating the application effectiveness of industrial software. By measuring industrial software application data, a comprehensive evaluation is conducted on the functions, performance, usability, reliability and other aspects of the industrial software from multiple angles, forming a complete domestic industrial software application effectiveness evaluation system, which provides a scientific basis for enterprises to select and use domestic industrial software, enhances users' confidence in domestic industrial software, and promotes the widespread application of domestic industrial software in the development of complex products.

[0076] Figure 1 This is a flowchart of an industrial software application effectiveness evaluation method provided by the present disclosure. Figure 1 As shown in the figure, the industrial software application effectiveness evaluation methods include:

[0077] Step 101: obtain the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated.

[0078] In the disclosed embodiment, the industrial software application effectiveness evaluation platform can integrate one or more industrial software, and can select one or more industrial software for evaluation according to the application scenario needs, that is, as the industrial software to be evaluated.

[0079] In the disclosed embodiment, after obtaining the industrial software to be evaluated, further demand analysis is performed on the industrial software to be evaluated, thereby obtaining multiple functional points of the industrial software to be evaluated, such as management functional points, drawing functional points, etc. It is understandable that the functional points of different industrial software to be evaluated may be the same or different, and the specific settings are selected according to the actual application scenario.

[0080] Step 102: Process each function point based on the pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each function point.

[0081] In the embodiment of the present disclosure, an industrial software application effectiveness evaluation model is pre-built as shown in Table 1.

[0082] Table 1 Industrial software application effectiveness evaluation model

[0083]

[0084]

[0085] Specifically, for each functional point, specific evaluation indicators are obtained based on the constructed industrial software application effectiveness evaluation model, and then summarized to form an overall evaluation indicator.

[0086] Specifically, the industrial software application effectiveness evaluation model adopts a classic hierarchical structure, which is mainly based on the characteristics and quality characteristics of industrial software applications, forming 9 major characteristics I = {I1, I2, …, I9} and 27 sub-characteristics of industrial software application effectiveness evaluation, as shown in Table 1 above.

[0087] Specifically, 1. Functional effectiveness I1, the degree to which the functions provided by industrial software meet the established or implicit requirements. Including: 1) Functional completeness: the degree to which the functions cover specific tasks and user goals; 2) Functional correctness: the degree to which correct results within the required accuracy are provided; 3) Functional appropriateness: the degree to which specific tasks and user goals are completed; 4) Functional substitutability: the degree to which another software product with the same functions can be replaced; 5) Functional superiority: the degree of advantage compared to other software products. 2. Application efficiency I2, the performance that industrial software can achieve using a certain amount of resources. Including: 1) Time efficiency: the degree to which response time, processing time and throughput meet requirements when running functions; 2) Resource utilization: the degree to which the number and type of resources occupied meet requirements when running functions; 3) Capacity: the degree to which the upper limit of use meets requirements. 3. Compatibility I3, the degree of ability to exchange information with other products, systems or software, or to perform their specific functions. Includes: 1) Interoperability: the degree to which the required functions can be effectively run without adversely affecting other products when sharing the environment and resources with other software or systems; 2) Coexistence: the degree to which two or more software can exchange information and use this information. IV. Usability I4, the degree to which a specific user can effectively, efficiently and satisfactorily achieve a specific goal. Includes: 1) Understandability: whether the function can be easily understood by the user; 2) Learnability: the degree to which the function can be effectively, efficiently and risk-free learned by the user to use and achieve specific goals; 3) User error defense: the degree to prevent users from making mistakes, whether there are ways to avoid user mistakes; 4) Error correction efficiency: whether the user has to spend a lot of time correcting errors; 5) Beautiful user interface: the degree to which the interface makes human-computer interaction pleasant and satisfactory.

[0088] Specifically, V. Reliability I5, the degree to which a specific function is performed within a specified time and under specific conditions. Includes: 1) Availability: the degree to which it is operable and accessible when used by users; 2) Fault tolerance: the degree to which it operates normally when hardware or software errors occur; 3) Ease of recovery: the degree to which the directly affected data is restored and the ideal state of the system is rebuilt after an interruption or failure. VI. Security I6, the degree to which information and data are protected so that users or other products, systems, and components can access data appropriately according to their permissions. In addition to data storage and reading, security also applies to data transmission. Includes: 1) Confidentiality: the degree to which data is accessible only to authorized users; 2) Integrity: the degree to which unauthorized access or modification of computer programs or data is prevented; 3) Non-repudiation: the degree to which the action of a function can be proven to have occurred and cannot be denied. VII. Scalability I7, the degree to which it can be effectively and efficiently reused and modified. Includes: 1) Reusability: the degree to which it can be used for more than one business or scenario; 2) Ease of modifiability: the degree to which the software can be effectively and efficiently modified without introducing defects or reducing the quality of the current product. 8. Portability I8, the degree to which a software can be effectively and efficiently ported from one hardware, software or usage environment to another. Includes: 1) Adaptability: the degree to which a software can be effectively and efficiently adapted to different hardware, software or usage environments; 2) Ease of installation: the degree to which a software can be successfully installed or uninstalled effectively and efficiently. 9. User satisfaction I9, the degree to which users are satisfied with the software. Includes: 1) Functional satisfaction: whether users are satisfied with the experience of using the function; 2) Probability of choice: whether users will choose to use this software instead of other software.

[0089] Step 103: Determine the evaluation method corresponding to the evaluation index of each function point, and perform evaluation according to the evaluation method to obtain the evaluation result of each function point.

[0090] Specifically, for different evaluation indicators, evaluation methods such as application data collection or user survey are adopted to form a data collection plan or evaluation questionnaire.

[0091] In some embodiments, determining the evaluation method corresponding to the evaluation index of each function point includes: obtaining the evaluation index of each function point as functional integrity, functional appropriateness, functional substitutability and functional superiority, determining the corresponding evaluation method as a user survey evaluation method, obtaining the evaluation index of each function point as functional correctness, determining the corresponding evaluation method as a data collection evaluation method, obtaining the evaluation index of each function point as time efficiency, resource utilization and capacity, determining the corresponding evaluation method as a data collection evaluation method, obtaining the evaluation index of each function point as coexistence, determining the corresponding evaluation method as a user survey evaluation method, obtaining the evaluation index of each function point as interoperability, determining the corresponding evaluation method as a data collection evaluation method, obtaining the evaluation index of each function point as easy to understand , ease of learning, user error defense, error correction efficiency and beautiful user interface, determine the corresponding evaluation method as user survey evaluation method, obtain the evaluation indicators of each functional point as availability, fault tolerance and recoverability, determine the corresponding evaluation method as data collection evaluation method, obtain the evaluation indicators of each functional point as confidentiality, integrity and non-repudiation, determine the corresponding evaluation method as data collection evaluation method, obtain the evaluation indicators of each functional point as reusability and modifiability, determine the corresponding evaluation method as user survey evaluation method, obtain the evaluation indicators of each functional point as adaptability and ease of installation, determine the corresponding evaluation method as data collection evaluation method, obtain the evaluation indicators of each functional point as function satisfaction and probability of selection and use, determine the corresponding evaluation method as user survey evaluation method.

[0092] In some embodiments, an evaluation is performed according to an evaluation method to obtain an evaluation result of each function point, including: performing an evaluation based on a user survey evaluation method, obtaining important function coverage, important function ratio, secondary function coverage and secondary function ratio for calculation, and obtaining a functional integrity evaluation result of each function point; performing an evaluation based on a data collection evaluation method, obtaining the number of qualified results of accessing the function and the total number of accesses for calculation, and obtaining a functional correctness evaluation result of each function point; performing an evaluation based on a user survey evaluation method, obtaining the execution target work task results, target software functions, execution time and execution resources, and determining a functional suitability evaluation result, a functional substitutability evaluation result and a functional superiority evaluation result for each function point; and performing an evaluation based on a data collection evaluation method. Evaluate based on the data collection evaluation method, obtain the amount of data generated by communicating with users after the function responds and the total time from the function being accessed to obtaining a response, and obtain the time efficiency evaluation result of each function point. Evaluate based on the data collection evaluation method, obtain the resource occupancy and the total amount of resources, and obtain the resource utilization evaluation result of each function point. Evaluate based on the data collection evaluation method, obtain the total number of users accessing at the same time and the total number of users, and obtain the capacity evaluation result of each function point. Evaluate based on the user survey evaluation method, obtain the information of software running at the same time, and determine the coexistence evaluation result of each function point. Evaluate based on the data collection evaluation method, obtain the processing data format and the preset data standard for judgment, and obtain The interoperability evaluation results of each functional point are evaluated based on the user survey evaluation method to obtain functional purpose information, user manual information, error prompt information, error correction time and interface information, and determine the understandability evaluation results, learnability evaluation results, user error defense evaluation results, error correction efficiency evaluation results and user interface aesthetics evaluation results of each functional point. The evaluation is based on the data collection evaluation method to obtain the number of invalid responses and the number of visits for calculation to obtain the usability evaluation results of each functional point, and obtain the exception handling mechanism information to determine the fault tolerance evaluation results of each functional point, as well as the exception storage data information, to determine the recoverability evaluation results of each functional point, and to obtain the accessibility evaluation results based on the data collection evaluation method. Control mechanism information, determine the confidentiality assessment results of each of the functional points, and obtain information on preventing unauthorized access, determine the integrity assessment results of each functional point, and obtain log information, determine the non-repudiation assessment results of each functional point, conduct an assessment based on a user survey assessment method, obtain information on the scope of software application fields, determine the reusability assessment results of each functional point, and obtain development document quality information, determine the modifiability assessment results of each functional point, conduct an assessment based on a data collection assessment method, obtain software and hardware environment operation information, determine the adaptability assessment results of each functional point, and obtain installation document information, determine the ease of installation assessment results of each functional point, conduct an assessment based on a user survey assessment method, and obtain function usage information,Determine the functional satisfaction evaluation results of each functional point, obtain software selection information, and determine the selection probability evaluation results of each functional point.

[0093] Specifically, different evaluation indicators require different evaluation methods:

[0094] Specifically, 1. Functional effectiveness: 1) Functional completeness, evaluated through user surveys, whether the function fully meets the needs of users, whether users need a software with more functions or an additional software to supplement the function. Functional completeness = important function coverage multiplied by the proportion of important functions + secondary function coverage multiplied by the proportion of secondary functions. 2) Functional correctness, evaluated through data collection, functional correctness = number of qualified results for accessing the function / total number of accesses. 3) Functional appropriateness, evaluated through user surveys, whether users can complete specific work tasks by using this function. 4) Functional substitutability, evaluated through user surveys, whether the function can be replaced by other software. 5) Functional superiority, evaluated through user surveys, compared with other methods, using this function saves users a lot of time or other resources.

[0095] Specifically, 2. Application efficiency: 1) Time efficiency, evaluated by data collection, time efficiency = the amount of data generated by communicating with customers after the function responds / the total time until the function is accessed until the response is obtained. 2) Resource utilization, evaluated by data collection, resource utilization = resource occupation / total resources. 3) Capacity, evaluated by data collection, capacity = the total number of users that can support simultaneous access / total number of users. 3. Compatibility: 1) Coexistence, evaluated by user survey, whether it can run simultaneously with other software. 2) Interoperability, evaluated by data collection, whether the processed data format meets certain data standards. 4. Ease of use: 1) Ease of understanding, evaluated by user survey, whether users can easily understand the purpose of the function, and whether they tend to make many mistakes. 2) Ease of learning, evaluated by user survey, the quality of the user manual provided to users. 3) User error defense, evaluated by user survey, whether there is an error prompt when the user enters an error. 4) Error correction efficiency, evaluated by user survey, using this function, users have to spend a lot of time correcting errors. 5) The user interface is beautiful. The aesthetics of the interface is evaluated through user surveys.

[0096] Specifically, V. Reliability: 1) Availability, evaluated by data collection, availability = invalid response times / access times. 2) Fault tolerance, evaluated by data collection, whether there is an exception handling mechanism. 3) Ease of recovery, evaluated by data collection, whether the user data before the exception can be saved when an exception occurs. VI. Security: 1) Confidentiality, evaluated by data collection, whether there is an access control mechanism. 2) Integrity, evaluated by data collection, whether unauthorized access can be prevented. 3) Non-repudiation, evaluated by data collection, whether the log is complete. VII. Scalability: 1) Reusability, evaluated by user survey, the scope of the software application. 2) Ease of modifiability, evaluated by user survey, the quality of the secondary development documents provided by the software. VIII. Portability: 1) Adaptability, evaluated by data collection, whether it can run in different versions of software and hardware environments. 2) Ease of installation, evaluated by data collection, whether detailed documentation and installation or uninstallation wizards are provided. IX. User satisfaction: 1) Functional satisfaction, evaluated through user surveys to determine whether users are satisfied with the experience of using the function. 2) Probability of choice, evaluated through user surveys to determine whether users will choose this software over other software.

[0097] Step 104: Construct an industrial software application effectiveness evaluation matrix based on the evaluation results of all functional points.

[0098] Specifically, the application data required for the evaluation is collected and user questionnaires are collected to obtain the evaluation results of each function and each evaluation indicator, forming an industrial software application effectiveness evaluation matrix, where, for example, function F = {F1, F2, …, F n} is the vertical axis, and the evaluation index I = {I1, I2, …, I9} is the horizontal axis, see Table 2 for details.

[0099] Table 2 Industrial software application effectiveness evaluation matrix

[0100]

[0101]

[0102] Step 105: Calculate based on the industrial software application effectiveness evaluation matrix using a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result.

[0103] Specifically, according to factors such as the number of functions of the industrial software to be evaluated and the number of similar industrial software products, the analytic hierarchy process or the entropy weight method is used to determine the weights of various functions and evaluation indicators, and a comprehensive evaluation result of the industrial software application effectiveness is formed.

[0104] In some embodiments, calculations are performed based on an industrial software application effectiveness evaluation matrix using a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result, including: determining the number of functions of the industrial software to be evaluated based on the industrial software application effectiveness evaluation matrix, and determining the weight information of the evaluation results of each functional point based on the evaluation algorithm, and performing calculations based on the weight information of the evaluation results of each functional point and the number of functions to obtain the industrial software application effectiveness evaluation result.

[0105] In some embodiments, the software type of the industrial software to be evaluated is obtained, and the number of software of the software type is obtained; when the number of software is less than or equal to a preset quantity threshold, the weight information of the evaluation result of each functional point is determined based on the evaluation algorithm, including: the weight information of the evaluation result of each functional point is determined based on the hierarchical analysis algorithm; when the number of software is greater than the quantity threshold, the weight information of the evaluation result of each functional point is determined based on the evaluation algorithm, including: the weight information of the evaluation result of each functional point is determined based on the entropy weight algorithm.

[0106] In some embodiments, the weight information of the evaluation result of each function point is determined based on the hierarchical analysis algorithm, including: obtaining the comparison result between each evaluation result of each function point and other evaluation results, and determining the numerical value corresponding to each comparison result, and performing calculation based on the numerical value corresponding to each comparison result to determine the weight information of the evaluation result of each function point.

[0107] In some embodiments, the weight information of the evaluation result of each function point is determined based on the entropy weight algorithm, including: normalizing the evaluation result of each function point to obtain a normalized numerical value of the evaluation result of each function point, calculating the entropy value of the evaluation result of each function point based on the normalized numerical value of the evaluation result of each function point, calculating the information entropy redundancy of the evaluation result of each function point based on the entropy value of the evaluation result of each function point, and calculating the weight information of the evaluation result of each function point based on the information entropy redundancy of the evaluation result of each function point.

[0108] Among them, the entropy weight method is an objective evaluation method with a certain degree of accuracy. Therefore, when there are multiple industrial software of the same type (i.e., industrial software with similar functions) on the market that can be used as sample space, the entropy weight method is selected to determine the weight information. The hierarchical analysis method is a highly authoritative method among subjective evaluation methods. It can obtain evaluation results through systematic analysis methods without historical sample data. Therefore, when there is no industrial software of the same type for reference, the hierarchical analysis method is used to determine the weight information.

[0109] As an example, Figure 2As shown, it includes the demand analysis stage, step 2.1 analyzes the functions of the industrial software to be evaluated, step 2.2 forms an application effectiveness evaluation plan based on the indicator system; the design and implementation stage, step 2.3 designs an evaluation questionnaire and data collection plan; step 2.4 collects data and collects questionnaires; in the summary stage, step 2.5 evaluates each function item; step 2.6 obtains the application effectiveness level of each function item; step 2.7 makes judgments based on the number of functions, the number of similar products, etc.; when the number of functions is limited, execute step 2.8 to adopt the tomography analysis method; step 2.9 determines the weight of each function; step 2.10 obtains the application effectiveness level through weighted evaluation; step 2.11 issues an evaluation report; when there are multiple similar products, execute step 2.12 to adopt the entropy weight method; step 2.13 determines the weight of each function; step 2.14 obtains the application effectiveness level through weighted evaluation.

[0110] As an example, the present disclosure proposes an industrial software application effectiveness evaluation system, including: an indicator system module: forming and revising the indicator system of the industrial software to be evaluated based on demand analysis; an application data collection module: collecting application data of the industrial software to be evaluated based on the constructed evaluation indicator system; a questionnaire survey module: forming a user questionnaire based on the constructed evaluation indicator system, issuing questionnaires and collecting questionnaires; an evaluation result calculation module: calculating the data collected by the application data collection module and the questionnaire survey module according to the weight values ​​selected by different evaluation methods, so as to obtain the application effectiveness score of the industrial software to be evaluated; an analysis and improvement module: analyzing and comparing the application effectiveness score of the industrial software with historical data or data of the same type of industrial software to obtain corresponding improvement points.

[0111] Therefore, by adopting the classic hierarchical structure and analyzing the characteristics and quality features of industrial software applications, an evaluation model of 9 major features and 27 sub-features was formed to ensure the comprehensiveness and systematicness of the evaluation. The evaluation includes a comprehensive consideration of the functional effectiveness, application efficiency, compatibility, ease of use, reliability, security, scalability, portability and user satisfaction of industrial software, with a wide coverage, which can fully reflect the actual application of industrial software. In addition, for different evaluation indicators, corresponding evaluation methods are proposed, combined with application data collection and user surveys, which integrate objective data and user subjective feelings, ensuring the objectivity and comprehensiveness of the evaluation. The entropy weight method and hierarchical analysis method are introduced to determine the weights of functions and evaluation indicators, taking into account objectivity and authority, and ensuring the accuracy and credibility of the evaluation results.

[0112] To sum up, the embodiments of the present disclosure can conduct a comprehensive evaluation of the functions, performance, usability, reliability and other aspects of domestic industrial software from multiple angles based on the application data measurement and user survey of industrial software, solve the problems of domestic industrial software not having a solid foundation for maturity, being difficult to use and not being dared to use, promote the maturity of domestic industrial software, provide evaluation data support for the promotion, application and industrialization of domestic industrial software, assist in the establishment of a new ecological environment for the combination of research and application of domestic industrial software, and promote the healthy and vigorous development of the domestic industrial software industry.

[0113] Figure 3 A schematic diagram of the structure of an industrial software application effectiveness evaluation device provided in an embodiment of the present disclosure, the industrial software application effectiveness evaluation device comprising:

[0114] The acquisition and analysis module 301 is used to acquire the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated.

[0115] The processing module 302 is used to process each of the function points based on a pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each of the function points.

[0116] The determination module 303 is used to determine the evaluation method corresponding to the evaluation index of each function point.

[0117] The evaluation module 304 is used to perform evaluation according to the evaluation method to obtain the evaluation result of each function point.

[0118] The construction module 305 is used to construct an industrial software application effectiveness evaluation matrix based on the evaluation results of all the functional points.

[0119] The calculation module 306 is used to perform calculations based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result.

[0120] In an optional embodiment of the present disclosure, the determining module 303 is specifically configured to:

[0121] The evaluation indicators for each of the functional points are obtained as functional completeness, functional appropriateness, functional substitutability and functional superiority, and the corresponding evaluation method is determined to be a user survey evaluation method;

[0122] Obtaining the evaluation index of each of the functional points as functional correctness, and determining the corresponding evaluation method as the data collection evaluation method;

[0123] Obtaining the evaluation indicators of each of the function points as time efficiency, resource utilization and capacity, and determining the corresponding evaluation method as the data collection evaluation method;

[0124] Obtaining the evaluation index of each of the functional points as coexistence, and determining the corresponding evaluation method as the user survey evaluation method;

[0125] Obtaining the evaluation index of each of the functional points as interoperability, and determining the corresponding evaluation method as the data collection evaluation method;

[0126] Obtaining the evaluation indicators of each of the functional points as understandability, learnability, user error prevention, error correction efficiency and user interface aesthetics, and determining the corresponding evaluation method as the user survey evaluation method;

[0127] Obtaining the evaluation indicators of each of the functional points as availability, fault tolerance and recoverability, and determining the corresponding evaluation method as the data collection evaluation method;

[0128] Obtaining the evaluation indicators of each of the functional points as confidentiality, integrity and non-repudiation, and determining the corresponding evaluation method as the data collection evaluation method;

[0129] Obtaining the evaluation indicators of each of the functional points as reusability and modifiability, and determining the corresponding evaluation method as the user survey evaluation method;

[0130] Obtaining the evaluation indicators of each of the functional points as adaptability and ease of installation, and determining the corresponding evaluation method as the data collection evaluation method;

[0131] The evaluation indicators for each of the functional points are obtained as functional satisfaction and probability of selection and use, and the corresponding evaluation method is determined to be the user survey evaluation method.

[0132] In an optional embodiment of the present disclosure, the evaluation module 304 is used to:

[0133] Based on the user survey evaluation method, the evaluation is performed to obtain the important function coverage, the important function ratio, the secondary function coverage and the secondary function ratio for calculation, and the functional integrity evaluation result of each function point is obtained;

[0134] Based on the data collection and evaluation method, the evaluation is performed to obtain the number of qualified results of the access function and the total number of accesses for calculation, and the functional correctness evaluation result of each of the functional points is obtained;

[0135] Conduct an evaluation based on the user survey evaluation method, obtain the results of executing the target work tasks, target software functions, execution time and execution resources, and determine the functional suitability evaluation results, functional substitutability evaluation results and functional superiority evaluation results of each of the functional points;

[0136] Based on the data collection and evaluation method, the amount of data generated by communicating with the user after obtaining the function response and the total time from the function being accessed to obtaining the response are calculated to obtain the time efficiency evaluation result of each function point;

[0137] Based on the data collection and evaluation method, the resource occupancy and total resource amount are obtained for calculation to obtain the resource utilization evaluation result of each function point;

[0138] Based on the data collection and evaluation method, the total number of users accessing at the same time and the total number of users are obtained for calculation to obtain the capacity evaluation result of each function point;

[0139] Performing an evaluation based on the user survey evaluation method, obtaining information on simultaneously running software, and determining a coexistence evaluation result for each of the function points;

[0140] Based on the data collection and evaluation method, the evaluation is performed, the processing data format and the preset data standard are obtained for judgment, and the interoperability evaluation result of each function point is obtained;

[0141] Conduct an evaluation based on the user survey evaluation method, obtain function usage information, user manual information, error prompt information, error correction time and interface information, and determine the understandability evaluation result, learnability evaluation result, user error prevention evaluation result, error correction efficiency evaluation result and user interface aesthetics evaluation result of each function point;

[0142] Based on the data collection and evaluation method, the evaluation is performed, the number of invalid responses and the number of accesses are obtained for calculation, the availability evaluation result of each function point is obtained, and the exception handling mechanism information is obtained to determine the fault tolerance evaluation result of each function point, and the exception storage data information is obtained to determine the recoverability evaluation result of each function point;

[0143] Performing an assessment based on the data collection and assessment method, obtaining access control mechanism information, determining a confidentiality assessment result for each of the function points, obtaining unauthorized access prevention information, determining an integrity assessment result for each of the function points, and obtaining log information to determine a non-repudiation assessment result for each of the function points;

[0144] Conducting an evaluation based on the user survey evaluation method, obtaining software application domain scope information, determining the reusability evaluation result of each of the function points, and obtaining development document quality information, determining the modifiability evaluation result of each of the function points;

[0145] Performing an evaluation based on the data collection and evaluation method, obtaining software and hardware environment operation information, determining the adaptability evaluation result of each of the functional points, and obtaining installation document information, determining the ease of installation evaluation result of each of the functional points;

[0146] An evaluation is performed based on the user survey evaluation method to obtain function usage information, determine a function satisfaction evaluation result for each function point, and obtain software selection information to determine a selection usage probability evaluation result for each function point.

[0147] In an optional embodiment of the present disclosure, the computing module includes:

[0148] A determination unit, configured to determine the number of functions of the industrial software to be evaluated based on the industrial software application effectiveness evaluation matrix, and to determine weight information of the evaluation result of each function point based on the evaluation algorithm;

[0149] A calculation unit is used to calculate based on the weight information of the evaluation results of each of the functional points and the number of functions to obtain the industrial software application effectiveness evaluation result.

[0150] In an optional embodiment of the present disclosure, the industrial software application effectiveness evaluation method further includes:

[0151] An acquisition module, used to acquire the software type of the industrial software to be evaluated and acquire the number of software of the software type;

[0152] When the software quantity is less than or equal to a preset quantity threshold, the determining unit is specifically configured to:

[0153] Determine the weight information of the evaluation result of each function point based on the hierarchical analysis algorithm;

[0154] When the software quantity is greater than the quantity threshold, the determining unit is specifically configured to:

[0155] The weight information of the evaluation result of each of the function points is determined based on the entropy weight algorithm.

[0156] In an optional embodiment of the present disclosure, the determining unit is specifically configured to:

[0157] Obtaining a comparison result between each evaluation result of each of the functional points and other evaluation results, and determining a numerical value corresponding to each of the comparison results;

[0158] Calculation is performed based on the numerical value corresponding to each of the comparison results to determine weight information of the evaluation result of each of the function points.

[0159] In an optional embodiment of the present disclosure, the determining unit is specifically configured to:

[0160] Normalizing the evaluation result of each function point to obtain a normalized value of the evaluation result of each function point;

[0161] Calculate the entropy value of the evaluation result of each function point based on the normalized value of the evaluation result of each function point;

[0162] Calculate the information entropy redundancy of the evaluation result of each function point based on the entropy value of the evaluation result of each function point;

[0163] The weight information of the evaluation result of each of the function points is calculated based on the information entropy redundancy of the evaluation result of each of the function points.

[0164] The industrial software application effectiveness evaluation device provided in the embodiments of the present disclosure can execute the industrial software application effectiveness evaluation method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0165] The embodiments of the present disclosure also provide a computer program product, including a computer program / instruction, which, when executed by a processor, implements the industrial software application effectiveness evaluation method provided by any embodiment of the present disclosure.

[0166] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, including:

[0167] processor;

[0168] a memory for storing instructions executable by the processor;

[0169] The processor is used to read the executable instructions from the memory and execute the instructions to implement any industrial software application effectiveness evaluation method provided in the present disclosure.

[0170] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute any industrial software application effectiveness evaluation method provided by the present disclosure.

[0171] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0172] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for evaluating the effectiveness of industrial software applications, characterized in that: include: Acquire the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated; Process each of the functional points based on a pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each of the functional points; Determine the evaluation method corresponding to the evaluation indicator of each function point, and evaluate according to the evaluation method to obtain the evaluation result of each function point; Construct an industrial software application effectiveness evaluation matrix based on the evaluation results of all the functional points mentioned above; The industrial software application effectiveness evaluation result is obtained by calculating based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm.

2. The industrial software application effectiveness evaluation method according to claim 1 is characterized in that: The evaluation method corresponding to the evaluation index of each function point is determined, including: The evaluation indicators for each of the functional points are obtained as functional completeness, functional appropriateness, functional substitutability and functional superiority, and the corresponding evaluation method is determined to be a user survey evaluation method; Obtaining the evaluation index of each of the functional points as functional correctness, and determining the corresponding evaluation method as the data collection evaluation method; Obtaining the evaluation indicators of each of the function points as time efficiency, resource utilization and capacity, and determining the corresponding evaluation method as the data collection evaluation method; Obtaining the evaluation index of each of the functional points as coexistence, and determining the corresponding evaluation method as the user survey evaluation method; Obtaining the evaluation index of each of the functional points as interoperability, and determining the corresponding evaluation method as the data collection evaluation method; Obtaining the evaluation indicators of each of the functional points as understandability, learnability, user error prevention, error correction efficiency and user interface aesthetics, and determining the corresponding evaluation method as the user survey evaluation method; Obtaining the evaluation indicators of each of the functional points as availability, fault tolerance and recoverability, and determining the corresponding evaluation method as the data collection evaluation method; Obtaining the evaluation indicators of each of the functional points as confidentiality, integrity and non-repudiation, and determining the corresponding evaluation method as the data collection evaluation method; Obtaining the evaluation indicators of each of the functional points as reusability and modifiability, and determining the corresponding evaluation method as the user survey evaluation method; Obtaining the evaluation indicators of each of the functional points as adaptability and ease of installation, and determining the corresponding evaluation method as the data collection evaluation method; The evaluation indicators for each of the functional points are obtained as functional satisfaction and probability of selection and use, and the corresponding evaluation method is determined to be the user survey evaluation method.

3. The industrial software application effectiveness evaluation method according to claim 2 is characterized in that: Perform the evaluation according to the evaluation method to obtain the evaluation results of each function point, including: Based on the user survey evaluation method, the evaluation is performed to obtain the important function coverage, the important function ratio, the secondary function coverage and the secondary function ratio for calculation, and the functional integrity evaluation result of each function point is obtained; Based on the data collection and evaluation method, the evaluation is performed to obtain the number of qualified results of the access function and the total number of accesses for calculation, and the functional correctness evaluation result of each of the functional points is obtained; Conduct an evaluation based on the user survey evaluation method, obtain the results of executing the target work tasks, target software functions, execution time and execution resources, and determine the functional suitability evaluation results, functional substitutability evaluation results and functional superiority evaluation results of each of the functional points; Based on the data collection and evaluation method, the amount of data generated by communicating with the user after obtaining the function response and the total time from the function being accessed to obtaining the response are calculated to obtain the time efficiency evaluation result of each function point; Based on the data collection and evaluation method, the resource occupancy and total resource amount are obtained for calculation to obtain the resource utilization evaluation result of each function point; Based on the data collection and evaluation method, the total number of users accessing at the same time and the total number of users are obtained for calculation to obtain the capacity evaluation result of each function point; Performing an evaluation based on the user survey evaluation method, obtaining information on simultaneously running software, and determining a coexistence evaluation result for each of the function points; Based on the data collection and evaluation method, the evaluation is performed, the processing data format and the preset data standard are obtained for judgment, and the interoperability evaluation result of each function point is obtained; Conduct an evaluation based on the user survey evaluation method, obtain function usage information, user manual information, error prompt information, error correction time and interface information, and determine the understandability evaluation result, learnability evaluation result, user error prevention evaluation result, error correction efficiency evaluation result and user interface aesthetics evaluation result of each function point; Based on the data collection and evaluation method, the evaluation is performed, the number of invalid responses and the number of accesses are obtained for calculation, the availability evaluation result of each function point is obtained, and the exception handling mechanism information is obtained to determine the fault tolerance evaluation result of each function point, and the exception storage data information is obtained to determine the recoverability evaluation result of each function point; Performing an assessment based on the data collection and assessment method, obtaining access control mechanism information, determining a confidentiality assessment result for each of the function points, obtaining unauthorized access prevention information, determining an integrity assessment result for each of the function points, and obtaining log information to determine a non-repudiation assessment result for each of the function points; Conducting an evaluation based on the user survey evaluation method, obtaining software application domain scope information, determining the reusability evaluation result of each of the function points, and obtaining development document quality information, determining the modifiability evaluation result of each of the function points; Performing an evaluation based on the data collection and evaluation method, obtaining software and hardware environment operation information, determining the adaptability evaluation result of each of the functional points, and obtaining installation document information, determining the ease of installation evaluation result of each of the functional points; An evaluation is performed based on the user survey evaluation method to obtain function usage information, determine a function satisfaction evaluation result for each function point, and obtain software selection information to determine a selection usage probability evaluation result for each function point.

4. The industrial software application effectiveness evaluation method according to claim 1 is characterized in that: The calculation is performed based on the industrial software application effectiveness evaluation matrix using a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result, including: Determine the number of functions of the industrial software to be evaluated based on the industrial software application effectiveness evaluation matrix, and determine the weight information of the evaluation result of each function point based on the evaluation algorithm; The industrial software application effectiveness evaluation result is obtained by performing calculation based on the weight information of the evaluation result of each functional point and the number of functions.

5. The industrial software application effectiveness evaluation method according to claim 4 is characterized in that: Also includes: Obtaining the software type of the industrial software to be evaluated, and obtaining the number of software of the software type; When the software quantity is less than or equal to a preset quantity threshold, the weight information of the evaluation result of each function point determined based on the evaluation algorithm includes: Determine the weight information of the evaluation result of each function point based on the hierarchical analysis algorithm; When the software quantity is greater than the quantity threshold, the weight information of the evaluation result of each function point determined based on the evaluation algorithm includes: The weight information of the evaluation result of each of the function points is determined based on the entropy weight algorithm.

6. The industrial software application effectiveness evaluation method according to claim 5 is characterized in that: The weight information of the evaluation result of each function point determined based on the hierarchical analysis algorithm includes: Obtaining a comparison result between each evaluation result of each of the functional points and other evaluation results, and determining a numerical value corresponding to each of the comparison results; Calculation is performed based on the numerical value corresponding to each of the comparison results to determine weight information of the evaluation result of each of the function points.

7. The industrial software application effectiveness evaluation method according to claim 5 is characterized in that: The weight information of the evaluation result of each function point determined based on the entropy weight algorithm includes: Normalizing the evaluation result of each function point to obtain a normalized value of the evaluation result of each function point; Calculate the entropy value of the evaluation result of each function point based on the normalized value of the evaluation result of each function point; Calculate the information entropy redundancy of the evaluation result of each function point based on the entropy value of the evaluation result of each function point; The weight information of the evaluation result of each of the function points is calculated based on the information entropy redundancy of the evaluation result of each of the function points.

8. An industrial software application effectiveness evaluation device, characterized in that: include: An acquisition and analysis module is used to acquire the industrial software to be evaluated, and analyze the industrial software to be evaluated to obtain multiple functional points of the industrial software to be evaluated; A processing module, used to process each of the function points based on a pre-built industrial software application effectiveness evaluation model to obtain evaluation indicators for each of the function points; A determination module, used to determine the evaluation method corresponding to the evaluation index of each function point; An evaluation module, used to perform evaluation according to the evaluation method to obtain evaluation results of each function point; A construction module, used for constructing an industrial software application effectiveness evaluation matrix based on the evaluation results of all the functional points; The calculation module is used to perform calculations based on the industrial software application effectiveness evaluation matrix through a preset evaluation algorithm to obtain an industrial software application effectiveness evaluation result.

9. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the industrial software application effectiveness evaluation method described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and the computer program is used to execute an industrial software application effectiveness evaluation method as described in any one of claims 1 to 7 above.