Application system credential reconstruction effect evaluation method and device and medium

Abstract

The invention provides a method and a device for evaluating a creative reformation effect of an application system and a medium. The method comprises the following steps: acquiring a plurality of assessment indexes corresponding to creative reformation of the application system; according to the plurality of assessment indexes, a reconstruction effect is evaluated according to a pre-constructed credential reconstruction effect evaluation model, an evaluation total value is obtained, and the credential reconstruction effect evaluation model comprises evaluation indexes of four evaluation categories of a localization substitution condition, a system operation condition, a diversity support condition and a risk improvement condition; and according to the total evaluation value, determining a level corresponding to the credential renovation effect of the application system. According to the method, the device and the medium, the problem that in the prior art, as the credential reconstruction effect evaluation of an application system cannot be considered from the aspects of traditional cost and benefits, a widely applied credential reconstruction effect evaluation model does not exist at present for carrying out credential reconstruction effect evaluation work can be solved.

Description

Technical Field

[0001] The present invention relates to the technical field of information and communication technology (ICT) innovation industry, and particularly to a method, device and medium for evaluating the effect of ICT innovation transformation of application systems. Background Art

[0002] With the launch of "New Infrastructure", the ICT innovation industry has started to be comprehensively promoted and has become a phenomenon-level trend. Driven by policies, the products of independent control are becoming increasingly rich, and the industrial chain is gradually formed. From the bottom-level CPU (central processing unit) chips, complete machines, operating systems, to the middle-level databases and middleware, and then to various application software at the top level, the products and related technologies of independent control are becoming increasingly perfect. In 2020, key fields such as finance took the lead in carrying out ICT innovation application substitution. So far, the ICT innovation in the financial field has gradually entered the stage of large-scale application and natural replacement. Other key industries such as energy, transportation, and telecommunications have gradually started or carried out small-scale ICT innovation application substitution work in the past two years, and implemented the substitution of ICT innovation software and hardware for comprehensive office systems, operation management systems, production operation systems, etc. So far, certain achievements have been made in the substitution pilot work in key industries.

[0003] However, the existing ICT innovation application substitution faces problems such as substitution but not use and waste of resources, and it is urgent to carry out the evaluation of the effect of ICT innovation transformation. According to the existing evaluation methodology of transformation effect, the investigation of cost, quality, and efficiency accounts for the main part. However, since the original intention of the ICT innovation transformation work is to build an ecological environment of our country's independent technologies and products regardless of cost and price, in order to further reduce network security risks and the problem of being restricted by others, the evaluation of the effect of ICT innovation transformation of application systems cannot be considered from the perspective of traditional cost and benefit. In addition, the large-scale deployment of ICT innovation substitution in China has not been realized, and it is limited to pilot and small-scale applications. There is a lack of an evaluation model for the effect of ICT innovation transformation, and there is no mature or widely applicable evaluation model temporarily. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a method, device and medium for evaluating the effect of ICT innovation transformation of application systems in view of the above deficiencies of the existing technology, so as to solve the problem that the evaluation of the effect of ICT innovation transformation of application systems cannot be considered from the perspective of traditional cost and benefit in the existing technology, and there is no widely applicable evaluation model for the effect of ICT innovation transformation to carry out the evaluation work of the effect of ICT innovation transformation.

[0005] In the first aspect, the present invention provides a method for evaluating the effect of ICT innovation transformation of application systems, and the method includes:

[0006] Obtaining a plurality of evaluation indicators corresponding to the ICT innovation transformation of the application system;

[0007] Evaluate the transformation effect according to the multiple assessment indicators based on the pre-constructed evaluation model for the effect of the IT infrastructure transformation with domestic technologies to obtain the total evaluation value, where the evaluation model for the effect of the IT infrastructure transformation with domestic technologies includes evaluation indicators for four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation;

[0008] Determine the level corresponding to the effect of the IT infrastructure transformation of the application system according to the total evaluation value.

[0009] Further, before obtaining the multiple assessment indicators corresponding to the IT infrastructure transformation of the application system, the method further includes:

[0010] Construct an evaluation model for the effect of the IT infrastructure transformation with domestic technologies, which includes evaluation indicators for four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation.

[0011] Further, the evaluation indicators in the evaluation model for the effect of the IT infrastructure transformation with domestic technologies are divided into priority evaluation items and general evaluation items. The step of evaluating the transformation effect according to the multiple assessment indicators based on the pre-constructed evaluation model for the effect of the IT infrastructure transformation with domestic technologies to obtain the total evaluation value specifically includes:

[0012] Score the evaluation indicators corresponding to the priority evaluation items among the multiple assessment indicators according to the evaluation model for the effect of the IT infrastructure transformation with domestic technologies to obtain the score of the priority evaluation items;

[0013] Judge whether the score of the priority evaluation items meets the pre-set conditions for the priority evaluation items;

[0014] In response to the score of the priority evaluation items meeting the conditions for the priority evaluation items, further score the evaluation indicators corresponding to the general evaluation items among the multiple assessment indicators to obtain the score of the general evaluation items, and take the sum of the score of the priority evaluation items and the score of the general evaluation items as the total evaluation value;

[0015] In response to the score of the priority evaluation items not meeting the conditions for the priority evaluation items, take the preset minimum score value as the total evaluation value.

[0016] Further, the evaluation indicators for the evaluation category of the situation of domestic substitution include the situation of domestic substitution of the server central processing unit (CPU), the situation of domestic substitution of the server operating system, and at least one of the following: the situation of domestic substitution of the server database, the situation of domestic substitution of the server middleware, the situation of domestic substitution of the terminal CPU, the situation of domestic substitution of the terminal operating system, the situation of domestic substitution of the terminal browser, and the client adaptation situation;

[0017] The evaluation indicators for the evaluation category of the system operation situation include at least one of the following: the single-track and double-track operation status, the proportion of the user scale carried, and the implementation situation of the domestic substitution plan;

[0018] The evaluation indicators of the diversity support situation evaluation category include at least one of the following: the support situation of the server domestic innovation CPU, the support situation of the server domestic innovation operating system, the support situation of the domestic innovation terminal CPU, the support situation of the domestic innovation terminal operating system, the support situation of the domestic innovation terminal browser;

[0019] The evaluation indicators of the risk improvement situation evaluation category include at least one of the following: the improvement / deterioration situation of the system risk, the system risk level.

[0020] Furthermore, the domestic substitution situation of the server CPU and the domestic substitution situation of the server operating system are the evaluation indicators of the priority evaluation items, and the remaining evaluation indicators are the evaluation indicators of the general evaluation items.

[0021] Furthermore, the levels corresponding to the domestic innovation transformation effect of the application system include the rectification level, the basic level, the reliable level, the excellent level, and the outstanding level.

[0022] Furthermore, determining the level corresponding to the domestic innovation transformation effect of the application system according to the evaluation total value specifically includes:

[0023] If the evaluation total value is less than or equal to 59, then determine that the level is the rectification level;

[0024] If the evaluation total value is greater than or equal to 60 and less than or equal to 69, then determine that the level is the basic level;

[0025] If the evaluation total value is greater than or equal to 70 and less than or equal to 79, then determine that the level is the reliable level;

[0026] If the evaluation total value is greater than or equal to 80 and less than or equal to 89, then determine that the level is the excellent level;

[0027] If the evaluation total value is greater than or equal to 90 and less than or equal to 100, then determine that the level is the outstanding level.

[0028] In a second aspect, the present invention provides an evaluation device for the domestic innovation transformation effect of an application system, including:

[0029] An assessment index acquisition module, configured to acquire a plurality of assessment indexes corresponding to the domestic innovation transformation of the application system;

[0030] A transformation effect evaluation module, connected to the assessment index acquisition module, configured to evaluate the transformation effect according to the plurality of assessment indexes according to a pre-constructed domestic innovation transformation effect evaluation model to obtain an evaluation total value, wherein the domestic innovation transformation effect evaluation model includes evaluation indexes of four evaluation categories: the domestic substitution situation, the system operation situation, the diversity support situation, and the risk improvement situation;

[0031] An evaluation level determination module, connected to the transformation effect evaluation module, is configured to determine the level corresponding to the Xinchuang transformation effect of the application system according to the total evaluation value.

[0032] In a third aspect, the present invention provides an apparatus for evaluating the Xinchuang transformation effect of an application system, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to implement the method for evaluating the Xinchuang transformation effect of the application system described in the first aspect above.

[0033] In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the method for evaluating the Xinchuang transformation effect of the application system described in the first aspect above.

[0034] The method, apparatus, and medium for evaluating the Xinchuang transformation effect of an application system provided by the present invention. First, obtain a plurality of assessment indicators corresponding to the Xinchuang transformation of the application system; then, according to the plurality of assessment indicators, evaluate the transformation effect according to a pre-constructed Xinchuang transformation effect evaluation model to obtain a total evaluation value, where the Xinchuang transformation effect evaluation model includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation; and then determine the level corresponding to the Xinchuang transformation effect of the application system according to the total evaluation value. By constructing a Xinchuang transformation effect evaluation model, the present invention uses the evaluation indicators of four evaluation categories, namely the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation, as assessment factors to evaluate the transformation effect, which can better standardize the requirements of Xinchuang work, improve the level of Xinchuang work, help promote the application of Xinchuang products, drive the real substitution and real use of the system, ensure the synchronous achievement of business development and Xinchuang substitution, and solve the problem that in the prior art, the evaluation of the Xinchuang transformation effect of the application system cannot be considered from the perspective of traditional costs and benefits, and there is currently no widely applicable Xinchuang transformation effect evaluation model to carry out the evaluation work of the Xinchuang transformation effect. Description of the Drawings

[0035] Figure 1 It is a flowchart of a method for evaluating the Xinchuang transformation effect of an application system according to Embodiment 1 of the present invention;

[0036] Figure 2 It is a schematic structural diagram of an apparatus for evaluating the Xinchuang transformation effect of an application system according to Embodiment 2 of the present invention;

[0037] Figure 3 It is a schematic structural diagram of an apparatus for evaluating the Xinchuang transformation effect of an application system according to Embodiment 3 of the present invention. Detailed Embodiments

[0038] To enable those skilled in the art to better understand the technical solutions of the present invention, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0039] It can be understood that the specific embodiments and the accompanying drawings described herein are only for explaining the present invention, rather than limiting the present invention.

[0040] It can be understood that, without conflict, the various embodiments in the present invention and the features in the embodiments can be combined with each other.

[0041] It can be understood that, for the convenience of description, only the parts related to the present invention are shown in the accompanying drawings of the present invention, and the parts unrelated to the present invention are not shown in the accompanying drawings.

[0042] It can be understood that each unit and module involved in the embodiments of the present invention may correspond to only one entity structure, or may be composed of multiple entity structures, or multiple units and modules may also be integrated into one entity structure.

[0043] It can be understood that the terms "first", "second", etc. in the embodiments of the present invention are used to distinguish different objects, or to distinguish different processes for the same object, rather than to describe a specific order of the objects.

[0044] It can be understood that, without conflict, the functions and steps marked in the flowcharts and block diagrams of the present invention may occur in an order different from that marked in the accompanying drawings.

[0045] It can be understood that in the flowcharts and block diagrams of the present invention, the possible architectures, functions, and operations of the systems, devices, equipment, and methods according to the embodiments of the present invention are shown. Among them, each block in the flowchart or block diagram may represent a unit, module, program segment, or code, which contains executable instructions for implementing the specified function. Moreover, each block or combination of blocks in the block diagram and flowchart can be implemented by a hardware-based system for implementing the specified function, or can be implemented by a combination of hardware and computer instructions.

[0046] It can be understood that the units and modules involved in the embodiments of the present invention can be implemented in software or in hardware. For example, the units and modules can be located in the processor.

[0047] Embodiment 1:

[0048] This embodiment provides a method for evaluating the effect of the information technology innovation transformation of an application system. As Figure 1 shown, the method includes:

[0049] Step S101: Obtain a plurality of assessment indicators corresponding to the information technology innovation transformation of the application system.

[0050] In this embodiment, the assessment indicators mainly involve indicators of four evaluation categories: the situation of domestic substitution, the operation of the system, the support for diversity, and the improvement of risks.

[0051] Step S102: According to the multiple assessment indicators, evaluate the transformation effect according to the pre-constructed evaluation model for the effect of IT innovation transformation, and obtain the total evaluation value, where the evaluation model for the effect of IT innovation transformation includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the operation of the system, the support for diversity, and the improvement of risks.

[0052] Optionally, before obtaining the multiple assessment indicators corresponding to the IT innovation transformation of the application system, the method further includes:

[0053] Construct an evaluation model for the effect of IT innovation transformation including evaluation indicators of four evaluation categories: the situation of domestic substitution, the operation of the system, the support for diversity, and the improvement of risks.

[0054] In this embodiment, to effectively control the risks faced by the application system in carrying out IT innovation transformation and ensure that the application system can achieve the application substitution of IT innovation products, realize the real substitution and real use of the system, improve the system adaptation ability, and eliminate and reduce network security risks through IT innovation transformation, an evaluation model for the effect of IT innovation transformation is first constructed. Among them:

[0055] 1) In terms of realizing the application substitution of IT innovation products, focus on examining the degree of IT innovation substitution achieved by the transformed system.

[0056] 2) In terms of realizing the real substitution and real use of the system, focus on examining the actual operation of the application system in the IT innovation environment.

[0057] 3) In terms of realizing the improvement of the system adaptation ability, focus on examining the performance of the application system in supporting the domestic IT innovation ecosystem.

[0058] 4) In terms of eliminating and reducing network security risks, focus on examining the risk improvement situation of the application system after the transformation is completed.

[0059] Optionally, the evaluation indicators in the evaluation model for the effect of IT innovation transformation are divided into priority evaluation items and general evaluation items. The specific steps of evaluating the transformation effect according to the multiple assessment indicators according to the pre-constructed evaluation model for the effect of IT innovation transformation to obtain the total evaluation value are as follows:

[0060] Score the evaluation indicators corresponding to the priority evaluation items in the multiple assessment indicators according to the evaluation model for the effect of IT innovation transformation to obtain the score of the priority evaluation items;

[0061] Judge whether the score of the priority evaluation items meets the pre-set conditions of the priority evaluation items;

[0062] In response to the fact that the score of the priority evaluation item meets the priority evaluation item condition, further score the evaluation indicators corresponding to the general evaluation items among the multiple assessment indicators to obtain the general evaluation item score, and use the sum of the priority evaluation item score and the general evaluation item score as the total evaluation value;

[0063] In response to the fact that the score of the priority evaluation item does not meet the priority evaluation item condition, use the preset minimum score value as the total evaluation value.

[0064] In this embodiment, the evaluation indicators for the application system's information technology innovation transformation effect include two major categories: priority evaluation items and general evaluation items. Among them, the priority evaluation items refer to the indicator items that seriously affect the information technology innovation transformation effect of the system, and such indicator items are preferentially evaluated at the beginning of the evaluation. During the evaluation process, once the priority evaluation item becomes effective, the evaluation result is the preset minimum score value (such as 0 points), and there is no need to conduct subsequent evaluations of the general evaluation items. The general evaluation items refer to the indicator items that affect the system transformation effect.

[0065] Optionally, the evaluation indicators of the domestic substitution situation evaluation category include the domestic substitution situation of the server CPU, the domestic substitution situation of the server operating system, and at least one of the following: the domestic substitution situation of the server database, the domestic substitution situation of the server middleware, the domestic substitution situation of the terminal CPU, the domestic substitution situation of the terminal operating system, the domestic substitution situation of the terminal browser, and the client adaptation situation;

[0066] The evaluation indicators of the system operation situation evaluation category include at least one of the following: the single / double-track operation status, the proportion of the user scale carried, and the implementation situation of the information technology innovation substitution plan;

[0067] The evaluation indicators of the diversity support situation evaluation category include at least one of the following: the support situation of the server information technology innovation CPU, the support situation of the server information technology innovation operating system, the support situation of the information technology innovation terminal CPU, the support situation of the information technology innovation terminal operating system, and the support situation of the information technology innovation terminal browser;

[0068] The evaluation indicators of the risk improvement situation evaluation category include at least one of the following: the improvement / deterioration situation of the system risk, and the system risk level.

[0069] Optionally, the domestic substitution situations of the server CPU and the server operating system are the evaluation indicators of the priority evaluation items, and the remaining evaluation indicators are the evaluation indicators of the general evaluation items.

[0070] In this embodiment, the set evaluation indicators can be as shown in Table 1:

[0071] Table 1. Setting of evaluation indicators

[0072]

[0073]

[0074] It should be noted that by taking the proportion of Xinchuang products (i.e., the replacement situation) used in key software and hardware products involved in the application system, such as server CPUs, operating systems, databases, etc., as an assessment factor, the present invention can promote the application of Xinchuang products; by taking the operating conditions of the application system based on the Xinchuang software and hardware environment, the business volume carried, etc. as assessment factors, the true replacement and true use of the system can be ensured; by taking the support situation of the diversity of Xinchuang software and hardware products as an assessment factor, the system adaptation ability can be improved; by taking the risk assessment level after the transformation of the application system, the sharing reduction / deterioration situation before and after the transformation, etc. as assessment factors, the system security risk can be reduced.

[0075] In this embodiment, the evaluation of the Xinchuang transformation effect of the application system adopts a hundred-point system, that is, the total evaluation value is between 0 and 100, and the total evaluation value is the sum of the scores of the priority evaluation items and the general evaluation items. The evaluation and scoring process scores according to the priority evaluation items and the general evaluation items in turn. If the priority evaluation items are not passed (that is, the conditions of the priority evaluation items are not met), the general evaluation items will not be scored. Among them, the scoring methods corresponding to each evaluation index can be as shown in Table 2:

[0076] Table 2. Setting of the scoring method for evaluation indicators

[0077]

[0078]

[0079]

[0080] Step S103: Determine the level corresponding to the Xinchuang transformation effect of the application system according to the total evaluation value.

[0081] In this embodiment, the levels corresponding to the Xinchuang transformation effect of the application system include the rectification level, the basic level, the reliable level, the excellent level, and the outstanding level. The sum of the scores of the priority evaluation items is the pre-score of the Xinchuang transformation effect of the application system. If it is less than 20 points, it is regarded as not meeting the Xinchuang transformation standard and is designated as the rectification level, and rectification is required, and a secondary evaluation work will be carried out at a later date.

[0082] Optionally, the determining the level corresponding to the Xinchuang transformation effect of the application system according to the total evaluation value specifically includes:

[0083] If the total evaluation value is less than or equal to 59, then determine that the level is the rectification level;

[0084] If the total evaluation value is greater than or equal to 60 and less than or equal to 69, then determine that the level is the basic level;

[0085] If the total evaluation value is greater than or equal to 70 and less than or equal to 79, the level is determined to be a reliable level;

[0086] If the total evaluation value is greater than or equal to 80 and less than or equal to 89, the level is determined to be excellent;

[0087] If the total evaluation value is greater than or equal to 90 and less than or equal to 100, the level is determined to be excellent.

[0088] In this embodiment, the sum of the priority evaluation item scores and the general evaluation item index scores (i.e., the total evaluation value) is the score of the application system's credible innovation transformation effect, which is used to evaluate the basic effect of the application system's credible innovation transformation. Among them, scores of 0-59 points are considered to have not met the credible innovation transformation requirements, and are determined to be at the rectification level. Rectification is required, and a second evaluation should be carried out at an appropriate time; scores of 60-69 points are considered to basically meet the credible innovation transformation requirements, and are determined to be at the basic level. The next transformation direction can be adjusted according to the evaluation opinions; scores of 70-79 points are considered to meet the credible innovation transformation requirements, and are determined to be at the reliable level. Further in-depth transformation can be carried out and a promotion plan can be formulated. Scores of 80-89 points are considered to have met the credible innovation transformation requirements well, and are determined to be at the excellent level. Scores of 90-100 points are considered to have fully met the credible innovation transformation requirements and have a demonstration effect, and are determined to be at the excellence level. They can be used as benchmarks for promotion and publicity.

[0089] In this embodiment, the definitions of each level are shown in Table 3:

[0090] Table 3. Definition of levels

[0091]

[0092] It should be noted that the value of the results of this invention lies in achieving a breakthrough from 0 to 1, solving the problem of the effectiveness of information technology innovation transformation, and proposing a more comprehensive and quantitative methodology that is more suitable for information technology innovation application replacement work, which can actually assess and guide the information technology innovation work of enterprises.

[0093] In a specific embodiment, the method for evaluating the effect of the application system's information innovation transformation may include the following steps:

[0094] (1) Establishing the overall framework of the evaluation index system

[0095] In order to effectively control the risks faced by application systems in carrying out ICT transformation, and to ensure that application systems can achieve ICT product application replacement, achieve real replacement and real use of systems, improve system adaptability, and reduce network security risks through ICT transformation, we first formulate an evaluation index system for the effect of ICT transformation of application systems. Among them:

[0096] a) In terms of implementing the replacement of IT products, the degree of replacement of the IT products in the transformed system is mainly investigated. This method sets index items such as the proportion of IT products used on the server side and the terminal side of the application system to be evaluated.

[0097] b) In terms of realizing the real replacement and real use of the system, the actual operation of the application system to be evaluated in the IT environment is mainly investigated. This method sets evaluation index items such as the single-track and double-track operation conditions, the proportion of the user scale carried, and whether the migration and transformation are completed according to the planned time of system replacement.

[0098] c) In terms of improving the system adaptation ability, the performance of the application system to be evaluated in supporting the domestic IT ecosystem is mainly investigated. This method sets index items such as the diversity support of IT products on the server side and the terminal side.

[0099] d) In terms of reducing network security risks, the risk improvement situation of the system to be evaluated after the transformation is mainly investigated. This method sets index items such as the risk improvement situation and the risk level.

[0100] (2) Setting of evaluation index types

[0101] The evaluation indexes for the IT transformation effect of the application system include two index types: priority evaluation items and general evaluation items.

[0102] Priority evaluation items refer to the index items that seriously affect the IT transformation effect of the application system. These index items are evaluated first at the beginning of the evaluation. During the evaluation process, once a priority evaluation item takes effect, the evaluation result is 0 points, and there is no need to evaluate the subsequent general evaluation items. For example, whether the server CPU and operating system used by the application system use independently controllable products are set as priority evaluation items. If it is found that both the server CPU and operating system used by the system do not meet the requirements of independent control, then according to the judgment principle of the priority evaluation item, the evaluation result of the transformation effect of the system is directly judged to be 0 points.

[0103] General evaluation items refer to the index items that affect the system transformation effect.

[0104] (3) Setting of evaluation indexes

[0105] As shown in Table 1, the evaluation index categories include four evaluation categories: domestic substitution situation, system operation situation, diversity support situation, and risk improvement situation.

[0106] The evaluation indexes for the domestic substitution situation include the domestic substitution situation of the server CPU, the domestic substitution situation of the server operating system, the domestic substitution situation of the server database, the domestic substitution situation of the server middleware, the domestic substitution situation of the terminal CPU, the domestic substitution situation of the terminal operating system, the domestic substitution situation of the terminal browser, and the client adaptation situation.

[0107] The evaluation indicators for the system operation status include the single-track / double-track operation status, the proportion of the user scale carried, and the implementation of the replacement plan for domestic information technology innovation.

[0108] The evaluation indicators for the diversity support situation include the support situation of domestic information technology innovation CPUs on the server side, the support situation of domestic information technology innovation operating systems on the server side, the support situation of domestic information technology innovation CPUs on the terminal side, the support situation of domestic information technology innovation operating systems on the terminal side, and the support situation of domestic information technology innovation browsers on the terminal side.

[0109] The evaluation indicators for the risk improvement situation include the improvement / deterioration situation of the system risk and the system risk level.

[0110] Among them, the domestic substitution situation of the server CPU and the domestic substitution situation of the server operating system are the priority evaluation items, and the rest are general evaluation items.

[0111] (4) Setting of the index scoring method

[0112] As shown in Table 2, set the evaluation methods for each evaluation indicator, including the score value and the scoring description. It should be noted that the evaluation of the domestic information technology innovation transformation effect of the system adopts a 100-point system. The total score of the domestic information technology innovation transformation effect of the application system is the sum of the scores of the priority evaluation items and the general evaluation items. The evaluation and scoring process is carried out in the order of priority evaluation items and general evaluation items. If the priority evaluation items are not passed (do not meet the conditions of the priority evaluation items), the general evaluation items will not be scored.

[0113] (5) Application of the scoring results

[0114] The evaluation of the domestic information technology innovation transformation effect of the system adopts a 100-point system. The lowest score is 0 points. Those who fail to pass the priority evaluation items are scored according to the lowest score, and the highest score is 100 points. The overall score of the evaluated party is calculated according to the index evaluation scoring method. The total score of the domestic information technology innovation transformation effect of the application system is the sum of the scores of the priority evaluation items and the general evaluation items.

[0115] The sum of the scores of the priority evaluation items is the pre-score of the domestic information technology innovation transformation effect of the application system. If it is lower than 20 points, it is regarded as not meeting the domestic information technology innovation transformation standard, and it is designated as the rectification level. Rectification is required, and a second evaluation will be carried out at a later date.

[0116] The sum of the scores of the priority evaluation items and the general evaluation item index items is the score of the Xinchuang transformation effect of the application system, which is used to evaluate the basic effect of the Xinchuang transformation of the application system. Among them, as shown in Table 3, a score of 0-59 points is regarded as not meeting the Xinchuang transformation requirements, and it is designated as the rectification level. Rectification is required, and a second evaluation will be carried out at a later date. A score of 60-69 points is regarded as basically meeting the Xinchuang transformation requirements, and it is designated as the basic level. The next transformation direction can be adjusted according to the evaluation opinions. A score of 70-79 points is regarded as meeting the Xinchuang transformation requirements, and it is designated as the reliable level. Further in-depth transformation can be carried out, and a promotion plan can be formulated. A score of 80-89 points is regarded as achieving the Xinchuang transformation requirements well, and it is designated as the excellent level. A score of 90-100 points is regarded as fully meeting the Xinchuang transformation requirements and having a demonstration effect, and it is designated as the outstanding level, which can be promoted and publicized as a benchmark.

[0117] (6) Evaluation process

[0118] Before carrying out the evaluation work on the Xinchuang transformation effect of the application system, the evaluation implementer should inform the party to be evaluated in advance of basic information such as the evaluation scope and evaluation criteria, and provide the evaluation results to the party to be evaluated as appropriate after the evaluation is completed. The entire evaluation process mainly includes four stages: preliminary preparation, plan formulation, evaluation implementation, and analysis and evaluation.

[0119] Preliminary preparation: The party to be evaluated carries out preparatory work before the evaluation according to the basic information provided by the evaluation implementer, including but not limited to confirming the accuracy, timeliness, and integrity of the materials and documents related to the evaluation indicators. According to the different evaluation objects, the implementer forms an evaluation implementation team.

[0120] Plan formulation: The implementer formulates an evaluation plan according to the actual situation of the application system to be evaluated, including evaluation methods, evaluation procedures, schedule arrangements, scoring tables, etc. The evaluation plan needs to be reviewed and approved by the evaluation implementation team and relevant experts.

[0121] Evaluation implementation: The implementer conducts verification or test verification based on the evaluation plan in combination with the materials provided by the party to be evaluated, and both parties confirm the on-site implementation results; during the evaluation implementation stage, the evaluation party may require the party to be evaluated to provide procurement documents for domestic products, product supply chain descriptions, system requirement specification documents, etc. as needed.

[0122] Effect evaluation: The implementer scores the party to be evaluated according to the verification and test results during the evaluation implementation stage. The evaluation results correspond to the transformation effect levels L1-L5, which are the rectification level, the basic level, the reliable level, the excellent level, and the outstanding level respectively.

[0123] (7) Evaluation method

[0124] In the evaluation of the effect of the replacement of information technology products with domestic alternatives in application systems, the evaluation implementer mainly adopts the verification method to verify whether the evaluation materials provided by the party to be evaluated meet the requirements of the index examination content. The evaluation implementer observes, inspects, and analyzes the relevant materials provided by the party to be evaluated. The submitted materials include, but are not limited to, the basic information of the system, the basic information of the key software and hardware products used in the system, the basic situation of the product suppliers, the verification indicators of the system function and performance, the procurement records of the core materials, and the compliance certification documents such as external certification qualifications.

[0125] (8) Requirements for evaluation materials

[0126] Evaluation materials include the materials that must be provided to the evaluation implementer for verification. The submitted materials include, but are not limited to, the basic information of the system, the basic information of the key software and hardware products used in the system, the basic situation of the product suppliers, and the compliance certification documents such as the verification of system function and performance indicators. Sensitive and confidential materials can be stored in the verification environment provided by the party to be evaluated. The evaluation materials are required to be true, verifiable, standardized, and complete.

[0127] a) Authenticity

[0128] The materials provided by the party to be evaluated should truly reflect the usage and operation status of the system and the key software and hardware products used in the system, and ensure that the system is in a real and in-use state.

[0129] b) Verifiability

[0130] The materials provided by the party to be evaluated should be verifiable and provide the necessary technical support for the evaluation implementer to conduct verification, including supporting necessary technical means for verification.

[0131] c) Standardization

[0132] The materials provided by the party to be evaluated should comply with the industry's prevailing standards and specifications, be able to support the evaluation implementer's accurate understanding of the corresponding technical principles and implementation mechanisms, and provide the basis for standards and specifications when necessary.

[0133] d) Completeness

[0134] The materials provided by the party to be evaluated should cover all the materials required by this method.

[0135] It should be noted that the evaluation model for the effect of the replacement of information technology products with domestic alternatives in application systems constructed in this invention is the basis for better standardizing the requirements of the replacement of information technology products with domestic alternatives work and improving the level of the replacement of information technology products with domestic alternatives work. First, it helps to promote the application of domestic information technology products and drive the optimization and upgrading of the capabilities of domestic information technology products; second, it helps to drive the real replacement and real use of the system and ensure the synchronous achievement of business development and the replacement of information technology products with domestic alternatives; third, it helps to improve the system adaptation ability and ensure future expansion, adaptation, migration and other requirements; finally, it helps to reduce the system security risks and ensure the sharing of development and security.

[0136] The method for evaluating the effect of the information technology innovation transformation of an application system provided by an embodiment of the present invention first obtains a plurality of evaluation indicators corresponding to the information technology innovation transformation of the application system; then, according to the plurality of evaluation indicators, evaluates the transformation effect according to a pre-constructed information technology innovation transformation effect evaluation model to obtain an evaluation total value, wherein the information technology innovation transformation effect evaluation model includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation; and then determines the level corresponding to the information technology innovation transformation effect of the application system according to the evaluation total value. By constructing an information technology innovation transformation effect evaluation model, the present invention uses the evaluation indicators of four evaluation categories, namely the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation, as evaluation factors to evaluate the transformation effect, which can better standardize the requirements of information technology innovation work, improve the level of information technology innovation work, help promote the application of information technology innovation products, drive the real substitution and real use of the system, ensure the synchronous achievement of business development and information technology innovation substitution, and solve the problem in the prior art that the evaluation of the information technology innovation transformation effect of an application system cannot be considered from the perspective of traditional costs and benefits, and there is currently no widely applicable information technology innovation transformation effect evaluation model to carry out the information technology innovation transformation effect evaluation work.

[0137] Embodiment 2:

[0138] As Figure 2 shown, this embodiment provides an information technology innovation transformation effect evaluation device for an application system, which is used to execute the above-mentioned information technology innovation transformation effect evaluation method for an application system, and includes:

[0139] An evaluation index acquisition module 11, which is used to acquire a plurality of evaluation indicators corresponding to the information technology innovation transformation of the application system;

[0140] A transformation effect evaluation module 12, which is connected to the evaluation index acquisition module 11, and is used to evaluate the transformation effect according to the plurality of evaluation indicators according to a pre-constructed information technology innovation transformation effect evaluation model to obtain an evaluation total value, wherein the information technology innovation transformation effect evaluation model includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation;

[0141] An evaluation level determination module 13, which is connected to the transformation effect evaluation module 12, and is used to determine the level corresponding to the information technology innovation transformation effect of the application system according to the evaluation total value.

[0142] Optionally, the device further includes:

[0143] An evaluation model construction module, which is used to construct an information technology innovation transformation effect evaluation model including evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation.

[0144] Optionally, the evaluation indicators in the evaluation model for the Xinchuang transformation effect are divided into priority evaluation items and general evaluation items. The transformation effect evaluation module 12 specifically includes:

[0145] A scoring unit for scoring the evaluation indicators corresponding to the priority evaluation items among the multiple assessment indicators according to the evaluation model for the Xinchuang transformation effect to obtain the scores of the priority evaluation items;

[0146] A judgment unit for judging whether the scores of the priority evaluation items meet the pre-set priority evaluation item conditions;

[0147] A first processing unit for, in response to the scores of the priority evaluation items meeting the priority evaluation item conditions, further scoring the evaluation indicators corresponding to the general evaluation items among the multiple assessment indicators to obtain the scores of the general evaluation items, and taking the sum of the scores of the priority evaluation items and the scores of the general evaluation items as the total evaluation value;

[0148] A second processing unit for, in response to the scores of the priority evaluation items not meeting the priority evaluation item conditions, taking the preset minimum score value as the total evaluation value.

[0149] Optionally, the evaluation indicators for the category of the domestic substitution situation include the domestic substitution situation of the server central processing unit (CPU), the domestic substitution situation of the server operating system, and at least one of the following: the domestic substitution situation of the server database, the domestic substitution situation of the server middleware, the domestic substitution situation of the terminal CPU, the domestic substitution situation of the terminal operating system, the domestic substitution situation of the terminal browser, and the client adaptation situation;

[0150] The evaluation indicators for the category of the system operation situation include at least one of the following: the single / dual-track operation status, the proportion of the user scale carried, and the implementation situation of the Xinchuang substitution plan;

[0151] The evaluation indicators for the category of the diversity support situation include at least one of the following: the support situation of the server Xinchuang CPU, the support situation of the server Xinchuang operating system, the support situation of the Xinchuang terminal CPU, the support situation of the Xinchuang terminal operating system, and the support situation of the Xinchuang terminal browser;

[0152] The evaluation indicators for the category of the risk improvement situation include at least one of the following: the improvement / deterioration situation of the system risk and the system risk level.

[0153] Optionally, the domestic substitution situations of the server CPU and the server operating system are the evaluation indicators for the priority evaluation items, and the remaining evaluation indicators are the evaluation indicators for the general evaluation items.

[0154] Optionally, the levels corresponding to the Xinchuang transformation effect of the application system include the rectification level, the basic level, the reliable level, the excellent level, and the outstanding level.

[0155] Optionally, the evaluation level determination module 13 specifically includes:

[0156] A first determination unit, configured to determine that the level is the rectification level if the total evaluation value is less than or equal to 59;

[0157] A second determination unit, configured to determine that the level is the basic level if the total evaluation value is greater than or equal to 60 and less than or equal to 69;

[0158] A third determination unit, configured to determine that the level is the reliable level if the total evaluation value is greater than or equal to 70 and less than or equal to 79;

[0159] A fourth determination unit, configured to determine that the level is the excellent level if the total evaluation value is greater than or equal to 80 and less than or equal to 89;

[0160] A fifth determination unit, configured to determine that the level is the outstanding level if the total evaluation value is greater than or equal to 90 and less than or equal to 100.

[0161] Example 3:

[0162] Reference Figure 3 , this embodiment provides an evaluation device for the information technology innovation transformation effect of an application system, including a memory 21 and a processor 22. A computer program is stored in the memory 21, and the processor 22 is configured to run the computer program to execute the information technology innovation transformation effect evaluation method in Embodiment 1.

[0163] Wherein, the memory 21 is connected to the processor 22. The memory 21 can adopt flash memory, read-only memory or other memories, and the processor 22 can adopt a central processing unit or a single-chip microcomputer.

[0164] Example 4:

[0165] This embodiment provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the information technology innovation transformation effect evaluation method in Embodiment 1 above.

[0166] The computer-readable storage medium includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, computer program modules, or other data. The computer-readable storage medium includes, but is not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other memory technologies, CD-ROM (Compact Disc Read-Only Memory), digital versatile disc (DVD) or other optical disc storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer.

[0167] In summary, the application system Xinchuang transformation effect evaluation method, device and medium provided by the embodiments of the present invention first obtain a plurality of evaluation indicators corresponding to the Xinchuang transformation of the application system; then, according to the plurality of evaluation indicators, evaluate the transformation effect according to the pre-constructed Xinchuang transformation effect evaluation model to obtain an evaluation total value, where the Xinchuang transformation effect evaluation model includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation; and then determine the level corresponding to the Xinchuang transformation effect of the application system according to the evaluation total value. By constructing the Xinchuang transformation effect evaluation model, the present invention uses the evaluation indicators of the four evaluation categories of the domestic substitution situation, the system operation situation, the diversity support situation, and the risk improvement situation as assessment factors to evaluate the transformation effect, which can better standardize the requirements of Xinchuang work, improve the level of Xinchuang work, help promote the application of Xinchuang products, drive the real substitution and real use of the system, ensure the synchronous achievement of business development and Xinchuang substitution, and solve the problem that in the prior art, the evaluation of the Xinchuang transformation effect of the application system cannot be considered from the perspective of traditional costs and benefits, and there is currently no widely applicable Xinchuang transformation effect evaluation model to carry out the Xinchuang transformation effect evaluation work.

[0168] It can be understood that the above embodiments are merely exemplary embodiments adopted to illustrate the principles of the present invention, and the present invention is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and essence of the present invention, and these modifications and improvements are also considered within the protection scope of the present invention.

Claims

1. An evaluation method for the effect of renovating an application system with domestic information technology, characterized in that, The method includes: Obtaining multiple assessment indicators corresponding to the Xinchuang transformation of the application system; Evaluating the transformation effect according to the multiple assessment indicators based on the pre-constructed Xinchuang transformation effect evaluation model to obtain an evaluation total value, where the Xinchuang transformation effect evaluation model includes evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation; Determining the level corresponding to the Xinchuang transformation effect of the application system according to the evaluation total value.

2. The method according to claim 1, wherein Before obtaining the multiple assessment indicators corresponding to the Xinchuang transformation of the application system, the method further includes: Constructing a Xinchuang transformation effect evaluation model including evaluation indicators of four evaluation categories: the situation of domestic substitution, the system operation situation, the diversity support situation, and the risk improvement situation.

3. The method according to claim 1, characterized in that, The evaluation indicators in the Xinchuang transformation effect evaluation model are divided into priority evaluation items and general evaluation items. The specific process of evaluating the transformation effect according to the multiple assessment indicators based on the pre-constructed Xinchuang transformation effect evaluation model to obtain an evaluation total value includes: Scoring the evaluation indicators corresponding to the priority evaluation items among the multiple assessment indicators according to the Xinchuang transformation effect evaluation model to obtain the scores of the priority evaluation items; Judging whether the scores of the priority evaluation items meet the pre-set priority evaluation item conditions; In response to the scores of the priority evaluation items meeting the priority evaluation item conditions, further scoring the evaluation indicators corresponding to the general evaluation items among the multiple assessment indicators to obtain the scores of the general evaluation items, and taking the sum of the scores of the priority evaluation items and the scores of the general evaluation items as the evaluation total value; In response to the scores of the priority evaluation items not meeting the priority evaluation item conditions, taking the preset lowest score value as the evaluation total value.

4. The method according to claim 3, characterized in that, The evaluation indicators of the domestic substitution situation evaluation category include the domestic substitution situation of the server central processing unit (CPU), the domestic substitution situation of the server operating system, and at least one of the following: the domestic substitution situation of the server database, the domestic substitution situation of the server middleware, the domestic substitution situation of the terminal CPU, the domestic substitution situation of the terminal operating system, the domestic substitution situation of the terminal browser, and the client adaptation situation; The evaluation indicators of the system operation situation evaluation category include at least one of the following: the single-track / double-track operation state, the proportion of the user scale carried, and the implementation situation of the Xinchuang substitution plan; The evaluation indicators of the diversity support situation evaluation category include at least one of the following: the support situation of the server Xinchuang CPU, the support situation of the server Xinchuang operating system, the support situation of the Xinchuang terminal CPU, the support situation of the Xinchuang terminal operating system, and the support situation of the Xinchuang terminal browser; The evaluation indicators of the risk improvement situation evaluation category include at least one of the following: the improvement / deterioration situation of the system risk and the system risk level.

5. The method according to claim 4, wherein The domestic substitution situations of the server CPU and the server operating system are priority evaluation item evaluation indicators, and the remaining evaluation indicators are general evaluation item evaluation indicators.

6. The method according to claim 1, wherein The levels corresponding to the Xinchuang transformation effect of the application system include the rectification level, the basic level, the reliable level, the excellent level, and the outstanding level.

7. The method according to claim 6, characterized in that, Determining the level corresponding to the effect of the application system's informatization and innovation transformation based on the total evaluation value specifically includes: If the total evaluation value is less than or equal to 59, the level is determined to be the rectification level; If the total evaluation value is greater than or equal to 60 and less than or equal to 69, the level is determined to be the basic level; If the total evaluation value is greater than or equal to 70 and less than or equal to 79, the level is determined to be a reliable level; If the total evaluation value is greater than or equal to 80 and less than or equal to 89, the level is determined to be excellent; If the total evaluation value is greater than or equal to 90 and less than or equal to 100, the level is determined to be excellent.

8. An evaluation device for the effect of the information technology application innovation transformation of an application system, characterized in that, include: The assessment indicator acquisition module is used to obtain multiple assessment indicators corresponding to the application system's information innovation transformation; a transformation effect evaluation module, connected to the assessment indicator acquisition module, for evaluating the transformation effect according to the plurality of assessment indicators and a pre-constructed information innovation transformation effect evaluation model to obtain a total evaluation value, wherein the information innovation transformation effect evaluation model includes evaluation indicators of four evaluation categories: domestic substitution, system operation, diversity support, and risk improvement; The evaluation level determination module is connected to the transformation effect evaluation module and is used to determine the level corresponding to the application system's information and innovation transformation effect based on the total evaluation value.

9. An evaluation device for the effect of renovating an application system with domestic information technology products, characterized in that, It includes a memory and a processor, the memory stores a computer program, and the processor is configured to run the computer program to implement the application system information innovation transformation effect evaluation method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the method for evaluating the effect of application system information innovation transformation as described in any one of claims 1 to 7.

Images