Evaluation method and device, equipment and storage medium

Abstract

The invention provides an evaluation method and device, equipment and a storage medium, relates to the field of communication, and is used for quantitatively evaluating the maturity of an application system. The method comprises the following steps: acquiring infrastructure information of a server and adaptation information of a client of a to-be-evaluated system; and determining a maturity score of the to-be-evaluated system based on the infrastructure information of the server, the adaptation information of the client and a preset evaluation standard. Wherein the adaptation information of the client is used for indicating the adaptation condition of the infrastructure in the client and the to-be-evaluated system.

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to an evaluation method, device, equipment and storage medium. Background Art

[0002] With the development of science and technology, the information technology application innovation industry has gradually become the foundation of data security and network security. Adhering to innovation has gradually become the core position in the overall modernization construction of our country. The dependence of various organizations on application systems has increased day by day, and system security risk issues have received widespread attention. Among them, xinchuang products mainly refer to products and services that are basically independently developed in China, have relatively complete intellectual property rights, and have a high degree of independent control over key core technologies and industrial chains.

[0003] Attaching great importance to network security and informatization has put forward a high degree of autonomy and controllability requirements for the systems, products, and data within each company. In the process of building big data infrastructure for telecom operators, strengthening the construction of information innovation capabilities has become an important part of it. It is particularly important to carry out systematic and comprehensive information technology application innovation application system maturity assessment research. Therefore, an assessment method for assessing system maturity is urgently needed. Summary of the invention

[0004] Based on the above technical problems, the present application provides an evaluation method, device, equipment and storage medium for determining the maturity of an application system, thereby optimizing and transforming the application system. The technical solution of the present application is as follows:

[0005] In a first aspect, the present application provides an evaluation method, the method comprising: obtaining infrastructure information of a server and adaptation information of a client of a system to be evaluated; determining a maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client, and a preset evaluation standard. The adaptation information of the client is used to indicate the adaptation of the infrastructure in the client and the system to be evaluated.

[0006] The technical solution provided by this application brings at least the following beneficial effects: it provides a comprehensive and accurate evaluation method for the maturity of the system, and realizes the quantitative evaluation of the maturity of the system (such as the information innovation application system). Moreover, the maturity score of the system to be evaluated is determined based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria. Among them, the adaptation information of the client is used to indicate the adaptation of the infrastructure in the client and the system to be evaluated, so that the maturity evaluation results are fair, the accuracy and reliability of the maturity evaluation results are improved, and the guidance reference is provided for the transformation priority of the business application system. In addition, this method is applicable to systems to be evaluated under different operators, ensuring the comparability of the maturity evaluation results of different systems to be evaluated.

[0007] In a possible implementation, the preset evaluation criteria include a server evaluation criteria and a client evaluation criteria; based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria, the maturity score of the system to be evaluated is determined, including:

[0008] Determine the maturity score of the server based on the server's infrastructure information, server evaluation criteria and grade scoring criteria; the server evaluation criteria are used to indicate the maturity levels corresponding to different infrastructure information in the server;

[0009] Determine the maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard; the client evaluation standard is used to indicate the maturity level corresponding to different adaptation information of the client;

[0010] Determine the maturity score of the system to be evaluated based on the maturity score of the server and the maturity score of the client;

[0011] Among them, the grade scoring standard is used to indicate the maturity scores corresponding to different maturity levels.

[0012] Based on this possible implementation, the maturity score of the server and the maturity score of the client are determined based on different evaluation criteria respectively, and the obtained maturity score of the server and the maturity score of the client are more accurate, thereby improving the accuracy of the maturity score of the system to be evaluated.

[0013] In a possible implementation, based on the adaptation information of the client, the number of infrastructures in the client's infrastructure that are adapted to the system to be evaluated is determined; based on the number of adapted infrastructures and the client evaluation criteria, the maturity level of the client is determined; based on the maturity level of the client and the level scoring criteria, the maturity score of the client is determined.

[0014] In another possible implementation, the client evaluation criteria include:

[0015] When the number of adapted infrastructures is less than or equal to a first preset value, the maturity level of the client is a first maturity level;

[0016] When the number of adapted infrastructures is greater than the first preset value and less than or equal to the second preset value, the maturity level of the client is the second maturity level;

[0017] When the number of adapted infrastructures is greater than the second preset value and less than or equal to the third preset value, the maturity level of the client is the third maturity level;

[0018] When the number of adapted infrastructures is greater than the third preset value, the maturity level of the client is the fourth maturity level.

[0019] Based on the above two possible implementation methods, the maturity level of the client can be determined by the number of adapted infrastructures, which can continuously improve the adaptability of the client infrastructure and optimize the client. The maturity level of the client corresponding to the number of adapted infrastructures is configured separately, and the evaluation of the maturity level of the client is more objective, which is applicable to different operators and ensures the fairness and comparability of the evaluation results.

[0020] In another possible implementation, the infrastructure information of the server includes software information and hardware information, the software information is used to indicate the supply source and / or substitutability of software components, and the hardware information is used to indicate the supply source and / or substitutability of hardware components.

[0021] Based on this possible implementation method, it is more objective to evaluate the maturity level of the server based on the infrastructure information of these servers, and it is also beneficial for developers to conduct development research in these areas based on the evaluation results, thereby improving the maturity level of the server.

[0022] In another possible implementation, the infrastructure information of the server and the adaptation information of the client are input into a maturity assessment model to obtain a maturity score of the system to be evaluated; wherein the maturity assessment model is used to evaluate the maturity of the system based on the adaptation information of the client and the infrastructure information of the server; the maturity assessment model is obtained by training a preset model through training samples, the preset model is constructed based on preset evaluation criteria, and the training samples are composed of historical server infrastructure information, historical client adaptation information and historical maturity scores.

[0023] Based on this possible implementation, the maturity score of the system to be evaluated can be determined more accurately and objectively through the model, and the evaluation efficiency is improved.

[0024] In yet another possible implementation, based on the maturity score of the system to be evaluated, a transformation priority corresponding to the system to be evaluated is determined, and there is a negative correlation between the maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated.

[0025] Based on this possible implementation method, human, material, financial and other resources can be allocated more reasonably according to the transformation priority to ensure the efficient progress of the transformation work. For example, by identifying systems with lower maturity scores as high-priority transformation objects, the focus of the transformation work can be clarified to avoid resource dispersion.

[0026] In a second aspect, the present application provides an evaluation device, which includes: an acquisition module and an evaluation module.

[0027] The acquisition module is used to obtain the infrastructure information of the server side and the adaptation information of the client side of the system to be evaluated;

[0028] The evaluation module is used to determine the maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria; wherein the adaptation information of the client is used to indicate the adaptation status of the infrastructure in the client and the system to be evaluated.

[0029] In a possible implementation, the preset evaluation criteria include a server evaluation criteria and a client evaluation criteria, and the evaluation module is specifically used to:

[0030] Determine the maturity score of the server based on the server's infrastructure information, server evaluation criteria and grade scoring criteria; the server evaluation criteria are used to indicate the maturity levels corresponding to different infrastructure information in the server;

[0031] Determine the maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard; the client evaluation standard is used to indicate the maturity level corresponding to different adaptation information of the client;

[0032] Determine the maturity score of the system to be evaluated based on the maturity score of the server and the maturity score of the client;

[0033] Among them, the grade scoring standard is used to indicate the maturity scores corresponding to different maturity levels.

[0034] In another possible implementation, the evaluation module is specifically used to:

[0035] Based on the adaptation information of the client, determine the number of infrastructures in the client's infrastructure that are adapted to the system to be evaluated;

[0036] Determine the maturity level of the client based on the number of adapted infrastructures and client evaluation criteria;

[0037] Based on the maturity level of the client and the level scoring criteria, a maturity score for the client is determined.

[0038] In another possible implementation, the client evaluation criteria include:

[0039] When the number of adapted infrastructures is less than or equal to a first preset value, the maturity level of the client is a first maturity level;

[0040] When the number of adapted infrastructures is greater than the first preset value and less than or equal to the second preset value, the maturity level of the client is the second maturity level;

[0041] When the number of adapted infrastructures is greater than the second preset value and less than or equal to the third preset value, the maturity level of the client is the third maturity level;

[0042] When the number of adapted infrastructures is greater than the third preset value, the maturity level of the client is the fourth maturity level.

[0043] In another possible implementation, the infrastructure information of the server includes software information and hardware information, the software information is used to indicate the supply source and / or substitutability of software components, and the hardware information is used to indicate the supply source and / or substitutability of hardware components.

[0044] In yet another possible implementation, the evaluation module is further configured to:

[0045] The infrastructure information of the server and the adaptation information of the client are input into the maturity assessment model to obtain the maturity score of the system to be evaluated; wherein the maturity assessment model is used to evaluate the maturity of the system based on the adaptation information of the client and the infrastructure information of the server; the maturity assessment model is obtained by training a preset model through training samples, and the preset model is constructed based on preset evaluation standards, and the training samples are composed of historical server infrastructure information, historical client adaptation information and historical maturity scores.

[0046] In yet another possible implementation, the evaluation module is further configured to:

[0047] Based on the maturity score of the system to be evaluated, the transformation priority corresponding to the system to be evaluated is determined, and there is a negative correlation between the maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated.

[0048] In a third aspect, an electronic device is provided, comprising: a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program instructions executable by the processor; and the processor implements the method of the first aspect and any possible implementation method when executing the computer program instructions.

[0049] In a fourth aspect, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed on an electronic device (such as a computer or an evaluation device), the method of the first aspect and any possible implementation method is implemented.

[0050] In a fifth aspect, a computer program product is provided, which includes computer program instructions, and when the computer program instructions are executed, the method of the first aspect and any possible implementation manner described above is implemented.

[0051] The specific description of the second to fifth aspects and their various implementations in this application can refer to the detailed description of the first aspect and its various implementations. The beneficial effects of the second to fifth aspects and their various implementations can refer to the beneficial effect analysis of the first aspect and its various implementations, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 Schematic diagram of four "TD" and four "reuse" provided in the embodiment of the present application;

[0054] Figure 2 A schematic diagram of the composition of an evaluation system provided in an embodiment of the present application;

[0055] Figure 3 A schematic diagram of the composition of an electronic device provided in an embodiment of the present application;

[0056] Figure 4 A schematic diagram of a flow chart of an evaluation method provided in an embodiment of the present application;

[0057] Figure 5 A schematic diagram of another evaluation method provided in an embodiment of the present application;

[0058] Figure 6 A maturity assessment composition diagram of a system to be assessed provided in an embodiment of the present application;

[0059] Figure 7 A schematic diagram of the structure of an evaluation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0061] It should be noted that, in the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0062] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. are used to distinguish the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first", "second", etc. are not limiting the quantity and execution order.

[0063] With the development of science and technology, the information technology application innovation industry has gradually become the foundation of data security and network security. Adhering to innovation has gradually become the core position in the overall modernization construction of our country. The dependence of various organizations on application systems has increased day by day, and system security risk issues have received widespread attention. Among them, Xinchuang products mainly refer to products and services that are basically independently developed in China, have relatively complete intellectual property rights, and have a high degree of independent control over key core technologies and industrial chains.

[0064] At present, telecom operators are facing many challenges in promoting the transformation to ICT. First, ICT technology involves multiple fields such as basic hardware, basic software, application software and information security, with high technical complexity and great difficulty in operation and maintenance. Secondly, since ICT technology is not yet fully mature, there is still a gap compared with the international advanced level, which may lead to compatibility and performance bottlenecks in actual applications. In addition, in the process of ICT transformation, operators lack unified evaluation standards and quantitative methods, making it difficult to accurately evaluate the maturity and transformation effect of ICT application systems, which in turn affects strategic decision-making and resource allocation.

[0065] Through communication and research, we studied the situation in some fields and the financial industry, and drew on them in the subsequent standard system construction methodology.

[0066] For some fields, the catalog of my country's independent innovation products issued by the Ministry of Industry and Information Technology serves as an authoritative guide, and adopts the core substitution, limited substitution, and step-by-step promotion strategies to carry out work. It has been clearly stated that "comprehensive TD" is not "all TD", but "core TD, limited TD", and pointed out the four "TD" and four "reuse". Figure 1 As shown, the four "TDs" are personal computers (PCs), servers, databases, and operating systems; the four "reuses" are network equipment, peripherals, storage, and security equipment.

[0067] It can be seen that my country's independent innovation products are classified into four parts: PC, server, database, and operating system, and the risk level is also determined by these four parts.

[0068] In the financial sector, similar to the telecommunications industry, there is no officially released catalog of my country's independent innovation products as a guide. The certification and testing of independent and controllable products in the financial sector is mainly undertaken by the People's Bank of China, and Chengfang Jinke is responsible for testing and maintenance of the company's internal directory. The compilation principle is to use the catalog of my country's independent innovation products as a basis, and select products with good performance, good compatibility, and adaptation to business scenarios through testing and verification methods. At the same time, the idea of ​​promoting independent and controllable work in the financial sector is to start from office scenarios and gradually expand to general business and core business areas.

[0069] In summary, we attach great importance to network security and informatization, which puts forward a high degree of autonomy and controllability requirements for the systems, products and data within each company. In the process of building big data infrastructure for telecom operators, strengthening the construction of information innovation capabilities has become an important part of it, and it is particularly important to carry out systematic and comprehensive information technology application innovation application system maturity assessment research.

[0070] Currently, there is a lack of unified evaluation standards and models for the maturity of operators' ICT application systems in the market, which makes it difficult to compare and reference the evaluation results horizontally. Moreover, the evaluation methods mostly rely on qualitative analysis, lack quantitative indicators and scientific evaluation models, and it is difficult to accurately reflect the true maturity and transformation effect of the system. The ICT application systems of different operators are unique, and existing evaluation methods often ignore these differences, resulting in a lack of pertinence and practicality in the evaluation results.

[0071] In view of this, the present application provides an evaluation method, which provides a comprehensive and accurate evaluation method for the maturity of the system, and realizes the quantitative evaluation of the maturity of the system (such as the information innovation application system). And the maturity score of the system to be evaluated is determined based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria. Among them, the adaptation information of the client is used to indicate the adaptation of the infrastructure in the client and the system to be evaluated, so that the maturity evaluation results are fair, the accuracy and reliability of the maturity evaluation results are improved, and the guidance reference is provided for the transformation priority of the business application system. In addition, this method is applicable to the systems to be evaluated under different operators, ensuring the comparability of the maturity evaluation results of different systems to be evaluated.

[0072] This application comprehensively considers domestic industry maturity, relevant policies, supply chain and other factors, and implements overall maturity downgrade and maturity reduction for maturity items that affect business continuity. The maturity assessment system for business applications (i.e. the system to be assessed below) can be decomposed into four stages:

[0073] 1. Selection of business application maturity assessment modules. Assessment modules refer to the module selection of key infrastructure of the business system, mainly including central processing unit (CPU), operating system, database, middleware, browser, etc.

[0074] 2. Business application maturity data collection and analysis: Collection and analysis refers to the assessment implementer determining the scope and magnitude of the collected data based on the specific company and application system situation to form a usable data set.

[0075] 3. Quantification of business application maturity assessment indicators. Indicator quantification means that the assessment implementer combines the actual situation of each application system indicator and scores and rates the system according to the assessment model and the weight of each parameter.

[0076] 4. Analysis of business application maturity assessment results. Result analysis means that the assessment implementer draws the assessment results based on the quantitative results of the assessment indicators, corresponds to each assessment level, and conducts quantitative analysis of the results.

[0077] Combined with the above evaluation system, Figure 2 The following is a schematic diagram of the composition of an evaluation system provided in an embodiment of the present application. Figure 2 The system includes: a data source module 100 and an evaluation module 200. The data source module 100 and the evaluation module 200 may be connected via a wired network or a wireless network.

[0078] The data source module 100 can be a computing device with computing processing functions such as a computer or a server. Among them, the server can be a single server, or it can also be a server cluster composed of multiple servers. In some implementations, the server cluster can also be a distributed cluster. Optionally, the server can also be implemented on a cloud platform. For example, the cloud platform can include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, and a multi-cloud, or any combination thereof.

[0079] The data source module 100 can be used to obtain infrastructure information of the server side and adaptation information of the client side of the system to be evaluated.

[0080] In some embodiments, the data source module 100 can collect and analyze data based on the specific company and application system conditions, determine the scope and magnitude of the collected data, and form a usable data set.

[0081] The specific form of the evaluation module 200 can refer to the above-mentioned data source module 100, which will not be repeated here.

[0082] The evaluation module 200 can be used to determine the maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria. The specific evaluation process can refer to the evaluation method provided in the following method embodiment or example, which will not be repeated here.

[0083] It should be noted that the above Figure 2 In the example, the data source module 100 and the evaluation module 200 are independent modules. Optionally, the data source module 100 and the evaluation module 200 can also be integrated. That is, the data source module 100 or its corresponding function, and the evaluation module 200 or its corresponding function can be integrated in one module. For example, a data source module with an evaluation function. The embodiment of the present application does not limit this. The execution subject of the evaluation method provided in the embodiment of the present application is the above-mentioned evaluation module 200. As above, the evaluation module 200 can be an electronic device with a computing and processing function such as a computer or a server. Optionally, the evaluation module 200 can also be a processor (such as a CPU) of the aforementioned electronic device; or, the evaluation module 200 can also be an application (application, APP) with an evaluation function installed in the aforementioned electronic device; or, the evaluation module 200 can also be a software system or platform deployed in the electronic device described later; or, the evaluation module 200 can also be a functional module with an evaluation function in the aforementioned electronic device, etc. For example, the evaluation module refers to the module selection of the key infrastructure of the business system, and the evaluation module 200 can include a CPU, an operating system, a database, a middleware, a browser, etc. This embodiment of the present application is not limited to this.

[0084] It is understandable that the evaluation system provided by the present application may include other modules in addition to the above modules, such as an evaluation result analysis module, which is used to correspond to each evaluation level according to the maturity score of the system to be evaluated calculated by the evaluation module 200 and perform quantitative analysis of the results.

[0085] For the sake of simplicity, the evaluation method provided in the embodiments of the present application is introduced below using an electronic device as an example.

[0086] Figure 3 The following is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application. Figure 3 As shown, the electronic device may include: a processor 10 , a memory 20 , a communication line 30 , a communication interface 40 , and an input / output interface 50 .

[0087] The processor 10 , the memory 20 , the communication interface 40 and the input / output interface 50 may be connected via a communication line 30 .

[0088] The processor 10 is used to execute the instructions stored in the memory 20 to implement the evaluation method provided in the following embodiments of the present application. The processor 10 can be a CPU, a general-purpose processor network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller (MCU) / single chip microcomputer / single chip microcomputer, a programmable logic device (PLD) or any combination thereof. The processor 10 can also be any other device with processing functions, such as a circuit, a device or a software module, which is not limited in the embodiments of the present application. In one example, the processor 10 may include one or more CPUs, such as Figure 3 As an optional implementation, the electronic device may include multiple processors, for example, in addition to the processor 10, it may also include a processor 60 ( Figure 3 The dashed line is used as an example.

[0089] The memory 20 is used to store instructions. For example, the instructions may be computer programs. Optionally, the memory 20 may be a read-only memory (ROM) or other types of static storage devices that can store static information and / or instructions, or a random access memory (RAM) or other types of dynamic storage devices that can store information and / or instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage devices, etc., and the embodiments of the present application are not limited to this.

[0090] It should be noted that the memory 20 may exist independently of the processor 10, or may be integrated with the processor 10. The memory 20 may be located inside the electronic device, or may be located outside the electronic device, which is not limited in the embodiment of the present application.

[0091] The communication line 30 is used to transmit information between various components included in the electronic device.

[0092] The communication interface 40 is used to communicate with other devices or other communication networks. The other communication networks may be Ethernet, radio access network (RAN), wireless local area network (WLAN), etc. The communication interface 40 may be a module, a circuit, a transceiver or any device capable of achieving communication.

[0093] It should be noted that Figure 3 The structure shown in the figure does not constitute a limitation on the electronic device, except Figure 3 In addition to the components shown, the electronic device may include more or fewer components than shown (eg, only the processor 10 and the memory 20 ), or a combination of certain components, or a different arrangement of components.

[0094] The following is an introduction to the evaluation method provided in the embodiments of the present application.

[0095] Figure 4 A schematic diagram of a flow chart of an evaluation method provided in an embodiment of the present application. Figure 4 As shown, the evaluation method includes:

[0096] S101: Obtain infrastructure information of the server side and adaptation information of the client side of the system to be evaluated.

[0097] The adaptation information of the client is used to indicate the adaptation status of the infrastructure in the client and the system to be evaluated. The client may also be referred to as a terminal, which is not limited in the present disclosure.

[0098] In some embodiments, the adaptation information of the client includes hardware adaptation information and software adaptation information. The hardware adaptation information is used to indicate whether the hardware of the client is adapted to the system to be evaluated. The software adaptation information is used to indicate whether the software of the client is adapted to the system to be evaluated.

[0099] The client hardware may include a client processor, and the client software may include a client operating system (OS) and / or a client browser.

[0100] It is understandable that the adaptation information of the client may be information entered in advance by the business personnel.

[0101] The infrastructure information of the server side can be used to characterize the autonomous provisioning capability and development maturity of the infrastructure of the server side.

[0102] In some embodiments, the server-side infrastructure includes server-side hardware and server-side software, and the server-side infrastructure information includes software information and hardware information. The software information is used to indicate the supply source and / or substitutability of software components, and the hardware information is used to indicate the supply source and / or substitutability of hardware components.

[0103] The server hardware may include a server processor. The server software may include at least one of the following: a server operating system, a server database (DB), and a server middleware (MW).

[0104] Exemplarily, the systems to be evaluated for maturity under the telecom operator include three categories: comprehensive office system, business management system and production operation system.

[0105] Among them, the integrated office system: a system that supports daily office and management activities, shares information and resources with other departments, and provides various functions to support internal operations of the enterprise.

[0106] Business management system: A system that supports the business activities of telecom operators, helps manage customer and partner relationships, implements sales and marketing, and monitors business operations and makes decisions.

[0107] Production and operation system: a system that supports the core business operations of telecom operators and is related to the stable operation of telecom networks, including key functions such as billing and settlement.

[0108] It is understandable that the system to be evaluated may have other names, such as object to be evaluated, business application, etc., and this application does not limit this.

[0109] S102: Determine a maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client, and preset evaluation criteria.

[0110] In some embodiments, the infrastructure information of the server and the adaptation information of the client are input into a maturity assessment model to obtain a maturity score of the system to be evaluated; wherein the maturity assessment model is used to evaluate the maturity of the system based on the adaptation information of the client and the infrastructure information of the server; the maturity assessment model is obtained by training a preset model through training samples, the preset model is constructed based on preset evaluation criteria, and the training samples are composed of historical server infrastructure information, historical client adaptation information and historical maturity scores.

[0111] In some embodiments, Figure 5 As shown, in the case where the preset evaluation criteria include the server evaluation criteria and the client evaluation criteria, step S102 can be implemented as the following steps:

[0112] S201. Determine a maturity score of the server based on the server's infrastructure information, server evaluation criteria, and grade scoring criteria.

[0113] The server-side evaluation criteria are used to indicate the maturity levels corresponding to different infrastructure information in the server. The grade scoring criteria are used to indicate the maturity scores corresponding to different maturity levels. The infrastructure in the present disclosure may also have other names, such as modules, which are not limited in the present disclosure.

[0114] In some embodiments, the maturity level of the server's infrastructure is determined based on the server's infrastructure information and the server's evaluation standards and grade scoring standards; the maturity score of the server's infrastructure is determined based on the maturity level of the server's infrastructure and grade scoring standards; the maturity score of the server is determined based on the maturity score of the server's infrastructure.

[0115] In some embodiments, the maturity score of the service end is equal to the weighted sum of the maturity scores of the infrastructure of the service end.

[0116] In some embodiments, the infrastructure of the server includes hardware and software, the infrastructure information of the server includes hardware information and software information, and the maturity score of the server is determined based on the infrastructure information of the server, the server evaluation criteria and the grade scoring criteria, including:

[0117] Determine the maturity level of the server-side hardware based on the hardware information and maturity assessment criteria;

[0118] Determine the maturity level of the server-side software based on software information and maturity assessment criteria;

[0119] Determine the maturity score of the server-side hardware based on the maturity level and level scoring criteria of the server-side hardware;

[0120] Determine the maturity rating of the server-side software based on the maturity rating and rating criteria of the server-side software;

[0121] The maturity score of the server's hardware and the maturity score of the server's software are weightedly summed to obtain the maturity score of the server.

[0122] For example, when conducting maturity assessment of information systems in the communications industry, the assessment is mainly conducted from the perspectives of usability maturity, data security, product compliance, etc. of business application systems. The software and hardware of a key infrastructure product are assessed to determine the maturity level of the product.

[0123] Exemplarily, Table 1 provides a maturity evaluation standard, including maturity levels corresponding to different hardware information and maturity levels corresponding to different software information. The maturity levels are M1-M5 from low to high, with M1 being the lowest maturity and M5 being the highest maturity.

[0124] Table 1

[0125]

[0126]

[0127] For example, Figure 6 A maturity assessment composition diagram of a system to be assessed is provided for this application. Figure 6 As shown, the maturity score of the system to be evaluated is determined based on the maturity score of the client and the maturity score of the server. The maturity score of the server is determined based on the maturity scores of four infrastructures (also called modules), namely, the maturity score of the server processor, the maturity score of the server operating system, the maturity score of the server database, and the maturity score of the server middleware.

[0128] For example, the maturity score of the service side is equal to the sum of the maturity scores of the four infrastructures. The calculation method is shown in formula (1):

[0129] Y=Y CPU +Y OS +Y DB +Y MW Formula (1)

[0130] Among them, Y CPU Score the maturity of the server processor; Y OS Score the maturity of the server operating system; Y DB Score the maturity of the server database; Y MW Rate the maturity of server-side middleware.

[0131] It is understandable that if a server-side infrastructure (such as a server-side processor, server-side operating system, server-side database or server-side middleware) uses multiple products (or components), the maturity score of the infrastructure is equal to the maturity score of the lowest maturity product (or component) used by the infrastructure. Products (or components) of the same maturity level of different infrastructures have the same maturity score.

[0132] Each infrastructure on the server side has five maturity levels (i.e., M1-M5 in Table 1), and different maturity levels correspond to different maturity scores, namely: M1 is the maturity score corresponding to the minimum maturity, Y M2is the maturity score corresponding to low maturity, Y M3 is the maturity score corresponding to medium maturity, Y M4 is the maturity score corresponding to high maturity, Y M5 is the maturity score corresponding to the highest maturity. (M can be CPU, OY, DB, MW respectively).

[0133] S202: Determine a maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard.

[0134] The adaptation information of the client is used to indicate the adaptation of the infrastructure in the client and the system to be evaluated. The client evaluation standard is used to indicate the maturity level corresponding to different adaptation information of the client. The grade scoring standard is used to indicate the maturity score corresponding to different maturity levels. The grade scoring standard here can be different from the grade scoring standard on the side of step S201, and can be set in advance based on different scenarios.

[0135] In some embodiments, based on the adaptation information of the client, the number of infrastructures in the client's infrastructure that are adapted to the system to be evaluated is determined; based on the number of adapted infrastructures and the client evaluation criteria, the maturity level of the client is determined; based on the maturity level of the client and the level scoring criteria, the maturity score of the client is determined.

[0136] In some embodiments, the client evaluation criteria include:

[0137] When the number of adapted infrastructures is less than or equal to a first preset value, the maturity level of the client is a first maturity level;

[0138] When the number of adapted infrastructures is greater than the first preset value and less than or equal to the second preset value, the maturity level of the client is the second maturity level;

[0139] When the number of adapted infrastructures is greater than the second preset value and less than or equal to the third preset value, the maturity level of the client is the third maturity level;

[0140] When the number of adapted infrastructures is greater than the third preset value, the maturity level of the client is the fourth maturity level.

[0141] It is understandable that the more infrastructures adapted in the client, the higher the maturity level of the client. Therefore, the maturity levels from low to high are: first maturity level, second maturity level, third maturity level, and fourth maturity level.

[0142] For example, continue to refer to Figure 6As shown, the maturity score of the system to be evaluated is determined based on the maturity score of the client and the maturity score of the server. The maturity score of the client can be determined based on the adaptation of three infrastructures (also called modules), namely, the adaptation of the client processor, the adaptation of the client operating system, and the adaptation of the client browser.

[0143] For example, the maturity level of the client is determined based on the adaptation of the three infrastructures, and the calculation method is shown in formula (2):

[0144] X=X CPU +X OS +X BR Formula (2)

[0145] Among them, X CPU Client processor adaptation; X OS The client operating system adaptation status; X BR The client browser is adapted.

[0146] Among them, the adaptation status of each client infrastructure (including client processor, client operating system and browser) is the adaptation status of the lowest maturity product (or component) used by the infrastructure.

[0147] The client has 5 maturity levels (i.e., M1-M5 as mentioned above), and different maturity levels correspond to different maturity scores, i.e., X M1 is the maturity score corresponding to the minimum maturity, X M2 is the maturity score corresponding to low maturity, X M3 is the maturity score corresponding to medium maturity, X M4 is the maturity score corresponding to high maturity, X M5 Give the maturity score corresponding to the highest maturity.

[0148] If the client processor, client operating system, and browser are all not adapted, the client's maturity level is the lowest maturity (M1); if only one of the three is adapted, the client's maturity level is low maturity (M2); if two of the three are adapted, the client's maturity level is high maturity (M4); the maturity level of the client that is fully adapted is the highest maturity (M5).

[0149] It is understandable that the maturity scoring method of the client side can also refer to the maturity scoring method of the server side. For example, based on the client side hardware information and maturity evaluation criteria, the maturity level of the client side hardware is determined; based on the client side software information and maturity evaluation criteria, the maturity level of the client side software is determined; based on the maturity level of the client side hardware, the maturity level of the client side software and the level scoring criteria, the maturity score of the client side of the system to be evaluated is determined.

[0150] S203: Determine the maturity score of the system to be evaluated based on the maturity score of the server and the maturity score of the client.

[0151] In some embodiments, the maturity score of the system to be evaluated is a weighted sum of the maturity score of the server and the maturity score of the client.

[0152] Illustratively, Table 2 provides a rating standard (ie, a quantitative rating for each maturity level), and different maturity levels correspond to different maturity ratings.

[0153] Table 2

[0154] Serial number Maturity Level Maturity Rating 1 Minimum maturity (M1) 0 2 Low maturity (M2) 5 3 Medium maturity (M3) 10 4 High maturity (M4) 15 5 Highest maturity (M5) 20

[0155] Combined with the above examples, the following rules are used to quantify the application maturity of the system to be evaluated:

[0156] (1) The score is based on a percentage system, with the lowest maturity score of the system to be evaluated being 0 and the highest maturity score of the system to be evaluated being 100.

[0157] (2) The maturity score of the system to be evaluated using low-maturity modules is higher than the maturity score of the system to be evaluated using high-maturity modules.

[0158] (3) The minimum maturity score of the system to be evaluated is 0. That is, the minimum maturity score of the system to be evaluated = maxY CPU1 +maxY OS1 +maxY DB1 +maxY MW1 +X=4Y M1 +X M1 =0.

[0159] (4) The maximum maturity score of the system to be evaluated is 100 points. That is, the maximum maturity score of the system to be evaluated = maxY CPU5 +maxY OS5 +maxY DB5 +maxY MW5 +X=4Y M5 +X M5 =100.

[0160] (5) The minimum maturity score of the system to be evaluated using the highest maturity module is 20 points, which is Y M5 (Y M5 +3Y M1 +X M1 ), the maximum maturity score of the system to be evaluated using the low maturity module is 25, which is 4Y M2 +X M2 .

[0161] In some embodiments, based on the maturity score of the system to be evaluated, the transformation priority corresponding to the system to be evaluated is determined, and there is a negative correlation between the maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated.

[0162] Exemplarily, in combination with the above examples and embodiments, the system to be evaluated is graded according to its maturity score, and the system to be evaluated is divided into five maturity levels (i.e., level I to level V). Based on the maturity level, the system to be evaluated with a low maturity level is transformed first to improve the transformation efficiency and accelerate the maturity improvement.

[0163] As shown in Table 3, the following rating principles are used to rate the maturity of the system to be evaluated:

[0164] The maturity score of the system to be evaluated is 0 points, which is a maturity level I system. That is, the server and client modules of the system to be evaluated are all at the lowest maturity level;

[0165] The maturity score of the system to be evaluated is 0-40 points, which is a Level II maturity system;

[0166] The maturity score of the system to be evaluated is 40-60 points, which is a Level III maturity system;

[0167] The maturity score of the system to be evaluated is 60-100 points, which is a Level IV maturity system;

[0168] The maturity score of the system to be evaluated is 100 points, which is a V-level maturity system. That is, the server and client modules of the system to be evaluated are all at the highest maturity level.

[0169] Table 3

[0170] Maturity Rating Maturity Level Renovation Priority 0 Level I Super [0，40] Level II high (40，60) Level III middle [60,100] Level IV Low 100 V-Class none

[0171] For example, the following is an example of a maturity assessment process for this application, which mainly includes four stages: assessment preparation, indicator system configuration, assessment implementation, and report preparation.

[0172] 1. Assessment Preparation

[0173] Assessment preparation work can be carried out according to the process of determining the purpose, determining the objects, and establishing the organization.

[0174] (1a) Determine the purpose of the assessment

[0175] The main assessment objectives include:

[0176] 1) Identify the key assets of the information system from the perspective of the telecom operator’s own system and data management.

[0177] 2) From the perspective of telecommunications operator security maturity assessment, clarify the assessment maturity and identify possible threats and vulnerabilities.

[0178] 3) From the perspective of communications industry management, determine the maturity level, classify and rate security maturity, determine the severity of maturity, and provide specific and actionable recommendations and measures.

[0179] (1b) Determine the evaluation object: According to the evaluation purpose, refer to the above embodiments or examples to select the evaluation object and content.

[0180] (1c) Establish an evaluation organization: Based on the evaluation purpose and evaluation object, clearly define the responsible and cooperating parties for each link and output of the evaluation preparation, indicator system configuration, and implementation process.

[0181] 2. Index system configuration

[0182] According to the specific circumstances of the evaluation purpose and object, determine the evaluation indicators, determine the indicator calculation method, and configure the weights.

[0183] (2a) Configuring evaluation indicators

[0184] Select appropriate evaluation indicators and evaluation content, which can be dynamically adjusted and expanded according to actual needs.

[0185] (2b) Determine the indicator calculation method

[0186] The indicator calculation method refers to the technical method used to check and analyze the data application effect according to the evaluation content, including tool calculation evaluation and manual calculation evaluation. When conditions permit, the calculation of data application effect evaluation indicators should adopt the tool calculation evaluation method.

[0187] (2c) Configuring indicator weights

[0188] The key product weight settings can be adjusted according to your own business characteristics and needs.

[0189] 3. Evaluation Implementation

[0190] The selected indicators are summarized and calculated according to the actual situation, and the indicator results are analyzed and evaluated, and finally an evaluation report is formed.

[0191] (3a) Calculation and summary of indicators

[0192] Verify and evaluate the maturity of business applications based on pre-configured rules and methods, convert the evaluation results of the rules into grades or score segments, and derive an overall score based on the evaluation model.

[0193] Taking system A as an example, if the system uses the server processor CPU: X86-Intel, the server operating system is centos7, the server database is: Mysql, the server middleware is: Redis, the client processor is: Feiteng ARM, the client operating system is: Kylin OS, and the client browser is: Qi'anxin Security Browser.

[0194] Combining the above examples and comparing Table 1 and Table 2, it can be determined that the server-side processor and server-side database are both at the lowest maturity level M1, with a maturity score of 0; the server-side middleware is at a low maturity level M2, with a maturity score of 5; the client-side processor, client-side operating system, and client-side browser are all adapted, so the client-side maturity level is at the highest maturity level M5, with a maturity score of 20. The detailed scores are shown in Table 4.

[0195] Table 4

[0196]

[0197] (3b) Preparation of reports

[0198] Combined with the quantitative scoring of business system maturity, a final assessment recommendation report is formed for the relevant departments or project teams to implement and establish a maturity assessment mechanism. The report content should include but not be limited to: organizational and data overview, assessment purpose, assessment object, assessment criteria, assessment benchmark date, assessment indicators, assessment implementation status, and assessment conclusions.

[0199] At the same time, maturity assessments are conducted regularly, compared with the best practices of related industries, and the maturity assessment model is continuously improved to ensure the continuous operation of business applications.

[0200] Based on this, a comprehensive and accurate evaluation method is provided for the maturity of the system, and a quantitative evaluation of the maturity of the system (such as the information and innovation application system) is realized. Moreover, the maturity score of the system to be evaluated is determined based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria. Among them, the adaptation information of the client is used to indicate the adaptation of the infrastructure in the client and the system to be evaluated, so that the maturity evaluation results are fair, the accuracy and reliability of the maturity evaluation results are improved, and a guiding reference is provided for the transformation priority of the business application system. In addition, this method is applicable to the systems to be evaluated under different operators, ensuring the comparability of the maturity evaluation results of different systems to be evaluated.

[0201] In addition, this application achieves a breakthrough from 0 to 1, solving the problem of establishing an independent and controllable product maturity assessment system for operators. Building a maturity assessment system for telecom operators' trust-based innovation products can be used to guide telecom operators' trust-based innovation product maturity assessment work, and can solve problems such as unclear maturity levels of operator products, difficulty in quantifying maturity levels, and unclear replacement priorities. It can specifically build a set of product maturity level models with visualization, manageability, scalability, security, reliability, and real-time characteristics, moving towards digitalization and informatization, and gradually moving closer to trust-based innovation.

[0202] It is understandable that the above method can be implemented by an evaluation device. In order to implement the above functions, the evaluation device includes a hardware structure or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments applied for herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0203] The embodiment of the present application can divide the functional modules of the above-mentioned evaluation device etc. according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0204] In the case of dividing each functional module into corresponding functional modules, Figure 7 FIG. 1 shows a possible structural diagram of the evaluation device involved in the above embodiment. Figure 7As shown, the evaluation device 600 includes: an acquisition module 601 and an evaluation module 602 .

[0205] The acquisition module 601 is used to acquire the infrastructure information of the server side and the adaptation information of the client side of the system to be evaluated;

[0206] The evaluation module 602 is used to determine the maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria; wherein the adaptation information of the client is used to indicate the adaptation status of the infrastructure in the client and the system to be evaluated.

[0207] In some embodiments, the preset evaluation criteria include a server evaluation criteria and a client evaluation criteria, and the evaluation module 602 is specifically used to:

[0208] Determine the maturity score of the server based on the server's infrastructure information, server evaluation criteria and grade scoring criteria; the server evaluation criteria are used to indicate the maturity levels corresponding to different infrastructure information in the server;

[0209] Determine the maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard; the client evaluation standard is used to indicate the maturity level corresponding to different adaptation information of the client;

[0210] Determine the maturity score of the system to be evaluated based on the maturity score of the server and the maturity score of the client;

[0211] Among them, the grade scoring standard is used to indicate the maturity scores corresponding to different maturity levels.

[0212] In some embodiments, the evaluation module 602 is specifically configured to:

[0213] Based on the adaptation information of the client, determine the number of infrastructures in the client's infrastructure that are adapted to the system to be evaluated;

[0214] Determine the maturity level of the client based on the number of adapted infrastructures and client evaluation criteria;

[0215] Based on the maturity level of the client and the level scoring criteria, a maturity score for the client is determined.

[0216] In some embodiments, the client evaluation criteria include:

[0217] When the number of adapted infrastructures is less than or equal to a first preset value, the maturity level of the client is a first maturity level;

[0218] When the number of adapted infrastructures is greater than the first preset value and less than or equal to the second preset value, the maturity level of the client is the second maturity level;

[0219] When the number of adapted infrastructures is greater than the second preset value and less than or equal to the third preset value, the maturity level of the client is the third maturity level;

[0220] When the number of adapted infrastructures is greater than the third preset value, the maturity level of the client is the fourth maturity level.

[0221] In some embodiments, the infrastructure information of the server includes software information and hardware information, the software information is used to indicate the supply source and / or substitutability of software components, and the hardware information is used to indicate the supply source and / or substitutability of hardware components.

[0222] In some embodiments, the evaluation module 602 is further configured to:

[0223] The infrastructure information of the server and the adaptation information of the client are input into the maturity assessment model to obtain the maturity score of the system to be evaluated; wherein the maturity assessment model is used to evaluate the maturity of the system based on the adaptation information of the client and the infrastructure information of the server; the maturity assessment model is obtained by training a preset model through training samples, and the preset model is constructed based on preset evaluation standards, and the training samples are composed of historical server infrastructure information, historical client adaptation information and historical maturity scores.

[0224] In some embodiments, the evaluation module 602 is further configured to:

[0225] Based on the maturity score of the system to be evaluated, the transformation priority corresponding to the system to be evaluated is determined, and there is a negative correlation between the maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated.

[0226] Wherein, the acquisition module 601 is used to obtain the server information and client information of the system to be evaluated;

[0227] An evaluation module 602, for determining a maturity score of a server of a system to be evaluated based on the server information;

[0228] The evaluation module 602 is further used to determine the maturity score of the client of the system to be evaluated based on the client information;

[0229] The evaluation module 602 is further configured to determine the maturity score of the system to be evaluated based on the maturity score of the server of the system to be evaluated and the maturity score of the client of the system to be evaluated.

[0230] In some embodiments, the server information includes hardware information and software information, and the evaluation module 602 is specifically used to:

[0231] Determine the maturity level of the server-side hardware based on the hardware information and maturity assessment criteria;

[0232] Determine the maturity level of the server-side software based on software information and maturity assessment criteria;

[0233] Determine the maturity score of the server side of the system to be evaluated based on the maturity level of the server side hardware, the maturity level of the server side software and the level scoring criteria;

[0234] Among them, the maturity assessment standard includes maturity levels corresponding to different hardware information and maturity levels corresponding to different software information; the grade scoring standard includes maturity scores corresponding to different maturity levels.

[0235] In some embodiments, the client information includes the hardware adaptation information of the client and the software adaptation information of the client. The evaluation module 602 is specifically used to:

[0236] Based on the hardware adaptation information of the client, determine the number of adapted hardware in the client;

[0237] Based on the software adaptation information of the server, determine the number of adapted software in the server;

[0238] Determine the maturity level of the client of the system to be evaluated based on the number of adapted hardware in the client and the number of adapted software in the server;

[0239] The maturity score of the client is determined based on the maturity level of the client and the level scoring criteria, and the level scoring criteria includes maturity scores corresponding to different maturity levels.

[0240] In some embodiments, the evaluation module 602 is specifically configured to:

[0241] When the sum of the number of adapted hardware and the number of adapted software is less than or equal to a first preset value, determining that the maturity level of the client is the lowest maturity level;

[0242] When the sum of the number of adapted hardware and the number of adapted software is greater than a first preset value and less than or equal to a second preset value, determining that the maturity level of the client is a low maturity level;

[0243] When the sum of the number of adapted hardware and the number of adapted software is greater than a second preset value and less than or equal to a third preset value, determining that the maturity level of the client is a high maturity level;

[0244] When the sum of the number of adapted hardware and the number of adapted software is greater than a third preset value, the maturity level of the client is determined to be the highest maturity level.

[0245] In some embodiments, the evaluation module 602 is further configured to:

[0246] Based on the maturity score of the system to be evaluated, the transformation priority corresponding to the system to be evaluated is determined. The maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated are negatively correlated.

[0247] For a more detailed description of the acquisition module 601 and the evaluation module 602, as well as a more detailed description of each technical feature therein and a description of the beneficial effects, etc., please refer to the corresponding method embodiment part above, which will not be repeated here.

[0248] Of course, the evaluation device 600 includes but is not limited to the unit modules listed above. Moreover, the specific functions that can be realized by the above functional units also include but are not limited to the functions corresponding to the method steps of the above examples. The detailed description of other modules of the evaluation device 600 can refer to the detailed description of the corresponding method steps, and the embodiments of the present application will not be repeated here.

[0249] In an exemplary embodiment, the embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to execute the above-mentioned related method steps to implement the method in the aforementioned method embodiment.

[0250] In an exemplary embodiment, the embodiment of the present application further provides a computer-readable storage medium, including software instructions, which, when executed on an electronic device, enables the electronic device to execute any one of the methods provided in the above embodiments.

[0251] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer-executable instructions. When the computer-executable instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer-executable instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer-executable instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more servers that can be integrated with the medium. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0252] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other changes to the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "one" or "an" does not exclude multiple situations. A single processor or other unit can implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0253] Although the present application has been described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely exemplary illustrations of the present application as defined by the appended claims, and are deemed to have covered any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0254] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An evaluation method, characterized in that: The method comprises: Obtain the server-side infrastructure information and client-side adaptation information of the system to be evaluated; Based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria, the maturity score of the system to be evaluated is determined; wherein the adaptation information of the client is used to indicate the adaptation status of the infrastructure in the client and the system to be evaluated.

2. The method according to claim 1, characterized in that The preset evaluation criteria include a server evaluation criteria and a client evaluation criteria; the step of determining the maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client and the preset evaluation criteria includes: Determining the maturity score of the server based on the infrastructure information of the server, the server evaluation criteria and the grade scoring criteria; the server evaluation criteria are used to indicate the maturity levels corresponding to different infrastructure information in the server; Determining the maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard; the client evaluation standard is used to indicate the maturity level corresponding to different adaptation information of the client; Determining the maturity score of the system to be evaluated based on the maturity score of the server and the maturity score of the client; The grade rating standard is used to indicate the maturity ratings corresponding to different maturity grades.

3. The method according to claim 2, characterized in that The determining the maturity score of the client based on the adaptation information of the client, the client evaluation standard and the grade scoring standard includes: Based on the adaptation information of the client, determine the number of infrastructures in the infrastructure of the client that are adapted to the system to be evaluated; Determining a maturity level of the client based on the number of adapted infrastructures and the client evaluation criteria; A maturity score of the client is determined based on the maturity level of the client and the level scoring criteria.

4. The method according to claim 3, characterized in that: The client evaluation criteria include: In the case where the number of adapted infrastructures is less than or equal to a first preset value, the maturity level of the client is a first maturity level; When the number of adapted infrastructures is greater than a first preset value and less than or equal to a second preset value, the maturity level of the client is a second maturity level; When the number of adapted infrastructures is greater than a second preset value and less than or equal to a third preset value, the maturity level of the client is a third maturity level; When the number of adapted infrastructures is greater than a third preset value, the maturity level of the client is a fourth maturity level.

5. The method according to claim 1, characterized in that The infrastructure information of the server includes software information and hardware information, wherein the software information is used to indicate the supply source and / or substitutability of software components, and the hardware information is used to indicate the supply source and / or substitutability of hardware components.

6. The method according to claim 1, characterized in that The step of determining the maturity score of the system to be evaluated based on the infrastructure information of the server, the adaptation information of the client, and a preset evaluation standard includes: The infrastructure information of the server and the adaptation information of the client are input into a maturity assessment model to obtain a maturity score of the system to be assessed; wherein the maturity assessment model is used to assess the maturity of the system based on the adaptation information of the client and the infrastructure information of the server; the maturity assessment model is obtained by training a preset model using training samples, the preset model is constructed based on the preset assessment criteria, and the training samples are composed of historical server infrastructure information, historical client adaptation information and historical maturity scores.

7. The method according to claim 1, characterized in that The method further comprises: Based on the maturity score of the system to be evaluated, a transformation priority corresponding to the system to be evaluated is determined, and there is a negative correlation between the maturity score of the system to be evaluated and the transformation priority corresponding to the system to be evaluated.

8. An electronic device, characterized in that: The electronic device comprises: a processor and a memory; The memory stores instructions executable by the processor; When the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes: computer software instructions; When the computer software instructions are executed in an electronic device, the electronic device is enabled to implement the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is executed, the method according to any one of claims 1 to 7 is implemented.

Images