Processing method and device for evaluating application system monitoring capability and electronic equipment

Abstract

The application provides a processing method and device for evaluating application system monitoring capability and electronic equipment, and relates to the technical field of big data. The method comprises the following steps: in response to an evaluation request for the monitoring capability of an application system, monitoring index data of the application system is acquired, the monitoring index data comprising at least one of application layer monitoring access data, infrastructure layer monitoring access data and monitoring alarm data; at least one of application layer monitoring access score, infrastructure layer monitoring access score and monitoring alarm score is determined according to a preset scoring rule and the monitoring index data; and an evaluation result about the monitoring capability of the application system is obtained according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score. Through the above method, accurate evaluation of the monitoring capability of the application system can be realized.

Description

Technical Field

[0001] This application relates to the field of big data technology, and in particular to a processing method, apparatus, and electronic device for evaluating the monitoring capabilities of application systems. Background Technology

[0002] As banking operations become increasingly complex and technology stacks are constantly updated and upgraded, the content and methods of monitoring application systems are becoming more and more intricate. This complexity makes the overall assessment of monitoring capabilities increasingly difficult, placing enormous pressure on operations and maintenance personnel. If the monitoring access strategy for an application system is not comprehensive enough, it can easily lead to incidents and thus pose significant risks.

[0003] Current assessments of application system monitoring capabilities primarily focus on application performance and system monitoring (e.g., evaluating only application performance monitoring metrics), often neglecting a more comprehensive consideration of the overall monitoring capabilities of the application system. This results in incomplete and inaccurate assessments of application system monitoring capabilities. Summary of the Invention

[0004] This application provides a processing method, apparatus, and electronic device for evaluating the monitoring capabilities of an application system, in order to solve one of the aforementioned technical problems.

[0005] In a first aspect, this application provides a processing method for evaluating the monitoring capabilities of an application system, comprising: responding to an evaluation request for the monitoring capabilities of the application system, obtaining monitoring indicator data of the application system, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data; determining at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score according to preset scoring rules and the monitoring indicator data; and obtaining an evaluation result regarding the monitoring capabilities of the application system based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score.

[0006] In one possible implementation, obtaining the monitoring metric data of the application system includes: obtaining the monitoring access method of the application system based on the monitoring access dimension, wherein the monitoring access method includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring; obtaining the monitoring object data of the application system based on the monitoring object dimension, wherein the monitoring object data includes at least one of the following: partition monitoring, site monitoring, and POD node monitoring; obtaining the data flow monitoring metrics of the application system based on the monitoring data flow metric dimension, wherein the data flow monitoring metrics include at least one of the following: transaction volume, response time, and process; and obtaining the application layer monitoring access data based on at least one of the monitoring access method, the monitoring object, and the monitoring data flow metrics.

[0007] In one possible implementation, obtaining the monitoring indicator data of the application system includes: collecting the technology stack adopted by the infrastructure layer of the application system, the technology stack including at least one of the following: platform resource layer, physical resource layer and virtual resource layer; obtaining the monitoring access data of the technology stack, and obtaining the monitoring access data of the infrastructure layer based on the monitoring access data.

[0008] In one possible implementation, acquiring the monitoring access data of the technology stack includes: acquiring platform resource layer access data based on the platform resource layer dimension, wherein the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; acquiring physical resource layer access data based on the physical resource layer dimension, wherein the physical layer access data includes at least one of the following: storage monitoring data, load balancing monitoring data, and network device monitoring data; and acquiring virtual resource layer access data based on the virtual resource layer dimension, wherein the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

[0009] In one possible implementation, obtaining the monitoring indicator data of the application system includes: collecting the monitoring alarm levels, monitoring alarm rules, and alarm monitoring platform display information of the application system; and obtaining the monitoring alarm data based on the monitoring alarm levels, the monitoring alarm rules, and the alarm monitoring platform display information.

[0010] In one possible implementation, the scoring rules include score configuration information set for each monitoring indicator data, the score configuration information being determined based on the disaster recovery level; determining at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score according to the preset scoring rules and the monitoring indicator data includes: configuring a first score for each data item in the application layer monitoring access data according to the score configuration information of the application layer monitoring access data, and obtaining the application layer monitoring access score based on the first score;

[0011] Based on the score configuration information of the infrastructure layer monitoring access data, a second score is configured for each data item in the infrastructure layer monitoring access data, and the infrastructure layer monitoring access score is obtained based on the second score; based on the score configuration information of the monitoring alarm data, a third score is configured for each data item in the monitoring alarm data, and the monitoring alarm score is obtained based on the third score.

[0012] In one possible implementation, obtaining the evaluation result of the application system's monitoring capability based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score includes: configuring corresponding weights for the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score respectively according to preset weight allocation information; obtaining the total score corresponding to the monitoring indicator data based on the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight; and obtaining the evaluation result of the application system's monitoring capability based on the total score.

[0013] In one possible implementation, the method further includes: obtaining a mapping table between the scores and evaluation levels of the monitoring indicator data; obtaining the evaluation result of the application system monitoring capability based on the total score includes: determining the evaluation level corresponding to the monitoring indicator data based on the mapping table and the total score of the monitoring indicator data; and obtaining the evaluation result of the application system monitoring capability based on the evaluation level.

[0014] Secondly, this application provides a processing apparatus for evaluating the monitoring capabilities of an application system, comprising: a data acquisition module configured to acquire monitoring indicator data of the application system in response to an evaluation request for the monitoring capabilities of the application system, the monitoring indicator data including at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data; a scoring determination module configured to determine at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score according to preset scoring rules and the monitoring indicator data; and an evaluation module configured to obtain an evaluation result regarding the monitoring capabilities of the application system based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score.

[0015] Thirdly, an electronic device is provided, comprising: a processor, and a memory communicatively connected to the processor; the memory storing computer-executable instructions; the processor executing the computer-executable instructions stored in the memory to implement the processing method for evaluating the monitoring capabilities of an application system as provided in any of the first aspects.

[0016] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the processing method for evaluating the monitoring capabilities of an application system as provided in any of the first aspects above.

[0017] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the processing method for evaluating the monitoring capabilities of an application system as provided in any of the first aspects above.

[0018] The processing method, apparatus, and electronic equipment provided in this application for evaluating the monitoring capabilities of an application system, in response to an evaluation request for the monitoring capabilities of an application system, acquires monitoring indicator data of the application system. This monitoring indicator data includes at least one of the following: application-layer monitoring access data, infrastructure-layer monitoring access data, and monitoring alarm data. Based on preset scoring rules and the monitoring indicator data, at least one of the application-layer monitoring access score, infrastructure-layer monitoring access score, and monitoring alarm score is determined. Based on this score, an evaluation result regarding the monitoring capabilities of the application system is obtained. This process replaces related technologies that only evaluate application performance and system monitoring. It systematically evaluates the monitoring capabilities of the application system from any one of the perspectives of application-layer monitoring, infrastructure-layer monitoring, and monitoring alarms. The evaluation process is more accurate and comprehensive, providing data support for optimizing the monitoring capabilities of the application system, thereby achieving efficient operation and timely response of the application system. Attached Figure Description

[0019] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0020] Figure 1 This is a schematic diagram of a possible scenario provided for an embodiment of this application;

[0021] Figure 2 A flowchart illustrating a processing method for evaluating the monitoring capabilities of an application system, provided as an embodiment of this application;

[0022] Figure 3 for Figure 2 A flowchart illustrating step S202;

[0023] Figure 4 for Figure 2 A flowchart illustrating step S203;

[0024] Figure 5 A flowchart illustrating a processing method for evaluating the monitoring capabilities of an application system, provided as an exemplary embodiment of this application;

[0025] Figure 6 This is a data example diagram used in an exemplary embodiment of this application to evaluate the completeness of application layer monitoring access;

[0026] Figure 7 This is a data example diagram used in an exemplary embodiment of this application to evaluate the completeness of infrastructure layer monitoring access;

[0027] Figure 8 This is an example diagram of data used to evaluate the effectiveness of monitoring alarms in an exemplary embodiment of this application;

[0028] Figure 9 A schematic diagram of a processing device for evaluating the monitoring capabilities of an application system, provided as an embodiment of this application;

[0029] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0030] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0031] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0032] The collection, storage, use, processing, transmission, provision, and disclosure of financial data or user data involved in the technical solution of this application all comply with the provisions of relevant laws and regulations and do not violate public order and good morals. It should be noted that certain software, components, models, and other existing solutions in the industry may be mentioned in the embodiments of this application. These should be considered as exemplary, and their purpose is only to illustrate the feasibility of implementing the technical solution of this application, but does not mean that the applicant has used or necessarily used such solutions.

[0033] Terminology Explanation:

[0034] Application system: A software system designed and developed to meet specific user needs. In this embodiment, it refers to an application system included in the application system service catalog of the head office or branch.

[0035] Monitoring access method: This refers to the method or means of accessing monitoring at the application level. In this embodiment, the monitoring access method at the application level may include performance monitoring, link monitoring, log monitoring, direct connection alarm, web page monitoring, heartbeat monitoring, network bypass monitoring, node (POD) resource monitoring, etc.

[0036] Technology stack: A collective term for a set of skills required for a particular job or position. In this embodiment, the technology stack at the infrastructure level may include operating systems, middleware, databases, big data, load balancing, cloud container engines (CCE), etc.

[0037] Application monitoring objects: Application monitoring objects can include application modules, running instances (application partitions, Pods, IIS sites, etc.), transactions, provinces and cities, channels, and other categories.

[0038] Monitoring data stream metrics: also known as monitoring content, can include categories such as transaction volume, average response time, success rate, and system status, depending on the monitoring object.

[0039] As banking operations become more complex and the technology stack continues to be updated and upgraded, the monitoring content and methods of application systems are becoming increasingly complex, and the overall assessment of monitoring capabilities is becoming more and more difficult. This puts a lot of pressure on operations and maintenance personnel. Incomplete application system monitoring access strategies can easily lead to incidents and bring significant risks.

[0040] Current application system monitoring capability assessments primarily focus on application performance and system monitoring (e.g., only collecting application performance monitoring data). This assessment process is too simplistic and fails to consider the overall monitoring capabilities of the application system, such as the completeness of application monitoring access, the completeness of infrastructure monitoring access, and the effectiveness of monitoring alarms. This approach makes it difficult to comprehensively evaluate the application system's monitoring capabilities. Therefore, the purpose of this application's embodiments is to design a more comprehensive application system monitoring capability assessment method. This method obtains an overall monitoring capability score for the application system by scoring three capability items: the completeness of application-layer monitoring access, the completeness of infrastructure-layer monitoring access, and the effectiveness of monitoring alarms. During the assessment process, the application system's monitoring capabilities are gradually improved, reducing the workload of operations and maintenance personnel and the risk of incidents.

[0041] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0042] Figure 1 This diagram illustrates an application scenario for the method applicable to the embodiments of this application. For example... Figure 1As shown, this application scenario includes: terminal device 110, server 120, and data source platform 130. Terminal device 110 can be a business terminal for bank user management. Users can initiate an evaluation request for the monitoring capabilities of the application system to server 120 through terminal device 110. Server 120 responds to the evaluation request, obtains various monitoring indicator data of the business system, and scores the data based on the monitoring indicators to evaluate the monitoring capabilities of the application system. Data source platform 130 can include one or more application system databases, each containing source data for monitoring the application system. Server 120 can obtain various monitoring indicator data of the business system through data source platform 130.

[0043] Optionally, server 120 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms; terminal device 110 can include, but is not limited to, computers, smartphones, tablets, e-book readers, Moving Picture Experts Group audio layer III (MP3) players, Moving Picture Experts Group audio layer IV (MP4) players, portable computers, in-vehicle computers, wearable devices, desktop computers, set-top boxes, smart TVs, etc.

[0044] based on Figure 1 As shown in the application scenario, this application embodiment also provides a processing method for evaluating the monitoring capabilities of an application system, and the executing entity can be a server 120. Figure 2 The flowcharts provided for the embodiments of this application are as follows: Figure 2 As shown, the method includes steps S201-S203:

[0045] Step S201: In response to an evaluation request for the monitoring capabilities of the application system, obtain monitoring indicator data of the application system. The monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data.

[0046] In this embodiment, the evaluation process for the application system monitoring capabilities first triggers an evaluation request. The system receives an evaluation request for the application system monitoring capabilities. This request can be sent from a business terminal, or it can come from a system administrator or an automated monitoring tool. This embodiment does not make any special limitations on this.

[0047] In response to the evaluation request, the system begins collecting monitoring metrics data related to the application system. This data includes, but is not limited to, the following categories: application-layer monitoring access data, which can be used to evaluate the monitoring performance of the application itself, including monitoring access methods, the monitored objects, and the monitoring data flow metrics, etc., to evaluate application-layer monitoring access performance; infrastructure-layer monitoring access data, which can be used to evaluate the status of the infrastructure supporting the application's operation, and may include monitoring data corresponding to each technology stack in the infrastructure layer (e.g., whether monitoring policies are set for each technology stack, etc.); and monitoring alarm data, involving alarm information triggered in the system, used to evaluate monitoring alarm performance, which may include the designed alarm levels, monitoring alarm rules, whether the alarm monitoring platform is displaying the alarms, etc.

[0048] Understandably, in response to, is used to indicate the conditions or states on which the operation being performed depends. When the conditions or states on which it depends are met, one or more operations being performed can be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations being performed are executed.

[0049] Step S202: Based on the preset scoring rules and the monitoring indicator data, determine at least one of the following: application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score.

[0050] In this embodiment, the collected monitoring indicator data is analyzed and scored according to pre-set scoring rules. The monitoring coverage and effectiveness at the application layer are evaluated by calculating the application-layer monitoring access score, the monitoring coverage and effectiveness at the infrastructure layer are evaluated by calculating the infrastructure-layer monitoring access score, and the response capability and accuracy of the alarm system are evaluated by calculating the monitoring alarm score.

[0051] It should be noted that those skilled in the art can determine the scoring rules based on actual applications or the adaptability of prior data. Taking the monitoring and alarm scoring as an example, if there is no alarm monitoring platform display, the score is 0. If there is an alarm platform display, the score can be obtained by jointly evaluating the alarm platform display based on dimensions such as the alarm (linkage) monitoring platform details display, alarm category data statistics, and key monitoring indicator view display (e.g., whether it exists).

[0052] Step S203: Based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score, obtain an evaluation result regarding the monitoring capability of the application system.

[0053] In this embodiment, based on the above scoring, the system comprehensively obtains an evaluation result of the application system's monitoring capabilities. This result can be a comprehensive score or grade, reflecting whether the current system's monitoring capabilities meet the expected standards. The evaluation result can be output to the requesting party so that it can be used for decision support, such as improving monitoring strategies, optimizing resource allocation, and improving system reliability.

[0054] The above technical solutions enable a systematic evaluation of the monitoring capabilities of application systems, providing data support for optimizing these capabilities and ensuring efficient operation and timely problem response.

[0055] Next, we will further describe step S201 above, which involves obtaining the monitoring indicator data of the application system:

[0056] In one example, the process of obtaining application-layer monitoring access data from the monitoring metrics data of an application system may include the following steps:

[0057] Based on the monitoring access dimension, the monitoring access method of the application system is obtained, and the monitoring access method includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring.

[0058] Based on the dimension of the monitored object, the monitoring object data of the application system is obtained, and the monitoring object data includes at least one of the following: partition monitoring, site monitoring and POD node monitoring;

[0059] Based on the monitoring data flow metrics, the data flow monitoring metrics of the application system are obtained. The data flow monitoring metrics include at least one of the following: transaction volume, response time, and process.

[0060] The application layer monitoring access data is obtained based on at least one of the monitoring access method, the monitoring object, and the monitoring data stream indicators.

[0061] In this example, direct connection monitoring involves directly connecting to the application system to obtain real-time performance and status data. This method is typically used for critical applications that require high-frequency data collection. Web page monitoring simulates user visits to web pages to monitor the availability and response time of the application system. This method is suitable for web applications and can evaluate user experience. Log keyword monitoring analyzes log files generated by the application system to extract specific keywords or patterns to monitor the system's operational status and anomalies. In addition to the above monitoring access methods, other methods may include performance monitoring, end-to-end monitoring, intelligent monitoring, heartbeat monitoring, and Bridge Control Protocol (BCP) bypass monitoring.

[0062] In this example, partition monitoring involves monitoring different functional modules or data partitions of the application system to identify performance issues in specific areas; site monitoring, for distributed application systems, involves monitoring sites in different geographical locations to ensure the availability and performance of each site; and POD node monitoring, in a containerized environment, involves monitoring the status and resource usage of each POD node to ensure the stable operation of the containerized application. In addition to the above monitoring objects, other possible monitoring targets include application modules / instances, microservice names, clusters, transaction codes, and so on.

[0063] In this example, transaction volume refers to the number of transactions accessed by the monitoring application system within a specific time period to assess whether the number of accesses meets expectations; response time refers to the response time of the monitoring to assess whether the monitoring responds in a timely manner; and processes refer to the status and resource usage of key monitoring processes to ensure the normal operation of the monitoring.

[0064] The data from each of the above dimensions can be obtained from system configuration files or custom scripts. For example, system configuration files contain information about monitoring settings, including the monitoring tools, interfaces, and protocols used. In some examples, one or any combination of the above dimensions can be used to obtain application-layer monitoring access data.

[0065] The above technical solution can comprehensively acquire application layer monitoring access data, so as to evaluate the completeness of application layer monitoring access and provide data support for subsequent monitoring performance scoring.

[0066] In another example, obtaining infrastructure layer access data from the monitoring metrics data of an application system may include the following steps:

[0067] The technology stack used by the infrastructure layer of the application system is collected, and the technology stack includes at least one of the following: platform resource layer, physical resource layer and virtual resource layer;

[0068] The monitoring access data of the technology stack is obtained, and the monitoring access data of the infrastructure layer is obtained based on the monitoring access data.

[0069] In this example, the acquisition of monitoring access data for the technology stack in the above steps can be achieved in the following ways: Based on the platform resource layer dimension, platform resource layer access data is acquired, which includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; Based on the physical resource layer dimension, physical resource layer access data is acquired, which includes at least one of the following: storage monitoring data, load balancing monitoring data, and network device monitoring data; Based on the virtual resource layer dimension, virtual resource layer access data is acquired, which includes cloud resource monitoring data and / or computing resource monitoring data.

[0070] Specifically, for the platform resource layer, the middleware, operating system, and container platform (such as Kubernetes) that run the application system are identified. This layer typically involves software platforms and services that support application execution. By identifying the monitoring tools or APIs built into the platform resource layer (such as middleware or operating system), for example, using Kubernetes monitoring tools (such as Prometheus) to obtain container status, the corresponding platform resource layer (monitoring) access data can be obtained, such as middleware and operating system monitoring data. For the physical resource layer, the physical hardware resources that the application system depends on are identified, such as storage devices, network devices, and load balancers. This layer involves the actual hardware infrastructure. And for the virtual resource layer, the virtualization technologies and resources used by the application system are identified, such as cloud resources and computing resources. This layer involves resource abstraction provided by virtualization technology. The process of obtaining physical layer (monitoring) access data and virtual resource layer (monitoring) access data is the same as that of obtaining platform resource layer (monitoring) access data.

[0071] The above technical solution can comprehensively acquire monitoring access data at the infrastructure layer, which is helpful for assessing the completeness of monitoring access at the infrastructure layer and providing data support for subsequent monitoring performance scoring.

[0072] In yet another example, retrieving monitoring alarm data from the monitoring metrics data of an application system may include the following steps:

[0073] Collect the monitoring alarm levels, monitoring alarm rules, and alarm monitoring platform display information of the application system;

[0074] The monitoring alarm data is obtained based on the monitoring alarm level, the monitoring alarm rules, and the information displayed on the alarm monitoring platform.

[0075] This example collects data on alarm levels, alarm rules, and platform view displays, and evaluates the effectiveness of monitoring alarms. Alarm levels can be categorized into six types: severe, major, minor, warning, alert, and recovery. For instance, in an example combining other monitoring metrics, each technology stack at the application layer and infrastructure layer can be configured to include at least major or severe alarms to determine if the alarm levels meet expectations. Alarm rules can monitor alarm thresholds, static or dynamic timeout warnings, and alarm suppression duration. By monitoring the reasonableness of each monitoring alarm threshold setting, whether batch jobs are configured with static or dynamic timeout warnings, and alarm suppression duration settings, the effectiveness of the monitoring rules can be determined. The platform view display can include detailed displays of each type of alarm linked to the monitoring platform, alarm category data statistics, and key monitoring metric views.

[0076] The above technical solutions can obtain comprehensive monitoring and alarm data from application systems, which can help assess the completeness of monitoring and alarms and provide data support for subsequent monitoring performance scoring.

[0077] In one possible implementation, the scoring rules may include score configuration information set for each monitoring indicator data, which is determined based on the disaster recovery level, such as... Figure 3 As shown, step S202 above determines at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score based on the preset scoring rules and the monitoring indicator data, and may include the following steps S2021-S2023.

[0078] It is understood that disaster recovery level refers to the standard of recovery capability and recovery speed set in information technology and business continuity management to cope with the impact of disaster events (such as natural disasters, hardware failures, network attacks, etc.) on information systems. It can include disaster recovery levels 5 or 6, 3 and 4, and 1 and 2, with levels 1 and 2 being the highest. This embodiment determines the score configuration information based on the disaster recovery level and uses this score configuration information to score the application system monitoring indicator data, which can provide a monitoring capability assessment method that is more in line with actual needs, and the assessment results are more accurate.

[0079] S2021. Based on the score configuration information of the application layer monitoring access data, configure a first score for each data item in the application layer monitoring access data, and obtain the application layer monitoring access score based on the first score.

[0080] For example, taking application-layer monitoring access data, including monitoring access methods, monitoring objects, and monitoring data flow metrics, as an example, the score configuration information includes score configurations for these data items respectively. The monitoring access methods are: Disaster recovery capability levels 6 and 5, which can be set to dual-path coverage of performance monitoring and full-link monitoring. Disaster recovery capability levels 4 and 3, which can be set to any monitoring method to achieve monitoring coverage, where online customer-facing systems and technical platforms supporting products and services can be set to access performance monitoring or full-link monitoring. Disaster recovery capability levels 2 and 1, which can be set to achieve monitoring coverage through any monitoring method. For monitoring access methods, if they meet the requirements, a corresponding score is assigned (those skilled in the art can determine the assigned score based on actual applications or prior data). The same applies to the monitoring objects and monitoring data flow metrics. Monitoring objects: Disaster recovery capability levels 6 and 5, online access includes partitions, sites, Pods, etc.; if there are batches, access plan template number, plan template number_parent node; cloud application monitoring objects should cover Pods, clusters, and microservices. The monitoring objects (performance dimension) for distributed core application modules must include cloud clusters, Pods, and microservices. For disaster recovery capability levels 4, 3, 2, and 1, in terms of online monitoring, the system should reflect whether its operating status is normal. At least one type of monitoring object should be selected, such as application modules, running instances, provinces / cities, transactions, channels, processes, Uniform Resource Locators (URLs), Structured Query Language (SQL), etc. If batch monitoring is involved, the plan template number and plan template number_parent node should be accessed. Cloud application monitoring objects should ideally cover Pods, clusters, and microservices. Monitoring metrics: For disaster recovery capability levels 6 and 5, in terms of online monitoring, the three critical metrics of transaction volume per unit time, response time, and success rate must be accessed. If batch monitoring is involved, the execution status of batch nodes and job plan status must be accessed. For other disaster recovery levels, in terms of online monitoring, the system should reflect whether its operating status is normal. At least one type of monitoring object should be selected, such as channels, processes, URLs, SQL, etc. If batch monitoring is involved, the execution status of batch nodes and job plan status should also be obtained.

[0081] S2022. Based on the score configuration information of the infrastructure layer monitoring access data, configure a second score for each data item in the infrastructure layer monitoring access data, and obtain the infrastructure layer monitoring access score based on the second score.

[0082] It should be noted that the scoring process for infrastructure layer monitoring access data here can be found in step S2021 above, which describes the application layer monitoring access data. It will not be elaborated on here.

[0083] S2023. Based on the score configuration information of the monitoring alarm data, configure a third score for each data item in the monitoring alarm data, and obtain the monitoring alarm score based on the third score.

[0084] It should be noted that the scoring process for infrastructure layer monitoring access data here can be found in step S2021 above, which describes the application layer monitoring access data. It will not be elaborated on here.

[0085] In one possible implementation, combining multiple monitoring indicator data to calculate the total score and configuring corresponding weights can effectively improve the scoring accuracy. Figure 4 As shown, step S203 above, based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score, obtains an evaluation result regarding the monitoring capability of the application system, which may include the following steps:

[0086] Step S2031: Configure corresponding weights for the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score according to the preset weight allocation information.

[0087] It should be noted that those skilled in the art can determine the weight allocation information based on actual applications or prior data adaptability. For example, they can configure an x ​​weight for the application layer monitoring access score, a y weight for the infrastructure layer monitoring access score, and a z weight for the monitoring alarm score, where x+y+z=1.

[0088] Step S2032: Based on the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight, obtain the total score corresponding to the monitoring indicator data.

[0089] For example, the evaluation of the monitoring capability A of an application system includes three dimensions: evaluation of the completeness of application layer monitoring access (corresponding to the application layer monitoring access score), evaluation of the completeness of infrastructure layer monitoring access (corresponding to the infrastructure layer monitoring access score), and evaluation of the effectiveness of monitoring and alarms (corresponding to the monitoring and alarm score), which are represented by B, C, and D respectively. The evaluation result of A is expressed as A = TB + TC + TD, where TB, TC, and TD are numerical scores after being weighted by x, y, and z respectively.

[0090] Step S2033: Obtain the evaluation result of the application system's monitoring capability based on the total score.

[0091] Compared to using only one type of monitoring indicator data, this embodiment combines several types of monitoring indicator data and assigns corresponding weights to them to calculate the total score of the monitoring indicator data, resulting in a more comprehensive and accurate score.

[0092] In some embodiments, the evaluation results of application system monitoring capabilities can be obtained through a rating system to facilitate the improvement of application system monitoring capabilities. Specifically, the method may further include the following steps: obtaining a mapping table between scores and evaluation levels for the monitoring indicator data; obtaining the evaluation result of the application system monitoring capabilities based on the total score includes: determining the evaluation level corresponding to the monitoring indicator data based on the mapping table and the total score of the monitoring indicator data; and obtaining the evaluation result of the application system monitoring capabilities based on the evaluation level.

[0093] In this embodiment, the mapping table can be a table determined by those skilled in the art based on actual applications or prior data. It is pre-stored in a database or server and retrieved when scoring is required. This table defines the correspondence between the scores and evaluation levels of monitoring indicator data. That is, it associates specific score values ​​with corresponding evaluation levels (such as excellent, good, average, poor, etc.). Next, using the previously obtained mapping table, the calculated total score is mapped to a specific evaluation level. This step can be achieved by finding the interval or value in the mapping table that matches the total score. Then, based on the determined evaluation level, the final evaluation result regarding the application system's monitoring capabilities can be obtained. This result can be used to determine the current state of the system, identify potential problems, or determine directions for improvement.

[0094] To facilitate understanding of the embodiments of this application, an exemplary embodiment is provided below for further description: Taking application system A as an example, before or after its production is put into operation, its application system monitoring capabilities are evaluated, the application system monitoring capability level is obtained based on the evaluation results, and the system monitoring capabilities are gradually improved based on the level.

[0095] Combination Figures 5-8 As shown, the monitoring capability assessment of application system A includes three dimensions: application layer monitoring access completeness assessment, infrastructure layer monitoring access completeness assessment, and monitoring alarm effectiveness assessment, denoted by B, C, and D respectively. The assessment result of A is expressed as A = TB + TC + TD. The overall score of A is 100, and the weights of the three dimensions are x, y, z, and x + y + z = 1. The system is managed in a hierarchical manner based on the scores: 0-20 is Level 1, 21-40 is Level 2, 41-60 is Level 3, 61-80 is Level 4, and 81-100 is Level 5 (in some similar embodiments, other level classifications may also apply). Based on the monitoring capability assessment level obtained by the system, relevant pending processes are pushed to gradually improve the system's monitoring capabilities.

[0096] The completeness evaluation of the application layer monitoring access is based on the disaster recovery level of the application system. The calculation score is carried out from the evaluation of the monitoring access method, the evaluation of the monitoring object, and the evaluation of the monitoring indicators (i.e., the data flow monitoring indicators). The evaluation results are represented by TAB1, TAB2, and TAB3 respectively. The weights of the three are x1, y1, z1, and x1 + y1 + z1 = 1. TAB1 ∈ {0, 100xx1}, TAB2 ∈ {0, 100xy1}, TAB3 ∈ {0, 100xz1}. The evaluation result of B is TB = TAB1 + TAB2 + TAB3, and TB ∈ {0, 100x}.

[0097] If TB = 0, the application layer monitoring is not accessed; if TB = 100x, the application layer monitoring access is complete; if 0 < TB < 100x, the application layer monitoring access needs to be improved.

[0098] If TAB1 = 100xx1, it is defined that the application layer monitoring access method is complete; if TAB1 = 0, the application layer monitoring access method is not accessed; if 0 < TAB1 < 100xx1, the application layer monitoring access method is not complete, and the application layer monitoring access method of the application system needs to be improved.

[0099] If TAB2 = 100xy1, it is defined that the application layer monitoring object is complete; if TAB2 = 0, the application layer monitoring object is not accessed; if 0 < TAB2 < 100xy1, the access of the application layer monitoring object needs to be improved.

[0100] If TAB3 = 100xz1, it is defined that the application layer monitoring indicators are complete; if TAB3 = 0, the application layer monitoring indicators are not accessed; if 0 < TAB3 < 100xz1, it is defined that the access of the application layer monitoring indicators needs to be improved.

[0101] The application layer monitoring access methods include 8 categories (in some embodiments, it can also be more or fewer categories), such as performance monitoring, link monitoring, log monitoring, direct connection alarm, web page monitoring, heartbeat monitoring, network bypass monitoring, Pod resource monitoring, etc. The evaluation results are represented by B 11、 B 12 …B 1a respectively. The weights of the 8 monitoring access methods are x 11 , x 12 ,..., x 1a , Σx 1a = 1, B 1a = 100xx1x 1a , a = 1,…, 8. The evaluation result of B1 is represented as TAB1 = ΣB 1a , a = 1,…, 8, TAB1 ∈ {0, 100xx1}.

[0102] The monitored objects can include 20 categories such as application modules / instances, microservice names, sites, application partitions, pods, and cloud clusters (in some embodiments, there may be more or fewer categories). The evaluation results are represented by B. 21、 B 22 …B 2b This indicates that the weights of the 20 types of monitored objects are as follows: y 11 y 12 , ..., y 1b ,Σy 1b =1,B 2b =100xy1y 1b The evaluation result of B2, where b = 1, ..., 20, is represented as TAB2 = ΣB. 2b ,b=1,…,20,TAB2∈{0,100xy1}.

[0103] The monitoring metrics cover 12 categories, including business metrics, transaction volume, response time, and online batch processing metrics (in some embodiments, there may be more or fewer categories). The evaluation results are represented by B. 31 B 32 …B 3c This indicates that the weight of each of the 12 monitoring indicators is z. 11 ,z 12, ...z 1c ,Σz 1c =1,B 3c =100xz1z1c, c=1,…,12, the evaluation result of B3 is expressed as TAB3=ΣB 3c ,c=1,…,12,TAB3∈{0,100xz1}.

[0104] The overall access principles (determination of corresponding score configuration information) can be as follows: Monitoring access methods: For disaster recovery capability levels 6 and 5, dual coverage of performance monitoring and end-to-end monitoring is required. For disaster recovery capability levels 4 and 3, monitoring coverage can be achieved through any monitoring method, with online customer-facing systems and technical platforms supporting products and services preferably connected to performance monitoring or end-to-end monitoring. For disaster recovery capability levels 2 and 1, monitoring coverage can be achieved through any monitoring method. Monitoring objects: For disaster recovery capability levels 6 and 5, online monitoring includes partitions, sites, Pods, etc.; if there are batches, access the plan template number and plan template number_parent node; cloud application monitoring objects should cover Pods, clusters, and microservices. Distributed core application module monitoring objects (performance dimension) must include cloud clusters, Pods, and microservice dimensions. For disaster recovery capability levels 4, 3, 2, and 1, in terms of online monitoring, the system should reflect whether its operational status is normal. At least one type of monitoring object should be selected, such as application modules, running instances, provinces / cities, transactions, channels, processes, Uniform Resource Locators (URLs), and Structured Query Language (SQL). If batch processing is involved, the plan template number and plan template number_parent node should be connected. Cloud application monitoring objects should ideally cover Pods, clusters, and microservices. Monitoring metrics: For disaster recovery capability levels 6 and 5, in terms of online monitoring, the three critical metrics of transaction volume per unit time, response time, and success rate must be connected. If batch processing is involved, the execution status of batch nodes and job plan status must be connected. For other disaster recovery levels, in terms of online monitoring, the system should reflect whether its operational status is normal. At least one type of monitoring object can be selected, such as channels, processes, URLs, and SQL. If batch processing is involved, the execution status of batch nodes and job plan status must be connected. In some embodiments, on-premises systems access the online monitoring platform through at least one monitoring method (direct monitoring, performance monitoring, web monitoring, end-to-end monitoring, log keyword monitoring, intelligent monitoring, heartbeat monitoring, BCP bypass monitoring); cloud systems access the platform through at least Pod monitoring.

[0105] The completeness of infrastructure layer monitoring access is scored based on the access status of general monitoring strategies for the technology stack used by the application system. The technology stack includes operating systems, middleware, databases, cloud resources, computing resources, network devices, storage, load balancers, etc. Each technology stack has specific monitoring targets and metrics. Evaluation results are represented by TAC1, TAC2, TAC3…TAC8, and the evaluation result for C is TC=ΣTAC. d ,TC∈{0,100y},d=1,…,8,The weights of each technology stack are n1,n2,...,n d ,Σn d =1,TAC d ∈{0,100ynd}.

[0106] If TC = 0, the infrastructure layer monitoring is not connected. If TC = 100y, the infrastructure layer monitoring connection is complete. If 0 < TC < 100y, the infrastructure layer monitoring connection needs to be improved.

[0107] Each category includes specific technology stack types. For example, the operating systems include AIX, Windows, and Linux. The evaluation results of the general monitoring policy access for the operating systems are represented by AC 11 , AC 12 , AC 13 respectively, where TAC1 = ΣAC 1e , e = 1, 2, 3. The weight of each type of operating system is o e , Σo e = 1, AC 1e = 100yn1o e , e = 1, 2, 3.

[0108] The middleware includes 9 categories such as Nginx, Tomcat, TongWeb, and WAS (in some embodiments, there may be more or fewer categories). The evaluation results are represented by AC 21 , AC 22 …AC 2f respectively, where TAC2 = ΣAC 2f , f = 1, 2, …, 9. The weight of each type of middleware is p f , Σp f = 1, AC 2f = 100yn2p f , f = 1, 2, …, 9.

[0109] The databases include 9 categories such as TDSQL, GaussDB, and Sybase (in some embodiments, there may be more or fewer categories). The evaluation results are represented by AC 31 , AC 32 …AC 3g respectively, where TAC3 = ΣAC 3g , g = 1, 2, …, 9. The weight of each type of database is q g , Σq g = 1, AC 3g = 100yn3q g , g = 1, 2, …, 9.

[0110] And so on. The evaluation results of cloud resources, computing resources, network devices, storage, and load balancing are TAC4 = ΣAC 4h , h = 1, 2; TAC5 = ΣAC 5i , i = 1; TAC6 = ΣAC6j j=1, …,4; TAC7=ΣAC 7k ,k=1;TAC8=ΣAC 8l ,l=1,2.

[0111] The weight of each type of cloud resource is r h ,Σr h =1, h=1,2, AC 4h =100yn4r h .

[0112] If computing resources are involved and monitoring is already integrated, then TAC5=AC 51 If not connected, then TAC5=0.

[0113] The weight of each type of network device is s j , Σs j =1, j=1, ...,4, AC 6j =100yn5s j .

[0114] If storage resources are involved and monitoring is already in place, then TAC7=AC 71 If not connected, then TAC7=0.

[0115] The weights of various load balancers are t l , Σt l =1, l=1,2, AC 8l =100yn7t l .

[0116] The effectiveness of monitoring and alerting is evaluated from three dimensions: alert level, alert rules, and platform view display. The evaluation results are represented as TAD1, TAD2, and TAD3. The evaluation result of the monitoring and alerting effectiveness D is TD=ΣTAD. M M=1,2,3,TD∈{0,100z}. The weights of the three dimensions are u, v, w respectively, u+v+w=1,TAD1∈{0,100zu},TAD2∈{0,100zv},TAD3∈{0,100zw}.

[0117] The alarm level assessment results for the application layer and infrastructure layer are represented as AD. 11 and AD 12 The weights of the two are u1 and u2 respectively, u1 + u2 = 1, AD 11 =100zuu1,AD 12 =100zuu2,TAD1=AD 11 +AD 12 .

[0118] The alarm rules are evaluated from several dimensions, including whether the threshold settings for each monitoring alarm are reasonable, whether static or dynamic timeout warnings are configured for batch jobs, and the alarm suppression duration settings (in some embodiments, more or fewer dimensions may be included). The evaluation results for the three dimensions are AD. 21 AD 22 AD 23 The weights of the three are v1, v2, and v3, respectively, and v1 + v2 + v3 = 1. AD 21 =100zvv1, AD 22 =100zvv2,AD 23 =100zvv3, the overall evaluation result of the alarm rules is TAD2=AD 21 +AD 22 +AD 23 .

[0119] The platform view is evaluated from three dimensions: detailed display of each type of alarm linkage monitoring platform, alarm category data statistics, and key monitoring indicator view (in some embodiments, more or fewer dimensions may be included). The evaluation results of the three dimensions are AD. 31 AD 32 AD 32 The weights of the three are w1, w2, and w3, respectively, and w1 + w2 + w3 = 1. AD 31 =100zvw1, AD 32 =100zvw2, AD 33 =100zvw3, the overall evaluation result displayed in the platform view is TAD3=AD. 31 +AD 32 +AD 33 .

[0120] As can be seen, the above technical solution sets up more comprehensive evaluation indicators for the monitoring access capabilities of the application system's application layer and infrastructure layer, realizes the application of the superposition method in the evaluation method of application system monitoring capabilities, and performs hierarchical management based on the monitoring capability scoring results, making the monitoring capabilities of the application system increasingly perfect and laying the foundation for the optimization of application system monitoring capabilities.

[0121] This application also provides a processing device for evaluating the monitoring capabilities of an application system, such as... Figure 9 As shown, the processing device 900 includes a data acquisition module 901, a scoring determination module 902, and an evaluation module 903, wherein...

[0122] The data acquisition module 901 is configured to acquire monitoring indicator data of the application system in response to an evaluation request for the monitoring capabilities of the application system. The monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data.

[0123] The scoring determination module 902 is configured to determine at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score based on preset scoring rules and the monitoring indicator data.

[0124] The evaluation module 903 is configured to obtain an evaluation result on the monitoring capability of the application system based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score.

[0125] In one possible implementation, the data acquisition module 901 includes:

[0126] The access method acquisition unit is configured to acquire the monitoring access method of the application system based on the monitoring access dimension. The monitoring access method includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring.

[0127] The monitoring object acquisition unit is configured to acquire monitoring object data of the application system based on the monitoring object dimension, wherein the monitoring object data includes at least one of the following: partition monitoring, site monitoring, and POD node monitoring;

[0128] A data flow metric acquisition unit is configured to acquire data flow monitoring metrics of the application system based on the dimension of monitoring data flow metrics, wherein the data flow monitoring metrics include at least one of the following: transaction volume, response time, and process.

[0129] The first acquisition unit is configured to obtain the application layer monitoring access data based on at least one of the monitoring access method, the monitoring object, and the monitoring data stream indicators.

[0130] In one possible implementation, the data acquisition module 901 includes:

[0131] The second acquisition unit is configured to acquire the technology stack used by the infrastructure layer of the application system, the technology stack including at least one of the following: platform resource layer, physical resource layer and virtual resource layer;

[0132] The infrastructure layer data acquisition unit is configured to acquire the monitoring access data of the technology stack and obtain the infrastructure layer monitoring access data based on the monitoring access data.

[0133] In one possible implementation, the second acquisition unit is specifically configured to: acquire platform resource layer access data based on the platform resource layer dimension, wherein the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; acquire physical resource layer access data based on the physical resource layer dimension, wherein the physical layer access data includes at least one of the following: storage monitoring data, load balancing monitoring data, and network device monitoring data; and acquire virtual resource layer access data based on the virtual resource layer dimension, wherein the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

[0134] In one possible implementation, the data acquisition module 901 includes:

[0135] The third data acquisition unit is configured to collect the monitoring alarm levels, monitoring alarm rules, and alarm monitoring platform display information of the application system.

[0136] The monitoring alarm acquisition unit is configured to obtain the monitoring alarm data based on the monitoring alarm level, the monitoring alarm rules, and the information displayed on the alarm monitoring platform.

[0137] In one possible implementation, the scoring rules include score configuration information set for each monitoring indicator data, the score configuration information being determined based on the disaster recovery level;

[0138] The scoring determination module 902 includes:

[0139] The first scoring unit is configured to configure a first score for each data item in the application layer monitoring access data according to the score configuration information of the application layer monitoring access data, and obtain the application layer monitoring access score based on the first score.

[0140] The second scoring unit is configured to configure a second score for each data item in the infrastructure layer monitoring access data according to the score configuration information of the infrastructure layer monitoring access data, and obtain the infrastructure layer monitoring access score based on the second score.

[0141] The third scoring unit is configured to assign a third score to each item in the monitoring alarm data based on the score configuration information of the monitoring alarm data, and to obtain the monitoring alarm score based on the third score.

[0142] In one possible implementation, the evaluation module 903 includes:

[0143] The weight allocation unit is configured to assign corresponding weights to the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score respectively according to the preset weight allocation information.

[0144] The total score calculation unit is configured to obtain the total score corresponding to the monitoring indicator data based on the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight.

[0145] The evaluation result acquisition unit is configured to acquire an evaluation result regarding the monitoring capability of the application system based on the total score.

[0146] In one possible implementation, the device further includes:

[0147] The mapping acquisition module is configured to acquire a mapping relationship table between the scores and evaluation levels of the monitoring indicator data.

[0148] The evaluation result acquisition unit is specifically configured to: determine the evaluation level corresponding to the monitoring indicator data based on the mapping relationship table and the total score of the monitoring indicator data; and obtain the evaluation result on the monitoring capability of the application system based on the evaluation level.

[0149] The apparatus provided in this application embodiment can be used to execute the technical solution of the processing method for evaluating the monitoring capabilities of the application system in the above embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0150] It should be noted that the division of the various modules in the above device is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing element calls; they can be fully implemented in hardware; or some modules can be implemented in software via processing element calls, while others are implemented in hardware. For example, the scoring determination module 902 can be a separate processing element, or it can be integrated into a chip in the above device. Alternatively, it can be stored as program code in the memory of the above device, and its function can be called and executed by a processing element of the above device. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0151] Figure 10This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 10 As shown, the electronic device may include: transceiver 101, processor 102, and memory 103.

[0152] Processor 102 executes computer execution instructions stored in memory, causing processor 102 to perform the scheme in the above embodiments. Processor 102 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0153] The memory 103 is connected to the processor 102 via the system bus and completes communication between them. The memory 103 is used to store computer program instructions.

[0154] Transceiver 101 can be used for data reception and data transmission.

[0155] The system bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The system bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus. Transceivers are used to enable communication between database access devices and other computers (e.g., clients, read-write libraries, and read-only libraries). Memory may include random access memory (RAM) and may also include non-volatile memory.

[0156] The electronic device provided in this application embodiment can be the server described in the above embodiment.

[0157] This application also provides a chip for executing instructions, which is used to execute the technical solution of the processing method for evaluating the monitoring capabilities of an application system described in the above embodiments.

[0158] This application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on a computer, the computer performs the technical solution of the processing method described above for evaluating the monitoring capabilities of an application system.

[0159] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium. When the at least one processor executes the computer program, it can implement the technical solution of the processing method for evaluating the monitoring capabilities of the application system described in the above embodiments.

[0160] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.

[0161] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.

[0162] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.

[0163] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.

[0164] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly manifested as execution by a hardware processor, or execution by a combination of hardware and software modules within the processor.

[0165] The memory may include high-speed RAM, and may also include non-volatile storage (NVM), such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk or optical disc, etc.

[0166] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0167] The aforementioned storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0168] An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. The processor and storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic control unit or main control device.

[0169] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0170] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A processing method for evaluating the monitoring capabilities of an application system, characterized in that, include: In response to an evaluation request regarding the monitoring capabilities of an application system, monitoring indicator data of the application system is obtained, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data. Based on the preset scoring rules and the monitoring indicator data, determine at least one of the following: application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score; An evaluation result regarding the monitoring capability of the application system is obtained based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score. The step of obtaining an evaluation result regarding the monitoring capability of the application system based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score includes: Based on the preset weight allocation information, corresponding weights are configured for the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score, respectively. The total score corresponding to the monitoring indicator data is obtained by summing the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight. The evaluation results regarding the monitoring capabilities of the application system are obtained based on the overall score.

2. The method according to claim 1, characterized in that, The acquisition of monitoring metric data of the application system includes: Based on the monitoring access dimension, the monitoring access method of the application system is obtained, and the monitoring access method includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring; Based on the dimension of the monitored object, the monitoring object data of the application system is obtained, and the monitoring object data includes at least one of the following: partition monitoring, site monitoring and POD node monitoring; Based on the monitoring data flow metrics, the data flow monitoring metrics of the application system are obtained. The data flow monitoring metrics include at least one of the following: transaction volume, response time, and process. The application layer monitoring access data is obtained based on at least one of the monitoring access method, the monitoring object, and the monitoring data stream indicators.

3. The method according to claim 1, characterized in that, The acquisition of monitoring metric data of the application system includes: The technology stack used by the infrastructure layer of the application system is collected, and the technology stack includes at least one of the following: platform resource layer, physical resource layer and virtual resource layer; The monitoring access data of the technology stack is obtained, and the monitoring access data of the infrastructure layer is obtained based on the monitoring access data.

4. The method according to claim 3, characterized in that, The acquisition of monitoring access data for the technology stack includes: Based on the platform resource layer dimension, obtain platform resource layer access data, which includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; Based on the physical resource layer dimension, physical resource layer access data is obtained, which includes at least one of the following: storage monitoring data, load balancing monitoring data, and network device monitoring data. Based on the virtual resource layer dimension, virtual resource layer access data is obtained, which includes cloud resource monitoring data and / or computing resource monitoring data.

5. The method according to claim 1, characterized in that, The acquisition of monitoring metric data of the application system includes: Collect the monitoring alarm levels, monitoring alarm rules, and alarm monitoring platform display information of the application system; The monitoring alarm data is obtained based on the monitoring alarm level, the monitoring alarm rules, and the information displayed on the alarm monitoring platform.

6. The method according to any one of claims 1-5, characterized in that, The scoring rules include score configuration information set for each monitoring indicator data, and the score configuration information is determined based on the disaster recovery level; The step of determining at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score based on preset scoring rules and the monitoring indicator data includes: Based on the score configuration information of the application layer monitoring access data, a first score is configured for each data item in the application layer monitoring access data, and the application layer monitoring access score is obtained based on the first score. Based on the score configuration information of the infrastructure layer monitoring access data, a second score is configured for each data item in the infrastructure layer monitoring access data, and the infrastructure layer monitoring access score is obtained based on the second score. Based on the score configuration information of the monitoring alarm data, a third score is configured for each data item in the monitoring alarm data, and the monitoring alarm score is obtained based on the third score.

7. The method according to claim 1, characterized in that, Also includes: Obtain a mapping table between the scores and evaluation levels of the monitoring indicator data; The process of obtaining the evaluation result regarding the monitoring capability of the application system based on the total score includes: Based on the mapping table and the total score of the monitoring indicator data, the evaluation level corresponding to the monitoring indicator data is determined; Based on the evaluation level, an assessment result is obtained regarding the monitoring capability of the application system.

8. A processing apparatus for evaluating the monitoring capabilities of an application system by performing the method according to any one of claims 1-7, characterized in that, include: The data acquisition module is configured to acquire monitoring indicator data of the application system in response to an evaluation request for the monitoring capabilities of the application system. The monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data. The scoring determination module is configured to determine at least one of the following based on preset scoring rules and the monitoring indicator data: application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score. The evaluation module is configured to obtain an evaluation result on the monitoring capability of the application system based on at least one of the application layer monitoring access score, infrastructure layer monitoring access score, and monitoring alarm score.

9. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the processing method for evaluating the monitoring capabilities of an application system as described in any one of claims 1-7.

Images