Processing method and device for evaluating monitoring capability of application system and electronic equipment

Abstract

The invention provides a processing method and device for evaluating the monitoring capability of an application system and electronic equipment, and relates to the technical field of big data, and the method comprises the steps: obtaining monitoring index data of the application system in response to an evaluation request for the monitoring capability of the application system, the monitoring index data comprises at least one of application layer monitoring access data, infrastructure layer monitoring access data and monitoring alarm data; determining at least one of an application layer monitoring access score, an infrastructure layer monitoring access score and a monitoring alarm score according to a preset scoring rule and the monitoring index data; and obtaining an evaluation result about the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score. Through the method, the monitoring capability of the application system can be accurately evaluated.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a processing method, device and electronic device for evaluating the monitoring capability of an application system. Background Art

[0002] With the increasing complexity of banking business and the continuous updating and upgrading of technology stacks, the monitoring content and methods of application systems have become increasingly complex. This complexity makes it increasingly difficult to evaluate the overall monitoring capabilities, which has brought tremendous pressure to operation and maintenance personnel. If the monitoring access strategy of the application system is not comprehensive enough, it is easy to cause incidents, thereby bringing greater risks.

[0003] The current evaluation of application system monitoring capabilities mainly focuses on application performance and system monitoring (for example, only evaluating application performance monitoring indicators), and usually ignores the more comprehensive consideration of the overall monitoring capabilities of the application system, resulting in an incomplete and inaccurate evaluation of the monitoring capabilities of the application system. Summary of the invention

[0004] The present application provides a processing method, device and electronic device for evaluating the monitoring capability of an application system, so as to solve one of the above-mentioned technical problems.

[0005] In a first aspect, the present application provides a processing method for evaluating the monitoring capability of an application system, comprising: in response to an evaluation request for the monitoring capability of an application system, obtaining monitoring indicator data of the application system, the monitoring indicator data comprising at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data; determining at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score according to preset scoring rules and the monitoring indicator data; obtaining an evaluation result of the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score.

[0006] In a possible implementation, obtaining the monitoring indicator data of the application system includes: based on the monitoring access dimension, obtaining the monitoring access method of the application system, the monitoring access method including at least one of the following: direct connection monitoring, web page monitoring and log keyword monitoring; based on the monitoring object dimension, obtaining the monitoring object data of the application system, the monitoring object data including at least one of the following: partition monitoring, site monitoring and POD node monitoring; based on the monitoring data flow indicator dimension, obtaining the data flow monitoring indicator of the application system, the data flow monitoring indicator including at least one of the following: transaction volume, response time and process; according to the monitoring access method, the monitoring object and at least one of the monitoring data flow indicators, the application layer monitoring access data is obtained.

[0007] In a possible implementation, obtaining the monitoring indicator data of the application system includes: collecting the technology stack adopted by the infrastructure layer of the application system, the technology stack including at least one of the following: platform resource layer, physical resource layer and virtual resource layer; obtaining the monitoring access data of the technology stack, and obtaining the monitoring access data of the infrastructure layer based on the monitoring access data.

[0008] In a possible implementation, obtaining monitoring access data of the technology stack includes: based on the platform resource layer dimension, obtaining platform resource layer access data, the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; based on the physical resource layer dimension, obtaining physical resource layer access data, the physical layer access data includes at least one of the following: storage monitoring data, load balancing monitoring data, and network equipment monitoring data; based on the virtual resource layer dimension, obtaining virtual resource layer access data, the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

[0009] In a possible implementation, obtaining the monitoring indicator data of the application system includes: collecting the monitoring alarm level, monitoring alarm rules and alarm monitoring platform display information of the application system; obtaining the monitoring alarm data according to the monitoring alarm level, the monitoring alarm rules and the alarm monitoring platform display information.

[0010] In a possible implementation, the scoring rule includes score configuration information set for each monitoring indicator data, and the score configuration information is determined based on the disaster recovery level; the determining, according to the preset scoring rule and the monitoring indicator data, at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score includes: configuring a first score for each data in the application layer monitoring access data according to the score configuration information of the application layer monitoring access data, and obtaining the application layer monitoring access score according to the first score;

[0011] According to the score configuration information of the infrastructure layer monitoring access data, a second score is configured for each data in the infrastructure layer monitoring access data, and the infrastructure layer monitoring access score is obtained according to the second score; according to the score configuration information of the monitoring alarm data, a third score is configured for each data in the monitoring alarm data, and the monitoring alarm score is obtained according to the third score.

[0012] In a possible implementation, obtaining an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score includes: configuring corresponding weights for the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score according to preset weight allocation information; obtaining a total score corresponding to the monitoring indicator data according to the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight; and obtaining an evaluation result on the monitoring capability of the application system according to the total score.

[0013] In a possible implementation, it also includes: obtaining a mapping relationship table between the score of the monitoring indicator data and the evaluation level; obtaining the evaluation result of the monitoring capability of the application system based on the total score, including: determining the evaluation level corresponding to the monitoring indicator data based on the mapping relationship table and the total score of the monitoring indicator data; and obtaining the evaluation result of the monitoring capability of the application system based on the evaluation level.

[0014] In a second aspect, the present application provides a processing device for evaluating the monitoring capability of an application system, comprising: a data acquisition module, which is configured to respond to an evaluation request for the monitoring capability of the application system and obtain monitoring indicator data of the application system, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data and monitoring alarm data; a score determination module, which is configured to determine at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score according to preset scoring rules and the monitoring indicator data; an evaluation module, which is configured to obtain an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score.

[0015] In a third aspect, an electronic device is provided, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement a processing method for evaluating the monitoring capability of an application system as provided in any one of the first aspects.

[0016] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer execution instructions are stored. When the computer execution instructions are executed by a processor, they are used to implement a processing method for evaluating the monitoring capability of an application system as provided in any one of the first aspects above.

[0017] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the processing method for evaluating the monitoring capability of an application system provided in any one of the first aspects above.

[0018] The processing method, device and electronic device for evaluating the monitoring capability of an application system provided by the present application obtain monitoring index data of the application system by responding to an evaluation request for the monitoring capability of the application system, and the monitoring index data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data and monitoring alarm data, and determines at least one of the application layer monitoring access score, infrastructure layer monitoring access score and monitoring alarm score according to preset scoring rules and the monitoring index data, and obtains the evaluation result of the monitoring capability of the application system according to at least one of the application layer monitoring access score, infrastructure layer monitoring access score and monitoring alarm score. This process replaces the evaluation of only application performance and system monitoring in the related technology, and systematically evaluates the monitoring capability of the application system from any one of the application layer monitoring perspective, infrastructure layer monitoring perspective and monitoring alarm perspective, and its evaluation process is more accurate and comprehensive, providing data support for optimizing the monitoring capability of the application system, thereby realizing efficient operation and timely response of the application system. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0020] Figure 1 A possible scenario diagram provided for an embodiment of the present application;

[0021] Figure 2 A flowchart of a processing method for evaluating the monitoring capability of an application system provided in an embodiment of the present application;

[0022] Figure 3 for Figure 2 Schematic diagram of the process of step S202;

[0023] Figure 4 for Figure 2 Schematic diagram of the process of step S203;

[0024] Figure 5 A flowchart of a processing method for evaluating application system monitoring capability provided by an exemplary embodiment of the present application;

[0025] Figure 6 This is an example diagram of data used to evaluate the completeness of application layer monitoring access in an exemplary embodiment of the present application;

[0026] Figure 7 This is an example diagram of data used to evaluate the completeness of monitoring access at the infrastructure layer in an exemplary embodiment of the present application;

[0027] Figure 8 This is an example diagram of data used to evaluate the effectiveness of monitoring alarms in an exemplary embodiment of the present application;

[0028] Fig. 9 A schematic diagram of the structure of a processing device for evaluating the monitoring capability of an application system provided in an embodiment of the present application;

[0029] Fig.10 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0030] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0031] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0032] In the technical solution of this application, the collection, storage, use, processing, transmission, provision and disclosure of financial data or user data and other information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals. It should be noted that in the embodiments of this application, some existing solutions in the industry such as certain software, components, models, etc. may be mentioned, and they should be considered as exemplary. Their purpose is only to illustrate the feasibility of the implementation of the technical solution of this application, but it does not mean that the applicant has or will necessarily use the solution.

[0033] Terminology explanation:

[0034] Application system: is a software system designed and developed to meet specific user needs. In this embodiment, it refers to the application system included in the service catalog of the head office or branch application system.

[0035] Monitoring access method: that is, the method or means of accessing monitoring at the application level. In this embodiment, the application level monitoring access method may include performance monitoring, link monitoring, log monitoring, direct connection alarm, web page monitoring, heartbeat monitoring, network bypass monitoring, node (POD) resource monitoring, etc.

[0036] Technology stack: a general term for a series of skill combinations required for a job or position. In this embodiment, the technology stack at the infrastructure level may include operating system, middleware, database, big data, load balancing, Cloud Container Engine (CCE), etc.

[0037] Application monitoring objects: Application monitoring objects can include application modules, running instances (application partitions, Pods, IIS sites, etc.), transactions, provinces, cities, channels and other categories.

[0038] Monitoring data flow indicators: that is, monitoring content, which can include transaction volume, average response time, success rate, system status and other categories depending on the monitored object.

[0039] With the increasing complexity of banking business and the continuous updating and upgrading of technology stacks, the monitoring content and methods of application systems are becoming more and more complex, and the overall evaluation of monitoring capabilities is becoming more and more difficult, which puts great pressure on operation and maintenance personnel. An incomplete application system monitoring access strategy can easily trigger incidents and bring greater risks.

[0040] At present, the monitoring capability evaluation of application systems focuses on application performance and system monitoring (for example, only collecting application performance monitoring data). The monitoring capability evaluation process is too simple, and does not take into account the overall monitoring capability of the application system, such as the completeness of application monitoring access, the completeness of infrastructure monitoring access, and the effectiveness of monitoring alarms. This monitoring method is difficult to comprehensively evaluate the monitoring capability of the application system. Therefore, the original intention of the embodiment of the present application is to design a more comprehensive monitoring capability evaluation method for the application system, by scoring the three capability items of completeness of application layer monitoring access, completeness of infrastructure layer monitoring access, and effectiveness of monitoring alarms, to obtain the overall monitoring capability score of the application system. In the process of evaluation, the monitoring capability of the application system is gradually improved to reduce the pressure on operation and maintenance personnel and the risk of triggering incidents.

[0041] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0042] Figure 1 FIG. 1 is an application scenario diagram of the method applicable to the embodiment of the present application. Figure 1As shown, the application scenario includes: a terminal device 110, a server 120, and a data source platform 130. The terminal device 110 may be a business terminal for bank management users. The user may initiate an evaluation request for the monitoring capability of the application system to the server 120 through the terminal device 110. The server 120 responds to the evaluation request, obtains various monitoring indicator data of the business system, and scores according to the monitoring indicator data, so as to evaluate the monitoring capability of the application system according to the score. The data source platform 130 may include one or more application system databases, each of which includes source data for monitoring the application system. The server 120 may obtain various monitoring indicator data of the business system through the data source platform 130.

[0043] Optionally, the server 120 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms; the terminal device 110 can include but is not limited to computers, smart phones, tablets, e-book readers, Moving Picture experts group audio layer III (MP3) players, Moving Picture experts group audio layer IV (MP4) players, portable computers, car computers, wearable devices, desktop computers, set-top boxes, smart TVs, etc.

[0044] based on Figure 1 In the application scenario shown, the embodiment of the present application also provides a processing method for evaluating the monitoring capability of an application system, and the execution entity may be the server 120. Figure 2 The flowchart provided for the embodiment of the present application is as follows: Figure 2 As shown, the method includes steps S201-S203:

[0045] Step S201: In response to an evaluation request for monitoring capability of an application system, monitoring indicator data of the application system is obtained, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data.

[0046] In this embodiment, for the evaluation process of the application system monitoring capability, an evaluation request is first triggered. The system receives an evaluation request for the application system monitoring capability. This request can be a request sent from a business terminal, or it can come from a system administrator or an automated monitoring tool. This embodiment does not specifically limit this.

[0047] In response to the evaluation request, the system starts to collect monitoring indicator data related to the application system. These data include but are not limited to the following categories: application layer monitoring access data, which can be used to evaluate the monitoring performance of the application itself at the application layer, including monitoring access mode, the monitoring object and the monitoring data flow indicator, etc., to evaluate the monitoring access performance of the application layer; infrastructure layer monitoring access data, which can be used to evaluate the status of the infrastructure supporting the operation of the application, which may include monitoring data corresponding to each technology stack of the infrastructure layer (for example, whether each technology stack has set up a monitoring strategy, etc.); monitoring alarm data, which involves the alarm information that has been triggered in the system, is used to evaluate the monitoring alarm performance, and may include the designed alarm level, monitoring alarm rules, whether the alarm monitoring platform is displayed, etc.

[0048] It can be understood that in response to the conditions or states on which the executed operations depend, when the dependent conditions or states are met, one or more operations executed can be in real time or have a set delay; unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0049] Step S202: Determine at least one of an application layer monitoring access score, an infrastructure layer monitoring access score, and a monitoring alarm score according to a preset scoring rule and the monitoring indicator data.

[0050] In this embodiment, the collected monitoring indicator data is analyzed and scored according to the pre-set scoring rules. The monitoring coverage and effectiveness of the application layer are evaluated by calculating the application layer monitoring access score, and the monitoring coverage and effectiveness of the infrastructure layer are evaluated by calculating the infrastructure layer monitoring access score, and the responsiveness and accuracy of the alarm system are evaluated by calculating the monitoring alarm score.

[0051] It should be noted that technical personnel in this field can determine the scoring rules based on actual applications or adaptability of prior data. Taking the monitoring alarm score as an example, if there is no alarm monitoring platform display, it will be 0 points. If there is an alarm platform display, it can be evaluated together based on the alarm platform display, alarm (linkage) monitoring platform details display, alarm category data statistics, key monitoring indicator view display and other dimensions (for example, whether there is) to obtain the alarm platform display score.

[0052] Step S203: Obtain an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score.

[0053] In this embodiment, based on the above-mentioned scoring, the system comprehensively obtains an evaluation result of the monitoring capability of the application system. This result can be a comprehensive score or grade, reflecting whether the monitoring capability of the current system meets the expected standards, and the evaluation result can be output to the requesting party so that the evaluation result can be used for decision support, such as improving monitoring strategies, optimizing resource allocation, and improving system reliability.

[0054] Through the above technical solution, the monitoring capability of the application system can be systematically evaluated, providing data support for optimizing the monitoring capability of the application system to ensure the efficient operation of the application system and timely response to problems.

[0055] Next, the above step S201 of obtaining the monitoring index data of the application system is further described:

[0056] In one example, the process of obtaining application layer monitoring access data in monitoring indicator data of an application system may include the following steps:

[0057] Based on the monitoring access dimension, a monitoring access method of the application system is obtained, where the monitoring access method includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring.

[0058] Based on the monitoring object dimension, acquiring monitoring object data of the application system, the monitoring object data including at least one of the following: partition monitoring, site monitoring and POD node monitoring;

[0059] Based on the monitoring data flow indicator dimension, obtaining the data flow monitoring indicator of the application system, wherein the data flow monitoring indicator includes at least one of the following: transaction volume, response time and process;

[0060] The application layer monitoring access data is obtained according to at least one of the monitoring access mode, the monitoring object and the monitoring data flow indicator.

[0061] In this example, direct connection monitoring, that is, directly connecting to the application system to obtain real-time performance and status data, is usually used for critical applications that require high-frequency data collection; web page monitoring, by simulating the way users access web pages, monitors the availability and response time of the application system. This method is suitable for Web applications and can evaluate user experience; log keyword monitoring, by analyzing the log files generated by the application system, extracting specific keywords or patterns to monitor the system's operating status and abnormal conditions. In addition to the above-mentioned monitoring access methods, it can also include performance monitoring, full-link monitoring, intelligent monitoring, heartbeat monitoring, and Bridge Control Protocol (BCP) bypass monitoring.

[0062] In this example, partition monitoring means monitoring different functional modules or data partitions of the application system to identify performance issues in specific areas; site monitoring means monitoring sites in different geographical locations for distributed application systems to ensure the availability and performance of each site; POD node monitoring means monitoring the status and resource usage of each POD node in a containerized environment to ensure the stable operation of containerized applications. In addition to the above monitoring objects, it can also include application modules / instances, microservice names, clusters, transaction codes, etc.

[0063] In this example, transaction volume refers to the number of transactions accessed by the monitoring application system within a specific time period to evaluate whether the number of monitoring accesses meets expectations; response time refers to the monitoring response time to evaluate whether the monitoring responds in a timely manner; process refers to the status and resource usage of the key monitored processes to ensure the normal operation of the monitoring.

[0064] The data of each dimension can be obtained from a system configuration file or a custom script. For example, the system configuration file contains information about monitoring settings, including the monitoring tools, monitoring interfaces and protocols used. In some examples, the data of each dimension can be selected or used in any combination to obtain application layer monitoring access data.

[0065] Through the above technical solution, the monitoring access data of the application layer can be obtained more comprehensively, so as to evaluate the completeness of the monitoring access of the application layer and provide data support for the subsequent monitoring performance scoring.

[0066] In another example, obtaining infrastructure layer access data in monitoring indicator data of an application system may include the following steps:

[0067] Collecting the technology stack used by the infrastructure layer of the application system, the technology stack including at least one of the following: a platform resource layer, a physical resource layer, and a virtual resource layer;

[0068] Acquire monitoring access data of the technology stack, and obtain the infrastructure layer monitoring access data based on the monitoring access data.

[0069] In this example, the monitoring access data of the technology stack is obtained in the above steps in the following manner: based on the platform resource layer dimension, the platform resource layer access data is obtained, and the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; based on the physical resource layer dimension, the physical resource layer access data is obtained, and the physical layer access data includes at least one of the following: storage monitoring data, load balancing monitoring data, and network equipment monitoring data; based on the virtual resource layer dimension, the virtual resource layer access data is obtained, and the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

[0070] Specifically, for the platform resource layer, the middleware, operating system, container platform (such as Kubernetes, Docker), etc. on which the application system runs are identified. This layer usually involves software platforms and services to support the operation of applications. By identifying the monitoring tools or APIs provided by the platform resource layer (such as middleware or operating system), for example, by using Kubernetes' monitoring tools (such as Prometheus) to obtain the container status, the corresponding platform resource layer (monitoring) access data, such as middleware and operating system monitoring data, can be obtained; for the physical resource layer, the physical hardware resources that the application system depends on, such as storage devices, network devices, load balancing, etc., are identified. This layer involves the actual hardware infrastructure; and for the virtual resource layer, the virtualization technology and resources used by the application system, such as cloud resources, computing resources, etc., are identified. This layer involves resource abstraction provided by virtualization technology, wherein the physical layer (monitoring) access data and the virtual resource layer (monitoring) access data are obtained in the same way as the above-mentioned platform resource layer (monitoring) access data.

[0071] Through the above technical solution, the monitoring access data of the infrastructure layer can be obtained more comprehensively, so as to evaluate the completeness of the monitoring access of the infrastructure layer and provide data support for the subsequent monitoring performance scoring.

[0072] In another example, obtaining monitoring alarm data in monitoring indicator data of an application system may include the following steps:

[0073] Collect the monitoring alarm level, monitoring alarm rules and alarm monitoring platform display information of the application system;

[0074] The monitoring alarm data is obtained according to the monitoring alarm level, the monitoring alarm rules and the alarm monitoring platform display information.

[0075] In this example, by collecting dimensional data such as alarm level, alarm rules, platform view display, and evaluating the effectiveness of monitoring alarms. Among them, the monitoring alarm level can include six categories, such as severe, major, minor, warning, reminder, and recovery. For example, in the example combined with other monitoring indicator data, the application layer monitoring object and each type of technology stack in the infrastructure layer can be set to include at least major or severe alarms to determine whether the alarm level meets expectations; the alarm rules can monitor the alarm threshold, static or dynamic timeout warning, alarm suppression duration, etc., and monitor whether the setting of each monitoring alarm threshold is reasonable, whether the batch job is configured with static or dynamic timeout warning, alarm suppression duration setting, etc., to determine whether the monitoring rules meet expectations; the platform view display can include each type of alarm linkage monitoring platform details display, alarm category data statistics, key monitoring indicator view display, etc.

[0076] Through the above technical solution, the monitoring and alarm data of the application system can be obtained more comprehensively, so as to evaluate the completeness of the monitoring and alarm and provide data support for subsequent monitoring performance scoring.

[0077] In a possible implementation, the scoring rule may include score configuration information set for each monitoring indicator data, and the score configuration information is determined based on the disaster recovery level, such as Figure 3 As shown, the above step S202 determines at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score according to the preset scoring rules and the monitoring indicator data, and may include the following steps S2021-S2023.

[0078] It is understood that the disaster recovery level refers to the standard of recovery capability and recovery speed set in information technology and business continuity management to cope with the impact of disaster events (such as natural disasters, hardware failures, network attacks, etc.) on information systems, and may include disaster recovery 5 or 6, disaster recovery levels 3 and 4, and disaster recovery levels 1 and 2, where levels 1 and 2 are the highest levels. This embodiment determines the score configuration information according to the disaster recovery level, and uses the score configuration information to score the application system monitoring indicator data, which can provide a monitoring capability evaluation method that is more in line with actual needs, and the evaluation result is more accurate.

[0079] S2021. Configure a first score for each item of data in the application layer monitoring access data according to the score configuration information of the application layer monitoring access data, and obtain the application layer monitoring access score according to the first score.

[0080] Exemplarily, taking the application layer monitoring access data including the monitoring access mode, the monitoring object and the monitoring data flow indicator as an example, the score configuration information includes the score configuration for these data respectively, wherein the monitoring access mode: disaster recovery capability level 6 and level 5 can be set to dual coverage of performance monitoring and full-link monitoring. Disaster recovery capability level 4 and level 3 can be set to any monitoring mode to achieve monitoring coverage, wherein the online customer system and the technical platform supporting products and services can be set to access performance monitoring or full-link monitoring. Disaster recovery capability level 2 and level 1 can be set to achieve monitoring coverage through any monitoring mode, identify the monitoring access mode, if the corresponding score is satisfied (technical personnel in this field can determine the assigned score in combination with actual applications or prior data), the following monitoring objects and monitoring data flow indicators are the same; monitoring objects: disaster recovery capability level 6 and level 5, online access partitions, sites, Pods, etc.; if there is a batch, access plan template number, plan template number_parent node; cloud application monitoring objects should cover Pods, clusters, and microservices. The monitoring objects (performance dimension) of distributed core application modules must include cloud cluster, Pod, and microservice dimensions. For disaster recovery capability levels 4, 3, 2, and 1, the online aspect can reflect whether the system operation status is normal. Select at least one type of monitoring object, such as application module, running instance, province, city, transaction, channel, process, Uniform Resource Locator (URL), Structured Query Language (SQL), etc.; if batch is involved, access the plan template number, plan template number_parent node; the cloud application monitoring objects should cover Pod, cluster, and microservice. Monitoring indicators: For disaster recovery capability levels 6 and 5, the online aspect must access the three life and death indicators of transaction volume per unit time, response time, and success rate. If batch is involved, the batch node execution status and job plan status must be accessed. For other disaster recovery levels, the online aspect can reflect whether the system operation status is normal. At least one type of monitoring object should be selected, such as channel, process, URL, SQL, etc. If batch is involved, access batch node execution status and job plan status at the same time.

[0081] S2022. Configure a second score for each item of data in the infrastructure layer monitoring access data according to the score configuration information of the infrastructure layer monitoring access data, and obtain the infrastructure layer monitoring access score according to the second score.

[0082] It should be noted that the scoring process for monitoring access data at the infrastructure layer can refer to the application layer monitoring access data in the above step S2021, and will not be further elaborated here.

[0083] S2023. Configure a third score for each item of the monitoring alarm data according to the score configuration information of the monitoring alarm data, and obtain the monitoring alarm score according to the third score.

[0084] It should be noted that the scoring process for monitoring access data at the infrastructure layer can refer to the application layer monitoring access data in the above step S2021, and will not be further elaborated here.

[0085] In a possible implementation, the total score is calculated by combining multiple monitoring indicator data and configuring corresponding weights, which can effectively improve the scoring accuracy. Figure 4 As shown, the above step S203 obtains the evaluation result of the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score, and may include the following steps:

[0086] Step S2031: According to preset weight allocation information, corresponding weights are respectively configured for the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score.

[0087] It should be noted that those skilled in the art can determine the weight distribution information based on actual applications or adaptability of prior data, for example, configuring an x ​​weight for the application layer monitoring access score, configuring a y weight for the infrastructure layer monitoring access score, and configuring a z weight for the monitoring alarm score, where x+y+z=1.

[0088] Step S2032: Obtain a total score corresponding to the monitoring indicator data according to the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight.

[0089] For example, the monitoring capability A evaluation of the application system includes three dimensions: application layer monitoring access completeness evaluation (corresponding to the application layer monitoring access score), infrastructure layer monitoring access completeness evaluation (corresponding to the infrastructure layer monitoring access score), and monitoring alarm effectiveness evaluation (corresponding to the monitoring alarm score), which are represented by B, C, and D respectively. The evaluation result of A is expressed as A=TB+TC+TD, where TB, TC, and TD are numerical scores weighted by x, y, and z, respectively.

[0090] Step S2033: Obtain an evaluation result on the monitoring capability of the application system according to the total score.

[0091] Compared to using only one type of monitoring indicator data, this embodiment combines these types of monitoring indicator data and assigns corresponding weights to them to calculate the total score of the monitoring indicator data, and the scoring result is more comprehensive and accurate.

[0092] In some embodiments, the evaluation results of the application system monitoring capability can be obtained by rating, so as to improve the application system monitoring capability. Specifically, the method can also include the following steps: obtaining a mapping relationship table between the score and the evaluation level of the monitoring indicator data; obtaining the evaluation results of the application system monitoring capability according to the total score, including: determining the evaluation level corresponding to the monitoring indicator data according to the mapping relationship table and the total score of the monitoring indicator data; obtaining the evaluation results of the application system monitoring capability according to the evaluation level.

[0093] In this embodiment, the mapping relationship table can be a table determined by those skilled in the art based on actual applications or prior data, which is pre-stored in a database or server, and the mapping relationship table is obtained when there is a scoring requirement. The table defines the corresponding relationship between the score of the monitoring indicator data and the evaluation level. That is, the specific score value is associated with the corresponding evaluation level (such as excellent, good, medium, poor, etc.). Then, using the previously obtained mapping relationship table, the calculated total score is corresponded to a specific evaluation level. This step can be achieved by looking up the interval or value matching the total score in the mapping relationship table, and then according to the determined evaluation level, the final evaluation result of the monitoring capability of the application system can be obtained. This result can be used to judge the current state of the system, identify potential problems or directions for improvement.

[0094] To facilitate understanding of the embodiments of the present application, an exemplary embodiment is provided below for further introduction: Taking application system A as an example, before it is put into production or after it is put into operation, its application system monitoring capability is evaluated, and the application system monitoring capability level is obtained based on the evaluation results, and the system monitoring capability is gradually improved based on the level.

[0095] Combination Figure 5-Figure 8 As shown, the monitoring capability evaluation of application system A includes three dimensions: application layer monitoring access completeness evaluation, infrastructure layer monitoring access completeness evaluation, and monitoring alarm effectiveness evaluation, which are represented by B, C, and D respectively. The evaluation result of A is expressed as A=TB+TC+TD. The overall score of A is 100, and the scoring weights of the three dimensions are x, y, z, and x+y+z=1. And hierarchical management is carried out according to the score, 0-20 is the first level, 21-40 is the second level, 41-60 is the third level, 61-80 is the fourth level, and 81-100 is the fifth level (in some similar embodiments, it can also be other levels). According to the monitoring capability evaluation level obtained by the system, the relevant to-do processes are pushed to gradually improve the system monitoring capability.

[0096] The completeness assessment of the application layer monitoring access calculates and scores based on the disaster recovery level of the application system, from the aspects of monitoring access method assessment, monitoring object assessment, and monitoring index (i.e., data flow monitoring index) assessment. The evaluation results are represented by TAB1, TAB2, and TAB3 respectively. The weights of the three are x1, y1, z1, and x1 + y1 + z1 = 1. TAB1 ∈ {0, 100xx1}, TAB2 ∈ {0, 100xy1}, TAB3 ∈ {0, 100xz1}. The evaluation result of B is TB = TAB1 + TAB2 + TAB3, and TB ∈ {0, 100x}.

[0097] If TB = 0, it means the application layer monitoring is not accessed; if TB = 100x, it means the application layer monitoring access is complete; if 0 < TB < 100x, it means the application layer monitoring access needs to be improved.

[0098] If TAB1 = 100xx1, it is defined that the application layer monitoring access method is complete; if TAB1 = 0, the application layer monitoring access method is not accessed; if 0 < TAB1 < 100xx1, the application layer monitoring access method is not complete, and the application layer monitoring access method of the application system needs to be improved.

[0099] If TAB2 = 100xy1, it is defined that the application layer monitoring object is complete; if TAB2 = 0, the application layer monitoring object is not accessed; if 0 < TAB2 < 100xy1, the access of the application layer monitoring object needs to be improved.

[0100] If TAB3 = 100xz1, it is defined that the application layer monitoring index is complete; if TAB3 = 0, the application layer monitoring index is not accessed; if 0 < TAB3 < 100xz1, it is defined that the access of the application layer monitoring index needs to be improved.

[0101] The application layer monitoring access methods include 8 categories (in some embodiments, it can also be more or fewer categories), such as performance monitoring, link monitoring, log monitoring, direct connection alarm, web page monitoring, heartbeat monitoring, network bypass monitoring, Pod resource monitoring, etc. The evaluation results are represented by B 11、 B 12 …B 1a respectively. The weights of the 8 monitoring access methods are x 11 , x 12 ,..., x 1a , Σx 1a = 1, B 1a = 100xx1x 1a , a = 1,…, 8. The evaluation result of B1 is represented as TAB1 = ΣB 1a , a = 1,…, 8, TAB1 ∈ {0, 100xx1}.

[0102] Monitoring objects may include 20 categories such as application modules / instances, microservice names, sites, application partitions, pods, and cloud clusters (in some embodiments, there may be more or fewer categories). The evaluation results are respectively expressed in B 21、 B 22 …B 2b Indicates that the weights of the 20 types of monitored objects are y 11 ,y 12 , ..., y 1b ,Σy 1b =1,B 2b =100xy1y 1b ,b=1,…,20, the evaluation result of B2 is expressed as TAB2=ΣB 2b ,b=1,…,20,TAB2∈{0,100xy1}.

[0103] The monitoring indicators involve 12 categories (in some embodiments, there may be more or fewer categories), such as business indicators, transaction volume, response time, and online batch processing indicators. The evaluation results are respectively expressed as B 31 , B 32 …B 3c Indicates that the weight of the 12 types of monitoring indicators is z 11 ,z 12 ,...z 1c ,Σz 1c =1,B 3c =100xz1z1c, c=1,…,12, the evaluation result of B3 is expressed as TAB3=ΣB 3c ,c=1,…,12,TAB3∈{0,100xz1}.

[0104] The overall access principle (determination of the corresponding score configuration information) can be: Monitoring access method: Disaster recovery capability levels 6 and 5 require dual coverage of performance monitoring and full-link monitoring. Disaster recovery capability levels 4 and 3 can achieve monitoring coverage through any monitoring method, among which online customer systems and technical platforms supporting products and services should be connected to performance monitoring or full-link monitoring. Disaster recovery capability levels 2 and 1 can achieve monitoring coverage through any monitoring method. Monitoring objects: Disaster recovery capability levels 6 and 5, online access partitions, sites, Pods, etc.; if there are batches, access plan template numbers, plan template numbers_parent nodes; cloud application monitoring objects should cover Pods, clusters, and microservices. The monitoring objects (performance dimensions) of distributed core application modules must include cloud clusters, Pods, and microservice dimensions. For disaster recovery capability levels 4, 3, 2, and 1, the online aspect can reflect whether the system is running normally. At least one type of monitoring object should be selected, such as application model, running instance, province, city, transaction, channel, process, Uniform Resource Locator (URL), Structured Query Language (SQL), etc. If batch is involved, access the plan template number, plan template number_parent node; the cloud application monitoring objects should cover Pod, cluster, and microservice. Monitoring indicators: For disaster recovery capability levels 6 and 5, the online aspect must access the three life and death indicators of transaction volume per unit time, response time, and success rate. If batch is involved, the batch node execution status and job plan status must be accessed. For other disaster recovery levels, the online aspect can reflect whether the system is running normally. At least one type of monitoring object can be selected, such as channel, process, URL, SQL, etc. If batch is involved, the batch node execution status and job plan status must be accessed. In some embodiments, the off-cloud system is connected to the platform for online monitoring through at least one monitoring method (direct connection monitoring, performance monitoring, web page monitoring, full-link monitoring, log keyword monitoring, intelligent monitoring, heartbeat monitoring, BCP bypass monitoring); the on-cloud system is connected to the platform through at least Pod monitoring.

[0105] The completeness of monitoring access at the infrastructure layer is scored based on the access status of the general monitoring strategy of the technology stack used by the application system. The technology stack includes operating systems, middleware, databases, cloud resources, computing resources, network equipment, storage, load balancing, etc. The general monitoring strategy of each technology stack has certain monitoring objects and monitoring indicators. The evaluation results are represented by TAC1, TAC2, TAC3...TAC8, and the evaluation result of C is TC=ΣTAC d ,TC∈{0,100y},d=1,…,8,The weights of various technology stacks are n1,n2,...,n d ,Σn d =1,TAC d ∈{0,100ynd}.

[0106] If TC = 0, the infrastructure layer monitoring is not connected. If TC = 100y, the infrastructure layer monitoring connection is complete. If 0 < TC < 100y, the infrastructure layer monitoring connection needs to be improved.

[0107] Each category includes specific technology stack types. For example, the operating systems include AIX, Windows, and Linux, and the evaluation results of the access of the general monitoring policies for the operating systems are represented by AC 11 , AC 12 , AC 13 respectively, where TAC1 = ΣAC 1e , e = 1, 2, 3. The weight of each type of operating system is o e , Σo e = 1, AC 1e = 100yn1o e , e = 1, 2, 3.

[0108] The middleware includes 9 categories such as Nginx, Tomcat, TongWeb, and WAS (in some embodiments, there may be more or fewer categories), and the evaluation results are represented by AC 21 , AC 22 … AC 2f respectively, where TAC2 = ΣAC 2f , f = 1, 2, …, 9. The weight of each type of middleware is p f , Σp f = 1, AC 2f = 100yn2p f , f = 1, 2, …, 9.

[0109] The databases include 9 categories such as TDSQL, GaussDB, and Sybase (in some embodiments, there may be more or fewer categories), and the evaluation results are represented by AC 31 , AC 32 … AC 3g respectively, where TAC3 = ΣAC 3g , g = 1, 2, …, 9. The weight of each type of database is q g , Σq g = 1, AC 3g = 100yn3q g , g = 1, 2, …, 9.

[0110] And so on, the evaluation results of cloud resources, computing resources, network devices, storage, and load balancing are TAC4 = ΣAC 4h , h = 1, 2; TAC5 = ΣAC 5i , i = 1; TAC6 = ΣAC6j ,j=1,…,4;TAC7=ΣAC 7k ,k=1;TAC8=ΣAC 8l ,l=1,2.

[0111] The weight of each type of cloud resource is r h ,Σr h =1,h=1,2,AC 4h =100yn4r h .

[0112] If computing resources are involved and monitoring is connected, TAC5 = AC 51 , if not connected, TAC5=0.

[0113] The weight of each type of network equipment is s j ,Σs j =1,j=1,…,4,AC 6j =100yn5s j .

[0114] If storage resources are involved and monitoring is connected, TAC7 = AC 71 , if not connected, TAC7=0.

[0115] The weight of each type of load balancing is t l ,Σt l =1, l=1,2, AC 8l =100yn7t l .

[0116] The effectiveness of monitoring alarms is evaluated from three dimensions: alarm level, alarm rules, and platform view display. The evaluation results are expressed as TAD1, TAD2, and TAD3. The evaluation result of monitoring alarm effectiveness D is TD = ΣTAD M ,M=1,2,3,TD∈{0,100z}. The weights of the three dimensions are u, v, w, u+v+w=1,TAD1∈{0,100zu},TAD2∈{0,100zv},TAD3∈{0,100zw}.

[0117] The application layer and infrastructure layer alarm level assessment results are expressed as AD 11 and AD 12 , the weights of the two are u1 and u2 respectively, u1+u2=1, AD 11 =100zuu1,AD 12 =100zuu2,TAD1=AD 11 +AD 12 .

[0118] The alarm rules are evaluated from the dimensions of whether the setting of each monitoring alarm threshold is reasonable, whether the batch job is configured with static or dynamic timeout warning, alarm suppression duration setting, etc. (in some embodiments, more or fewer dimensions may be included). The evaluation results of the three dimensions are AD 21 ,AD 22 ,AD 23 , the weights of the three are v1, v2, v3, v1+v2+v3=1, AD 21 =100zvv1,AD 22 =100zvv2,AD 23 =100zvv3, the overall evaluation result of the alarm rule is TAD2=AD 21 +AD 22 +AD 23 .

[0119] The platform view display is evaluated from the dimensions of each type of alarm linkage monitoring platform details display, alarm category data statistics, key monitoring indicator view display, etc. (in some embodiments, more or fewer dimensions may be included). The evaluation results of the three dimensions are AD 31 ,AD 32 ,AD 32 , the weights of the three are w1, w2, w3, w1+w2+w3=1, AD 31 =100zvw1,AD 32 =100zvw2,AD 33 =100zvw3, the overall evaluation result displayed in the platform view is TAD3=AD 31 +AD 32 +AD 33 .

[0120] It can be seen that the above technical solution sets the monitoring access capability evaluation indicators of the application layer and infrastructure layer of the application system in a more comprehensive and integrated manner, realizes the application of the superposition method in the application system monitoring capability evaluation method, and performs hierarchical management based on the monitoring capability scoring results, making the monitoring capability of the application system more and more perfect, laying the foundation for the optimization of the monitoring capability of the application system.

[0121] The present application also provides a processing device for evaluating the monitoring capability of an application system. Fig. 9 As shown, the processing device 900 includes a data acquisition module 901, a score determination module 902 and an evaluation module 903, wherein:

[0122] A data acquisition module 901 is configured to acquire monitoring indicator data of the application system in response to an evaluation request for monitoring capability of the application system, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data;

[0123] A score determination module 902, which is configured to determine at least one of an application layer monitoring access score, an infrastructure layer monitoring access score, and a monitoring alarm score according to a preset scoring rule and the monitoring indicator data;

[0124] The evaluation module 903 is configured to obtain an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score.

[0125] In a possible implementation, the data acquisition module 901 includes:

[0126] The access mode acquisition unit is configured to acquire the monitoring access mode of the application system based on the monitoring access dimension, wherein the monitoring access mode includes at least one of the following: direct connection monitoring, web page monitoring and log keyword monitoring.

[0127] A monitoring object acquisition unit, configured to acquire monitoring object data of the application system based on a monitoring object dimension, wherein the monitoring object data includes at least one of the following: partition monitoring, site monitoring, and POD node monitoring;

[0128] A data flow indicator acquisition unit, which is configured to acquire a data flow monitoring indicator of the application system based on a monitoring data flow indicator dimension, wherein the data flow monitoring indicator includes at least one of the following: transaction volume, response time and process;

[0129] The first collection unit is configured to obtain the application layer monitoring access data according to at least one of the monitoring access mode, the monitoring object and the monitoring data flow indicator.

[0130] In a possible implementation, the data acquisition module 901 includes:

[0131] A second collection unit is configured to collect a technology stack used by an infrastructure layer of the application system, wherein the technology stack includes at least one of the following: a platform resource layer, a physical resource layer, and a virtual resource layer;

[0132] An infrastructure layer data acquisition unit is configured to acquire monitoring access data of the technology stack and obtain the infrastructure layer monitoring access data based on the monitoring access data.

[0133] In a possible implementation, the second acquisition unit is specifically configured to: based on the platform resource layer dimension, obtain platform resource layer access data, the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data and middleware monitoring data; based on the physical resource layer dimension, obtain physical resource layer access data, the physical layer access data includes at least one of the following: storage monitoring data, load balancing monitoring data and network equipment monitoring data; based on the virtual resource layer dimension, obtain virtual resource layer access data, the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

[0134] In a possible implementation, the data acquisition module 901 includes:

[0135] A third collection unit, which is configured to collect monitoring alarm levels, monitoring alarm rules, and alarm monitoring platform display information of the application system;

[0136] A monitoring alarm acquisition unit is configured to obtain the monitoring alarm data according to the monitoring alarm level, the monitoring alarm rule and the alarm monitoring platform display information.

[0137] In a possible implementation manner, the scoring rule includes score configuration information set for each monitoring indicator data, and the score configuration information is determined based on the disaster recovery level;

[0138] The score determination module 902 includes:

[0139] A first scoring unit, configured to configure a first score for each item of data in the application layer monitoring access data according to the score configuration information of the application layer monitoring access data, and obtain the application layer monitoring access score according to the first score;

[0140] A second scoring unit, which is configured to configure a second score for each item of data in the infrastructure layer monitoring access data according to the score configuration information of the infrastructure layer monitoring access data, and obtain the infrastructure layer monitoring access score according to the second score;

[0141] The third scoring unit is configured to configure a third score for each item of the monitoring alarm data according to the score configuration information of the monitoring alarm data, and obtain the monitoring alarm score according to the third score.

[0142] In a possible implementation, the evaluation module 903 includes:

[0143] A weight allocation unit, configured to respectively configure corresponding weights for the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score according to preset weight allocation information;

[0144] a total score calculation unit, configured to obtain a total score corresponding to the monitoring indicator data according to the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight;

[0145] An evaluation result acquisition unit is configured to acquire an evaluation result on the monitoring capability of the application system according to the total score.

[0146] In a possible implementation, the device further includes:

[0147] A mapping acquisition module, configured to acquire a mapping relationship table between the scores and evaluation levels of the monitoring indicator data;

[0148] The evaluation result acquisition unit is specifically configured to: determine the evaluation level corresponding to the monitoring indicator data according to the mapping relationship table and the total score of the monitoring indicator data; and obtain the evaluation result on the monitoring capability of the application system according to the evaluation level.

[0149] The above-mentioned device provided in the embodiment of the present application can be used to execute the technical solution of the processing method for evaluating the monitoring capability of the application system in the above-mentioned embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0150] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the score determination module 902 can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The function of the above score determination module 902. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0151] Fig.10This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.10 As shown, the electronic device may include: a transceiver 101 , a processor 102 , and a memory 103 .

[0152] The processor 102 executes the computer execution instructions stored in the memory, so that the processor 102 executes the scheme in the above embodiment. The processor 102 can be a general-purpose processor, including a central processing unit CPU, a network processor (network processor, NP), etc.; it can also be a digital signal processor DSP, an application-specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

[0153] The memory 103 is connected to the processor 102 via a system bus and implements communication therebetween. The memory 103 is used to store computer program instructions.

[0154] The transceiver 101 can be used for data reception and data transmission.

[0155] The system bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The system bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. The transceiver is used to realize the communication between the database access device and other computers (such as clients, read-write libraries, and read-only libraries). The memory may include random access memory (RAM) and may also include non-volatile memory.

[0156] The electronic device provided in the embodiment of the present application may be the server in the above embodiment.

[0157] An embodiment of the present application also provides a chip for running instructions, which is used to execute the technical solution of the processing method for evaluating the monitoring capability of the application system in the above embodiment.

[0158] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a computer, the computer executes the technical solution of the processing method for evaluating the monitoring capability of an application system in the above embodiment.

[0159] An embodiment of the present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium. When at least one processor executes the computer program, it can implement the technical solution of the processing method for evaluating the monitoring capability of the application system in the above embodiment.

[0160] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0161] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to implement the solution of this embodiment.

[0162] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The above-mentioned module-composed unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0163] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the methods of various embodiments of the present application.

[0164] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

[0165] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.

[0166] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0167] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0168] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic control unit or a main control device.

[0169] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0170] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A processing method for evaluating the monitoring capability of an application system, characterized in that: include: In response to an evaluation request for monitoring capability of an application system, obtaining monitoring indicator data of the application system, the monitoring indicator data comprising at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data; Determine at least one of an application layer monitoring access score, an infrastructure layer monitoring access score, and a monitoring alarm score according to preset scoring rules and the monitoring indicator data; An evaluation result on the monitoring capability of the application system is obtained according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score.

2. The method according to claim 1, characterized in that The obtaining of monitoring indicator data of the application system includes: Based on the monitoring access dimension, obtaining a monitoring access mode of the application system, wherein the monitoring access mode includes at least one of the following: direct connection monitoring, web page monitoring, and log keyword monitoring; Based on the monitoring object dimension, acquiring monitoring object data of the application system, the monitoring object data including at least one of the following: partition monitoring, site monitoring and POD node monitoring; Based on the monitoring data flow indicator dimension, obtaining the data flow monitoring indicator of the application system, wherein the data flow monitoring indicator includes at least one of the following: transaction volume, response time and process; The application layer monitoring access data is obtained according to at least one of the monitoring access mode, the monitoring object and the monitoring data flow indicator.

3. The method according to claim 1, characterized in that The obtaining of monitoring indicator data of the application system includes: Collecting the technology stack used by the infrastructure layer of the application system, the technology stack including at least one of the following: a platform resource layer, a physical resource layer, and a virtual resource layer; Acquire monitoring access data of the technology stack, and obtain the infrastructure layer monitoring access data based on the monitoring access data.

4. The method according to claim 2, characterized in that: The obtaining of monitoring access data of the technology stack includes: Based on the platform resource layer dimension, obtaining platform resource layer access data, wherein the platform resource layer access data includes at least one of the following: operating system monitoring data, database monitoring data, and middleware monitoring data; Based on the physical resource layer dimension, obtaining physical resource layer access data, the physical layer access data including at least one of the following: storage monitoring data, load balancing monitoring data, and network equipment monitoring data; Based on the virtual resource layer dimension, the virtual resource layer access data is obtained, where the virtual resource layer access data includes cloud resource monitoring data and / or computing resource monitoring data.

5. The method according to claim 1, characterized in that The obtaining of monitoring indicator data of the application system includes: Collect monitoring alarm levels, monitoring alarm rules and alarm monitoring platform display information of the application system; The monitoring alarm data is obtained according to the monitoring alarm level, the monitoring alarm rules and the alarm monitoring platform display information.

6. The method according to any one of claims 1 to 5, characterized in that: The scoring rules include score configuration information set for each monitoring indicator data, and the score configuration information is determined based on the disaster recovery level; Determining at least one of an application layer monitoring access score, an infrastructure layer monitoring access score, and a monitoring alarm score according to a preset scoring rule and the monitoring indicator data includes: According to the score configuration information of the application layer monitoring access data, configure a first score for each item of data in the application layer monitoring access data, and obtain the application layer monitoring access score according to the first score; According to the score configuration information of the infrastructure layer monitoring access data, configuring a second score for each item of data in the infrastructure layer monitoring access data, and obtaining the infrastructure layer monitoring access score according to the second score; According to the score configuration information of the monitoring alarm data, a third score is configured for each item of the monitoring alarm data, and the monitoring alarm score is obtained according to the third score.

7. The method according to any one of claims 1 to 5, characterized in that: Obtaining an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score, and the monitoring alarm score, includes: According to the preset weight allocation information, corresponding weights are respectively configured for the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score; Obtaining a total score corresponding to the monitoring indicator data according to the sum of the application layer monitoring access score and its weight, the infrastructure layer monitoring access score and its weight, and the monitoring alarm score and its weight; An evaluation result on the monitoring capability of the application system is obtained according to the total score.

8. The method according to claim 7, characterized in that Also includes: Obtaining a mapping relationship table between the scores and evaluation levels of the monitoring indicator data; The obtaining of the evaluation result on the monitoring capability of the application system according to the total score includes: Determine the evaluation level corresponding to the monitoring indicator data according to the mapping relationship table and the total score of the monitoring indicator data; According to the evaluation level, an evaluation result on the monitoring capability of the application system is obtained.

9. A processing device for evaluating the monitoring capability of an application system, characterized in that: include: A data acquisition module, configured to acquire monitoring indicator data of the application system in response to an evaluation request for monitoring capability of the application system, wherein the monitoring indicator data includes at least one of the following: application layer monitoring access data, infrastructure layer monitoring access data, and monitoring alarm data; A score determination module, configured to determine at least one of an application layer monitoring access score, an infrastructure layer monitoring access score, and a monitoring alarm score according to a preset scoring rule and the monitoring indicator data; An evaluation module is configured to obtain an evaluation result on the monitoring capability of the application system according to at least one of the application layer monitoring access score, the infrastructure layer monitoring access score and the monitoring alarm score.

10. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the processing method for evaluating the monitoring capability of an application system according to any one of claims 1 to 8.

Images