Distributed database monitoring method and device, computer equipment and storage medium

Abstract

The embodiment of the invention provides a distributed database monitoring method and device, computer equipment and a storage medium, and belongs to the technical field of database management. The method comprises the steps of obtaining multiple pieces of operation state information corresponding to multiple preset operation monitoring indexes in a distributed database, wherein the preset operation monitoring indexes are indexes having influences on stable operation of the distributed database; displaying each piece of operation state information in the plurality of pieces of operation state information in a corresponding visual panel of a preset operation monitoring index; and when the operation state information under any target operation monitoring index in the plurality of preset operation monitoring indexes indicates that the business service pressure of the distributed database under the target operation monitoring index is greater than or equal to a pressure threshold value associated with the target operation monitoring index, the distributed database operates according to the pressure threshold value. And displaying the alarm prompt information in a visual panel of the target operation monitoring index. According to the embodiment of the invention, the capability of ensuring the TIDB database to provide stable services can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of database management, and in particular to a monitoring method, device, computer equipment and storage medium for a distributed database. Background Art

[0002] The enterprise-level open source distributed database (TiKV Distributed Database, TIDB) is a real-time relational database that is distributed, storage-computing separated, highly available, and can maintain strong consistency. The TIDB database has been widely used in many industries. In the related technology, the daily use and operation and maintenance of the TIDB database are still based on the traditional monitoring methods developed based on the stand-alone architecture database. However, since the distributed architecture of the TIDB database itself is more complex than that of the stand-alone architecture database, the daily use and operation and maintenance of the TIDB database still use traditional monitoring methods. It is impossible to accurately evaluate the various indicators of the TIDB database, making it difficult to ensure that the TIDB database provides stable services. Therefore, how to improve the ability to ensure that the TIDB database provides stable services has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The main purpose of the embodiments of the present application is to propose a distributed database monitoring method, apparatus, computer equipment and readable storage medium, aiming to enhance the ability of the TIDB database to provide stable services.

[0004] To achieve the above object, a first aspect of an embodiment of the present application proposes a monitoring method for a distributed database, the method comprising:

[0005] Acquire multiple operation status information corresponding to multiple preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database;

[0006] Displaying each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto;

[0007] When the operating status information under the target operation monitoring indicator indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to the target pressure threshold, an alarm prompt information is displayed in the target visualization panel, the target operation monitoring indicator is any one of a plurality of preset operation monitoring indicators, the target visualization panel is a visualization panel of the target operation monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operation monitoring indicator.

[0008] In some embodiments, the plurality of preset operation monitoring indicators include: key monitoring indicators, basic health indicators and component indicators; the basic health indicators include: cluster indicators and node indicators;

[0009] The obtaining of a plurality of operation status information corresponding to a plurality of preset operation monitoring indicators in a distributed database includes:

[0010] In the monitoring component of the distributed database, link resources, auxiliary computing resources, available storage space and global clock service of the distributed database are obtained as operation status information corresponding to the key monitoring indicators;

[0011] The total query frequency and overall time consumption of the distributed database are obtained in the monitoring component as the operation status information corresponding to the cluster indicator; and based on the node indicator in the basic health indicator, the node service health of the distributed database is obtained in the monitoring component as the operation status information corresponding to the node indicator;

[0012] The monitoring component obtains the status information of the access computing component, the storage computing component and the global clock component in the distributed database as the running status information corresponding to the component indicator.

[0013] In some embodiments, before displaying each of the plurality of operating status information in a visualization panel of a preset operating monitoring indicator corresponding thereto, the method further comprises:

[0014] Constructing visualization panels corresponding to the key monitoring indicators, the basic health indicators, and the component indicators;

[0015] The visualization panel corresponding to the basic health indicator includes: a first visualization panel corresponding to the cluster indicator and a second visualization panel corresponding to the node indicator.

[0016] In some embodiments, before displaying the warning prompt information in the target visualization panel, the method further includes:

[0017] Based on the key monitoring indicators, business service pressure prediction is performed on the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database to obtain the pressure threshold associated with the key monitoring indicators;

[0018] Based on the cluster indicators in the basic health indicators, the total query frequency and the overall time consumption of the distributed database are predicted for business service pressure, and the pressure threshold associated with the cluster indicators is obtained; and based on the node indicators in the basic health indicators, the node service health of the distributed database is predicted for business service pressure, and the pressure threshold associated with the node indicators is obtained;

[0019] Based on the component indicators, business service pressure prediction is performed on the access computing component, storage computing component and global clock component of the distributed database to obtain pressure thresholds associated with the component indicators.

[0020] In some embodiments, before displaying the warning prompt information in the target visualization panel, the method further includes:

[0021] Generating initial alarm thresholds for the key monitoring indicators, the basic health indicators, and the component indicators based on the configuration information of the distributed database;

[0022] Based on the initial alarm threshold corresponding to the key monitoring indicator, the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database are predicted to obtain the pressure threshold associated with the key monitoring indicator;

[0023] Based on the initial alarm threshold corresponding to the cluster indicator in the basic health indicator, the total query frequency and the overall time consumption of the distributed database are predicted for business service pressure, and the pressure threshold associated with the cluster indicator is obtained; and based on the initial alarm threshold of the node indicator in the basic health indicator, the node service health of the distributed database is predicted for business service pressure, and the pressure threshold associated with the node indicator is obtained;

[0024] Based on the initial alarm threshold corresponding to the component indicator, the business service pressure of the access computing component, the storage computing component and the global clock component of the distributed database is predicted to obtain the pressure threshold associated with the component indicator.

[0025] In some embodiments, the method further comprises:

[0026] The pressure threshold associated with the key monitoring indicator is configured and displayed in the visualization panel corresponding to the key monitoring indicator;

[0027] The pressure threshold value associated with the cluster indicator is configured to be displayed in a first visualization panel corresponding to the cluster indicator;

[0028] The pressure threshold value associated with the node indicator is configured to be displayed in a second visualization panel corresponding to the node indicator;

[0029] The pressure threshold associated with the component indicator is configured and displayed in the visualization panel corresponding to the component indicator.

[0030] In some embodiments, the method further comprises:

[0031] Obtaining concurrent query volume information, query response time information and connection number information of the distributed database;

[0032] The concurrent query volume information, the query response time information and the connection number information are visualized through the visualization panel corresponding to the key monitoring indicators among the multiple preset operation monitoring indicators.

[0033] To achieve the above-mentioned purpose, a second aspect of an embodiment of the present application provides a monitoring device for a distributed database, the device comprising:

[0034] An acquisition module, used to acquire a plurality of operation status information corresponding to a plurality of preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database;

[0035] A visualization display module, used to display each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto;

[0036] A monitoring alarm module is used to display an alarm prompt information in a target visualization panel when the operating status information under a target operating monitoring indicator indicates that the business service pressure of the distributed database under the target operating monitoring indicator is greater than or equal to a target pressure threshold. The target operating monitoring indicator is any one of a plurality of preset operating monitoring indicators, the target visualization panel is a visualization panel of the target operating monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operating monitoring indicator.

[0037] To achieve the above-mentioned purpose, the third aspect of an embodiment of the present application proposes a computer device, which includes a memory and a processor, the memory stores a computer program, and the processor implements the method described in the first aspect when executing the computer program.

[0038] To achieve the above-mentioned purpose, the fourth aspect of an embodiment of the present application proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect is implemented.

[0039] In addition, to achieve the above-mentioned purpose, the fifth aspect of an embodiment of the present application also proposes a computer program product, which includes a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the first aspect is implemented.

[0040] The monitoring method, device, computer equipment and storage medium of a distributed database proposed in the present application obtain multiple operation status information corresponding to multiple preset operation monitoring indicators in a distributed database, wherein the different operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database; each of the multiple operation status information is displayed in a visualization panel of the preset operation monitoring indicators corresponding thereto; when the operation status information under the target operation monitoring indicator indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to a target pressure threshold, an alarm prompt information is displayed in the target visualization panel, the target operation monitoring indicator is any one of the multiple preset operation monitoring indicators, the target visualization panel is a visualization panel of the target operation monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operation monitoring indicator.

[0041] Compared with the use of traditional monitoring methods to monitor distributed databases, the embodiment of the present application obtains multiple preset operation monitoring indicators that have an impact on the stable operation of the distributed database by analyzing the architecture of the distributed database, thereby obtaining multiple operation status information corresponding to the multiple preset operation monitoring indicators in the distributed database, and the operation status information is displayed through the visualization panel of the preset operation monitoring indicators corresponding to different operation status information, and the operation status information under one or more target operation monitoring indicators in the multiple preset operation monitoring indicators indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to the target pressure threshold associated with the target operation monitoring indicator, and the warning prompt information is displayed through the visualization panel of the target operation monitoring indicator. In this way, by applying the embodiment of the present application to the daily inspection and preliminary location of the TIDB database service during the daily operation and maintenance of the TIDB database, it can not only simplify the difficulty of daily maintenance and inspection to improve maintenance efficiency, but also more conveniently discover the hidden dangers of the TIDB database in advance to improve the efficiency of preliminary location problems, thereby effectively improving the ability to ensure that the TIDB database provides stable services. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 It is a schematic diagram of the architecture of the TIDB database involved in the embodiment of the present application;

[0043] Figure 2 A schematic diagram of the steps of the distributed database monitoring method provided in some embodiments of the present application;

[0044] Figure 3 for Figure 2 Schematic diagram of detailed process flow of step S201;

[0045] Figure 4 A schematic flow chart of a step of performing stress testing on a judgment threshold involved in some embodiments of the distributed database monitoring method provided in the embodiments of the present application;

[0046] Figure 5 A schematic flow chart of another step of performing stress testing on a judgment threshold involved in some embodiments of the distributed database monitoring method provided in the embodiments of the present application;

[0047] Figure 6 A schematic diagram of the steps of the distributed database monitoring method provided in the embodiment of the present application in some other embodiments;

[0048] Figure 7 It is a schematic diagram of the structure of a monitoring device for a distributed database provided in an embodiment of the present application;

[0049] Figure 8 It is a schematic diagram of the hardware structure of the computer device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0051] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0053] First, some professional and technical terms involved in the embodiments of this application are analyzed:

[0054] Enterprise-level open source distributed database (TiKV Distributed Database, TIDB).

[0055] The enterprise-level open source distributed database (TiKV Distributed Database, TIDB) is a distributed, storage-computing separation, highly available, and highly consistent real-time relational database. Unlike traditional stand-alone databases, TIDB is a complex distributed, high-concurrency real-time relational database. Based on a high-concurrency real-time relational database, it has the characteristics of distributed and architectural design. Figure 1 As shown in the figure, the architecture of the TIDB database consists of an access computing layer (TIDBserver), a global clock layer (PD), and a storage computing layer (TIKV), and each layer contains multiple components. For example, the access computing layer (TIDBserver) includes multiple TIDB components, and the TIDB components are designed to be stateless access and computing layers; the global clock layer (PD) includes multiple PD components, and the PD components mainly serve as global clocks; the storage computing layer (TIKV) includes multiple TIKV components, and the TIKV components integrate independent data storage and distributed features.

[0056] Natural language processing (NLP): NLP uses computers to process, understand and apply human languages ​​(such as Chinese, English, etc.). NLP is a branch of artificial intelligence and an interdisciplinary subject between computer science and linguistics. It is often referred to as computational linguistics. Natural language processing includes grammatical analysis, semantic analysis, and text understanding. Natural language processing is often used in technical fields such as machine translation, handwritten and printed character recognition, speech recognition and text-to-speech conversion, information intent recognition, information extraction and filtering, text classification and clustering, public opinion analysis and opinion mining. It involves data mining related to language processing, machine learning, knowledge acquisition, knowledge engineering, artificial intelligence research, and linguistic research related to language computing.

[0057] Information Extraction: A text processing technology that extracts specified types of entity, relationship, event and other factual information from natural language text and forms structured data output. Information extraction is a technology that extracts specific information from text data. Text data is composed of some specific units, such as sentences, paragraphs, and chapters. Text information is composed of some small specific units, such as characters, words, phrases, sentences, paragraphs, or a combination of these specific units. Extracting noun phrases, names, place names, etc. from text data are all text information extraction. Of course, the information extracted by text information extraction technology can be various types of information.

[0058] Next, the overall technical concept of the embodiments of the present application is described.

[0059] In the field of database management systems (DBMS), TIDB database is a powerful database product. After years of development, it has been put into production as a mature product. TIDB database belongs to the relational database (RDBMS) and supports strong consistency. Its architecture is designed with distributed architecture to ensure high availability of the database, as well as rapid horizontal expansion of computing power and capacity. At the same time, the database itself is compatible with the MySQL protocol, which is very friendly to the transformation of existing systems and has a relatively low learning cost. It has been widely used in the financial industry.

[0060] As a distributed, storage-computing-separated, highly available, and highly consistent real-time relational database system, the daily operation and maintenance of the TIDB database is bound to be very different from previous stand-alone database systems. However, in the related technology, the daily use and operation and maintenance of the TIDB database are still based on the traditional monitoring methods developed for stand-alone database architectures. Therefore, in the daily use and operation and maintenance of the TIDB database, it is found that the traditional monitoring methods developed based on stand-alone database architectures cannot accurately evaluate the various indicators of the TIDB database, making it difficult to ensure that the TIDB database provides stable services. Therefore, how to improve the ability to ensure that the TIDB database provides stable services has become a technical problem that needs to be solved urgently.

[0061] Based on this, considering that the TIDB database is a distributed database and its distributed and complex architecture will cause a sharp increase in monitoring indicators, which indicators should be prioritized for monitoring and where are the relationships between the indicators? And when an exception occurs, is there a well-organized visualization panel (dashboard) for operation and maintenance personnel to make direction judgments in the first place? The embodiments of the present application provide a monitoring method, device, computer equipment and storage medium for a distributed database by carefully analyzing the architectural characteristics and design principles of the TIDB database itself, aiming to enhance the ability of the TIDB database to provide stable services.

[0062] The distributed database monitoring method, apparatus, computer equipment and storage medium provided in the embodiments of the present application are specifically described through the following embodiments. First, the distributed database monitoring method in the embodiments of the present application is described.

[0063] The monitoring method of a distributed database provided in an embodiment of the present application relates to the field of database management technology. The monitoring method of a distributed database provided in an embodiment of the present application can be applied to a terminal, can be applied to a server side, or can be software running in a terminal or a server side. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.; the server side can be configured as an independent physical server, or can be configured as a server cluster or a distributed system composed of multiple physical servers, or can be configured as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements the monitoring method of a distributed database, etc., but is not limited to the above forms.

[0064] In addition, the monitoring method of the distributed database provided by the embodiment of the present application can also be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer computer devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0065] For ease of understanding and explanation, the following text will take the distributed database monitoring method provided by the terminal device application embodiment of the present application as an example for detailed description. The implementation of the distributed database monitoring method provided by the embodiment of the present application in any of the above-mentioned forms of the subject application can refer to the process of the distributed database monitoring method applied by the terminal device described later.

[0066] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0067] Please refer to Figure 2 , Figure 2 The following is a flow chart of the steps of the distributed database monitoring method provided in some embodiments of the present application. Figure 2 The execution order of some method steps is shown in the figure, but based on different design requirements of actual applications, the distributed database monitoring method provided in the embodiment of the present application can certainly adopt an execution order different from the method steps shown in the figure. That is, Figure 2 The order of the steps of the method shown does not constitute a limitation on the execution logic order of the distributed database monitoring method provided in the embodiment of the present application. Figure 2 Reasonable changes in the order of the steps of the method shown should be included in the protection scope of the distributed database monitoring method provided in the embodiments of the present application.

[0068] like Figure 2 As shown, in some embodiments, the distributed database monitoring method provided in the embodiments of the present application may include but is not limited to steps S201 to S203.

[0069] Step S201: Acquire multiple operation status information corresponding to multiple preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the corresponding preset operation monitoring indicators, and the preset operation monitoring indicators are indicators that affect the stable operation of the distributed database.

[0070] The terminal device obtains a plurality of preset operation monitoring indicators that have an impact on the stable operation of the distributed database by analyzing the architecture of the distributed database, thereby obtaining a plurality of operation status information corresponding to the plurality of preset operation monitoring indicators in the distributed database.

[0071] It should be noted that among the multiple operation status information of the distributed database obtained by the terminal device, different operation status information is the status information under the corresponding preset operation monitoring indicators. Exemplarily, the terminal device obtains multiple preset operation monitoring indicators including indicator 1, indicator 2...indicator n by analyzing the architecture of the distributed database, and the multiple operation status information of the distributed database obtained by the terminal device are the status information of the distributed database under indicator 1, the status information of the distributed database under indicator 2...the status information of the distributed database under indicator n.

[0072] In some embodiments, the plurality of preset operation monitoring indicators include: key monitoring indicators, basic health indicators and component indicators. Among them, the basic health indicators include: cluster indicators and node indicators.

[0073] It should be noted that when analyzing the architecture of a distributed database, the terminal device can divide the distributed database into two perspectives to observe the database service situation. That is, as a whole, the terminal device can observe the distributed database as a high-concurrency real-time relational database; and as the components that constitute the overall service, the terminal device can conduct targeted analysis and observation according to the different roles and characteristics it plays in the architecture. In addition, for each component of the distributed database, the terminal device also superimposes the analysis of each component separately. Among them, for the PD component in the distributed database, since the PD component mainly plays a global role in the entire system of distributed data to ensure global consistency and metadata management, the terminal device only requires the PD component to be available and the service response delay to be within a certain range. In addition, for the TIDB component in the distributed database, in addition to monitoring the basic computing resources of each node, the terminal device only needs to pay attention to the connection status and the total connection resources provided by all access computing layers (TIDBserver). Furthermore, for the TIKV component in the distributed database, since the TIKV component integrates independent data storage and distributed characteristics, including multi-copy mechanisms, such as data partitioning (region) mechanism and distributed computing mechanism (each TIKV node performs partial auxiliary calculations on the query locally and then aggregates them to the access computing layer to complete the final calculation), the terminal device needs to focus on the auxiliary computing CPU consumption (coporocess cpu cost) and the number of surviving copies of the TIKV component.

[0074] Based on this, when the terminal device sets the operation monitoring indicators for the distributed database, for distributed data, in addition to the need to monitor the cluster indicators of the entire step data (cluster_qps, cluster_connetion, cluster_duration_p95, cluster_duration_p99), the health of each node must also be considered, because the high availability of the cluster design itself may to some extent conceal the unhealthy nodes within the high availability tolerance. Of course, because the cluster provides services as a whole, only the most basic available indicators are required for each node. In addition, for distributed databases, the three major components of distributed components (PD components, TIDB components, and TIKV components) also need to extract corresponding indicators based on characteristics. Therefore, the terminal device can ultimately determine that the multiple preset operation monitoring indicators set for the distributed database are cluster, key, node, and component, namely: cluster indicators, key monitoring indicators, node indicators, and component indicators, among which cluster indicators and node indicators can be classified as basic health indicators of distributed databases.

[0075] Please refer to Figure 3 , Figure 3 for Figure 2 Schematic diagram of the detailed step flow of step S201.

[0076] like Figure 3 As shown, in some embodiments, the above-mentioned step S201: obtaining multiple operation status information corresponding to multiple preset operation monitoring indicators in a distributed database may include steps S301 to S303 as shown below.

[0077] Step S301: In the monitoring component of the distributed database, link resources, auxiliary computing resources, available storage space and global clock service of the distributed database are obtained as operation status information corresponding to the key monitoring indicators.

[0078] It should be noted that the monitoring component of the distributed database may be a monitoring component provided by the integration after the distributed database is deployed. For example, when the distributed database is a TIDB database, the monitoring component may be a promethues component provided by the integration after the TIDB database is deployed.

[0079] After analyzing the architecture of the distributed database to obtain the preset operation monitoring indicators that affect the stable operation of the distributed database, the terminal device obtains the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database as the operation status information corresponding to the key monitoring indicators from the monitoring components of the distributed database.

[0080] Exemplarily, in the case where the distributed database is a TIDB database, as a key monitoring indicator of the TIDB database, the terminal device can obtain the number of connections of the TIDB database through the integrated provided promethues component: tidbserver_connection represents the link resources of the TIDB database, and obtain the TIDB database's tikv auxiliary computing consumption: tikv_corprocess_cpu represents the TIDB database's auxiliary computing resources, and obtain the TIDB database's temporary storage space: tikv_disk_space represents the available storage space of the TID B database, and obtain the TIDB database's global clock service: pd_request_handel_duraion, as the running status information corresponding to the TIDB database's key monitoring indicators for inspection and monitoring. Among them, the terminal device obtains the tikv auxiliary computing consumption: tikv_corprocess_cpu as the running status information under the key monitoring indicator because the TIDB database also includes auxiliary computing when providing the overall query service, so if the tikv auxiliary computing is slow, it will cause the overall query to be abnormal. In addition, the terminal device obtains the temporary storage space tikv_disk_space as the operation status information under the key monitoring indicator because tikv needs to be sorted before actual writing, so it is necessary to pay attention to the temporary storage space.

[0081] Step S302: Obtain the total query frequency and overall time consumption of the distributed database in the monitoring component as the operating status information corresponding to the cluster indicator; and, based on the node indicator in the basic health indicator, obtain the node service health level of the distributed database in the monitoring component as the operating status information corresponding to the node indicator.

[0082] The terminal device needs to pay attention to the total query frequency and overall time consumption from the perspective of the distributed database cluster, so that the terminal device obtains the total query frequency and overall time consumption of the distributed database as the operating status information corresponding to the cluster indicator through the monitoring component of the distributed database.

[0083] Exemplarily, when the distributed database is a TIDB database, the terminal device can obtain the total query frequency of the TIDB database: cluster_qps, the overall time consumption p95: cluster_duraion_p95, and the overall time consumption p99: cluster_duration_p99 by integrating the provided promethues component, and monitor them as the operating status information under the cluster indicators, thereby measuring the overall service status of the TIDB database cluster.

[0084] The terminal device needs to pay attention to the node service health status from the distributed database node aspect, so the terminal device obtains the node service health status of the distributed database as the running status information corresponding to the node indicator through the monitoring component of the distributed database.

[0085] For example, when the distributed database is a TIDB database, the terminal device can obtain the node service health program of each component of the TIDB database as the operation status information under the node indicator for monitoring by integrating the provided promethues component, which can be used for subsequent inspections and further problem location.

[0086] Step S303: acquiring, in the monitoring component, respective status information of the access computing component, the storage computing component and the global clock component in the distributed database as the running status information corresponding to the component indicator.

[0087] The terminal device also obtains the status information of the three major components of the distributed database from the monitoring component of the distributed database, namely the status information of the access computing component (TIDB), the storage computing component (TIKV) and the global clock component (PD), and monitors the operating status information corresponding to the component indicators.

[0088] It should be noted that for the access computing component (TIDB), the terminal device can obtain the number of available connections of TIDB-server as the status information of the access computing component (TIDB) for monitoring. For the global clock component (PD), the terminal device can obtain the number of available nodes and the global clock request duration: cmd_exc utor_duraion as the status information of the PD component for monitoring. For the storage computing component (TIKV), the terminal device can obtain the number of guaranteed copies: alive_replicas, service availability, and node resource consumption as the status information of the TIKV component for monitoring.

[0089] Step S202: Display each of the plurality of operating status information in a visualization panel of a corresponding preset operating monitoring indicator.

[0090] After the terminal device obtains the running status information of the distributed database under multiple preset running monitoring indicators, it displays the multiple running status information respectively through the visualization panels of the preset running monitoring indicators corresponding to the different running status information. For example, the multiple running status information of the distributed database obtained by the terminal device are the status information of the distributed database under indicator 1, the status information of the distributed database under indicator 2... the status information of the distributed database under indicator n. After that, the terminal device displays the status information of the distributed database under indicator 1 through the visualization panel of indicator 1, and displays the status information of the distributed database under indicator 2 through the visualization panel of indicator 2... and displays the status information of the distributed database under indicator n through the visualization panel of indicator n.

[0091] It should be noted that the visualization panel of the preset operation monitoring indicator can be a panel pre-built by the terminal device for each operation monitoring indicator. For example, the visualization panel corresponding to each operation monitoring indicator can be a panel (Dashboard) built based on a data visualization tool (such as Grafana).

[0092] In some embodiments, before the above step S102: displaying each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto, the monitoring method for a distributed database provided in an embodiment of the present application may further include the following steps:

[0093] Construct visualization panels corresponding to the key monitoring indicators, the basic health indicators, and the component indicators.

[0094] It should be noted that, since the basic health indicators among the multiple preset operation monitoring indicators include cluster indicators and node indicators, the visualization panels corresponding to the basic health indicators may include: a first visualization panel corresponding to the cluster indicators and a second visualization panel corresponding to the node indicators.

[0095] After analyzing the architecture of the distributed database to obtain multiple operation monitoring indicators that affect its stable operation: key monitoring indicators, basic health indicators and component indicators, the terminal device can use data visualization tools to build a visualization panel for the key monitoring indicators, a first visualization panel for the cluster indicators in the basic health indicators, and a second visualization panel for the node indicators in the basic health indicators.

[0096] In this way, after obtaining the operating status information of the distributed database under multiple preset operating monitoring indicators, the terminal device can display multiple operating status information respectively through the visualization panels of the preset operating monitoring indicators corresponding to different operating status information.

[0097] Step S203: When the operating status information under the target operation monitoring indicator indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to the target pressure threshold, an alarm prompt information is displayed in the target visualization panel, the target operation monitoring indicator is any one of a plurality of preset operation monitoring indicators, the target visualization panel is the visualization panel of the target operation monitoring indicator, and the target pressure threshold is the pressure threshold associated with the target operation monitoring indicator.

[0098] After the terminal device visualizes the multiple operating status information of the distributed database under multiple preset operating monitoring indicators through the visualization panels corresponding to each of the multiple preset operating monitoring indicators, if the operating status information under one or more target operating monitoring indicators among the multiple preset operating monitoring indicators indicates that the business service pressure of the distributed database under the target operating monitoring indicator is greater than or equal to the target pressure threshold associated with the target operating monitoring indicator, the terminal device immediately displays an alarm prompt information through the visualization panel corresponding to the target operating monitoring indicator.

[0099] It should be noted that the pressure thresholds associated with each of the multiple preset operation monitoring indicators can be warning thresholds flexibly configured by the terminal device based on the different impacts of each of the multiple preset operation monitoring indicators on the stable operation of the distributed database, combined with database system management experience. Due to the different types of the multiple preset operation monitoring indicators, the pressure thresholds associated with each of the multiple preset operation monitoring indicators may also differ in type and / or value.

[0100] In addition, the warning prompt information displayed by the terminal device through the visualization panel may include: a light signal and / or a text signal with a warning color. For example, the warning prompt information may specifically be a red light signal output by the terminal device through the visualization panel and the words "Database service overload" displayed in red font.

[0101] In the embodiment of the present application, the architecture of the distributed database is analyzed by the terminal device to obtain multiple preset operation monitoring indicators that have an impact on the stable operation of the distributed database, thereby obtaining multiple operation status information corresponding to the multiple preset operation monitoring indicators in the distributed database, and the terminal device uses the visualization panel of the preset operation monitoring indicators corresponding to different operation status information to display the operation status information, and the operation status information under one or more target operation monitoring indicators in the multiple preset operation monitoring indicators indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to the target pressure threshold associated with the target operation monitoring indicator. The terminal device displays an alarm prompt information through the visualization panel of the target operation monitoring indicator. In this way, in the daily operation and maintenance process of the TIDB database by the terminal device, by applying the embodiment of the present application to perform daily inspections and preliminary problem location of the TIDB database service, it can not only simplify the difficulty of daily maintenance and inspection to improve maintenance efficiency, but also more conveniently discover the hidden dangers of the TIDB database in advance to improve the efficiency of preliminary problem location, thereby effectively improving the ability to ensure that the TIDB database provides stable services.

[0102] In some embodiments, the pressure thresholds associated with each of the plurality of preset operation monitoring indicators may also be obtained by the terminal device based on stress testing of the distributed database.

[0103] Please refer to Figure 4 , Figure 4 A schematic flow chart of the steps of performing stress testing on a judgment threshold involved in some embodiments of the distributed database monitoring method provided in the embodiments of the present application.

[0104] like Figure 4 As shown, in some embodiments, before the above-mentioned step of "displaying alarm prompt information in the target visualization panel", the distributed database monitoring method provided in the embodiment of the present application may also include steps S401 to S403 as shown below.

[0105] Step S401: Based on the key monitoring indicators, business service pressure prediction is performed on the link resources, auxiliary computing resources, available storage space and global clock services of the distributed database to obtain the pressure threshold associated with the key monitoring indicators.

[0106] It should be noted that the pressure threshold associated with the key monitoring indicator is used for the terminal device to determine whether to issue an alarm for the business service pressure of the distributed database under the key monitoring indicator. That is, if the operating status information of the distributed database under the key monitoring indicator indicates that the business service pressure of the distributed database under the key monitoring indicator exceeds (is greater than or equal to) the pressure threshold associated with the key monitoring indicator, the terminal device will display the alarm prompt information through the visualization panel corresponding to the key monitoring indicator.

[0107] The terminal device predicts the service pressure of the distributed database's link resources, auxiliary computing resources, available storage space, and global clock services in combination with the services that can affect the operating status of the distributed database under the key monitoring indicators, thereby obtaining the pressure threshold associated with the key monitoring indicators. For example, the terminal device executes the services that can affect the operating status of the distributed database under the key monitoring indicators through the distributed database, and obtains the link resources, auxiliary computing resources, available storage space, and global clock services of the distributed database by continuously superimposing the business workload. These operating status information indicate the changes in the service pressure of the distributed database for the business, thereby taking the maximum service pressure of the distributed database on the business as the pressure threshold associated with the key monitoring indicators of the distributed database.

[0108] Step S402: Based on the cluster indicators in the basic health indicators, business service pressure prediction is performed on the total query frequency and overall time consumption of the distributed database to obtain the pressure threshold associated with the cluster indicator; and based on the node indicators in the basic health indicators, business service pressure prediction is performed on the node service health of the distributed database to obtain the pressure threshold associated with the node indicator.

[0109] It should be noted that the pressure threshold associated with the cluster indicator is used for the terminal device to determine whether to issue an alarm for the business service pressure of the distributed database under the cluster indicator. That is, if the running status information of the distributed database under the cluster indicator indicates that the business service pressure of the distributed database under the cluster indicator exceeds (is greater than or equal to) the pressure threshold associated with the cluster indicator, the terminal device will display the alarm prompt information through the visualization panel corresponding to the cluster indicator. In addition, the pressure threshold associated with the node indicator is used for the terminal device to determine whether to issue an alarm for the business service pressure of the distributed database under the node indicator. That is, if the running status information of the distributed database under the node indicator indicates that the business service pressure of the distributed database under the node indicator exceeds (is greater than or equal to) the pressure threshold associated with the node indicator, the terminal device will display the alarm prompt information through the visualization panel corresponding to the node indicator.

[0110] The terminal device predicts the service pressure of the total query frequency and overall time of the distributed database in combination with the business that can affect the running state of the distributed database under the cluster indicator, thereby obtaining the pressure threshold associated with the cluster indicator. For example, the terminal device executes the business that can affect the running state of the distributed database under the cluster indicator through the distributed database, and obtains the total query frequency and overall time of the distributed database by continuously superimposing the business workload. These two operating status information indicate the changes in the service pressure of the distributed database for the business, thereby taking the maximum service pressure of the distributed database for the business as the pressure threshold associated with the cluster indicator of the distributed database.

[0111] The terminal device predicts the service pressure of the node service health of the distributed database in combination with the business that can affect the running state of the distributed database under the node indicator, thereby obtaining the pressure threshold associated with the node indicator. For example, the terminal device executes the business that can affect the running state of the distributed database under the node indicator through the distributed database, and obtains the node service health of the distributed database by continuously superimposing the business workload, indicating the change of the service pressure of the distributed database for the business, and thus uses the maximum service pressure of the distributed database for the business as the pressure threshold associated with the node indicator of the distributed database.

[0112] Step S403: Based on the component indicators, business service pressure prediction is performed on the access computing component, storage computing component and global clock component of the distributed database to obtain pressure thresholds associated with the component indicators.

[0113] It should be noted that the pressure threshold associated with the component indicator is used for the terminal device to determine whether to issue an alarm for the business service pressure of the distributed database under the component indicator. That is, if the running status information of the distributed database under the component indicator indicates that the business service pressure of the distributed database under the component indicator exceeds (is greater than or equal to) the pressure threshold associated with the component indicator, the terminal device will display the alarm prompt information through the visualization panel corresponding to the component indicator.

[0114] The terminal device predicts the service pressure of the access computing component, storage computing component and global clock component of the distributed database in combination with the services that can affect the running status of the distributed database under the component monitoring indicators, thereby obtaining the pressure threshold associated with the component indicator. For example, the terminal device executes the services that can affect the running status of the three major components of the distributed database through the distributed database, and obtains the service pressure changes of the distributed database for the services indicated by the running status information of the access computing component, storage computing component and global clock component of the distributed database by continuously superimposing the business workload, thereby taking the maximum service pressure of the distributed database for the services as the pressure threshold associated with the component indicator of the distributed database.

[0115] Please refer to Figure 5 , Figure 5 A schematic flow chart of another step of stress testing a judgment threshold involved in some embodiments of the distributed database monitoring method provided in the embodiments of the present application.

[0116] like Figure 5 As shown, in some embodiments, before the above-mentioned step of "displaying alarm prompt information in the target visualization panel", the distributed database monitoring method provided in the embodiment of the present application may also include steps S501 to S504 as shown below.

[0117] Step S501: generating initial alarm thresholds for the key monitoring indicators, the basic health indicators and the component indicators based on the configuration information of the distributed database.

[0118] It should be noted that the configuration information of the distributed database used by the terminal device to generate the initial alarm threshold may include: node type, quota, and node and computer room step-by-step structure, etc. It should be understood that based on the different design requirements of actual applications, in different feasible embodiments, the configuration information of the distributed database used by the terminal device may also include other types of information not listed here. The distributed database monitoring method provided in the embodiment of the present application does not specifically limit the configuration information of the distributed database used by the terminal device when generating the initial alarm threshold.

[0119] After the distributed database is deployed, the terminal device obtains the configuration information of the distributed database based on the implementation plan of the distributed database: node type, quota, and node and computer room step-by-step structure, and then combines these configuration information to generate the initial alarm thresholds of key monitoring indicators in multiple preset operation monitoring indicators of the distributed database, the initial alarm thresholds of basic health indicators in multiple preset operation monitoring indicators, and the initial alarm thresholds of component indicators in multiple preset operation monitoring indicators. Among them, the initial alarm thresholds of basic health indicators can include: the initial alarm thresholds corresponding to cluster indicators and the initial alarm thresholds corresponding to node live broadcast.

[0120] In some embodiments, the terminal device can visualize the acquired configuration information of the distributed database to the operation and maintenance personnel, so that the operation and maintenance personnel can customize the initial alarm thresholds of the key monitoring indicators, basic health indicators and component indicators based on the management experience of the database system.

[0121] Step S502: Based on the initial alarm threshold corresponding to the key monitoring indicator, the business service pressure of the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database is predicted to obtain the pressure threshold associated with the key monitoring indicator.

[0122] After the terminal device determines the initial alarm threshold of the key monitoring indicator in combination with the configuration information of the distributed database, it configures the workload of the business that can affect the running state of the distributed database under the key monitoring indicator based on the initial alarm threshold, and then adjusts the workload according to a preset ratio (such as 10%, 20% or 30%, etc.), and performs business services according to the adjusted workload through the distributed database to predict the business service pressure of the link resources, auxiliary computing resources, available storage space and global clock services of the distributed database, thereby obtaining the pressure threshold associated with the key monitoring indicator. For example, the terminal device performs business services according to the adjusted workload through the distributed database, thereby obtaining the link resources, auxiliary computing resources, available storage space and global clock services of the distributed database, and the service pressure changes of the distributed database when performing business services according to the adjusted workload indicated by these running status information, thereby taking the maximum service pressure of the distributed database on the business as the pressure threshold associated with the key monitoring indicator of the distributed database.

[0123] Step S503: Based on the initial alarm threshold corresponding to the cluster indicator in the basic health indicator, a business service pressure prediction is performed on the total query frequency and the overall time consumption of the distributed database to obtain the pressure threshold associated with the cluster indicator; and, based on the initial alarm threshold of the node indicator in the basic health indicator, a business service pressure prediction is performed on the node service health of the distributed database to obtain the pressure threshold associated with the node indicator.

[0124] After the terminal device determines the initial alarm threshold of the cluster indicator in the basic health indicator in combination with the configuration information of the distributed database, it configures the workload of the business that can affect the running status of the distributed database under the cluster indicator based on the initial alarm threshold, and then adjusts the workload according to the preset ratio, and performs business services according to the adjusted workload through the distributed database to predict the total query frequency and overall time consumption of the distributed database, thereby obtaining the pressure threshold associated with the cluster indicator. For example, the terminal device performs business services according to the adjusted workload through the distributed database, thereby obtaining the total query frequency and overall time consumption of the distributed database. These two pieces of running status information indicate the changes in the service pressure of the distributed database performing business services according to the adjusted workload, and thus the maximum service pressure of the distributed database on the business is used as the pressure threshold associated with the cluster indicator of the distributed database.

[0125] After the terminal device determines the initial alarm threshold of the node indicator in the basic health indicator in combination with the configuration information of the distributed database, it configures the workload of the business that can affect the running state of the distributed database under the node indicator based on the initial alarm threshold, and then adjusts the workload according to the preset ratio, and performs business service pressure prediction on the node service health of the distributed database through the distributed database to perform business services according to the adjusted workload, thereby obtaining the pressure threshold associated with the node indicator. For example, the terminal device performs business services according to the adjusted workload through the distributed database to obtain the node service health of the distributed database, indicating the change in service pressure of the distributed database performing business services according to the adjusted workload, and thus uses the maximum service pressure of the distributed database on the business as the pressure threshold associated with the node indicator of the distributed database.

[0126] Step S504: Based on the initial alarm threshold corresponding to the component indicator, the business service pressure of the access computing component, the storage computing component and the global clock component of the distributed database is predicted to obtain the pressure threshold associated with the component indicator.

[0127] After the terminal device determines the initial alarm threshold of the component indicator in combination with the configuration information of the distributed database, it configures the workload of the business that can affect the operating status of the three major components of the distributed database based on the initial alarm threshold, and then adjusts the workload according to the preset ratio, and performs business services through the distributed database according to the adjusted workload to predict the business service pressure of the three major components of the distributed database: the access computing component, the storage computing component, and the global clock component, thereby obtaining the pressure threshold associated with the component indicator. For example, the terminal device performs business services according to the adjusted workload through the distributed database, thereby obtaining the operating status information of the access computing component, the storage computing component, and the global clock component of the distributed database, indicating the change in the service pressure of the distributed database performing business services according to the adjusted workload, and thus taking the maximum service pressure of the distributed database on the business as the pressure threshold associated with the component indicator of the distributed database.

[0128] In some embodiments, after the terminal device performs service pressure prediction on multiple preset operation monitoring indicators of the distributed database to obtain pressure thresholds associated with each of the multiple preset operation monitoring indicators, the terminal device configures each pressure threshold in a visualization panel of the corresponding preset operation monitoring indicator for display.

[0129] Based on this, the distributed database monitoring method provided in the embodiment of the present application also includes the following steps:

[0130] The pressure threshold associated with the key monitoring indicator is configured and displayed in the visualization panel corresponding to the key monitoring indicator.

[0131] After obtaining the pressure threshold associated with the key monitoring indicator, the terminal device configures the pressure threshold in the visualization panel corresponding to the key monitoring indicator to visualize the pressure threshold, thereby facilitating the alert of the business service pressure of the distributed database under the key monitoring indicator.

[0132] In addition, the distributed database monitoring method provided in the embodiment of the present application also includes the following steps:

[0133] The pressure threshold associated with the cluster indicator is configured to be displayed in a first visualization panel corresponding to the cluster indicator.

[0134] After obtaining the pressure threshold associated with the cluster indicator, the terminal device configures the pressure threshold in the first visualization panel corresponding to the cluster indicator for visualization, thereby facilitating alerting the business service pressure of the distributed database under the cluster indicator.

[0135] In addition, the distributed database monitoring method provided in the embodiment of the present application also includes the following steps:

[0136] The pressure threshold associated with the node indicator is configured and displayed in a second visualization panel corresponding to the node indicator.

[0137] After obtaining the pressure threshold associated with the node indicator, the terminal device configures the pressure threshold in the second visualization panel corresponding to the node indicator for visualization, thereby facilitating alerting the business service pressure of the distributed database under the node indicator.

[0138] Furthermore, the distributed database monitoring method provided in the embodiment of the present application further includes the following steps:

[0139] The pressure threshold associated with the component indicator is configured and displayed in the visualization panel corresponding to the component indicator.

[0140] After obtaining the pressure threshold associated with the component indicator, the terminal device configures the pressure threshold in the visualization panel corresponding to the component indicator for visualization, thereby facilitating alerting the business service pressure of the distributed database under the component indicator.

[0141] In this embodiment, the terminal device tests the business service pressure of the distributed database under multiple preset operation monitoring indicators according to different businesses, so as to obtain the pressure threshold corresponding to each preset operation monitoring indicator. Then, the terminal device uses multiple preset operation monitoring indicators and the pressure threshold corresponding to each indicator to perform alarm monitoring on the distributed database, that is, when the operation status information of the distributed database under a certain indicator indicates that its business service pressure under the indicator exceeds the pressure threshold used for the indicator, the alarm prompt information is immediately displayed through the visualization panel of the indicator.

[0142] In this way, the difficulty of daily maintenance and inspection of distributed databases can be simplified, making it easier for operation and maintenance personnel to accurately obtain the operating status information and business service pressure of distributed databases under different operating monitoring indicators, thereby improving the maintenance efficiency of distributed databases and facilitating the early detection of database risks.

[0143] In some embodiments, the terminal device may also pay attention to the operating status information of the distributed database under three indicators, namely, the concurrent query volume, the query response time and the number of connections, from an overall perspective.

[0144] Please refer to Figure 6 , Figure 6 A flowchart of steps in some further embodiments of the distributed database monitoring method provided in the embodiments of the present application.

[0145] like Figure 6As shown, in some embodiments, the distributed database monitoring method provided in the embodiments of the present application also includes steps S601 and S602 as shown below.

[0146] Step S601: Acquire concurrent query volume information, query response time information and connection number information of the distributed database.

[0147] When the terminal device obtains the running status information of the distributed database under multiple preset running monitoring indicators, it can also obtain the concurrent query volume information of the distributed database: cluster_qps, query response time information: cluster_Duration_p99, cluster_duration_p95, and the number of connections information: connections.

[0148] Step S602: Visually display the concurrent query volume information, the query response time information and the connection number information through a visualization panel corresponding to a key monitoring indicator among the plurality of preset operation monitoring indicators.

[0149] The terminal device can configure the obtained concurrent query volume information: cluster_qps, query response time information: cluster_Duration_p99, cluster_duration_p95, and connection number information: connections on the visualization panel corresponding to the key monitoring indicators in multiple preset operation monitoring indicators, so as to display various information through the visualization panel.

[0150] In other embodiments, the terminal device may also construct visualization panels corresponding to the three indicators of concurrent query volume, query response time and number of connections (or a visualization panel corresponding to the three indicators) in advance through a data visualization tool. Then, after obtaining the concurrent query volume information: cluster_qps, the query response time information: cluster_Duration_p99, cluster_duration_p95, and the number of connections information: connections, the terminal device may display the concurrent query volume information: cluster_qps through the visualization panel corresponding to the concurrent query volume, display the query response time information: cluster_Duration_p99, cluster_duration_p95 through the visualization panel corresponding to the query response time, and display the number of connections information: connections through the visualization panel corresponding to the number of connections.

[0151] In this embodiment, the terminal device also obtains the operating status information of the distributed database under the three indicators of concurrent query volume, query response time and number of connections from an overall perspective, and displays the obtained operating status information through a visualization panel. In addition, in the future, the pressure thresholds associated with these three indicators can be configured to monitor the business service pressure of the distributed database under these three indicators through the three indicators and the pressure thresholds. In this way, the operation and maintenance personnel of the distributed database can accurately know the operating status of the distributed database under multiple indicators through the visualization panel, thereby further simplifying the difficulty of daily maintenance and inspection of the distributed database and improving the operation and maintenance efficiency of the distributed database.

[0152] See also Figure 7 The embodiment of the present application also provides a monitoring device for a distributed database, which can implement the above-mentioned monitoring method for a distributed database, and the device includes:

[0153] An acquisition module, used to acquire a plurality of operation status information corresponding to a plurality of preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database;

[0154] A visualization display module, used to display each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto;

[0155] A monitoring alarm module is used to display an alarm prompt information in a target visualization panel when the operating status information under a target operating monitoring indicator indicates that the business service pressure of the distributed database under the target operating monitoring indicator is greater than or equal to a target pressure threshold. The target operating monitoring indicator is any one of a plurality of preset operating monitoring indicators, the target visualization panel is a visualization panel of the target operating monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operating monitoring indicator.

[0156] In some embodiments, the plurality of preset operation monitoring indicators include: key monitoring indicators, basic health indicators and component indicators; the basic health indicators include: cluster indicators and node indicators.

[0157] The acquisition module is also used to obtain the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database as the operating status information corresponding to the key monitoring indicators in the monitoring component of the distributed database; obtain the total query frequency and overall time consumption of the distributed database as the operating status information corresponding to the cluster indicator in the monitoring component; and, based on the node indicator in the basic health indicator, obtain the node service health of the distributed database in the monitoring component as the operating status information corresponding to the node indicator; and obtain the respective status information of the access computing component, storage computing component and global clock component in the distributed database in the monitoring component as the operating status information corresponding to the component indicator.

[0158] In some embodiments, the visualization display module is also used to construct visualization panels corresponding to the key monitoring indicators, the basic health indicators and the component indicators respectively; wherein the visualization panels corresponding to the basic health indicators include: a first visualization panel corresponding to the cluster indicators and a second visualization panel corresponding to the node indicators.

[0159] In some embodiments, the monitoring and alarm module is also used to predict the business service pressure of the link resources, auxiliary computing resources, available storage space and global clock services of the distributed database based on the key monitoring indicators, and obtain the pressure threshold associated with the key monitoring indicators; predict the total query frequency and overall time consumption of the distributed database based on the cluster indicators in the basic health indicators, and obtain the pressure threshold associated with the cluster indicators; and predict the node service health of the distributed database based on the node indicators in the basic health indicators, and obtain the pressure threshold associated with the node indicators; and predict the access computing component, storage computing component and global clock component of the distributed database based on the component indicators to obtain the pressure threshold associated with the component indicators.

[0160] In some embodiments, the monitoring and alarm module is also used to generate initial alarm thresholds for the key monitoring indicators, the basic health indicators and the component indicators based on the configuration information of the distributed database; based on the initial alarm thresholds corresponding to the key monitoring indicators, the link resources, auxiliary computing resources, available storage space and global clock services of the distributed database are predicted for business service pressure to obtain the pressure threshold associated with the key monitoring indicators; based on the initial alarm thresholds corresponding to the cluster indicators in the basic health indicators, the total query frequency and overall time consumption of the distributed database are predicted for business service pressure to obtain the pressure threshold associated with the cluster indicators; and, based on the initial alarm thresholds of the node indicators in the basic health indicators, the node service health of the distributed database is predicted for business service pressure to obtain the pressure threshold associated with the node indicator; and, based on the initial alarm thresholds corresponding to the component indicators, the access computing components, storage computing components and global clock components of the distributed database are predicted for business service pressure to obtain the pressure threshold associated with the component indicators.

[0161] In some embodiments, the visualization display module is also used to configure the pressure threshold associated with the key monitoring indicator for display in the visualization panel corresponding to the key monitoring indicator; configure the pressure threshold associated with the cluster indicator for display in the first visualization panel corresponding to the cluster indicator; configure the pressure threshold associated with the node indicator for display in the second visualization panel corresponding to the node indicator; and configure the pressure threshold associated with the component indicator for display in the visualization panel corresponding to the component indicator.

[0162] In some embodiments, the acquisition module is further used to obtain concurrent query volume information, query response time information and connection number information of the distributed database.

[0163] The visualization display module is also used to visualize the concurrent query volume information, the query response time information and the connection number information through the visualization panel corresponding to the key monitoring indicators among the multiple preset operation monitoring indicators.

[0164] It should be noted that the specific implementation of the distributed database monitoring device provided in the embodiment of the present application is basically the same as the specific implementation of the distributed database monitoring method described above, and will not be repeated here.

[0165] The embodiment of the present application also provides a computer device, the computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the above-mentioned distributed database monitoring method when executing the computer program. The computer device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0166] See also Figure 8 , Figure 8 The hardware structure of a computer device according to another embodiment is shown, and the computer device includes:

[0167] The processor 801 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0168] The memory 802 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 802 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 802, and the processor 801 calls and executes the monitoring method of the distributed database in the embodiment of this application;

[0169] Input / output interface 803, used to implement information input and output;

[0170] The communication interface 804 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0171] A bus 805 that transmits information between the various components of the device (e.g., the processor 801, the memory 802, the input / output interface 803, and the communication interface 804);

[0172] The processor 801 , the memory 802 , the input / output interface 803 and the communication interface 804 are connected to each other in communication within the device via a bus 805 .

[0173] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned distributed database monitoring method is implemented.

[0174] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0175] An embodiment of the present application also provides a computer program product, which stores a computer program, and when the computer program is executed by a processor, the above-mentioned distributed database monitoring method is implemented.

[0176] The specific implementation modes of the computer device, computer-readable storage medium, and computer program product provided in the embodiments of the present application are basically the same as the specific implementation modes of the above-mentioned distributed database monitoring method, and will not be repeated here.

[0177] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0178] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0179] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0180] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0181] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0182] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0183] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0184] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0185] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0186] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0187] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A distributed database monitoring method, characterized in that: The method comprises: Acquire multiple operation status information corresponding to multiple preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database; Displaying each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto; When the operating status information under the target operation monitoring indicator indicates that the business service pressure of the distributed database under the target operation monitoring indicator is greater than or equal to the target pressure threshold, an alarm prompt information is displayed in the target visualization panel, the target operation monitoring indicator is any one of a plurality of preset operation monitoring indicators, the target visualization panel is a visualization panel of the target operation monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operation monitoring indicator.

2. The method according to claim 1, characterized in that The multiple preset operation monitoring indicators include: key monitoring indicators, basic health indicators and component indicators; the basic health indicators include: cluster indicators and node indicators; The obtaining of a plurality of operation status information corresponding to a plurality of preset operation monitoring indicators in a distributed database includes: In the monitoring component of the distributed database, link resources, auxiliary computing resources, available storage space and global clock service of the distributed database are obtained as operation status information corresponding to the key monitoring indicators; The total query frequency and overall time consumption of the distributed database are obtained in the monitoring component as the operation status information corresponding to the cluster indicator; and based on the node indicator in the basic health indicator, the node service health of the distributed database is obtained in the monitoring component as the operation status information corresponding to the node indicator; The monitoring component obtains the status information of the access computing component, the storage computing component and the global clock component in the distributed database as the running status information corresponding to the component indicator.

3. The method according to claim 2, characterized in that Before displaying each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto, the method further includes: Constructing visualization panels corresponding to the key monitoring indicators, the basic health indicators, and the component indicators; The visualization panel corresponding to the basic health indicator includes: a first visualization panel corresponding to the cluster indicator and a second visualization panel corresponding to the node indicator.

4. The method according to claim 2, characterized in that: Before displaying the warning prompt information in the target visualization panel, the method further includes: Based on the key monitoring indicators, business service pressure prediction is performed on the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database to obtain the pressure threshold associated with the key monitoring indicators; Based on the cluster indicators in the basic health indicators, the total query frequency and the overall time consumption of the distributed database are predicted for business service pressure, and the pressure threshold associated with the cluster indicators is obtained; and based on the node indicators in the basic health indicators, the node service health of the distributed database is predicted for business service pressure, and the pressure threshold associated with the node indicators is obtained; Based on the component indicators, business service pressure prediction is performed on the access computing component, storage computing component and global clock component of the distributed database to obtain pressure thresholds associated with the component indicators.

5. The method according to claim 2, characterized in that: Before displaying the warning prompt information in the target visualization panel, the method further includes: Generating initial alarm thresholds for the key monitoring indicators, the basic health indicators, and the component indicators based on the configuration information of the distributed database; Based on the initial alarm threshold corresponding to the key monitoring indicator, the link resources, auxiliary computing resources, available storage space and global clock service of the distributed database are predicted to obtain the pressure threshold associated with the key monitoring indicator; Based on the initial alarm threshold corresponding to the cluster indicator in the basic health indicator, the total query frequency and the overall time consumption of the distributed database are predicted for business service pressure, and the pressure threshold associated with the cluster indicator is obtained; and based on the initial alarm threshold of the node indicator in the basic health indicator, the node service health of the distributed database is predicted for business service pressure, and the pressure threshold associated with the node indicator is obtained; Based on the initial alarm threshold corresponding to the component indicator, the business service pressure of the access computing component, the storage computing component and the global clock component of the distributed database is predicted to obtain the pressure threshold associated with the component indicator.

6. The method according to claim 5, characterized in that The method further comprises: The pressure threshold associated with the key monitoring indicator is configured and displayed in the visualization panel corresponding to the key monitoring indicator; The pressure threshold value associated with the cluster indicator is configured to be displayed in a first visualization panel corresponding to the cluster indicator; The pressure threshold value associated with the node indicator is configured to be displayed in a second visualization panel corresponding to the node indicator; The pressure threshold associated with the component indicator is configured and displayed in the visualization panel corresponding to the component indicator.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: Obtaining concurrent query volume information, query response time information and connection number information of the distributed database; The concurrent query volume information, the query response time information and the connection number information are visualized through the visualization panel corresponding to the key monitoring indicators among the multiple preset operation monitoring indicators.

8. A monitoring device for a distributed database, characterized in that: The device comprises: An acquisition module, used to acquire a plurality of operation status information corresponding to a plurality of preset operation monitoring indicators in a distributed database, wherein the operation status information is status information under the preset operation monitoring indicators corresponding thereto, and the preset operation monitoring indicators are indicators that have an impact on the stable operation of the distributed database; A visualization display module, used to display each of the plurality of operation status information in a visualization panel of a preset operation monitoring indicator corresponding thereto; A monitoring alarm module is used to display an alarm prompt information in a target visualization panel when the operating status information under a target operating monitoring indicator indicates that the business service pressure of the distributed database under the target operating monitoring indicator is greater than or equal to a target pressure threshold. The target operating monitoring indicator is any one of a plurality of preset operating monitoring indicators, the target visualization panel is a visualization panel of the target operating monitoring indicator, and the target pressure threshold is a pressure threshold associated with the target operating monitoring indicator.

9. A computer device, characterized in that: The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the distributed database monitoring method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the distributed database monitoring method according to any one of claims 1 to 7 is implemented.

Images