A SAAS-based IT centralized monitoring and management system

Abstract

The present invention relates to the field of IT monitoring technology, and discloses a SAAS-based IT centralized monitoring and management system, comprising: an edge information collection module, comprising a plurality of collectors; a load balancing proxy service module, used for sending the operation-related data to a monitoring system service module according to a preset load balancing configuration; the monitoring system service module comprises at least n IT monitoring servers, and the IT monitoring servers are used for jointly executing the same work processing business; the collector sends the collected data to the monitoring system service module through a virtual IP address and a load balancing proxy server for processing and monitoring, and when a fault is found, the relevant operation and maintenance engineers can be reminded in time to perform operation and maintenance inspection, and the monitoring system service module can also automatically search for the corresponding collector to request data and obtain the result.

Description

Technical Field

[0001] The present invention relates to the field of IT monitoring technology, and in particular to a SAAS-based IT centralized monitoring and management system. Background Art

[0002] With the development of digital power grid, information technology has penetrated into every aspect of power production, and IT information systems have become the most important data carrier and information source. At the same time, with the rapid development of various businesses, the scale of information systems supporting business operations has become increasingly large, transaction processes are complex, the root causes of failures are difficult to locate quickly, and the extent and scope of the impact of information system failures on business are difficult to quickly determine. While new technologies make IT systems more agile, robust, and high-performance, they also bring higher technical architecture complexity, bringing unprecedented challenges to business application monitoring.

[0003] Traditional IT monitoring systems are deployed and maintained one-to-one based on the customer's situation, which requires a lot of maintenance costs and personnel investment. If the systems need to be upgraded or vulnerabilities appear at the same time, the processing time is very tight, and the customer's system problems cannot be maintained in a timely manner within the limited manpower. Summary of the invention

[0004] The purpose of the present invention is to provide a SAAS-based IT centralized monitoring and management system to solve the following technical problems:

[0005] How to provide an IT centralized monitoring and management system that can reduce the pressure of IT operation and maintenance services and ensure efficient IT monitoring operations.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] An IT centralized monitoring and management system based on SAAS, comprising:

[0008] The edge information collection module includes a plurality of collectors, and the collectors are used to collect, analyze and store operation-related data of the server in the designated customer room;

[0009] A load balancing proxy service module, connected to the edge information collection module and the monitoring system service module, for sending the operation-related data to the monitoring system service module according to a preset load balancing configuration;

[0010] The monitoring system service module includes at least n IT monitoring servers, and the IT monitoring servers are used to jointly execute the same work processing business; n≥4;

[0011] The work processing business includes: saving and writing the operation-related data uploaded by the collector, reading, searching and calculating and analyzing the operation-related data, returning relevant data in response to customer requests, and rendering and calculating processing of static page operations.

[0012] Through the above technical solution, the collector sends the collected data to the monitoring system service module through the virtual IP address and the load balancing proxy server for processing and monitoring. When a fault is found, the relevant operation and maintenance engineers can be reminded in time to conduct operation and maintenance inspection. The monitoring system service module can also automatically find the corresponding collector to request data and obtain the results.

[0013] As a further solution of the present invention: the load balancing proxy service module includes a primary load balancing proxy server and a backup load balancing proxy server;

[0014] The primary load balancing proxy server and the backup load balancing proxy server share the same virtual IP address.

[0015] As a further solution of the present invention: the IT monitoring server includes a database cluster, and the database cluster includes a master database responsible for writing data and a slave database responsible for reading, searching and computing and analyzing.

[0016] As a further solution of the present invention: the preset load balancing configuration includes:

[0017] Parsing the operation-related data to determine the type and quantity of data requests;

[0018] Monitor the running status of the monitoring system service module to obtain the response status of the data request of the corresponding category;

[0019] Determine the computing power allocation weight of the data request of the corresponding category according to the response situation;

[0020] The computing power allocation weight determines the allocation amount of the data request of the corresponding category.

[0021] As a further solution of the present invention: the method for obtaining the computing power allocation weight includes:

[0022]

[0023] Among them, i=1, 2,...m, m≥n, α 0i is the weight assigned to the initial computing power, pi(t) is the processing speed of the i-th data request at time t, pi(t-Δt) is the average processing speed of the i-th data request from t-Δt to t, K q (t) is the idleness of all non-class i data requests at time t;

[0024] α ic (t) is the first-order weight, which is calculated and obtained according to the underlying preset order;

[0025] Get the first-order weights of all types of data requests;

[0026]

[0027] Among them, α i (t) assigning a weight to the computing power.

[0028] As a further solution of the present invention: the method for obtaining the idleness includes:

[0029]

[0030]

[0031] Among them, i≠j, K j (t) is the idleness of the jth data request at time t, μ j is the dynamic weight, h j (t) is the percentage of computing power occupied by the j-th data request at time t;

[0032] f M (x) is a preset logic function;

[0033] When x is greater than the preset rated value, f M (x) = 1 / h j (t); otherwise, f M (x) = 0;

[0034] Ld(t) is the real-time power load occupancy of the IT monitoring server that processes the j-th type of data request with the largest proportion, Ldt is the rated power load of the IT monitoring server, Lc(t) is the real-time refrigeration equipment load of the IT monitoring server, and Lct is the rated load of the refrigeration equipment of the IT monitoring server.

[0035] As a further solution of the present invention: the dynamic weight μ j Methods for determining include:

[0036]

[0037] Among them, μ 0j is the initial quota weight, Q jL Q is the data volume of the jth data request from t-Δt to t, j+Δt Q is the expected data volume of the jth data request from t to t+Δt, j The average data volume per unit time period for the j-th data request on the day.

[0038] The beneficial effects of the present invention are as follows: the present invention uses a collector to send the collected data to the monitoring system service module through a virtual IP address and a load balancing proxy server for processing and monitoring. When a fault is found, the relevant operation and maintenance engineers can be reminded in time to perform operation and maintenance inspection. The monitoring system service module can also automatically search for the corresponding collector to request data and obtain results. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The present invention will be further described below in conjunction with the accompanying drawings.

[0040] Figure 1 It is a schematic diagram of the system architecture of the SAAS-based IT centralized monitoring and management system in the present invention. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] See also Figure 1 As shown, the present invention is a SAAS-based IT centralized monitoring and management system, comprising:

[0043] The edge information collection module includes a plurality of collectors, and the collectors are used to collect, analyze and store operation-related data of the server in the designated customer room;

[0044] A load balancing proxy service module, connected to the edge information collection module and the monitoring system service module, for sending the operation-related data to the monitoring system service module according to a preset load balancing configuration;

[0045] The monitoring system service module includes at least n IT monitoring servers, and the IT monitoring servers are used to jointly execute the same work processing business; n≥4;

[0046] The work processing business includes: saving and writing the operation-related data uploaded by the collector, reading, searching and calculating and analyzing the operation-related data, returning relevant data in response to customer requests, and rendering and calculating processing of static page operations.

[0047] In this embodiment, the collector can send the collected data to the monitoring system service module through the virtual IP address and the load balancing proxy server for processing and monitoring. When a fault is found, the relevant operation and maintenance engineers can be promptly reminded to perform operation and maintenance inspection. The monitoring system service module can also automatically search for the corresponding collector to request data and obtain the results.

[0048] In this embodiment, the system cost of the collector is lower than that of the IT monitoring system, because the customer's computer room only needs to upload the data of the collector to the monitoring system service module of the SAAS platform ( Figure 1 The data is stored in the IT monitoring server cluster in the data center. This part of the data is not real-time data, but is the summary data after edge computing analysis by the collector. Therefore, the traffic demand of this architecture is not high. The collector in this embodiment has a certain amount of data storage capacity, which is generally enough to store 6 months of data.

[0049] The load balancing proxy service module includes a primary load balancing proxy server and a backup load balancing proxy server;

[0050] The primary load balancing proxy server and the backup load balancing proxy server share the same virtual IP address.

[0051] Among them, the virtual IP uses the KEEPALIVE virtual IP. The collector communicates with the KEEPALIVE virtual IP through the TCP protocol and maintains communication for a long time. If a network interruption occurs, the collector can unilaterally reconnect to the server. If the collector registered in the IT monitoring server is not online for more than 30 minutes, the relevant operation and maintenance engineer will be prompted to conduct an operation and maintenance check. The operation and maintenance engineer will only check the customer's collector, and there is no need to check whether the IT monitoring system deployed in the customer environment is normal or troubleshoot network problems in the customer environment as in the traditional mode.

[0052] The IT monitoring server includes a database cluster, which includes a master database responsible for writing data and a slave database responsible for reading, searching and computing and analyzing.

[0053] In order to ensure that the system equipment is not interrupted, that is, to prevent the main server from crashing due to a failure, which would cause all business interruptions, multiple IT monitoring servers are needed to assume the role of IT monitoring and operation center servers. If one IT monitoring server crashes, there are still other IT monitoring servers to take on business operations. Therefore, a virtual IP that can be used by multiple machines is needed. Keepalived can meet the needs of this application scenario, so a Keepalived application is needed to assist.

[0054] As a further solution of the present invention: the preset load balancing configuration includes:

[0055] Parsing the operation-related data to determine the type and quantity of data requests;

[0056] Monitor the running status of the monitoring system service module to obtain the response status of the data request of the corresponding category;

[0057] Determine the computing power allocation weight of the data request of the corresponding category according to the response situation;

[0058] The computing power allocation weight determines the allocation amount of the data request of the corresponding category. The higher the computing power allocation weight, the higher the allocation amount, and the higher the computing power resources allocated to the corresponding IT monitoring server.

[0059] The method for obtaining the computing power allocation weight includes:

[0060]

[0061] Among them, i=1, 2,...m, m≥n, α 0i is the weight assigned to the initial computing power, pi(t) is the processing speed of the i-th data request at time t, pi(t-Δt) is the average processing speed of the i-th data request from t-Δt to t, K q (t) is the idleness of all non-class i data requests at time t;

[0062] α ic (t) is the first-order weight, which is calculated and obtained according to the underlying preset order;

[0063] Get the first-order weights of all types of data requests;

[0064]

[0065] Among them, α i (t) assigning a weight to the computing power.

[0066] The method for obtaining the idleness includes:

[0067]

[0068]

[0069] Among them, i≠j, K j (t) is the idleness of the jth data request at time t, μ j is the dynamic weight, h j (t) is the percentage of computing power occupied by the j-th data request at time t;

[0070] f M (x) is a preset logic function;

[0071] When x is greater than the preset rated value, f M (x) = 1 / h j (t); otherwise, f M (x) = 0;

[0072] Ld(t) is the real-time power load occupancy of the IT monitoring server that processes the j-th type of data request with the largest proportion, Ldt is the rated power load of the IT monitoring server, Lc(t) is the real-time refrigeration equipment load of the IT monitoring server, and Lct is the rated load of the refrigeration equipment of the IT monitoring server.

[0073] The dynamic weight μ j Methods for determining include:

[0074]

[0075] Among them, μ 0j is the initial quota weight, Q jL Q is the data volume of the jth data request from t-Δt to t, j+Δt Q is the expected data volume of the jth data request from t to t+Δt, j The average data volume per unit time period for the j-th data request on the day.

[0076] The above is a detailed description of an embodiment of the present invention, but the content is only a preferred embodiment of the present invention and cannot be considered to limit the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of the patent coverage of the present invention.

Claims

1. A SAAS-based IT centralized monitoring and management system, characterized in that: include: The edge information collection module includes a plurality of collectors, and the collectors are used to collect, analyze and store operation-related data of the server in the designated customer room; A load balancing proxy service module, connected to the edge information collection module and the monitoring system service module, for sending the operation-related data to the monitoring system service module according to a preset load balancing configuration; The monitoring system service module includes at least n IT monitoring servers, and the IT monitoring servers are used to jointly execute the same work processing business; n≥4； The work processing business includes: saving and writing the operation-related data uploaded by the collector, reading, searching and computing and analyzing the operation-related data, returning relevant data in response to customer requests, and rendering and computing processing of static page operations; The load balancing proxy service module includes a primary load balancing proxy server and a backup load balancing proxy server; The primary load balancing proxy server and the backup load balancing proxy server share the same virtual IP address; The IT monitoring server includes a database cluster, which includes a master database responsible for writing data and a slave database responsible for reading, searching and computing and analyzing; The preset load balancing configuration includes: Parsing the operation-related data to determine the type and quantity of data requests; Monitor the running status of the monitoring system service module to obtain the response status of the data request of the corresponding category; Determine the computing power allocation weight of the data request of the corresponding category according to the response situation; The computing power allocation weight determines the allocation amount of the data request of the corresponding category; The method for obtaining the computing power allocation weight includes: Among them, i=1, 2,...m, m≥n, α 0i is the weight assigned to the initial computing power, pi(t) is the processing speed of the i-th data request at time t, pi(t-Δt) is the average processing speed of the i-th data request from t-Δt to t, K q (t) is the idleness of all non-class i data requests at time t; α ic (t) is the first-order weight, which is calculated and obtained according to the underlying preset order; Get the first-order weights of all types of data requests; Among them, α i (t) assigning a weight to the computing power.

2. The SAAS-based IT centralized monitoring and management system according to claim 1 is characterized in that: The method for obtaining the idleness includes: Among them, i≠j, K j (t) is the idleness of the jth data request at time t, μ j is the dynamic weight, h j (t) is the percentage of computing power occupied by the j-th data request at time t; f M (x) is the preset logic function. When x is greater than the preset rated value, f M (x) = 1 / h j (t); otherwise, f M (x) = 0; Ld(t) is the real-time power load occupancy of the IT monitoring server that processes the j-th type of data request with the largest proportion, Ldt is the rated power load of the IT monitoring server, Lc(t) is the real-time refrigeration equipment load of the IT monitoring server, and Lct is the rated load of the refrigeration equipment of the IT monitoring server.

3. The SAAS-based IT centralized monitoring and management system according to claim 2 is characterized in that: The dynamic weight μ j Methods for determining include: Among them, μ 0j is the initial quota weight, Q jL Q is the data volume of the jth data request from t-Δt to t, j+Δt Q is the expected data volume of the jth data request from t to t+Δt, j The average data volume per unit time period for the j-th data request on the day.

Images