Full-link large-screen global monitoring billboard method based on monitoring platform observation system

Abstract

The invention discloses a full-link large-screen global monitoring billboard method based on a monitoring platform observation system, relates to the technical field of computers, and solves the technical problem that in the prior art, the operation condition of a service system is not observed from a global perspective, and the loss of enterprise services is possibly caused by operation faults of the service system. The service request data is acquired, and the life cycle of the service request is determined; dividing a service system into a plurality of service nodes, and defining corresponding monitoring indexes; a large-screen full-link monitoring billboard platform is constructed, and the defined monitoring indexes are displayed on a full-link monitoring billboard in a visual mode; acquiring operation data of the business system, and processing the operation data to obtain monitoring index data; judging whether a fault node exists in the plurality of service nodes or not according to the monitoring index data; if yes, generating an early warning notification; if not, continuously detecting the monitoring index data; and the fault node is processed according to the early warning notification, and normal operation of the service system is ensured.

Description

Technical Field

[0001] The present invention belongs to the field of computer technology and relates to business system monitoring and data analysis technology, and specifically to a full-link large-screen global monitoring dashboard method based on a monitoring platform observation system. Background Art

[0002] The full-link large screen can display the IT operation status in real time to ensure the immediacy of monitoring; through the large-screen interface, information such as asset quantity, link relationship, and abnormal quantity can be presented in intuitive and vivid visual graphics to help operation and maintenance personnel quickly understand the system status; the full-link large screen incorporates all IT assets into a unified monitoring platform, realizing integrated monitoring of the data center; the unified monitoring interface enables operation and maintenance personnel to fully grasp the system status, avoid the problem of information islands, and improve monitoring efficiency.

[0003] The prior art (the invention patent application with the publication number CN115878425A) discloses an automated monitoring method for enterprise big data business reports, which includes the following steps: S1, obtaining different types of core indicator data for different reports; S2, configuring the core indicator data; S3, obtaining the interface address based on the primary key under different pre-configured scheduling frequencies, obtaining the required core indicator data in the report by splicing the interface parameters and the interface address, and parsing the response message for the required core indicator data; S4, storing the encrypted data in a MySQL database; S5, configuring monitoring conditions, performing early warning monitoring, and obtaining monitoring results; however, the prior art quickly configures the report interface address and interface parameters, automatically generates a complete interface access address after configuration, and then uses regular expressions and basic notation to parse and mark the result data returned by the interface to achieve global automated monitoring; it does not consider observing the operation of the business system from a global perspective, which may lead to losses in the enterprise business due to business system operation failures.

[0004] The present invention provides a full-link large-screen global monitoring dashboard method based on a monitoring platform observation system to solve the above technical problems. Summary of the invention

[0005] The present invention aims to solve at least one of the technical problems existing in the prior art; to this end, the present invention proposes a full-link large-screen global monitoring dashboard method based on a monitoring platform observation system, which is used to solve the technical problem that the prior art does not consider observing the operation of the business system from a global perspective, which may cause losses to the company's business due to business system operation failures.

[0006] To achieve the above object, the first aspect of the present invention provides a full-link large-screen global monitoring dashboard method based on a monitoring platform observation system, comprising:

[0007] Step S1: Obtaining service request data, and determining the life cycle of the service request according to the service request data; wherein the service request data includes initiation data, processing data, and response data;

[0008] Step S2: Divide the business system into several business nodes according to the life cycle of the business request; define corresponding monitoring indicators according to the several business nodes;

[0009] Step S3: Build a large-screen full-link monitoring dashboard platform to display the defined monitoring indicators in a visual manner on the full-link monitoring dashboard;

[0010] Step S4: The operation data of the business system is collected in real time through the full-link monitoring dashboard platform, and the operation data is processed and analyzed to obtain real-time monitoring indicator data;

[0011] Step S5: Detect the monitoring indicator data of several business nodes to determine whether there is a faulty node among the several business nodes; if yes, generate an early warning notification; if not, continue to detect the monitoring indicator data; and process the faulty node according to the early warning notification.

[0012] Preferably, determining the life cycle of the service request according to the service request data includes:

[0013] The user enters the URL in the client and initiates a request for the service; the client requests the DNS server to resolve the domain name in the URL and obtain the IP address of the target server; the client sends the request to the IDC computer room based on the IP address of the target server;

[0014] In the IDC computer room, the firewall will determine whether the request complies with the security policy; if yes, the request will be allowed to pass and sent to the core switch; if no, the request will not be allowed to pass;

[0015] The core switch forwards the request to the WEB application server corresponding to the target server according to the routing table, and uses the gateway to process different requests and send the requests to several corresponding servers;

[0016] After the request is processed by the middleware, the processing results are stored in the database or file system; the processing results are encapsulated into HTTP responses and returned to the client through gateways, switches, firewalls and the Internet.

[0017] It should be noted that the request lifecycle refers to the entire process from the client initiating a request to the client receiving the server's response and ending the request;

[0018] The present invention obtains the entire process of business request data in the business system and determines the life cycle of the request based on the entire process; it can monitor each link in the entire life cycle, ensure the smooth operation of the business, is conducive to monitoring the entire link, and enhances the relevance of each link.

[0019] Preferably, the business system is divided into several business nodes according to the life cycle of the business request, including:

[0020] Retrieve the life cycle of business requests and extract the data type of business request data; assign business data of each data type to the corresponding server; design a portal page on each server as the business entrance; the portal page displays the core functions and information of the business type;

[0021] Extract core businesses from business request data of several data types as primary business entrances; analyze requests under several primary business entrances to obtain all requests generated by users when performing operations; identify businesses that meet set standards from several requests as secondary businesses;

[0022] Determine the data sources and data types required for several secondary businesses; select the storage nodes of the requests that meet the secondary business requirements from the database as the end nodes of the requests.

[0023] The present invention determines a primary business entry according to the data type of business request data; extracts secondary business from the request under the primary business entry, and selects storage nodes that meet business requirements as end nodes; can flexibly divide business nodes, and when business requirements change, only the corresponding business nodes need to be adjusted; it is beneficial to improve the flexibility of the business system.

[0024] Preferably, the monitoring indicators include: IDC network equipment, infrastructure, basic monitoring, service monitoring, application services, middleware, log monitoring, and processing time, response rate and success rate of business indicators.

[0025] Preferably, the processing and analysis of the operating data to obtain real-time monitoring index data includes:

[0026] Retrieve the operation data of the business system and determine whether the operation data is complete; if yes, retain the corresponding operation data; if no, manually supplement the operation data; the operation data includes log data, performance indicators and transaction tracking data;

[0027] According to the logical structure of the business system, the operation data is divided into corresponding business nodes, the performance indicators of several business nodes are calculated, and the performance indicators are marked as monitoring indicator data; wherein, the monitoring indicator data includes processing time, response rate and success rate.

[0028] The present invention collects and processes operation data in real time through a monitoring platform observation system, and generates monitoring index data according to the performance indicators of the operation data; it can understand the usage of system resources, which is conducive to optimizing resource allocation, ensuring that key tasks receive sufficient resource support, and avoiding resource waste.

[0029] Preferably, the determining whether there is a faulty node among the plurality of service nodes includes:

[0030] Retrieve monitoring indicator data of several business nodes, fit the monitoring indicator data into a curve F(t); solve the first-order derivative f(t) of the curve F(t);

[0031] Determine whether there is a part greater than y=n in the first-order derivative |f(t)|; if yes, mark the abnormal part and generate an early warning notification; if no, continue to analyze the monitoring indicator data.

[0032] The present invention analyzes the abnormal growth and decrease of the monitoring index curve, and generates an early warning notification in time when an abnormality is found; it can immediately start the troubleshooting and repair process, reduce the interruption time of the business system, and is conducive to ensuring the continuity and stability of the business.

[0033] Preferably, the processing of the faulty node according to the early warning notification includes:

[0034] Retrieve the early warning notification, determine the abnormal monitoring indicator data according to the early warning notification, and mark the abnormal monitoring indicator data as abnormal data;

[0035] Obtain historical abnormal data from the database, match the abnormal data with the historical abnormal data, and obtain the similarity between the historical abnormal data and the abnormal data; select several historical abnormal data with similarity greater than a similarity threshold as reference data;

[0036] Analyze several parameter data to obtain several abnormal reasons; check the log files according to the several abnormal reasons, and select the log files corresponding to the abnormal reasons;

[0037] The screened log files are analyzed to obtain the corresponding processing methods, the abnormal data are processed according to the processing methods and the processed results are verified; the processing process and results are stored in the corresponding database.

[0038] The present invention timely checks and processes faulty nodes through early warning notifications, and can take intervention measures before the fault spreads, which is beneficial to avoiding the occurrence of chain reactions and reducing business losses caused by the fault.

[0039] Compared with the prior art, the present invention has the following beneficial effects:

[0040] 1. The present invention obtains the entire process of business request data in the business system, and determines the life cycle of the request based on the entire process; it can monitor each link in the entire life cycle, and can ensure the smooth operation and problem-solving of the business, which is conducive to monitoring the entire link and enhancing the relevance of each link; it determines the primary business entrance according to the data type of the business request data; it extracts the secondary business from the request under the primary business entrance, and selects the storage node that meets the business needs as the end node; it can flexibly divide the business nodes, and when the business needs change, only the corresponding business nodes need to be adjusted; it is conducive to improving the flexibility of the business system.

[0041] 2. The present invention collects and processes operating data in real time through a monitoring platform observation system, and generates monitoring index data according to the performance indicators of the operating data; it can understand the use of system resources, which is conducive to optimizing resource allocation, ensuring that key tasks are supported by sufficient resources, and avoiding resource waste; it analyzes the abnormal growth and decrease of the monitoring index curve, and when an abnormality is found, it generates an early warning notification in time; it can immediately start the troubleshooting and repair process, reduce the interruption time of the business system, and is conducive to ensuring the continuity and stability of the business; through early warning notifications, faulty nodes are checked and processed in time, and intervention measures can be taken before the fault spreads, which is conducive to avoiding the occurrence of chain reactions and reducing business losses caused by faults. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0043] Figure 1 It is a schematic diagram of the specific steps of the present invention;

[0044] Figure 2 A schematic diagram of the configuration connections for the present invention;

[0045] Figure 3 A schematic diagram of the steps of dividing service nodes in the present invention;

[0046] Figure 4 A schematic diagram of the abnormal monitoring indicator data detection step of the present invention;

[0047] Figure 5 It is a schematic diagram of the abnormal point representation of the present invention. DETAILED DESCRIPTION

[0048] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] See also Figure 1 The first embodiment of the present invention provides a full-link large-screen global monitoring dashboard method based on a monitoring platform observation system, including:

[0050] Step S1: Obtaining service request data, and determining the life cycle of the service request according to the service request data; wherein the service request data includes initiation data, processing data, and response data;

[0051] Step S2: Divide the business system into several business nodes according to the life cycle of the business request; define corresponding monitoring indicators according to the several business nodes;

[0052] Step S3: Build a large-screen full-link monitoring dashboard platform to display the defined monitoring indicators in a visual manner on the full-link monitoring dashboard;

[0053] Step S4: The operation data of the business system is collected in real time through the full-link monitoring dashboard platform, and the operation data is processed and analyzed to obtain real-time monitoring indicator data;

[0054] Step S5: Detect the monitoring indicator data of several business nodes to determine whether there is a faulty node among the several business nodes; if yes, generate an early warning notification; if not, continue to detect the monitoring indicator data; and process the faulty node according to the early warning notification.

[0055] It is worth noting that the monitoring indicators include: IDC network equipment, infrastructure, basic monitoring, service monitoring, application services, middleware, log monitoring, and processing time, response rate and success rate of business indicators.

[0056] It should be noted that monitoring indicators are generally expressed as a range or a threshold, which is used as a standard to lay the foundation for subsequent analysis.

[0057] See also Figure 2-Figure 3 , determine the life cycle of a business request, including the following steps:

[0058] The user enters the URL in the client and initiates a request for the service; the client requests the DNS server to resolve the domain name in the URL and obtain the IP address of the target server; the client sends the request to the IDC computer room based on the IP address of the target server;

[0059] In the IDC computer room, the firewall will determine whether the request complies with the security policy; if yes, the request will be allowed to pass and sent to the core switch; if no, the request will not be allowed to pass;

[0060] The core switch forwards the request to the WEB application server corresponding to the target server according to the routing table, and uses the gateway to process different requests and send the requests to several corresponding servers;

[0061] After the request is processed by the middleware, the processing results are stored in the database or file system; the processing results are encapsulated into HTTP responses and returned to the client through gateways, switches, firewalls and the Internet.

[0062] For example: Assume that the existing clients initiate business requests A, B and C; the client requests the DNS server to resolve the domain name in the URL and obtains the IP addresses A and B in the target server; based on the IP addresses A, B and C in the target server, the client sends the request to the IDC computer room;

[0063] In the IDC computer room, the firewall checks whether service requests A, B, and C comply with the security policy. If request A does not comply with the security policy, but requests B and C comply with the security policy, request A is not allowed to pass, and requests B and C are sent to the central switch.

[0064] After being processed by the WEB application server, request B is sent to server 3, and request C is sent to server 1. After back-end processing of requests B and C using the middleware, requests B and C are returned to the client.

[0065] Divide the business system into several business nodes, including the following steps:

[0066] Retrieve the life cycle of business requests and extract the data type of business request data; assign business data of each data type to the corresponding server; design a portal page on each server as the business entrance; the portal page displays the core functions and information of the business type;

[0067] Extract core businesses from business request data of several data types as primary business entrances; analyze requests under several primary business entrances to obtain all requests generated by users when performing operations; identify businesses that meet set standards from several requests as secondary businesses;

[0068] Determine the data sources and data types required for several secondary businesses; select the storage nodes of the requests that meet the secondary business requirements from the database as the end nodes of the requests.

[0069] See also Figure 4-Figure 5, retrieve the operation data of the business system and determine whether the operation data is complete; if yes, retain the corresponding operation data; if not, manually supplement the operation data; the operation data includes log data, performance indicators and transaction tracking data;

[0070] According to the logical structure of the business system, the operation data is divided into corresponding business nodes, the performance indicators of several business nodes are calculated, and the performance indicators are marked as monitoring indicator data; wherein, the monitoring indicator data includes processing time, response rate and success rate.

[0071] Retrieve monitoring indicator data of several business nodes, fit the monitoring indicator data into a curve F(t); solve the first-order derivative f(t) of the curve F(t);

[0072] Determine whether there is a part greater than y=n in the first-order derivative |f(t)|; if yes, mark the abnormal part and generate an early warning notification; if no, continue to analyze the monitoring indicator data.

[0073] It is worth noting that the analysis of the anomalies in the monitoring indicator data can also compare the monitoring indicator data with the defined monitoring indicators to determine whether the monitoring indicator data is within the defined monitoring indicator range. If so, it is determined that there is no anomaly in the monitoring indicator data; if not, it is determined that an anomaly has occurred in the monitoring indicator data; an early warning notification is generated, and the anomaly is investigated and processed.

[0074] Retrieve the early warning notification, determine the abnormal monitoring indicator data according to the early warning notification, and mark the abnormal monitoring indicator data as abnormal data;

[0075] Obtain historical abnormal data from the database, match the abnormal data with the historical abnormal data, and obtain the similarity between the historical abnormal data and the abnormal data; select several historical abnormal data with similarity greater than a similarity threshold as reference data;

[0076] Analyze several parameter data to obtain several abnormal reasons; check the log files according to the several abnormal reasons, and select the log files corresponding to the abnormal reasons;

[0077] The screened log files are analyzed to obtain the corresponding processing methods, the abnormal data are processed according to the processing methods and the processed results are verified; the processing process and results are stored in the corresponding database.

[0078] For example, when an abnormality occurs, such as an abnormal callback line, it will first be reflected in the abnormal response request of the monitoring platform application, such as a significant increase in the single-unit throughput and the number of connection waits; checking the line flow chart, it is found that the overall flow has dropped sharply;

[0079] The monitoring platform found that the line interface had normal requests, but according to the called party provided by the user, it was found that the request did not reach the data center. The data center log was checked and it was found that the callback 20 was fuse-broken. The alarm triggered by the abnormal access to the monitoring platform page found that the gateway service was abnormal.

[0080] It was found that the gateway service log had memory anomalies; the gateway service was restarted; and finally, the business indicators were verified to be back to normal.

[0081] The working principle of the present invention is as follows: the present invention obtains business request data, and determines the life cycle of the business request according to the business request data; wherein the business request data includes initiation data, processing data and response data; according to the life cycle of the business request, the business system is divided into several business nodes; according to the several business nodes, corresponding monitoring indicators are defined; a large-screen full-link monitoring dashboard platform is constructed, and the defined monitoring indicators are displayed in a visual manner on the full-link monitoring dashboard; the operation data of the business system is collected in real time through the full-link monitoring dashboard platform, and the operation data is processed and analyzed to obtain real-time monitoring indicator data; the monitoring indicator data of several business nodes are detected to determine whether there are faulty nodes among the several business nodes; if yes, an early warning notification is generated; if not, the monitoring indicator data is continuously detected; and the faulty node is processed according to the early warning notification.

[0082] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A full-link large-screen global monitoring dashboard method based on a monitoring platform observation system, characterized in that: include: Step S1: Obtaining service request data, and determining the life cycle of the service request according to the service request data; wherein the service request data includes initiation data, processing data, and response data; Step S2: Divide the business system into several business nodes according to the life cycle of the business request; define corresponding monitoring indicators according to the several business nodes; Step S3: Build a large-screen full-link monitoring dashboard platform to display the defined monitoring indicators in a visual manner on the full-link monitoring dashboard; Step S4: The operation data of the business system is collected in real time through the full-link monitoring dashboard platform, and the operation data is processed and analyzed to obtain real-time monitoring indicator data; Step S5: Detect the monitoring indicator data of several business nodes to determine whether there is a faulty node among the several business nodes; if yes, generate an early warning notification; if not, continue to detect the monitoring indicator data; and process the faulty node according to the early warning notification.

2. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 1 is characterized in that: Determining the life cycle of the service request according to the service request data includes: The user enters the URL in the client and initiates a request for the service; the client requests the DNS server to resolve the domain name in the URL and obtain the IP address of the target server; the client sends the request to the IDC computer room based on the IP address of the target server; In the IDC computer room, the firewall will determine whether the request complies with the security policy; if yes, the request will be allowed to pass and sent to the core switch; if no, the request will not be allowed to pass; The core switch forwards the request to the WEB application server corresponding to the target server according to the routing table, and uses the gateway to process different requests and send the requests to several corresponding servers; After the request is processed by the middleware, the processing results are stored in the database or file system; the processing results are encapsulated into HTTP responses and returned to the client through gateways, switches, firewalls and the Internet.

3. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 2 is characterized in that: According to the life cycle of the business request, the business system is divided into several business nodes, including: Retrieve the life cycle of business requests and extract the data type of business request data; assign business data of each data type to the corresponding server; design a portal page on each server as the business entrance; the portal page displays the core functions and information of the business type; Extract core businesses from business request data of several data types as primary business entrances; analyze requests under several primary business entrances to obtain all requests generated by users when performing operations; identify businesses that meet set standards from several requests as secondary businesses; Determine the data sources and data types required for several secondary businesses; select the storage nodes of the requests that meet the secondary business requirements from the database as the end nodes of the requests.

4. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 1 is characterized in that: The monitoring indicators include: IDC network equipment, infrastructure, basic monitoring, service monitoring, application services, middleware, log monitoring, and processing time, response rate and success rate of business indicators.

5. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 1 is characterized in that: The operation data is processed and analyzed to obtain real-time monitoring index data, including: Retrieve the operation data of the business system and determine whether the operation data is complete; if yes, retain the corresponding operation data; if no, manually supplement the operation data; the operation data includes log data, performance indicators and transaction tracking data; According to the logical structure of the business system, the operation data is divided into corresponding business nodes, the performance indicators of several business nodes are calculated, and the performance indicators are marked as monitoring indicator data; wherein, the monitoring indicator data includes processing time, response rate and success rate.

6. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 5 is characterized in that: The determining whether there is a faulty node among the plurality of service nodes includes: Retrieve monitoring indicator data of several business nodes, fit the monitoring indicator data into a curve F(t); solve the first-order derivative f(t) of the curve F(t); Determine whether there is a part greater than y=n in the first-order derivative |f(t)|; if yes, mark the abnormal part and generate an early warning notification; if no, continue to analyze the monitoring indicator data.

7. The full-link large-screen global monitoring dashboard method based on the monitoring platform observation system according to claim 6 is characterized in that: The processing of the faulty node according to the early warning notification includes: Retrieve the early warning notification, determine the abnormal monitoring indicator data according to the early warning notification, and mark the abnormal monitoring indicator data as abnormal data; Obtain historical abnormal data from the database, match the abnormal data with the historical abnormal data, and obtain the similarity between the historical abnormal data and the abnormal data; select several historical abnormal data with similarity greater than a similarity threshold as reference data; Analyze several parameter data to obtain several abnormal reasons; check the log files according to the several abnormal reasons, and select the log files corresponding to the abnormal reasons; The screened log files are analyzed to obtain the corresponding processing methods, the abnormal data are processed according to the processing methods and the processed results are verified; the processing process and results are stored in the corresponding database.

Images