A data processing system and method for monitoring

Abstract

The application discloses a kind of monitoring data processing system and method, monitoring data processing system includes first processing system, first processing system includes first processing subsystem and second processing subsystem, first processing subsystem includes data acquisition unit and first reporting unit, second processing subsystem includes first message queue and first check unit, data acquisition unit is used to collect the monitoring index value of first monitoring index item from target monitoring object, first reporting unit is used to send first monitoring data to first message queue, and first monitoring data includes target monitoring object, first monitoring index item and monitoring index value, and first check unit is used to check first monitoring data in first message queue.The application can obtain effective monitoring data in target monitoring object by the collection and check of monitoring data in target monitoring object, to improve the monitoring efficiency of the running state of target monitoring object.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular, to a monitoring data processing system and method. BACKGROUND

[0002] With the development of data processing technology, data monitoring technology is constantly improving.

[0003] Currently, a computer system will have more system software and application programs installed. The normal operation of system software and application programs is the premise of the computer system processing and completing business. The prior art can monitor the running data of system software and application programs in the running process to monitor the running state of system software and application programs.

[0004] However, the prior art fails to effectively monitor the running data of system software and application programs. SUMMARY

[0005] In view of the above problems, the present application provides a monitoring data processing system and method which overcomes the above problems or at least partially solves the above problems, and the technical solution is as follows:

[0006] A monitoring data processing system, comprising: a first processing system, the first processing system comprising: a first processing subsystem and a second processing subsystem, the first processing subsystem comprising: a data acquisition unit and a first reporting unit, the second processing subsystem comprising: a first message queue and a first verification unit;

[0007] The data acquisition unit is configured to perform: acquiring a monitoring indicator value of a first monitoring indicator item from a target monitoring object;

[0008] The first reporting unit is configured to perform: sending first monitoring data to the first message queue for storage, the first monitoring data including the target monitoring object, the first monitoring indicator item and the monitoring indicator value;

[0009] The first verification unit is configured to perform: verifying the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item correspondingly exist in predefined configuration management information, and if so, determining that the first monitoring data passes the verification.

[0010] Optionally, the second processing subsystem further comprises: a first obtaining unit;

[0011] The first obtaining unit is configured to perform: obtaining the predefined configuration management information from a configuration management system before the verification of the first monitoring data in the first message queue.

[0012] Optionally, the first monitoring data includes an object identifier of the target monitoring object and an indicator item identifier of the first monitoring indicator item; the first processing subsystem further includes a second obtaining unit;

[0013] The second obtaining unit is configured to perform: obtaining the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item from a configuration management system before the first monitoring data is sent to the first message queue for storage.

[0014] Optionally, the first checking unit is configured to perform:

[0015] checking the first monitoring data in the first message queue to determine whether the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item correspondingly exist in predefined configuration management information.

[0016] Optionally, the monitoring data processing system further includes a second processing system, the second processing system including a third processing subsystem and a fourth processing subsystem, the third processing subsystem including a monitoring agent and a second reporting unit, and the fourth processing subsystem including a second message queue and a second checking unit;

[0017] The monitoring agent is configured to perform: collecting monitoring indicator values of a second monitoring indicator item from the target monitoring object;

[0018] The second reporting unit is configured to perform: sending second monitoring data to the second message queue for storage, the second monitoring data including the target monitoring object, the second monitoring indicator item, and the monitoring indicator values of the second monitoring indicator item;

[0019] The second checking unit is configured to perform: checking whether the second monitoring data in the second message queue is legitimate, and if so, determining that the second monitoring data passes the check.

[0020] Optionally, the monitoring data processing system further includes a data processing unit;

[0021] The data processing unit is configured to perform: aggregating and alarm processing on the first monitoring data that passes the check.

[0022] A monitoring data processing method is applied to a monitoring data processing system, the monitoring data processing system comprising: a first processing system, the first processing system comprising: a first processing subsystem and a second processing subsystem, the first processing subsystem comprising: a data acquisition unit and a first reporting unit, the second processing subsystem comprising: a first message queue and a first verification unit; the method comprising:

[0023] The data acquisition unit collects the monitoring index value of the first monitoring index item from the target monitoring object;

[0024] The first reporting unit sends the first monitoring data to the first message queue for storage. The first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value.

[0025] The first verification unit verifies the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information. If so, the first monitoring data is determined to have passed the verification.

[0026] Optionally, the second processing subsystem further includes: a first obtaining unit; before verifying the first monitoring data in the first message queue, the method further includes:

[0027] The first obtaining unit obtains the predefined configuration management information from the configuration management system.

[0028] Optionally, the first monitoring data includes the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator; the first processing subsystem further includes: a second obtaining unit; before sending the first monitoring data to the first message queue for storage, the method further includes:

[0029] The second obtaining unit obtains the object identifier of the target monitoring object from the configuration management system, and obtains the indicator item identifier of the first monitoring indicator item.

[0030] Optionally, the first verification unit verifies the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in predefined configuration management information, including:

[0031] The first verification unit verifies the first monitoring data in the first message queue to determine whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item exist in the predefined configuration management information.

[0032] Optionally, the monitoring data processing system further includes: a second processing system, which includes a third processing subsystem and a fourth processing subsystem; the third processing subsystem includes a monitoring agent and a second reporting unit; the fourth processing subsystem includes a second message queue and a second verification unit; the method further includes:

[0033] The monitoring agent collects the monitoring index value of the second monitoring index item from the target monitoring object;

[0034] The second reporting unit sends the second monitoring data to the second message queue for storage. The second monitoring data includes the target monitoring object, the second monitoring indicator item, and the monitoring indicator value of the second monitoring indicator item.

[0035] The second verification unit verifies whether the second monitoring data in the second message queue is valid. If it is, the second monitoring data is determined to have passed the verification.

[0036] Optionally, the monitoring data processing system further includes: a data processing unit; the method further includes:

[0037] The data processing unit aggregates and processes the verified first monitoring data.

[0038] The monitoring data processing system and method proposed in this embodiment include a first processing system, which further includes a first processing subsystem and a second processing subsystem. The first processing subsystem includes a data acquisition unit and a first reporting unit, while the second processing subsystem includes a first message queue and a first verification unit. The data acquisition unit is used to acquire monitoring indicator values ​​of a first monitoring indicator item from the target monitoring object. The first reporting unit is used to send the first monitoring data to the first message queue for storage. The first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value. The first verification unit is used to verify the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item correspond to and exist in predefined configuration management information. If so, the first monitoring data is determined to have passed verification. This invention can effectively acquire monitoring data from the target monitoring object and send the acquired monitoring data to the first message queue for storage. Subsequently, the monitoring data in the first message queue can be verified, retaining the verified monitoring data and discarding the unverified monitoring data. This invention can obtain effective monitoring data from the target monitoring object by collecting and verifying the monitoring data in the target monitoring object, thereby improving the monitoring efficiency of the target monitoring object's operating status.

[0039] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description

[0040] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0041] Figure 1 A schematic diagram of the structure of the first monitoring data processing system provided in an embodiment of the present invention is shown;

[0042] Figure 2 A schematic diagram of the structure of a second monitoring data processing system provided in an embodiment of the present invention is shown;

[0043] Figure 3 A schematic diagram of the structure of a third type of monitoring data processing system provided in an embodiment of the present invention is shown;

[0044] Figure 4 A schematic diagram of the structure of the fourth monitoring data processing system provided in an embodiment of the present invention is shown;

[0045] Figure 5 A schematic diagram of the structure of the fifth monitoring data processing system provided in this embodiment of the invention is shown;

[0046] Figure 6 A schematic diagram of the structure of the sixth monitoring data processing system provided in this embodiment of the invention is shown;

[0047] Figure 7 A flowchart of the first monitoring data processing method provided by an embodiment of the present invention is shown;

[0048] Figure 8 A flowchart of a second monitoring data processing method provided in an embodiment of the present invention is shown;

[0049] Figure 9 A flowchart of the third monitoring data processing method provided in an embodiment of the present invention is shown;

[0050] Figure 10 A flowchart of the fourth monitoring data processing method provided in the embodiments of the present invention is shown;

[0051] Figure 11A flowchart of the fifth monitoring data processing method provided in an embodiment of the present invention is shown. Detailed Implementation

[0052] Exemplary embodiments of the invention will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this invention will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

[0053] like Figure 1 As shown, this embodiment proposes a first monitoring data processing system, which may include: a first processing system 100. The first processing system 100 may include: a first processing subsystem 200 and a second processing subsystem 300. The first processing subsystem 200 may include: a data acquisition unit 201 and a first reporting unit 202, and the second processing subsystem 300 may include: a first message queue 301 and a first verification unit 302.

[0054] The data acquisition unit 201 is configured to perform the following: acquire the monitoring index value of the first monitoring index item from the target monitoring object;

[0055] The monitoring data processing system can be software or hardware used to collect and process monitoring data.

[0056] The first processing system 100 can be a component of the monitoring data processing system. The first processing system 100 can be software or hardware, and can be used to collect and verify monitoring data.

[0057] The first processing subsystem 200 can be a component of the first processing system 100. The first processing subsystem 200 can be software or hardware, and can collect monitoring data and report it to the second processing subsystem 300.

[0058] The second processing subsystem 300 can be a component of the first processing system 100. The second processing subsystem 300 can receive monitoring data reported by the first processing subsystem 200 and perform verification and other related processing on the monitoring data.

[0059] Specifically, the monitoring data can be any data that needs to be monitored. Optionally, the monitoring data can be the runtime data of the target software. The target software can be any software whose runtime data needs to be monitored; this invention does not limit the specific software type of the target software.

[0060] The data acquisition unit 201 can be a component of the first processing subsystem 200. The data acquisition unit 201 can collect monitoring data from the target monitoring object.

[0061] The target monitoring object can be an electronic device on which the aforementioned target software is installed, such as a mobile phone, tablet computer, or desktop computer. It is understood that the data acquisition unit 201 can be adapted to the target monitoring object, and the data acquisition unit 201 can collect monitoring data from the adapted target monitoring object.

[0062] Optionally, the data acquisition unit 201 can be a component within the target monitored object itself capable of acquiring monitoring data. In this case, the target monitored object can utilize its own data acquisition unit 201 to acquire monitoring data.

[0063] Optionally, the data acquisition unit 201 may not be installed in the target monitoring object. In this case, the data acquisition unit 201 may be an entity independent of the target monitoring object, which may be software or hardware.

[0064] The first monitoring indicator can be a specific indicator that needs to be monitored, such as memory utilization, network latency, disk utilization, and CPU utilization.

[0065] The monitoring metric value can be the value of the first monitoring metric item. For example, when the target monitoring metric item is memory utilization, the monitoring metric value can be the memory utilization value.

[0066] Optionally, the data acquisition unit 201 can periodically collect the monitoring index value of the first monitoring index item from the target monitoring object; the data acquisition unit 201 can also continuously poll the target monitoring object to query the changes in the index value of the first monitoring index item. When the index value of the first monitoring index item changes, the index value of the first monitoring index item can be collected from the target monitoring object in real time.

[0067] Specifically, the data acquisition unit 201 can determine the first monitoring data that will be reported by the first reporting unit 202 after acquiring the monitoring indicator value of the first monitoring indicator item.

[0068] The first reporting unit 202 is configured to perform the following: send the first monitoring data to the first message queue 301 for storage. The first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value.

[0069] The first reporting unit 202 can be a component of the first processing subsystem 200, and the first reporting unit 202 can report the monitoring data collected by the data acquisition unit 201 to the second processing subsystem 300.

[0070] Specifically, the first reporting unit 202 can report the first monitoring data to the second processing subsystem 300 by sending the first monitoring data to the first message queue 301 in the second processing subsystem 300 for storage.

[0071] The first message queue 301 can be a message queue in the second processing subsystem 300 used to store monitoring data.

[0072] Specifically, when the data acquisition unit 201 collects the monitoring index value of the first monitoring index item, the first reporting unit 202 can report the first monitoring data to the first message queue 301 to realize real-time reporting of monitoring data.

[0073] The first verification unit 302 is configured to perform the following: verify the first monitoring data in the first message queue 301 to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information. If so, the first monitoring data is determined to have passed the verification.

[0074] The first verification unit 302 may be a component of the second processing subsystem 300. The first verification unit 302 may be used to verify the monitoring data in the first message queue 301.

[0075] Specifically, the first verification unit 302 can first obtain monitoring data from the first message queue 301, and then verify the monitoring data.

[0076] Optionally, the first verification unit 302 may periodically extract monitoring data from the first message queue 301.

[0077] Optionally, the first verification unit 302 can continuously poll the first message queue 301 to check whether new monitoring data is stored in the first message queue 301. If so, the monitoring data can be obtained from the first message queue 301 in real time.

[0078] Optionally, the first verification unit 302 may extract the monitoring data from the first message queue 301 upon receiving a message notification from the first message queue 301 indicating that monitoring data has been received. The message notification may be sent by the first message queue 301 to the first verification unit 302 upon receiving the monitoring data.

[0079] It should be noted that the present invention sets up a first message queue 301 in the second processing subsystem 300 and uses the first message queue 301 as an intermediate storage container in the process of transmitting the first monitoring data to the first verification unit 302, which can buffer the working pressure of the first verification unit 302 and reduce the workload of the first verification unit 302.

[0080] The establishment of the first message queue 301 allows the second processing subsystem 300 to respond to the first reporting unit 202 (i.e., respond to the first processing subsystem 200) immediately after the first reporting unit 202 sends monitoring data to the first message queue 301. This effectively improves the response speed to the first reporting unit 202 and enhances the overall system response speed. Furthermore, it prevents the second processing subsystem 300 from failing to respond promptly to the first reporting unit 202 (i.e., failing to respond promptly to the first processing subsystem 200) if the first verification unit 302 fails to verify the monitoring data in a timely manner due to a heavy workload or slow verification rate when the first message queue 301 is not set.

[0081] Meanwhile, the setup of the first message queue 301 can also reduce the tightness between the first processing subsystem 200 and the first verification unit 302, effectively decoupling them. Specifically, when the first verification unit 302 is in maintenance or abnormal state, the data acquisition unit 201 can continue to collect monitoring data from the target monitoring object, and the first reporting unit 202 will send the collected monitoring data to the first message queue 301 for storage, maintaining the first processing subsystem 200's collection and reporting of monitoring data. The first verification unit 302 can resume verifying the monitoring data in the first message queue 301 after returning to normal. This avoids situations where the first processing subsystem 200 is unable to collect and report monitoring data while the first verification unit 302 is malfunctioning, thus avoiding impact on the efficiency of the first processing subsystem 200 and improving the robustness and stability of the monitoring data processing system.

[0082] Among them, the configuration management information can be the management information configured in the configuration management system, and can correspondingly store the monitoring objects and monitoring indicators that need to be monitored.

[0083] The configuration management system can be a system for predefined configuration management information that is independent of the monitoring data processing system of this invention, or it can be a component of the monitoring data processing system.

[0084] It should be noted that in this invention, the corresponding monitoring objects and monitoring indicators that need to be monitored can be identified as configuration management information and stored in the configuration management system. It is understood that the configuration management information can store one or more monitoring objects that need to be monitored, and it can also store one or more monitoring indicators that need to be monitored. One monitoring object can correspond to one or more monitoring indicators.

[0085] The selection of monitoring objects and monitoring indicators can be determined by technical personnel based on actual business needs, and this invention does not impose any limitations on this. The monitoring indicators can be general indicators that need to be monitored during business production and operation, or they can be personalized indicators for the monitored objects.

[0086] Optionally, the first verification unit 302 can send query information to the configuration management system upon obtaining the first monitoring data. This allows the configuration management system to check whether the target monitoring object and the first monitoring indicator item exist in the configuration management information. Based on the query results returned by the configuration management system, it determines whether the verification of the first monitoring data has passed. In this case, when verifying the first monitoring data, the first verification unit 302 does not need to search for the first monitoring data in the configuration management information itself. Instead, it can instruct the configuration management system to perform the search in the configuration management information, thus reducing the workload of the first verification unit 302.

[0087] Optionally, the second processing subsystem 300 may obtain and save predefined configuration management information from the configuration management system before the first verification unit 302 verifies the first monitoring data. In this case, when the first verification unit 302 verifies the first monitoring data, the first verification unit 302 may verify the first monitoring data based on the configuration management information already saved in the second processing subsystem 300.

[0088] Optionally, the second processing subsystem 300 may further include: a first obtaining unit 203;

[0089] The first acquisition unit 203 is configured to perform the following: before verifying the first monitoring data in the first message queue 301, obtain predefined configuration management information from the configuration management system.

[0090] Specifically, the first obtaining unit 203 can be a component of the second processing subsystem 300. Before the first verification unit 302 verifies the first monitoring data, the first obtaining unit 203 can obtain configuration management information from the configuration management system. At this time, the first verification unit 302 can verify the first monitoring data based on the configuration management information already obtained by the first obtaining unit 203. The second processing subsystem 300 does not need to rely on the configuration management system to search for the first monitoring data in the configuration management information every time the first verification unit 302 performs verification, thus reducing the number of interactions between the second processing subsystem 300 and the configuration management system and reducing the consumption of interaction resources.

[0091] Specifically, when the target monitoring object and the first monitoring indicator item in the first monitoring data reported by the first reporting unit 202 exist in the configuration management information, the first verification unit 302 can determine that the first monitoring data is legal data, and can determine that the data collection performed by the data collection unit 201 is legal collection. The first verification unit 302 can verify the first monitoring data.

[0092] When the target monitoring object and the first monitoring indicator item in the first monitoring data reported by the first reporting unit 202 do not exist in the configuration management information, the first verification unit 302 can determine that the first monitoring data is not illegal data, and can determine that the data collection performed by the data collection unit 201 is illegal collection. The first verification unit 302 can fail to verify the first monitoring data.

[0093] If the target monitoring object in the first monitoring data does not exist in the configuration management information, the first verification unit 302 can determine that the target monitoring object is a monitoring object that does not need to be monitored, or is an invalid monitoring object.

[0094] If the first monitoring indicator item in the first monitoring data does not exist in the configuration management information, the first verification unit 302 can determine that the first monitoring indicator item is a monitoring indicator item that does not need to be monitored, or is an invalid monitoring indicator item.

[0095] If both the target monitoring object and the first monitoring indicator in the first monitoring data exist but do not exist in the corresponding configuration management information, then the first verification unit 302 can determine that the target monitoring object is a legitimate monitoring object, but the first monitoring indicator is a monitoring indicator in the target monitoring object that does not require data monitoring or is not legitimate.

[0096] It should be noted that this invention can effectively collect monitoring data from the target monitoring object and send the collected monitoring data to the first message queue 301 for storage. Subsequently, the monitoring data in the first message queue 301 can be verified, retaining the verified monitoring data and discarding the unverified monitoring data. This invention can obtain effective monitoring data from the target monitoring object by collecting and verifying the monitoring data, thereby improving the efficiency of monitoring the operational status of the target monitoring object.

[0097] Optionally, if the first verification unit 302 passes the verification of the first monitoring data, the second processing subsystem 300 can save the first monitoring data and send it to the backend for aggregation and alarm processing; if the first verification unit 302 fails the verification of the first monitoring data, the second processing subsystem 300 can prohibit the saving of the first monitoring data and discard the first monitoring data to avoid ineffective use of data storage space and to avoid consumption of the operating resources required for subsequent processing.

[0098] Optional, such as Figure 2 As shown, in the second type of monitoring data processing system proposed in this embodiment, the second type of monitoring data processing system may further include: a data processing unit 400;

[0099] The data processing unit 400 is configured to perform aggregation and alarm processing on the first monitoring data that has passed the verification.

[0100] Specifically, the data processing unit 400 can be a component of the monitoring data processing system. The data processing unit 400 can perform real-time aggregation and calculation on the first monitoring data that has passed verification and other monitoring data, and trigger alarms for abnormal situations of the target monitoring object.

[0101] It should be noted that the first verification unit 302 in the first processing system 100 can be the server in the monitoring data processing system, and the data processing unit 400 can be the backend in the monitoring data processing system.

[0102] The monitoring data processing system proposed in this embodiment includes a first processing system 100, which includes a first processing subsystem 200 and a second processing subsystem 300. The first processing subsystem 200 includes a data acquisition unit 201 and a first reporting unit 202. The second processing subsystem 300 includes a first message queue 301 and a first verification unit 302. The data acquisition unit 201 is used to acquire the monitoring index value of the first monitoring index item from the target monitoring object. The first reporting unit 202 is used to send the first monitoring data to the first message queue 301 for storage. The first monitoring data includes the target monitoring object, the first monitoring index item, and the monitoring index value. The first verification unit 302 is used to verify the first monitoring data in the first message queue 301 to determine whether the target monitoring object and the first monitoring index item exist in the predefined configuration management information. If so, the first monitoring data is determined to have passed the verification. This invention can effectively collect monitoring data from a target monitoring object and send the collected monitoring data to a first message queue 301 for storage. Subsequently, the monitoring data in the first message queue 301 can be verified, retaining the verified data and discarding the unverified data. This invention can obtain effective monitoring data from the target monitoring object through the collection and verification of monitoring data, thereby improving the efficiency of monitoring the operational status of the target monitoring object.

[0103] based on Figure 1 The structural diagram shown is as follows: Figure 3 As shown, this embodiment proposes a third type of monitoring data processing system. In the third type of monitoring data processing system, the first monitoring data may include the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item; the first processing subsystem 200 may further include: a second acquisition unit 204.

[0104] The second acquisition unit 204 is configured to perform the following: before sending the first monitoring data to the first message queue 301 for storage, obtain the object identifier of the target monitoring object from the configuration management system and obtain the indicator item identifier of the first monitoring indicator item.

[0105] Specifically, this invention can predefine the monitoring objects and monitoring indicators (i.e., the configuration management information) by configuring the object identifier of the monitoring object to be monitored and the indicator identifier of the monitoring indicator item to be monitored in the configuration management system.

[0106] The configuration management system can predefine object identifiers for one or more monitoring objects that need to be monitored, as well as indicator identifiers for one or more monitoring indicators that need to be monitored.

[0107] It should be noted that the object identifier can be a unique identifier for the monitored object in the configuration management information, and the indicator item identifier can be a unique identifier for the monitored indicator item in the configuration management information.

[0108] Optionally, before the data acquisition unit 201 acquires the indicator value of the first monitoring indicator item, the second obtaining unit 204 may first obtain configuration management information from the configuration management system, which stores the object identifier of the monitored object and the indicator identifier of the monitoring indicator item. Then, the data acquisition unit 201 may determine the target monitored object to be monitored based on the object identifier of the monitored object in the configuration management information acquired by the second obtaining unit 204, and determine the first monitoring indicator item to be monitored based on the indicator identifier of the monitoring indicator item corresponding to the target monitored object in the configuration management information acquired by the second obtaining unit 204. Then, the data acquisition unit 201 may acquire the indicator value of the first monitoring indicator item, and may determine the acquired indicator value, the object identifier of the target monitored object, and the indicator identifier of the first monitoring indicator item as the first monitoring data. At this time, the first monitoring data reported by the first reporting unit 202 may include the object identifier of the target monitored object, the indicator identifier of the first monitoring indicator item, and the monitoring indicator value.

[0109] Optionally, after the data acquisition unit 201 acquires the indicator value of the first monitoring indicator item, the second acquisition unit 204 can obtain the object identifier of the target monitoring object from the configuration management system based on the device identifier of the target monitoring object, and obtain the indicator item identifier of the first monitoring indicator item from the configuration management system based on the identifier of the first monitoring indicator item in the target monitoring object. It should be noted that the configuration management system can pre-store the device identifier and object identifier of the target monitoring object, and can pre-store the identifier and indicator item identifier of the first monitoring indicator item. Afterwards, the data acquisition unit 201 can determine the acquired indicator value, the object identifier of the target monitoring object, and the indicator item identifier of the first monitoring indicator item as the first monitoring data.

[0110] Specifically, after the data acquisition unit 201 determines the first monitoring data, the first reporting unit 202 can send the first monitoring data to the first message queue 301 for storage.

[0111] Optionally, the first verification unit 302 is configured to perform:

[0112] The first monitoring data in the first message queue 301 is verified to determine whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item exist in the predefined configuration management information. If they do, the first monitoring data is determined to have passed the verification.

[0113] When the first monitoring data includes the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator, the first verification unit 302 can verify the first monitoring data by verifying whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator exist in the configuration management information.

[0114] It should be noted that the present invention can verify whether the first monitoring data is valid by verifying the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item in the first monitoring data.

[0115] The monitoring data processing system proposed in this embodiment can verify whether the first monitoring data is valid by verifying the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item in the first monitoring data, thus effectively completing the verification of the first monitoring data.

[0116] based on Figure 1 The structural diagram shown is as follows: Figure 4 As shown, this embodiment proposes a fourth type of monitoring data processing system. This fourth type of monitoring data processing system may further include a second processing system 500. The second processing system 500 may include a third processing subsystem 600 and a fourth processing subsystem 700. The third processing subsystem 600 includes a monitoring agent 601 and a second reporting unit 602. The fourth processing subsystem 700 includes a second message queue 701 and a second verification unit 702.

[0117] Monitoring agent 601 is configured to perform: collect the monitoring indicator value of the second monitoring indicator item from the target monitoring object;

[0118] The second processing system 500 can be a component of the monitoring data processing system. The second processing system 500 can be software or hardware, and can be used to collect and verify monitoring data.

[0119] The third processing subsystem 600 can be a component of the second processing system 500. The third processing subsystem 600 can be software or hardware, and can collect monitoring data and report it to the fourth processing subsystem 700.

[0120] The fourth processing subsystem 700 can be a component of the second processing system 500. The fourth processing subsystem 700 can receive monitoring data reported by the second processing system 500 and perform verification and other related processing on the monitoring data.

[0121] Among them, monitoring agent 601 can be a program used to collect monitoring data of the target monitored object. It should be noted that monitoring agent 601 can collect the indicator values ​​of the monitoring indicator items in the target monitored object according to the monitoring indicator items specified in the general indicator set.

[0122] The general indicator set can consist of one or more monitoring indicator items. Specifically, this invention can prevent the monitoring agent 601 from collecting indicator values ​​for monitoring indicator items that do not belong to the general indicator set.

[0123] Optionally, monitoring agent 601 may include: a local monitoring agent and / or a remote monitoring agent.

[0124] The local monitoring agent can be a monitoring agent 601 installed on the target monitored object to collect monitoring data from the target monitored object. For example, the local monitoring agent can use the `free` command to collect the memory usage of the target monitored device.

[0125] Among them, the remote monitoring agent can be a monitoring agent 601 installed on a device other than the target monitoring object to collect monitoring data of the target monitoring object. For example, the remote monitoring agent can use the ping command on the device on which it is installed to collect network latency indicators on the target monitoring object.

[0126] The second monitoring indicator can be any indicator that needs to be monitored. It is understood that the second monitoring indicator can be the same as the first monitoring indicator, or it can be a different indicator.

[0127] The second reporting unit 602 is configured to perform the following: send the second monitoring data to the second message queue 701 for storage. The second monitoring data includes the target monitoring object, the second monitoring indicator item, and the monitoring indicator value of the second monitoring indicator item.

[0128] Specifically, the second reporting unit 602 can be a component of the third processing subsystem 600. The second reporting unit 602 can report the second monitoring data collected by the monitoring agent 601 to the second message queue 701.

[0129] Optionally, the second message queue 701 can be a different message queue from the first message queue 301 (e.g., Figure 4 (As shown). At this time, the first processing system 100 and the second processing system 500 have different data reporting channels, which can avoid the impact of one party arbitrarily reporting monitoring data on the other party's reported monitoring data, perform fault domain isolation, prevent mutual influence when data is blocked, and the two message queues can effectively improve the maximum data transmission capacity of monitoring data reporting.

[0130] Optionally, the second message queue 701 and the first message queue 301 can be the same message queue. In this case, the first processing system 100 and the second processing system 500 have the same monitoring data reporting channel, which can improve the control and management efficiency of the monitoring data reporting channel and reduce the consumption of control resources.

[0131] The second verification unit 702 is configured to perform the following: verify whether the second monitoring data in the second message queue 701 is valid; if so, determine that the second monitoring data has passed the verification.

[0132] The second verification unit 702 can be the same as the first verification unit 302. In this case, the monitoring data processing system contains only one verification unit.

[0133] The second verification unit 702 and the first verification unit 302 can also be different verification units (e.g., Figure 4 (As shown). At this point, the monitoring data processing system can contain two verification units.

[0134] Specifically, the second verification unit 702 can verify the second monitoring data by verifying the legality of the data format and content of the monitoring indicator values ​​in the second monitoring data.

[0135] If the data format and content of the monitoring indicator values ​​in the second monitoring data meet the requirements, the second verification unit 702 can determine that the second monitoring data passes the verification, and the fourth processing subsystem 700 can retain the first monitoring data. If the data format and / or content of the monitoring indicator values ​​in the second monitoring data do not meet the requirements, the second verification unit 702 can determine that the second monitoring data fails the verification, and the fourth processing subsystem 700 can prohibit the retention of the second monitoring data and discard the second monitoring data.

[0136] It should be noted that when the second verification unit 702 and the first verification unit 302 are the same verification unit, the verification unit can use the same verification mechanism or different verification mechanisms for the first monitoring data and the second monitoring data. For example, when verifying the first monitoring data, the verification unit can determine whether the first monitoring data passes the verification by verifying whether the target monitoring object and the first monitoring indicator item in the first monitoring data are stored in the predefined configuration management information, and by verifying whether the data and format of the first monitoring data are valid. When verifying the second monitoring data, the verification unit can determine whether the second monitoring data passes the verification by only verifying whether the data format and content of the second monitoring data are valid.

[0137] It is understandable that the monitoring data processing system can have two different ways of collecting and reporting monitoring data of the target monitoring object: one is to use the first processing subsystem 200 to collect and report the monitoring data of the target monitoring object, and the other is to use the third processing subsystem 600 to collect and report the monitoring data of the target monitoring object.

[0138] Specifically, the monitoring data processing system can use the third processing subsystem 600 to collect and report the indicator values ​​of traditional or general monitoring indicators in the target monitoring object, and can use the first processing subsystem 200 to collect and report the indicator values ​​of personalized monitoring indicators in the target monitoring object.

[0139] It should be noted that, because the monitoring agent 601 is somewhat intrusive to the target monitoring object, it may be prohibited from collecting monitoring data in certain special environments. In such cases, the data acquisition unit 201 can be used to collect monitoring data from the target monitoring object. For example, when the target monitoring object is incompatible with the monitoring agent 601, the target monitoring object is not allowed to install the monitoring agent 601, or the monitoring agent 601 is not allowed to collect monitoring data, the present invention can use the first processing subsystem 200, which includes the data acquisition unit 201, to collect and report monitoring data from the target monitoring object.

[0140] For example, when there are some personalized monitoring indicators in the target monitoring object that do not belong to the above-mentioned general indicator set, the present invention can predefine the personalized monitoring indicators in the configuration management information and use the first processing subsystem 200 to collect the indicator values ​​of the personalized monitoring indicators in the target monitoring object.

[0141] For example, when the target monitoring object itself has a data acquisition unit 201 capable of collecting monitoring data, and the indicator values ​​of certain personalized monitoring indicators can only be collected by its own existing data acquisition unit 201, this invention can use its own existing data acquisition unit 201 as the data acquisition unit 201 in the first sub-processing system, and use the first sub-processing system to collect the indicator values ​​of the personalized monitoring indicators on the target monitoring object. It should be noted that when this invention utilizes the target monitoring object's own existing data acquisition unit 201 to collect monitoring data, there is no need to redevelop the collection script, saving development resources.

[0142] Specifically, for different monitoring objects in a production environment, the present invention can use the third processing subsystem 600 to collect the indicator values ​​of monitoring indicator items belonging to the general indicator set, making full use of the universality of the third processing subsystem 600 for different monitoring objects, and use the first processing subsystem 200 to collect the indicator values ​​of a certain monitoring object or monitoring indicator item (such as some personalized indicator items) that the third processing subsystem 600 cannot collect monitoring data from, making full use of the applicability of the third processing subsystem 600 to special monitoring objects or personalized monitoring indicator items.

[0143] Optional, such as Figure 5 As shown, this embodiment proposes a fifth monitoring data processing system based on the fourth type of monitoring data processing system. The fifth monitoring data processing system may further include the aforementioned data processing unit 400; in this case, the data processing unit 400 can be configured to execute:

[0144] Aggregate and process alarms on the first and / or second monitoring data that have passed the verification.

[0145] Specifically, the data processing unit 400 can serve as the backend of the monitoring data processing system, receiving the verified monitoring data sent by the first verification unit 302 and the second verification unit 702, performing real-time aggregation and calculation on the received monitoring data, and triggering alarms for abnormal situations of the target monitoring object.

[0146] Optional, such as Figure 6 As shown, based on the fourth type of monitoring data processing system, this embodiment proposes a sixth type of monitoring data processing system. In the first processing system 100 and the second processing system 500 of the sixth type of monitoring data processing system, the first message queue 301 and the second message queue 701 can be different message queues, the first verification unit 302 and the second verification unit 702 can be the same verification unit 800 (that is, the first processing system 100 and the second processing system 500 can share a verification unit 800), and can include the same data processing unit 400. The data processing unit 400 can aggregate and alarm the first monitoring data and / or the second monitoring data that have passed the verification.

[0147] The monitoring data processing system proposed in this embodiment has a second processing system 500 that can collect and process the indicator values ​​of monitoring indicator items belonging to the general indicator set on the monitored object, and a first processing system 100 that can collect and process the indicator values ​​of a certain monitored object or monitoring indicator item that the first processing system 100 cannot collect and process. By making full use of the versatility of the second processing system 500 and the special characteristics of the first processing system 100, the monitoring data of the monitored object can be effectively obtained, thereby improving the processing efficiency of the monitoring data.

[0148] like Figure 7 As shown, this embodiment proposes a first method for processing monitoring data. This method can be applied to... Figure 1 The monitoring data processing system shown may include: a first processing system; a first processing subsystem and a second processing subsystem; the first processing subsystem may include: a data acquisition unit and a first reporting unit; the second processing subsystem may include: a first message queue and a first verification unit; the method may include the following steps:

[0149] S101. The data acquisition unit collects the monitoring index value of the first monitoring index item from the target monitoring object;

[0150] The monitoring data processing system can be software or hardware used to collect and process monitoring data.

[0151] The first processing system can be a component of the monitoring data processing system. The first processing system can be software or hardware, and can be used to collect and verify monitoring data.

[0152] The first processing subsystem can be a component of the first processing system. The first processing subsystem can be software or hardware, and it can collect monitoring data and report it to the second processing subsystem.

[0153] The second processing subsystem can be a component of the first processing system. The second processing subsystem can receive monitoring data reported by the first processing subsystem and perform verification and other related processing on the monitoring data.

[0154] Specifically, the monitoring data can be any data that needs to be monitored. Optionally, the monitoring data can be the runtime data of the target software. The target software can be any software whose runtime data needs to be monitored; this invention does not limit the specific software type of the target software.

[0155] The data acquisition unit can be a component of the first processing subsystem. The data acquisition unit can collect monitoring data from the target monitored object.

[0156] The target monitoring object can be an electronic device on which the aforementioned target software is installed, such as a mobile phone, tablet computer, or desktop computer. It is understood that the data acquisition unit can be adapted to the target monitoring object, and the data acquisition unit can collect monitoring data from the adapted target monitoring object.

[0157] Optionally, the data acquisition unit can be a component within the target monitored object itself that enables the acquisition of monitoring data. In this case, the target monitored object can utilize its own data acquisition unit to acquire monitoring data.

[0158] Optionally, the data acquisition unit may not be located within the target monitored object. In this case, the data acquisition unit can be an entity independent of the target monitored object, which can be either software or hardware.

[0159] The first monitoring indicator can be a specific indicator that needs to be monitored, such as memory utilization, network latency, disk utilization, and CPU utilization.

[0160] The monitoring metric value can be the value of the first monitoring metric item. For example, when the target monitoring metric item is memory utilization, the monitoring metric value can be the memory utilization value.

[0161] Optionally, the data acquisition unit can periodically collect the monitoring index value of the first monitoring index item from the target monitoring object; the data acquisition unit can also continuously poll the target monitoring object to query the changes in the index value of the first monitoring index item. When the index value of the first monitoring index item changes, the index value of the first monitoring index item can be collected from the target monitoring object in real time.

[0162] Specifically, the data acquisition unit can determine the first monitoring data that will be reported by the first reporting unit after acquiring the monitoring indicator value of the first monitoring indicator item.

[0163] S102, the first reporting unit sends the first monitoring data to the first message queue for storage. The first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value.

[0164] The first reporting unit can be a component of the first processing subsystem, and the first reporting unit can report the monitoring data collected by the data acquisition unit to the second processing subsystem.

[0165] Specifically, the first reporting unit can report the first monitoring data to the second processing subsystem by sending the first monitoring data to the first message queue in the second processing subsystem for storage.

[0166] The first message queue can be a message queue used to store monitoring data in the second processing subsystem.

[0167] Specifically, when the data acquisition unit collects the monitoring index value of the first monitoring index item, the first reporting unit can report the first monitoring data to the first message queue, thereby realizing real-time reporting of monitoring data.

[0168] S103. The first verification unit verifies the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information. If so, the first monitoring data is determined to pass the verification.

[0169] The first verification unit can be a component of the second processing subsystem. The first verification unit can be used to verify the monitoring data in the first message queue.

[0170] Specifically, the first verification unit can first obtain monitoring data from the first message queue, and then verify the monitoring data.

[0171] Optionally, the first verification unit may periodically extract monitoring data from the first message queue.

[0172] Optionally, the first verification unit can continuously poll the first message queue to check whether new monitoring data is stored in the first message queue. If so, the monitoring data can be obtained from the first message queue in real time.

[0173] Optionally, the first verification unit may extract the monitoring data from the first message queue upon receiving a message notification from the first message queue indicating that monitoring data has been received. The message notification may be sent by the first message queue to the first verification unit upon receiving the monitoring data.

[0174] It should be noted that the present invention sets up a first message queue in the second processing subsystem and uses the first message queue as an intermediate storage container in the process of transmitting the first monitoring data to the first verification unit, which can buffer the working pressure of the first verification unit and reduce the workload of the first verification unit.

[0175] Among them, the configuration management information can be the management information configured in the configuration management system, and can correspondingly store the monitoring objects and monitoring indicators that need to be monitored.

[0176] The configuration management system can be a system for predefined configuration management information that is independent of the monitoring data processing system of this invention, or it can be a component of the monitoring data processing system.

[0177] It should be noted that in this invention, the corresponding monitoring objects and monitoring indicators that need to be monitored can be identified as configuration management information and stored in the configuration management system. It is understood that the configuration management information can store one or more monitoring objects that need to be monitored, and it can also store one or more monitoring indicators that need to be monitored. One monitoring object can correspond to one or more monitoring indicators.

[0178] The selection of monitoring objects and monitoring indicators can be determined by technical personnel based on actual business needs, and this invention does not impose any limitations on this. The monitoring indicators can be general indicators that need to be monitored during business production and operation, or they can be personalized indicators for the monitored objects.

[0179] Optionally, the first verification unit can send a query to the configuration management system upon obtaining the first monitoring data. This allows the configuration management system to check if the target monitoring object and the first monitoring indicator item exist in the configuration management information. Based on the query results returned by the configuration management system, the system determines whether the verification of the first monitoring data has passed. In this case, the first verification unit does not need to perform the search for the first monitoring data itself in the configuration management information; instead, it can instruct the configuration management system to perform the search, thus reducing the workload of the first verification unit.

[0180] Optionally, the second processing subsystem may obtain and save predefined configuration management information from the configuration management system before the first verification unit verifies the first monitoring data. In this case, when the first verification unit verifies the first monitoring data, the first verification unit may verify the first monitoring data based on the configuration management information already saved in the second processing subsystem.

[0181] Optionally, the second processing subsystem may further include: a first obtaining unit; in this case, before step S104, the first monitoring data processing method described above may further include:

[0182] The first obtaining unit obtains predefined configuration management information from the configuration management system.

[0183] Specifically, the first obtaining unit can be a component of the second processing subsystem. Before the first verification unit verifies the first monitoring data, the first obtaining unit can obtain configuration management information from the configuration management system. At this time, the first verification unit can verify the first monitoring data based on the configuration management information already obtained by the first obtaining unit. The second processing subsystem does not need to rely on the configuration management system to search for the first monitoring data in the configuration management information every time the first verification unit performs verification, thus reducing the number of interactions between the second processing subsystem and the configuration management system and reducing the consumption of interaction resources.

[0184] Specifically, when the target monitoring object and the first monitoring indicator item in the first monitoring data reported by the first reporting unit exist in the configuration management information, the first verification unit can determine that the first monitoring data is valid data, and can determine that the data collection performed by the data collection unit is valid collection. The first verification unit can verify the first monitoring data.

[0185] Specifically, when the target monitoring object and the first monitoring indicator item in the first monitoring data reported by the first reporting unit do not exist in the configuration management information, the first verification unit can determine that the first monitoring data is not illegal data, and can determine that the data collection performed by the data collection unit is illegal collection. The first verification unit can refuse to verify the first monitoring data.

[0186] If the target monitoring object in the first monitoring data does not exist in the configuration management information, the first verification unit can determine that the target monitoring object is a monitoring object that does not need to be monitored, or an invalid monitoring object.

[0187] If the first monitoring indicator item in the first monitoring data does not exist in the configuration management information, the first verification unit can determine that the first monitoring indicator item is a monitoring indicator item that does not need to be monitored, or is an invalid monitoring indicator item.

[0188] If both the target monitoring object and the first monitoring indicator in the first monitoring data exist but do not exist in the corresponding configuration management information, the first verification unit can determine that the target monitoring object is a legitimate monitoring object, but the first monitoring indicator is a monitoring indicator in the target monitoring object that does not require data monitoring or is not legitimate.

[0189] It should be noted that this invention can effectively collect monitoring data from the target monitoring object and send the collected monitoring data to a first message queue for storage. Subsequently, the monitoring data in the first message queue can be verified, retaining the verified data and discarding the unverified data. This invention can obtain effective monitoring data from the target monitoring object through the collection and verification of monitoring data, thereby improving the efficiency of monitoring the operational status of the target monitoring object.

[0190] Optionally, if the first verification unit passes the verification of the first monitoring data, the second processing subsystem can save the first monitoring data and send it to the backend for aggregation and alarm processing; if the first verification unit fails the verification of the first monitoring data, the second processing subsystem can prohibit the saving of the first monitoring data and discard the first monitoring data to avoid ineffective use of data storage space and to avoid consumption of the operating resources required for subsequent processing.

[0191] Optional, such as Figure 8 As shown, in the second monitoring data processing method proposed in this embodiment, the monitoring data processing system may further include: a data processing unit; in this case, the second monitoring data processing method may further include:

[0192] S201, The data processing unit aggregates and processes the first monitoring data that has passed the verification.

[0193] Specifically, the data processing unit can be a component of the monitoring data processing system. The data processing unit can perform real-time aggregation and calculation on the first verified monitoring data and other monitoring data, and trigger alarms for abnormal situations of the target monitored object.

[0194] It should be noted that the first verification unit in the first processing system can be the server in the monitoring data processing system, and the data processing unit can be the backend in the monitoring data processing system.

[0195] The monitoring data processing method proposed in this embodiment can effectively collect monitoring data from the target monitoring object and send the collected monitoring data to a first message queue for storage. Subsequently, the monitoring data in the first message queue can be verified, retaining the verified monitoring data and discarding the unverified data. This invention can obtain effective monitoring data from the target monitoring object by collecting and verifying the monitoring data, thereby improving the efficiency of monitoring the operational status of the target monitoring object.

[0196] based on Figure 7 The steps shown are as follows: Figure 9 As shown, this embodiment proposes a third monitoring data processing method. In the third monitoring data processing method, the first monitoring data may include the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item; the first processing subsystem further includes: a second obtaining unit; at this time, the third monitoring data processing method may further include, before step S102:

[0197] S301, the second obtaining unit obtains the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item from the configuration management system.

[0198] Specifically, this invention can predefine the monitoring objects and monitoring indicators (i.e., the configuration management information) by configuring the object identifier of the monitoring object to be monitored and the indicator identifier of the monitoring indicator item to be monitored in the configuration management system.

[0199] The configuration management system can predefine object identifiers for one or more monitoring objects that need to be monitored, as well as indicator identifiers for one or more monitoring indicators that need to be monitored.

[0200] It should be noted that the object identifier can be a unique identifier for the monitored object in the configuration management information, and the indicator item identifier can be a unique identifier for the monitored indicator item in the configuration management information.

[0201] Optionally, before the data acquisition unit collects the value of the first monitoring indicator, the second obtaining unit may first obtain configuration management information from the configuration management system, which stores the object identifier of the monitored object and the indicator identifier of the monitoring indicator. Then, the data acquisition unit may determine the target monitored object according to the object identifier of the monitored object in the configuration management information obtained by the second obtaining unit, and determine the first monitoring indicator to be monitored according to the indicator identifier of the monitoring indicator corresponding to the target monitored object in the configuration management information obtained by the second obtaining unit.

[0202] Subsequently, the data acquisition unit can collect the indicator value of the first monitoring indicator item, and can determine the collected indicator value, the object identifier of the target monitoring object, and the indicator item identifier of the first monitoring indicator item as the first monitoring data. At this time, the first monitoring data in step S102 may include the object identifier of the target monitoring object, the indicator item identifier of the first monitoring indicator item, and the monitoring indicator value.

[0203] Optionally, after the data acquisition unit collects the indicator value of the first monitoring indicator, the second obtaining unit can obtain the object identifier of the target monitoring object from the configuration management system based on the device identifier of the target monitoring object, and obtain the indicator identifier of the first monitoring indicator from the configuration management system based on the identifier of the first monitoring indicator in the target monitoring object. It should be noted that the configuration management system can pre-store the device identifier and object identifier of the target monitoring object, and can pre-store the identifier and indicator identifier of the first monitoring indicator. Afterwards, the data acquisition unit can determine the collected indicator value, the object identifier of the target monitoring object, and the indicator identifier of the first monitoring indicator as the first monitoring data.

[0204] Specifically, after the data acquisition unit determines the first monitoring data, the first reporting unit can send the first monitoring data to the first message queue for storage.

[0205] Optional, such as Figure 9 As shown, in the third monitoring data processing method described above, step S103 may include:

[0206] The first verification unit verifies the first monitoring data in the first message queue to determine whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item exist in the predefined configuration management information. If so, the first monitoring data is determined to have passed the verification.

[0207] When the first monitoring data includes the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item, the first verification unit can verify the first monitoring data by verifying whether the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item exist in the configuration management information.

[0208] It should be noted that the present invention can verify whether the first monitoring data is valid by verifying the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item in the first monitoring data.

[0209] The monitoring data processing method proposed in this embodiment can verify whether the first monitoring data is valid by verifying the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator in the first monitoring data, thus effectively completing the verification of the first monitoring data.

[0210] based on Figure 7 The steps shown are as follows: Figure 10 As shown, this embodiment proposes a fourth monitoring data processing method. In this method, the monitoring data processing system may further include: a second processing system, which may include: a third processing subsystem and a fourth processing subsystem. The third processing subsystem may include: a monitoring agent and a second reporting unit; the fourth processing subsystem may include: a second message queue and a second verification unit. In this case, the fourth monitoring data processing method may further include:

[0211] S401. The monitoring agent collects the monitoring index value of the second monitoring index item from the target monitoring object.

[0212] The second processing system can be a component of the monitoring data processing system. The second processing system can be software or hardware, and can be used to collect and verify monitoring data.

[0213] The third processing subsystem can be a component of the second processing system. The third processing subsystem can be software or hardware, and it can collect monitoring data and report it to the fourth processing subsystem.

[0214] The fourth processing subsystem can be a component of the second processing system. The fourth processing subsystem can receive monitoring data reported by the second processing system and perform verification and other related processing on the monitoring data.

[0215] The monitoring agent can be a program used to collect monitoring data from the target monitored object. It should be noted that the monitoring agent can collect the indicator values ​​of the monitoring indicators in the target monitored object according to the monitoring indicator items specified in the general indicator set.

[0216] The general indicator set can consist of one or more monitoring indicator items. Specifically, this invention can prevent monitoring agents from collecting indicator values ​​for monitoring indicator items that do not belong to the general indicator set.

[0217] Optionally, the monitoring agent may include: a local monitoring agent and / or a remote monitoring agent.

[0218] In this context, a local monitoring agent can be installed on the target monitored object to collect monitoring data from that object. For example, a local monitoring agent can use the `free` command to collect memory usage data on the target monitored device.

[0219] In this context, a remote monitoring agent can be a monitoring agent installed on a device other than the target monitored object to collect monitoring data from the target monitored object. For example, a remote monitoring agent can use the ping command on the device on which it is installed to collect network latency metrics on the target monitored object.

[0220] The second monitoring indicator can be any indicator that needs to be monitored. It is understood that the second monitoring indicator can be the same as the first monitoring indicator, or it can be a different indicator.

[0221] S402, the second reporting unit sends the second monitoring data to the second message queue for storage. The second monitoring data includes the target monitoring object, the second monitoring indicator item, and the monitoring indicator value of the second monitoring indicator item.

[0222] Specifically, the second reporting unit can be a component of the third processing subsystem. The second reporting unit can report the second monitoring data collected by the monitoring agent to the second message queue.

[0223] Optionally, the second message queue can be a different message queue from the first message queue. In this case, the first processing system and the second processing system have different data reporting channels, which can avoid the impact of one party arbitrarily reporting monitoring data on the other party's reported monitoring data, perform fault domain isolation, prevent mutual interference when data is blocked, and the two message queues can effectively improve the maximum data transmission capacity of monitoring data reporting.

[0224] Optionally, the second message queue and the first message queue can be the same message queue. In this case, the first processing system and the second processing system have the same monitoring data reporting channel, which can improve the control and management efficiency of the monitoring data reporting channel and reduce the consumption of control resources.

[0225] S403. The second verification unit verifies whether the second monitoring data in the second message queue is valid. If it is, the second monitoring data is determined to have passed the verification.

[0226] The second verification unit can be the same as the first verification unit, in which case the monitoring data processing system contains only one verification unit.

[0227] The second verification unit can be different from the first verification unit. In this case, the monitoring data processing system can contain two verification units.

[0228] Specifically, the second verification unit can verify the second monitoring data by checking the legality of the data format and content of the monitoring indicator values ​​in the second monitoring data.

[0229] If the data format and content of the monitoring indicator values ​​in the second monitoring data meet the requirements, the second verification unit can determine that the second monitoring data passes the verification, and the fourth processing subsystem can retain the first monitoring data. If the data format and / or content of the monitoring indicator values ​​in the second monitoring data do not meet the requirements, the second verification unit can determine that the second monitoring data fails the verification, and the fourth processing subsystem can prohibit the retention of the second monitoring data and discard the second monitoring data.

[0230] It should be noted that when the second verification unit and the first verification unit are the same verification unit, the verification unit can use the same verification mechanism for the first monitoring data and the second monitoring data, or it can use different verification mechanisms. For example, when verifying the first monitoring data, the verification unit can determine whether the first monitoring data passes verification by verifying whether the target monitoring object and the first monitoring indicator item in the first monitoring data are stored in the predefined configuration management information, and by verifying whether the data and format of the first monitoring data are valid. However, when verifying the second monitoring data, the verification unit can determine whether the second monitoring data passes verification by only verifying whether the data format and content of the second monitoring data are valid.

[0231] It is understandable that a monitoring data processing system can have two different ways of collecting and reporting monitoring data of the target monitoring object: one is to use the first processing subsystem to collect and report the monitoring data of the target monitoring object, and the other is to use the third processing subsystem to collect and report the monitoring data of the target monitoring object.

[0232] Specifically, the monitoring data processing system can use a third processing subsystem to collect and report the indicator values ​​of traditional or general monitoring indicators in the target monitoring object, and can use a first processing subsystem to collect and report the indicator values ​​of personalized monitoring indicators in the target monitoring object.

[0233] It should be noted that, because the monitoring agent is somewhat intrusive to the target monitored object, it may be prohibited from collecting monitoring data in certain special environments. In such cases, a data acquisition unit can be used to collect the monitoring data of the target monitored object. For example, when the target monitored object is incompatible with the monitoring agent, the target monitored object is not allowed to install the monitoring agent, or the monitoring agent is not allowed to collect monitoring data, this invention can use a first processing subsystem including a data acquisition unit to collect and report the monitoring data of the target monitored object.

[0234] For example, when there are some personalized monitoring indicators in the target monitoring object that do not belong to the above-mentioned general indicator set, the present invention can predefine the personalized monitoring indicators in the configuration management information and use the first processing subsystem to collect the indicator values ​​of the personalized monitoring indicators in the target monitoring object.

[0235] For example, when the target monitoring object itself has a data acquisition unit capable of collecting monitoring data, and the values ​​of certain personalized monitoring indicators can only be collected by its own existing data acquisition unit, this invention can use its existing data acquisition unit as the data acquisition unit in the first sub-processing system, and use the first sub-processing system to collect the values ​​of the personalized monitoring indicators on the target monitoring object. It should be noted that when this invention utilizes the target monitoring object's own existing data acquisition unit to collect monitoring data, there is no need to redevelop the collection script, saving development resources.

[0236] Specifically, for different monitoring objects in a production environment, this invention can use a third processing subsystem to collect the indicator values ​​of monitoring indicator items belonging to the general indicator set, making full use of the universality of the third processing subsystem for different monitoring objects, and use a first processing subsystem to collect the indicator values ​​of a certain monitoring object or monitoring indicator item (such as certain personalized indicator items) that the third processing subsystem cannot collect monitoring data from, making full use of the applicability of the third processing subsystem to special monitoring objects or personalized monitoring indicator items.

[0237] Optional, such as Figure 11 As shown, this embodiment proposes a fifth monitoring data processing method based on the fourth monitoring data processing method. In the fifth monitoring data processing method, the monitoring data processing system may further include the aforementioned data processing unit; in this case, the fifth monitoring data processing method may further include:

[0238] S501, The data processing unit aggregates and performs alarm processing on the first and / or second monitoring data that have passed the verification.

[0239] Specifically, the data processing unit can serve as the backend of the monitoring data processing system, receiving the verified monitoring data sent by the first and second verification units, performing real-time aggregation and calculation on the received monitoring data, and triggering alarms for abnormal situations of the target monitoring object.

[0240] Optionally, based on the fourth monitoring data processing method, this embodiment proposes a sixth monitoring data processing method. In the sixth monitoring data processing method, the first message queue and the second message queue can be different message queues, the first verification unit and the second verification unit can be the same verification unit (i.e., the first processing system and the second processing system can share a verification unit), and can include the same data processing unit. The data processing unit can aggregate and alarm the verified first monitoring data and / or second monitoring data.

[0241] The monitoring data processing method proposed in this embodiment allows the second processing system to collect and process the indicator values ​​of monitoring indicator items belonging to the general indicator set on the monitored object, while the first processing system can collect the indicator values ​​of a certain monitored object or monitoring indicator item that the first processing system cannot collect and process. By making full use of the versatility of the second processing system and the special characteristics of the first processing system, the monitoring data of the monitored object can be effectively obtained, thereby improving the processing efficiency of the monitoring data.

[0242] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0243] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A monitoring data processing system, characterized in that, The monitoring data processing system includes: a first processing system and a second processing system. The first processing system includes: a first processing subsystem and a second processing subsystem. The first processing subsystem includes: a data acquisition unit and a first reporting unit. The data acquisition unit belongs to the target monitoring object itself. The second processing subsystem includes: a first message queue and a first verification unit. The second processing system also includes: a third processing subsystem and a fourth processing subsystem. The third processing subsystem includes: a monitoring agent and a second reporting unit. The fourth processing subsystem includes: a second message queue and a second verification unit. The first message queue and the second message queue belong to the same message queue, and the first verification unit and the second verification unit belong to the same verification unit. The data acquisition unit is configured to perform the following: acquire the monitoring indicator value of a first monitoring indicator item from the target monitoring object; the first monitoring data includes the object identifier of the target monitoring object and the indicator item identifier of the first monitoring indicator item, wherein the first monitoring indicator item is a personalized indicator. The first reporting unit is configured to perform the following: send the first monitoring data to the first message queue for storage, wherein the first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value; The first verification unit is configured to perform the following: verify the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information; if so, determine that the first monitoring data passes the verification. The monitoring agent is configured to perform the following: collect the monitoring indicator value of a second monitoring indicator item from the target monitoring object; the second monitoring indicator item is a general indicator. The second reporting unit is configured to perform the following: send the second monitoring data to the second message queue for storage. The second monitoring data includes the target monitoring object, the second monitoring indicator item, and the monitoring indicator value of the second monitoring indicator item. The second verification unit is configured to perform the following: verify whether the second monitoring data in the second message queue is valid; if so, determine that the second monitoring data has passed the verification.

2. The monitoring data processing system according to claim 1, characterized in that, The second processing subsystem further includes: a first obtaining unit; The first obtaining unit is configured to perform the following: before verifying the first monitoring data in the first message queue, obtain the predefined configuration management information from the configuration management system.

3. The monitoring data processing system according to claim 1, characterized in that, The first monitoring data includes the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item; The first processing subsystem further includes: a second obtaining unit; The second obtaining unit is configured to perform the following: before sending the first monitoring data to the first message queue for storage, obtain the object identifier of the target monitoring object from the configuration management system, and obtain the indicator item identifier of the first monitoring indicator item.

4. The monitoring data processing system according to claim 3, characterized in that, The first verification unit is configured to perform: The first monitoring data in the first message queue is verified to determine whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item exist in the predefined configuration management information.

5. The monitoring data processing system according to claim 1, characterized in that, The monitoring data processing system further includes: a data processing unit; The data processing unit is configured to perform the following: aggregate and alarm processing on the first monitoring data that has passed verification.

6. A method for processing monitoring data, characterized in that, This system is applied to a monitoring data processing system, which includes: a first processing system and a second processing system. The first processing system includes: a first processing subsystem and a second processing subsystem. The first processing subsystem includes: a data acquisition unit and a first reporting unit. The data acquisition unit belongs to the target monitoring object itself. The second processing subsystem includes: a first message queue and a first verification unit. The second processing system also includes: a third processing subsystem and a fourth processing subsystem. The third processing subsystem includes: a monitoring agent and a second reporting unit. The fourth processing subsystem includes: a second message queue and a second verification unit. The first message queue and the second message queue belong to the same message queue, and the first verification unit and the second verification unit belong to the same verification unit. The method includes: The data acquisition unit collects the monitoring index value of the first monitoring index item from the target monitoring object; the first monitoring data includes the object identifier of the target monitoring object and the index item identifier of the first monitoring index item, and the first monitoring index item is a personalized index. The first reporting unit sends the first monitoring data to the first message queue for storage. The first monitoring data includes the target monitoring object, the first monitoring indicator item, and the monitoring indicator value. The first verification unit verifies the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information. If so, the first monitoring data is determined to pass the verification. The monitoring agent collects the monitoring index value of the second monitoring index item from the target monitoring object; the second monitoring index item is a general index. The second reporting unit sends the second monitoring data to the second message queue for storage. The second monitoring data includes the target monitoring object, the second monitoring indicator item, and the monitoring indicator value of the second monitoring indicator item. The second verification unit verifies whether the second monitoring data in the second message queue is valid. If it is, the second monitoring data is determined to have passed the verification.

7. The method according to claim 6, characterized in that, The second processing subsystem further includes: a first obtaining unit; before verifying the first monitoring data in the first message queue, the method further includes: The first obtaining unit obtains the predefined configuration management information from the configuration management system.

8. The method according to claim 6, characterized in that, The first monitoring data includes the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item; The first processing subsystem further includes: a second obtaining unit; before sending the first monitoring data to the first message queue for storage, the method further includes: The second obtaining unit obtains the object identifier of the target monitoring object from the configuration management system, and obtains the indicator item identifier of the first monitoring indicator item.

9. The method according to claim 8, characterized in that, The first verification unit verifies the first monitoring data in the first message queue to determine whether the target monitoring object and the first monitoring indicator item exist in the predefined configuration management information, including: The first verification unit verifies the first monitoring data in the first message queue to determine whether the object identifier of the target monitoring object and the indicator identifier of the first monitoring indicator item exist in the predefined configuration management information.

Images