Data monitoring method and device, electronic equipment, storage medium and program

Abstract

The embodiment of the invention discloses a data monitoring method and device, electronic equipment, a storage medium and a program.The method is applied to a monitoring object and comprises the steps that monitoring index data collected by a plurality of index collectors for the monitoring object is inquired through a plurality of index inquirers; determining a data sending channel matched with each index querier; wherein the data sending frequencies of different data sending channels are different; and sending the monitoring index data to monitoring equipment through a data sending channel matched with the corresponding index querier. According to the technical scheme provided by the embodiment of the invention, the real-time performance of data monitoring can be improved, and the abnormity of the monitored object can be responded and repaired in time.

Description

Technical Field

[0001] Embodiments of the present invention relate to the technical field of data processing, and in particular, to a data monitoring method, device, electronic device, storage medium, and program. Background Art

[0002] Monitoring systems are widely used, covering almost all fields of IT (Information Technology) and industry.

[0003] In the process of implementing the present invention, the inventors found that the prior art has the following defects: the detection period of the current monitoring system is generally at the second level or even the minute level, and there are problems in terms of detection real-time performance and data accuracy. In adjacent detection periods, if there is sudden traffic increase or decrease, or continuous traffic fluctuation, many problems cannot be detected due to the long interval between detection periods. In addition, the monitoring system is completely invisible to the data distribution between two sampling intervals, and by default, it can only assume that the data between two sampling points changes linearly, but this often does not conform to the actual situation. Summary of the Invention

[0004] Embodiments of the present invention provide a data monitoring method, device, electronic device, storage medium, and program, which can improve the real-time performance of data monitoring and is conducive to timely responding to and repairing anomalies of monitored objects.

[0005] According to one aspect of the present invention, there is provided a data monitoring method, applied to a monitored object, including:

[0006] Querying, by multiple metric queryers, monitoring metric data collected by multiple metric collectors for the monitored object;

[0007] Determining a data sending channel matched by each of the metric queryers; wherein, data sending frequencies of different data sending channels are different;

[0008] Sending the monitoring metric data to a monitoring device through the data sending channel matched by the corresponding metric queryer.

[0009] According to another aspect of the present invention, there is provided a data monitoring device, configured in a monitored object, including:

[0010] A monitoring metric data query module, configured to query, by multiple metric queryers, monitoring metric data collected by multiple metric collectors for the monitored object;

[0011] A data sending channel determination module, configured to determine a data sending channel matched by each of the metric queryers; wherein, data sending frequencies of different data sending channels are different;

[0012] A monitoring index data sending module, configured to send the monitoring index data to a monitoring device through a data sending channel matched by a corresponding index query device.

[0013] According to another aspect of the present invention, there is provided an electronic device, including:

[0014] At least one processor; and

[0015] A memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and when the computer program is executed by the at least one processor, the at least one processor is enabled to execute the data monitoring method according to any embodiment of the present invention.

[0017] According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for implementing the data monitoring method according to any embodiment of the present invention when executed by a processor.

[0018] According to another aspect of the present invention, there is also provided a computer program product including a computer program, which implements the data monitoring method according to any embodiment of the present invention when executed by a processor.

[0019] In the embodiments of the present invention, a plurality of index query devices of a monitoring object are used to query monitoring index data collected by a plurality of index collection devices for the monitoring object, and a data sending channel matched by each index query device is determined, so as to send the monitoring index data to a monitoring device through the data sending channel matched by the corresponding index query device. Since the query operation of the index query device and the collection operation of the index collection device are decoupled, an asynchronous execution mode for collecting and sending monitoring index data is realized. Further, since the data sending frequencies of different data sending channels are different, different types of monitoring index data can be sent at different data sending frequencies according to data monitoring requirements. The asynchronous execution mode of data collection and sending combined with different data sending frequencies can realize real-time processing of monitoring index data. The above technical solution solves the problems such as poor real-time performance existing in the existing data monitoring methods, can improve the real-time performance of data monitoring, and is beneficial to timely respond to and repair the anomalies of the monitoring object.

[0020] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0022] Figure 1 is a flowchart of a data monitoring method provided by an embodiment of the present invention;

[0023] Figure 2 is a flowchart of another data monitoring method provided by an embodiment of the present invention;

[0024] Figure 3 shows a schematic structural diagram of a monitoring system applicable to an embodiment of the present invention;

[0025] Figure 4 shows a schematic diagram of the processing flow of a monitoring client in a monitoring system applicable to an embodiment of the present invention;

[0026] Figure 5 is a schematic diagram of a data monitoring device provided by an embodiment of the present invention;

[0027] Figure 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. Detailed implementation manners

[0028] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0029] It should be noted that the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily have to be limited to those clearly listed steps or units, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or devices.

[0030] Figure 1The figure is a flowchart of a data monitoring method provided by an embodiment of the present invention. This embodiment is applicable to the situation where monitoring metric data asynchronously queried by a metric query device is sent through data sending channels with different data sending frequencies. This method can be executed by a data monitoring device, which can be implemented in software and / or hardware and is generally integrated in an electronic device. The electronic device can be a monitoring object, which can be a terminal device or a server device, as long as it can execute the data monitoring method. The specific device type of the electronic device is not limited in the embodiments of the present invention. Correspondingly, as Figure 1 shown, the method includes the following operations:

[0031] S110. Query, through a plurality of metric query devices, the monitoring metric data collected by a plurality of metric collection devices for the monitoring object.

[0032] Among them, the metric query device can be used to query the monitoring metric data. The metric collection device can be used to collect the monitoring metric data. The monitoring metric data is the metric data obtained by monitoring and detecting the monitoring object. The monitoring object can include various types. For example, it can include, but is not limited to, device type monitoring objects such as client devices, power devices, and industrial devices. It can also be environmental type monitoring objects such as physical environment metrics (temperature, humidity, air pressure, and air quality, etc.), safety environment metrics (smoke concentration, water immersion detection, and access control status, etc.), and energy consumption metrics (cooling capacity, power load rate, current, and voltage). It can also be business monitoring objects, application monitoring objects, component monitoring objects, and network monitoring objects, etc., as long as there is a monitoring requirement. The specific type of the monitoring object is not limited in the embodiments of the present invention.

[0033] Optionally, the metric query device and the metric collection device can be hardware modules arranged for the monitoring object. For example, a sensor can be used as the metric collection device, and [not specified in the original] can be used as the metric query device. Optionally, the metric query device and the metric collection device can also be software components arranged for the monitoring object. For example, the metric query device and the metric collection device execute data collection and query operations as internal threads or components of a client device. The embodiments of the present invention do not limit the implementation manners of the metric query device and the metric collection device. The metric query device and the metric collection device can be configured within the monitoring object. Exemplarily, if the monitoring object is a device, the metric query device and the metric collection device can be hardware modules integrated within the device or software components; if the monitoring object is an environmental type monitoring object, the metric query device and the metric collection device can be hardware modules arranged within the monitoring environment range or software components within the monitoring modules arranged within the monitoring environment range, etc.

[0034] It can be understood that the types of monitoring metric data are related to the types of monitoring objects and the actual monitoring service requirements. Exemplarily, when the monitoring object is a client device, the monitoring metric data may include, but is not limited to, CPU (Central Processing Unit) usage rate, memory usage rate, host temperature, packet loss rate, network latency, etc. When the monitoring object is an environmental monitoring object, the monitoring metric data may include, but is not limited to, temperature, humidity, air quality, etc.

[0035] It should be noted that existing monitoring systems are difficult to adapt to high-frequency sampling scenarios, especially millisecond-level high-frequency sampling scenarios. For example, taking the collection of monitoring metric data with a client device as the monitoring object as an example, in the related art, generally, after the client receives a query request from the server, or after the periodic timer of the client times out, the client initiates the collection of monitoring metric data. After the client device completes the collection of the monitoring metric data, the result is sent to the server. Since the collection of monitoring metric data itself takes a certain amount of time and the collection frequency is generally from several seconds to several minutes, this implementation method is not applicable to millisecond-level high-frequency sampling scenarios.

[0036] To achieve asynchronous collection and query of monitoring metric data and improve the real-time performance of monitoring metric data processing, in the embodiments of the present invention, multiple metric queryers and multiple metric collectors are configured for the monitoring object. Among them, each metric collector can be correspondingly configured with a metric data collection frequency. The metric data collection frequency is also the frequency of collecting the monitoring metric data. Optionally, the metric data collection frequencies of different metric collectors can be the same or different, and each metric collector can collect one or more types of monitoring metric data according to the configured metric data collection frequency. The embodiments of the present invention do not limit this. Exemplarily, taking the client device as the monitoring object as an example, the metric collectors configured for the client device can set different metric data collection frequencies according to different collection objects (such as internal functional modules of the client device). For example, for metrics that can quickly read memory or registers, the metric data collection frequency of the corresponding metric collector can be set to 1 ms, and for metrics that require a long-time system call to obtain, the metric data collection frequency of the corresponding metric collector can be set to 20 ms. It can be seen that the metric data collection frequencies of the metric collectors support diversification, and different metric data collection frequencies and combinations can be supported according to the monitoring scenario. The minimum metric data collection frequency can support the millisecond level, and the maximum can support the second level, minute level and above, so as to meet diverse monitoring requirements.

[0037] Correspondingly, each index query device is responsible for periodically querying and sending monitoring index data according to a certain index data query frequency. The index query device can adopt a periodic polling method to send the queried monitoring index data to the monitoring device. The index data query frequency can be set to different frequencies according to different monitoring objects. That is, the index data query frequencies of different index query devices can be the same or different. Optionally, an index query device can query the monitoring index data collected by one or more index collectors.

[0038] S120. Determine the data sending channels matched by each of the index query devices; wherein, the data sending frequencies of different data sending channels are different.

[0039] Among them, the data sending channel can be the channel through which the index query device sends the monitoring index data to the monitoring device. The data sending frequency is also the frequency at which the data sending channel is used to send the monitoring index data.

[0040] It can be understood that the monitoring system needs to cover various different index objects. Some monitoring indexes take a long time to collect themselves, while some are very short. Currently, the index data collection frequency of the existing monitoring system is fixed, and generally the longest interval frequency is used as the sampling period. This solution will lose a large number of monitoring sampling indexes with low time intervals.

[0041] To ensure that the monitoring system can cover indexes with various different sampling intervals and maintain the overall processing performance at the same time, the embodiments of the present invention perform diversification processing on the data sending channels for sending the monitoring index data. That is, the data sending channels are split, and the same data sending frequency is configured for each data sending channel. Exemplarily, for the monitoring index data that needs to be sent quickly, a data sending channel with a faster data sending frequency can be configured, such as a data sending frequency of 1 ms; for the monitoring index data that needs to be sent slowly, a data sending channel with a slower data sending frequency can be configured, such as a data sending frequency of 20 ms, etc. The number of data sending channels can be dynamically configured according to the data sending requirements, and the embodiments of the present invention do not limit the specific number of data sending channels.

[0042] Optionally, each index query device can be correspondingly bound to a data sending channel. The binding relationship between the index query device and the corresponding data sending channel can be dynamically adjusted as needed. Exemplarily, if there is a binding relationship between index query device 1 and data sending channel 1, then index query device 1 can send the queried monitoring index data through data sending channel 1. When the binding relationship between index query device 1 and data sending channel 1 is unbound and a new binding relationship is established between index query device 1 and data sending channel 2, index query device 1 can subsequently send the queried monitoring index data through data sending channel 2.

[0043] S130. Send the monitoring metric data to the monitoring device through the data sending channel matched by the corresponding metric query device.

[0044] Among them, the monitoring device can be a device for monitoring the monitored object.

[0045] Correspondingly, after determining the data sending channels matched by each metric query device, the metric query device can query the monitoring metric data obtained by the corresponding metric collector and send it to the monitoring device through the corresponding data sending channel. Since the data sending frequencies of different data sending channels are different and the metric query device and the metric collector work asynchronously, it can meet diverse collection frequencies, ensuring that the collected monitoring metric data can be timely sent to the monitoring device through the corresponding data sending channel that meets the data sending frequency requirements. Through the high coordination of the collection, query, and sending of the monitoring metric data, the real-time performance of data monitoring is improved, which is conducive to timely responding to and repairing the anomalies of the monitored object.

[0046] In the embodiment of the present invention, multiple metric query devices of the monitored object query the monitoring metric data collected by multiple metric collectors for the monitored object, and determine the data sending channels matched by each metric query device, so as to send the monitoring metric data to the monitoring device through the data sending channels matched by the corresponding metric query devices. Since the query operation of the metric query device and the collection operation of the metric collector are decoupled, an asynchronous execution mode for the collection and sending of the monitoring metric data is realized. Further, since the data sending frequencies of different data sending channels are different, different types of monitoring metric data can be sent at different data sending frequencies according to the data monitoring requirements. The asynchronous execution mode of data collection and sending combined with different data sending frequencies can realize the real-time processing of the monitoring metric data. The above technical solution solves the problems such as poor real-time performance existing in the existing data monitoring methods, can improve the real-time performance of data monitoring, and is conducive to timely responding to and repairing the anomalies of the monitored object.

[0047] Figure 2 It is a flowchart of another data monitoring method provided by the embodiment of the present invention. This embodiment is specific based on the above embodiment. In this embodiment, multiple specific optional implementation manners for configuring the data sending channel, establishing the mapping relationship between the metric query device and each metric collector, and determining the connection mode of each data sending channel are given. Correspondingly, as Figure 2 shown, the method of this embodiment may include:

[0048] S210. Initialize and configure the metric query device and the metric collector, and determine the number of the data sending channels according to the configuration information of the metric query device.

[0049] It can be understood that before using the monitoring system to monitor the monitored object, the monitored object can be initialized to configure an index queryer and an index collector first, such as determining the number of the index collector and the index queryer, and configuring the attribute information of each index collector and index queryer, such as identification, index data collection frequency, or index data query frequency, etc.

[0050] Correspondingly, after determining that the index queryer has completed the initialization configuration, the configuration information of each index queryer can be determined to determine the number of data sending channels according to the configuration information of the index queryer. Exemplarily, if an index queryer corresponds to a data sending channel, the total number of index queryers can be determined according to the configuration information of the index queryer, and the number of data sending channels can be determined according to the total number of index queryers. If a data sending channel can serve one or more index queryers, that is, a data sending channel can send the monitored index data queried by multiple index queryers, it can be determined according to the configuration information of the index queryer which index queryers can share a data sending channel, and further determine the number of data sending channels.

[0051] S220. Configure each of the data sending channels according to the index data sending requirement, and establish a mapping relationship between each of the index queryers and each of the data sending channels.

[0052] Among them, the index data sending requirement is also the requirement for the sending frequency of the monitored index data.

[0053] Correspondingly, after determining the number of data sending channels, each data sending channel can be configured in sequence according to the index data sending requirement, such as configuring the connection type of the data sending channel and the data sending frequency corresponding to each data sending channel, etc. After each data sending channel is configured, a mapping relationship between each index queryer and each data sending channel can be established to implement the binding process between the index queryer and the corresponding data sending channel.

[0054] In an optional embodiment of the present invention, the step of configuring each of the data sending channels according to the index data sending requirement may include: configuring a data transmitter for each of the data sending channels according to the index data sending requirement; configuring the data sending frequency of the data transmitter of each of the data sending channels.

[0055] Among them, the data transmitter is a component mainly used to transmit the monitored index data from its monitored object to the monitoring device.

[0056] Specifically, data transmitters can be configured for each data transmission channel according to the requirements of the indicator data transmission. The data transmitters can be implemented through separate threads or coroutines. For the data transmitters of each data transmission channel, the corresponding data transmission frequency can be configured as needed. For example, a fast data transmission channel can be configured with a data transmission frequency of 10 ms, and a slow data transmission channel can be configured with a data transmission frequency of 100 ms, etc.

[0057] In an alternative embodiment of the present invention, the monitored object may include multiple data communication modules; after configuring the data transmission frequencies of the data transmitters for each of the data transmission channels, it may further include: determining the data transmission rates corresponding to each of the data communication modules; and allocating the data communication modules to each of the data transmission channels according to the data transmission rates of each of the data communication modules and the data transmission frequencies of the data transmitters.

[0058] Among them, the data communication module may be a module within the monitored object for providing data communication functions, and may include, for example, but not limited to, network cards, etc.

[0059] If the monitored object is a specific hardware device and multiple optional data communication modules are configured within the monitored object, after configuring the corresponding data transmission frequencies of the data transmitters for each data transmission channel, the data transmission rates corresponding to each data communication module within the monitored object can be further determined, so as to allocate the data communication modules to each data transmission channel according to the matching degree between the data transmission rates of each data communication module and the data transmission frequencies of the data transmitters.

[0060] In a specific example, assume that the monitored object is a client device and the monitoring device is a server device. If the client device and the server device are configured with 10G and 25G network cards, then the fast data transmission channel can select to configure the high-bandwidth 25G network card or network link during initialization configuration, and the slow data transmission channel can select to configure the low-bandwidth 10G network card or network link during initialization configuration.

[0061] S230. Determine the acquisition classifier reference factors of the indicator acquirer, and classify each of the indicator acquirers according to the acquisition classifier reference factors to obtain classified indicator acquirers.

[0062] Among them, the acquisition classifier reference factors may be factors for reference in classifying the indicator acquirers. The classified indicator acquirers may be a set including one type of indicator acquirer obtained after classifying the indicator acquirers.

[0063] It can be understood that an index queryer can be responsible for querying the monitoring index data collected by one or more index collectors. Before binding the index collectors that the index queryer is responsible for querying, each index collector can be classified first. Specifically, the reference factors for classifying the index collectors can be determined, and then each index collector can be classified according to the reference factors for classifying the index collectors to obtain classified index collectors. Each type of classified index collector can be queried by an index queryer. If the reference factors for classifying the index collectors are different, the types of the classified index collectors obtained by classifying according to the reference factors for classifying the index collectors may also be different.

[0064] In an optional embodiment of the present invention, the reference factors for classifying the index collectors may include the index data collection frequency of the index collectors; the step of classifying each of the index collectors according to the reference factors for classifying the index collectors to obtain classified index collectors may include: determining the index data collection frequency of each of the index collectors; and classifying each of the index collectors according to a preset frequency interval of the index data collection frequency to obtain the classified index collectors.

[0065] Among them, the preset frequency interval may be the classification interval of the pre-reviewed index data collection frequency.

[0066] Optionally, the index data collection frequency can be used as a reference factor for classifying the index collectors to classify each index collector. Specifically, the index data collection frequency corresponding to each index collector can be determined, and then each index collector can be classified according to a preset frequency interval of the index data collection frequency to obtain classified index collectors. Among the classified index collectors obtained by this classification method, the index data collection frequencies of the index collectors included in each type of classified index collector are similar.

[0067] Exemplarily, assume that the index data collection frequency of index collector 1 is 1 ms, the index data collection frequency of index collector 2 is 1.5 ms, the index data collection frequency of index collector 3 is 2 ms, the index data collection frequency of index collector 4 is 10 ms, and the index data collection frequency of index collector 5 is 11 ms. If the preset frequency interval is 2 ms, then index collector 1, index collector 2, and index collector 3 can be classified into one type of classified index collector, and index collector 4 and index collector 5 can be classified into one type of classified index collector. The difference between the index data collection frequencies of the index collectors within each type of classified index collector does not exceed 2 ms.

[0068] In an optional embodiment of the present invention, the collector classification reference factor may include the collection object of the indicator collector; the classification of each indicator collector according to the collector classification reference factor to obtain a classified indicator collector may include: determining the collection object corresponding to each indicator collector; classifying each indicator collector according to the collection object corresponding to each indicator collector to obtain the classified indicator collector; wherein the collection object corresponding to each type of classified indicator collector is the same.

[0069] The collection object is the object for which the indicator collector is responsible for collecting indicator data. The embodiment of the present invention does not limit the specific type of the collection object.

[0070] Optionally, the collection object can be used as a reference factor for classifying the collectors to classify the indicator collectors. Specifically, the collection object corresponding to each indicator collector can be determined, so that the indicator collectors can be classified according to the collection object of the indicator data collection frequency to obtain classified indicator collectors. In the classified indicator collectors obtained by this classification method, the collection objects of the indicator collectors included in each type of classified indicator collector are the same.

[0071] For example, it is assumed that the collection object of indicator collector 1 is CPU, the collection object of indicator collector 2 is CPU, the collection object of indicator collector 3 is memory, and the collection object of indicator collector 4 is memory. Further, indicator collector 1 and indicator collector 2 can be divided into a category of classified indicator collectors, and indicator collector 3 and indicator collector 4 can be divided into a category of classified indicator collectors. The collection objects of each indicator collector in each category of classified indicator collectors are the same.

[0072] S240: Establish a mapping relationship between the classification indicator collector and each of the indicator collectors.

[0073] Accordingly, each indicator collector is classified according to the collector classification reference factor. After obtaining the classified indicator collector, the mapping relationship between the classified indicator collector and each indicator collector can be established based on the classified indicator collector. That is, each indicator query can query the monitoring indicator data collected by a category of indicator collectors.

[0074] It is understandable that the indicator data query frequency of the indicator query device needs to be greater than or equal to the indicator data collection frequency of each indicator query device in the classified indicator collector to which it is bound, so as to avoid the data query speed being lower than the data collection speed, resulting in data transmission delay.

[0075] S250: query the monitoring indicator data collected by multiple indicator collectors on the monitored object through multiple indicator query devices.

[0076] In an alternative embodiment of the present invention, the querying of the monitoring metric data collected by multiple metric collectors by multiple metric queryers may include: determining, according to the mapping relationship between each metric queryer and each metric collector, the target metric collector corresponding to each metric queryer; and querying, by each metric queryer, the corresponding target metric collector to obtain the monitoring metric data.

[0077] Specifically, the mapping relationship between each metric queryer and each metric collector may be determined according to the mapping relationship between the metric queryer and the corresponding classified metric collector, so as to further determine the target metric collector corresponding to each metric queryer. It can be understood that the target metric collector corresponding to the metric queryer is specifically all the metric collectors included in the classified metric collector bound to the metric queryer. Correspondingly, the monitoring metric data can be obtained by querying, by each metric queryer, the corresponding target metric collector. The monitoring metric data obtained by querying each metric queryer may be data with similar metric data collection frequencies, or may also be data collected for the same collection object. The embodiments of the present invention do not limit this.

[0078] In an alternative embodiment of the present invention, before the querying of the monitoring metric data collected by multiple metric collectors by multiple metric queryers, it may further include: collecting, by each metric collector, the monitoring metric data for the monitoring object; storing the monitoring metric data in the local shared memory of the monitoring object; and the querying, by each metric queryer, the corresponding target metric collector to obtain the monitoring metric data may include: querying, by the metric queryer, the target shared memory area of the corresponding target metric collector in the local shared memory to obtain the monitoring metric data.

[0079] Among them, the target shared memory area may be the shared memory area corresponding to the target metric collector in the local shared memory.

[0080] Since the metric collector and the metric queryer work asynchronously, if the monitoring object is a device type, after each metric collector collects the monitoring metric data for the monitoring object according to its own metric data collection frequency, the collected monitoring metric data may be temporarily stored in the local shared memory of the monitoring object. Correspondingly, the metric queryer may query the target shared memory area of the corresponding target metric collector in the shared memory to obtain the corresponding monitoring metric data. Optionally, each metric collector of each type of classified metric collector may correspond to a target shared memory area in the local shared memory.

[0081] In an optional embodiment of the present invention, the monitoring device caches the monitoring indicator data via a local shared memory; wherein: the local shared memory of the monitored object and the local shared memory cache of the monitoring device are a circular cache queue.

[0082] Most of the existing monitoring systems apply for memory in real time when data needs to be stored, and release the memory after the monitoring data is collected. The entire memory application and release are repeated, which will cause performance overhead caused by repeated memory allocation / release and GC (garbage collection) memory recovery. At the same time, the existing technology often uses data structures such as hash tables or dynamic linked lists to store monitoring indicator data. This special data structure, if locked, will seriously affect performance when multiple threads access it concurrently. If it is not locked, problems such as data conflicts, data inconsistencies, and dirty data will occur.

[0083] Optionally, the monitoring object and the monitoring device in the embodiment of the present invention can use a circular cache queue to set up a local shared memory. The circular cache queue can be a memory area that can be written cyclically. In a specific example, assuming that the circular cache queue is a shared memory area of ​​address 000-999, when it is necessary to store monitoring index data, it can be stored from the starting address of the memory area until the entire memory area is full. If the memory of the shared memory area of ​​000-999 is full and new monitoring index data is received, it can be written cyclically from the starting address of the shared memory area of ​​000-999. It can be seen that by writing cyclically to the local shared memory, a circular cache queue is functionally formed. The circular cache queue combines the CPU prefetch technology to realize automatic loading of adjacent data blocks, load data into the cache in advance, and try to avoid slower main memory loading. Pre-allocation of storage space and cyclic use through local shared memory can avoid the performance overhead caused by repeated allocation & release of memory and garbage collection, as well as performance jitter caused by GC memory recovery, and optimize memory usage.

[0084] Optionally, the local shared memory can store the monitoring metric data in the chronological order of the monitoring metric data. Meanwhile, to support the query of historical data, the monitoring device can also configure a scheduled task. The scheduled task can periodically store the data stored in the local shared content of the monitoring device into an external time series database, ensuring that the data in the circular buffer queue of the monitoring device has been stored in the external database before being overwritten by writing, avoiding the loss of monitoring metric data and facilitating subsequent retrieval and analysis. In the circular buffer queue structure of the local shared memory, the stored monitoring metric data can be directly accessed to the corresponding storage location through an index. The monitoring metric data can be stored in the local shared memory using a simple data structure, such as the integer or float type, to avoid anomalies such as data inconsistency, data corruption, and "dirty data" caused by concurrent lock-free access to complex data structures. The local shared memory adopts a lock-free concurrent access-safe data structure design, which can avoid performance losses caused by lock operations.

[0085] S260. Determine the data sending channels matched by each of the metric queryers; wherein, the data sending frequencies of different data sending channels are different.

[0086] S270. Send the monitoring metric data to the monitoring device through the data sending channels matched by the corresponding metric queryers.

[0087] In an optional embodiment of the present invention, the above method may further include: determining the connection configuration reference factors of the data sending channels; wherein, the connection configuration reference factors include at least one of the type of the data sending channels and the priority of the monitoring metric data; configuring the connection manners of each of the data sending channels according to the connection configuration reference factors of the data sending channels; wherein, the connection manners of the data sending channels include at least one of the long connection manner and the short connection manner.

[0088] Among them, the connection configuration reference factors may be reference factors for referring to and determining the connection manners of the data sending channels.

[0089] For the connection manners of the data sending channels, the long connection manner or the short connection manner can be selected. Among them, the long connection manner maintains the connection state and can transmit data multiple times until one party actively closes it. The long connection manner can reduce the overhead of frequently establishing / disconnecting connections and improve efficiency, but it occupies system resources for a long time and may increase security risks. The short connection manner actively disconnects the connection after each request is completed and is suitable for one-time and non-persistent communications. Since the short connection manner needs to re-establish the connection for each request, the resource consumption is relatively high, but the security is relatively controllable. Therefore, for the data sending requirements of different data sending channels, the connection manners of each data sending channel can be configured as needed.

[0090] Specifically, the connection configuration reference factors of the data sending channel can be determined first, such as the type of the data sending channel and the priority of the monitoring metric data sent by the data sending channel, etc. Further, the connection methods adapted to each data sending channel can be configured according to the connection configuration reference factors of the data sending channel. Establishing the data sending channel using a long connection can improve the data transmission efficiency and the stability of the channel, enhance the sending efficiency of the monitoring metric data, and avoid the overhead of re-establishing and tearing down the packet receiving and sending channels each time. At the same time, by introducing the binary encoding and decoding method of TLV (Type-Length-Value), the bandwidth utilization rate of data transmission and the efficiency of message encoding and decoding can be improved. Establishing the data sending channel using a short connection can ensure the security of the monitoring metric data. Therefore, by comprehensively using the long connection and short connection methods to establish the data sending channel, the personalized and flexible configuration requirements of the data sending channel can be met.

[0091] In a specific example, assume that the data sending channel is a fast channel, that is, a relatively fast data sending frequency is used to send the monitoring metric data, then this type of data sending channel can use the long connection method. Assume that the data sending channel is a slow channel, that is, a relatively slow data sending frequency is used to send the monitoring metric data, then this type of data sending channel can use the short connection method. Assume that the priority of the monitoring metric data sent by the data sending channel is low, then this type of data sending channel can use the short connection method. Assume that the priority of the monitoring metric data sent by the data sending channel is high, then this type of data sending channel can use the long connection method. In addition, other types of connection configuration reference factors can be considered to determine the connection methods of each data sending channel, and the embodiments of the present invention do not limit this.

[0092] Exemplarily, the long connection can be established based on HTTP2 (Hypertext Transfer Protocol 2), and the short connection can be established based on HTTP / 1.x (Hypertext Transfer Protocol version1.x).

[0093] Optionally, if the monitoring system is applied to a cluster system, the monitoring device may need to monitor a relatively large number of monitoring objects simultaneously. Due to the processing bottleneck of a single monitoring device, in a large cluster scenario, when the QPS (Queries Per Second) processed by the monitoring device reaches a certain scale, such as exceeding 1 Million QPS, it is necessary to horizontally expand the monitoring device to improve the overall processing capacity of the monitoring system. For a large cluster, the partition Zone (partition / range) method can be used to split a large cluster into multiple Zones. Each Zone contains a group of monitoring objects, such as 1000 nodes, and the monitoring requests sent by them are processed by a group of monitoring device instances (greater than or equal to 3). This group of monitoring device instances can adopt a primary-backup high-availability scheme based on a distributed lock, and one of the primary monitoring devices is responsible for the monitoring data of the current Zone.

[0094] Optionally, to further improve the overall performance of the monitoring system, for monitoring objects of the device type, if the processor of the monitoring object is a multi-core processor, CPU isolation and binding technology can be used to isolate several CPU cores from the operating system and specifically use them for the collection and transmission of monitoring metric data through CPU binding. Exemplarily, CPU1 can be bound to metric collector 1 and metric collector 2, and metric collectors 1 and 2 are responsible for querying data by metric queryer 1; CPU2 can be bound to metric collectors 3, 4, and 5, and metric collectors 3 - 5 are responsible for querying data by metric queryer 2, etc. At the same time, in terms of memory usage, memory locking technology and system large page memory can be adopted to improve the efficiency and stability of memory access.

[0095] The above technical solution realizes the binding between the metric collector and the metric queryer by configuring data transmission channels with different data transmission frequencies as needed and establishing a mapping relationship between the metric collectors. Further, the memory areas for storing monitoring metric data of the monitoring objects and the monitoring devices are optimized, and the connection method of the data transmission channels is flexibly configured as needed, further optimizing the overall performance of the monitoring system, improving the real-time performance of data monitoring, and facilitating the timely response and repair of anomalies of the monitoring objects.

[0096] Specific application scenarios

[0097] To more clearly describe the technical solution provided by the embodiments of the present invention, Figure 3 shows a schematic structural diagram of a monitoring system applicable to the embodiments of the present invention, Figure 4 shows a schematic processing flow diagram of a monitoring client in a monitoring system applicable to the embodiments of the present invention. In a specific example, such as Figure 3 and Figure 4As shown below, taking the monitoring client (hereinafter referred to as the client) and the monitoring server (hereinafter referred to as the server) as examples, the client in the monitoring system is the monitoring object, and the server is the monitoring device. The monitoring system adopts the classic C / S (Client / Server) architecture. Based on the push mode of the monitoring system, the server first subscribes to the monitoring content from the monitoring client. The client can collect, query, and send various monitoring metric data at millisecond-level time intervals, and the server can collect, analyze, and store the monitoring metric data.

[0098] Specifically, multiple metric collectors and metric queryers can be configured on the client. Optionally, to reduce costs, the metric collectors and metric queryers can be configured in software. After receiving the subscription request sent by the server, the client can initialize the metric collectors and metric queryers according to the subscription request, and initialize the fast and slow data sending channels according to the metric queryers. The metric collector can be responsible for the timed collection of monitoring metrics and writing them into the local shared memory of the client. The sampling period of the metric collector is set with different collection frequencies according to different collection objects. For example, for metrics that can quickly read memory or registers, it is set to 1ms, and for metrics that need to be obtained through time-consuming system calls, it can be set to 20ms. The metric queryer can be responsible for timed querying and sending of monitoring data. It adopts a non-blocking design, directly obtains the metrics and writes them into the local shared memory of the client, and uses a timed polling method to send the queried monitoring metric data to the server. The query frequency of the metric queryer can be set with different frequencies according to different collection objects. At the same time, the metric query frequency should be greater than or equal to the metric collection frequency.

[0099] The monitoring system needs to cover various different metric objects. Some monitoring metrics themselves take a long time to collect, while some are very short. To ensure that the millisecond-level monitoring system can cover metrics with various different sampling intervals and maintain the overall processing performance of the monitoring system, the embodiment of the present invention splits the data sending channel between the client and the server. For example, it can be divided into a fast channel and a slow channel. For the data on the fast channel, it is sent at a faster frequency, such as 1ms; for the data on the slow channel, it is sent at a slower frequency, such as 20ms. At the same time, according to the actual monitoring requirements, the fast and slow channels can be further expanded and split into multiple channels such as L1 / L2 / …… / Ln, and each data sending channel is configured with different data sending frequencies.

[0100] It can be seen that the above monitoring system realizes a software implementation solution for millisecond-level monitoring. Without the need for dedicated hardware or network devices, a standard server can be used to capture abnormal metrics in real time with millisecond-level accuracy, respond in a timely manner, and repair client failures. At the same time, the detailed distribution of the monitored metric data can be obtained, providing data support for the business, such as providing the maximum value, minimum value, average value of the monitored metric data within a certain range, as well as related information such as the 50th percentile, 90th percentile, and 99th percentile.

[0101] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of the relevant data comply with the relevant laws, regulations, and standards in the relevant regions.

[0102] It should be noted that any permutation and combination of the technical features in the above embodiments also fall within the protection scope of the present invention.

[0103] Figure 5 is a schematic diagram of a data monitoring device provided by an embodiment of the present invention. As Figure 5 shown, the device includes: a monitored metric data query module 310, a data transmission channel determination module 320, and a monitored metric data transmission module 330, where:

[0104] The monitored metric data query module 310 is configured to query the monitored metric data collected by a plurality of metric collectors for the monitored object through a plurality of metric queryers;

[0105] The data transmission channel determination module 320 is configured to determine the data transmission channels matched by the respective metric queryers; wherein, the data transmission frequencies of different data transmission channels are different;

[0106] The monitored metric data transmission module 330 is configured to transmit the monitored metric data to the monitoring device through the data transmission channels matched by the corresponding metric queryers.

[0107] In an embodiment of the present invention, a plurality of index queryers of a monitored object query monitored index data collected by a plurality of index collectors for the monitored object, and determine data sending channels matched by each index queryer, so as to send the monitored index data to a monitoring device through the data sending channels matched by the corresponding index queryers. Since the query operation of the index queryer and the collection operation of the index collector are decoupled, an asynchronous execution mode for collecting and sending monitored index data is realized. Further, since the data sending frequencies of different data sending channels are different, different types of monitored index data can be sent at different data sending frequencies according to data monitoring requirements. The asynchronous execution mode of data collection and sending combined with different data sending frequencies can realize real-time processing of monitored index data. The above technical solution solves problems such as poor real-time performance existing in the existing data monitoring method, can improve the real-time performance of data monitoring, and is beneficial to timely respond to and repair anomalies of the monitored object.

[0108] Optionally, the above device further includes a first mapping relationship establishment module, configured to: initialize and configure the index queryer and the index collector; determine the number of data sending channels according to the configuration information of the index queryer; configure each data sending channel according to the index data sending requirement; establish a mapping relationship between each index queryer and each data sending channel.

[0109] Optionally, the first mapping relationship establishment module is further configured to: configure a data sender for each data sending channel according to the index data sending requirement; configure the data sending frequency of the data sender of each data sending channel.

[0110] Optionally, the monitored object includes multiple data communication modules; the first mapping relationship establishment module is further configured to: determine the data transmission rate corresponding to each data communication module; allocate each data communication module to each data sending channel according to the data transmission rate of each data communication module and the data sending frequency of the data sender.

[0111] Optionally, the above device further includes a second mapping relationship establishment module, configured to: determine the collection device classification reference factor of the index collector; classify each index collector according to the collection device classification reference factor to obtain a classified index collector; establish a mapping relationship between the classified index collector and each index collector.

[0112] Optionally, the collection device classification reference factor includes the index data collection frequency of the index collector; the second mapping relationship establishment module is further configured to: determine the index data collection frequency of each index collector; classify each index collector according to a preset frequency interval of the index data collection frequency to obtain the classified index collector.

[0113] Optionally, the reference factors for classifying the collectors include the collection objects of the metric collectors; the second mapping relationship establishing module is further configured to: determine the collection objects corresponding to the metric collectors; classify the metric collectors according to the collection objects corresponding to the metric collectors to obtain the classified metric collectors.

[0114] Optionally, the monitoring metric data query module 310 is further configured to: determine the target metric collectors corresponding to the metric queryers according to the mapping relationships between the metric queryers and the metric collectors; query the corresponding target metric collectors through the metric queryers to obtain the monitoring metric data.

[0115] Optionally, the above device further includes a monitoring metric data caching module, configured to: collect the monitoring metric data for the monitoring object through the metric collectors; store the monitoring metric data in the local shared memory of the monitoring object; the monitoring metric data query module 310 is further configured to: query the target shared memory area of the corresponding target metric collector in the local shared memory through the metric queryer to obtain the monitoring metric data.

[0116] Optionally, the monitoring device caches the monitoring metric data through the local shared memory; wherein: the local shared memory of the monitoring object and the local shared memory cache of the monitoring object are circular cache queues.

[0117] Optionally, the above device further includes a connection method configuration module, configured to: determine the connection configuration reference factors of the data sending channel; wherein, the connection configuration reference factors include at least one of the type of the data sending channel and the priority of the monitoring metric data; configure the connection methods of the data sending channels according to the connection configuration reference factors of the data sending channel; wherein, the connection methods of the data sending channels include at least one of a long connection method and a short connection method.

[0118] The above data monitoring device can execute the data monitoring method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in this embodiment, reference can be made to the data monitoring method provided in any embodiment of the present invention.

[0119] Since the data monitoring device introduced above is a device that can execute the data monitoring method in the embodiments of the present invention, based on the data monitoring method introduced in the embodiments of the present invention, those skilled in the art can understand the specific implementation manners and various variations of the data monitoring device in this embodiment. Therefore, the details of how the data monitoring device implements the data monitoring method in the embodiments of the present invention will not be introduced in detail here. As long as the device adopted by those skilled in the art to implement the data monitoring method in the embodiments of the present invention falls within the scope of protection of this application.

[0120] Figure 6 FIG. shows a schematic structural diagram of an electronic device 10 that can be used to implement the embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0121] As Figure 6 shown, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. The memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0122] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0123] The processor 11 may be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the data monitoring method.

[0124] Optionally, the data monitoring method applied to the monitoring object may include: querying, by multiple metric queryers, the monitoring metric data collected by multiple metric collectors for the monitoring object; determining the data sending channels matched by each of the metric queryers; wherein, the data sending frequencies of different data sending channels are different; and sending the monitoring metric data to the monitoring device through the data sending channels matched by the corresponding metric queryers.

[0125] In some embodiments, the data monitoring method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the data monitoring method described above may be executed. Alternatively, in other embodiments, the processor 11 may be configured to execute the data monitoring method by any other suitable means (e.g., by means of firmware).

[0126] The various embodiments of the systems and technologies described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs being executable and / or interpretable on a programmable system including at least one programmable processor, the programmable processor being a special-purpose or general-purpose programmable processor, receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0127] A computer program for implementing the method of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, a special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The computer program may be executed entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine, or entirely on the remote machine or server.

[0128] In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium may be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0129] In order to provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0130] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), blockchain network, and the Internet.

[0131] A computing system can include a client and a server. The client and the server are generally remote from each other and typically interact via a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0132] It should be understood that various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps recited in this disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this is not limited herein.

[0133] The above specific embodiments do not constitute a limitation on the protection scope of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the protection scope of this disclosure.

Claims

1. A data monitoring method, characterized in that: Applicable to monitoring objects, including: Querying the monitoring indicator data collected by multiple indicator collectors on the monitoring object through multiple indicator query devices; Determine the data transmission channel matched by each of the indicator query devices; wherein the data transmission frequencies of different data transmission channels are different; The monitoring indicator data is sent to the monitoring device through the data sending channel matched by the corresponding indicator query device.

2. The method according to claim 1, characterized in that Before querying the multiple indicator collectors through the multiple indicator query devices, the method further includes: Initialize configuration of the indicator query device and the indicator collector; Determine the number of the data sending channels according to the configuration information of the indicator query device; Configuring each of the data transmission channels according to the indicator data transmission requirements; A mapping relationship between each of the indicator query devices and each of the data sending channels is established.

3. The method according to claim 2, characterized in that The configuring each of the data transmission channels according to the indicator data transmission requirements includes: According to the indicator data transmission requirements, a data transmitter is configured for each of the data transmission channels; The data transmission frequency of the data transmitter of each data transmission channel is configured.

4. The method according to claim 3, characterized in that The monitoring object includes a plurality of data communication modules; after configuring the data transmission frequency of the data transmitter of each data transmission channel, it also includes: Determine the data transmission rate corresponding to each of the data communication modules; The data communication modules are allocated to the data transmission channels according to the data transmission rates of the data communication modules and the data transmission frequency of the data transmitter.

5. The method according to claim 1, characterized in that Before querying the monitoring indicator data collected by the multiple indicator collectors for the monitoring object through the multiple indicator query devices, the method further includes: Determine collector classification reference factors of the indicator collector; Classify each of the indicator collectors according to the collector classification reference factors to obtain classified indicator collectors; A mapping relationship between the classification indicator collector and each of the indicator collectors is established.

6. The method according to claim 5, characterized in that The collector classification reference factor includes the index data collection frequency of the index collector; the index collectors are classified according to the collector classification reference factor to obtain classified index collectors, including: Determining the indicator data collection frequency of each of the indicator collectors; Each of the indicator collectors is classified according to a preset frequency interval of the indicator data collection frequency to obtain the classified indicator collectors.

7. The method according to claim 5, characterized in that The collector classification reference factor includes the collection object of the indicator collector; the indicator collectors are classified according to the collector classification reference factor to obtain the classified indicator collectors, including: Determine the collection object corresponding to each of the indicator collectors; The indicator collectors are classified according to the collection objects corresponding to the indicator collectors to obtain the classified indicator collectors.

8. The method according to claim 1, characterized in that The querying of the monitoring indicator data collected by the multiple indicator collectors on the monitoring object by the multiple indicator query devices includes: Determine the target indicator collector corresponding to each indicator query device according to the mapping relationship between each indicator query device and each indicator collector; The corresponding target indicator collector is queried through each indicator query device to obtain the monitoring indicator data.

9. The method according to claim 8, characterized in that Before querying the monitoring indicator data collected by the multiple indicator collectors for the monitoring object through the multiple indicator query devices, the method further includes: Collecting the monitoring indicator data from the monitored object through each of the indicator collectors; The monitoring indicator data is stored in the local shared memory of the monitored object; The querying of the corresponding target indicator collector by each indicator query device to obtain the monitoring indicator data includes: The indicator query device queries the target shared memory area of ​​the corresponding target indicator collector in the local shared memory to obtain the monitoring indicator data.

10. The method according to claim 9, characterized in that: The monitoring device caches the monitoring indicator data via local shared memory; wherein: The local shared memory of the monitored object and the local shared memory cache of the monitored object are circular cache queues.

11. The method according to any one of claims 1 to 10, characterized in that: Also includes: Determine a connection configuration reference factor of the data transmission channel; wherein the connection configuration reference factor includes at least one of the type of the data transmission channel and the priority of the monitoring indicator data; configuring a connection mode of each of the data sending channels according to a connection configuration reference factor of the data sending channel; The connection mode of the data transmission channel includes at least one of a long connection mode and a short connection mode.

12. A data monitoring device, characterized in that: Configured in monitoring objects, including: A monitoring indicator data query module, used to query the monitoring indicator data collected by multiple indicator collectors on the monitored object through multiple indicator query devices; A data transmission channel determination module, used to determine the data transmission channel matched by each of the indicator query devices; wherein different data transmission channels have different data transmission frequencies; The monitoring indicator data sending module is used to send the monitoring indicator data to the monitoring device through the data sending channel matched by the corresponding indicator query device.

13. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the data monitoring method described in any one of claims 1-11.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the data monitoring method described in any one of claims 1-11 when executed.

15. A computer program product comprising a computer program / instructions, wherein: When the computer program / instructions are executed by a processor, the data monitoring method described in any one of claims 1-11 is implemented.

Images