Data monitoring method, device, terminal equipment and storage medium
By splitting and grouping the message data of the SMS monitoring system, the problem of low development and maintenance efficiency of SMS monitoring in the existing technology is solved, and a more efficient analysis, processing and maintenance process is achieved.
Patent Information
- Application Number
- CN202111365102.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-17
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2041-11-17
AI Technical Summary
The prior art has low work efficiency in the development and maintenance of SMS monitoring work, and requires different types of message data to be processed according to different types of protocols, resulting in frequent code modifications.
By obtaining the message data of the monitoring object for splitting and processing, each message indicator is obtained, and these indicators are grouped and processed and analyzed, the process of processing message data according to different protocols is avoided, thereby improving the analysis and processing efficiency.
It improves the development and maintenance efficiency of SMS monitoring work, reduces the frequency of code modification, and makes it more convenient to add new monitoring indicators and maintain existing indicators.
Smart Images

Figure CN114168405B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of data monitoring technology, and in particular, relates to a data monitoring method, device, terminal equipment and storage medium. Background Art
[0002] With the rapid development of science and technology, the emergence of more and more smart products has made people's communication methods more and more simple, enabling people to communicate and contact each other without leaving home. For example, end users can send messages to each other through text messages. There are many types of text messages at present, such as text messages, rich messages, smart text messages and 5G messages. In the process of users sending messages through text messages, the first concern of text message service providers is the sending status of text messages. Therefore, it is necessary to monitor the sending status of text message sending channels and text message sending accounts.
[0003] However, since the indicators of SMS sending channels and SMS sending accounts are different, when monitoring the SMS sending status in the prior art, different SMS sending channels and SMS sending accounts need to use different message protocols for data transmission and processing, which results in that in the later development and maintenance process, only the corresponding type of messages can be processed according to the specified message protocol, so a whole set of codes need to be modified accordingly, resulting in low efficiency in the later development and maintenance of SMS monitoring. For example, if you want to add a monitoring indicator for SMS, you need to go through a series of operations such as development, testing, online, and bug fixing. Summary of the invention
[0004] The embodiments of the present application provide a data monitoring method, apparatus, terminal device and storage medium, which can solve the problem of low work efficiency in the later development and maintenance of SMS monitoring work.
[0005] In a first aspect, an embodiment of the present application provides a data monitoring method, including:
[0006] Obtaining the message data of the monitored object, splitting the message data to obtain the message indicators of each of the monitored objects;
[0007] The above-mentioned message indicators are grouped and processed to obtain at least one indicator group;
[0008] Analyze and process the at least one indicator group to obtain an analysis result of the at least one indicator group;
[0009] The current status of the monitored object is determined based on the analysis result of the at least one indicator group.
[0010] In a second aspect, an embodiment of the present application provides a data monitoring device, including:
[0011] A data acquisition module is used to acquire the message data of the monitored object, split the message data, and obtain the message indicators of the monitored object;
[0012] A group processing module, used for grouping the above-mentioned message indicators to obtain at least one indicator group;
[0013] An analysis and processing module, used to analyze and process the at least one indicator group to obtain an analysis result of the at least one indicator group;
[0014] The status determination module is used to determine the current status of the above-mentioned monitored object based on the analysis result of the above-mentioned at least one indicator group.
[0015] In a third aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above-mentioned data monitoring methods when executing the computer program.
[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any of the above-mentioned data monitoring methods are implemented.
[0017] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute any one of the data monitoring methods in the first aspect.
[0018] In the embodiment of the present application, message data of the monitored object is obtained, the above message data is split and processed to obtain the various message indicators of the above monitored object, thereby avoiding the process of processing different types of message data according to different types of protocols respectively by splitting the message indicators, and then the above various message indicators are grouped and processed to obtain at least one indicator group, and the above at least one indicator group is analyzed and processed to obtain the analysis result of the above at least one indicator group, thereby improving the analysis and processing efficiency of the message indicators by grouping the message indicators for analysis and processing, and finally determining the current status of the above monitored object according to the analysis result of the above at least one indicator group, thereby improving the work efficiency when developing and maintaining the SMS monitoring work in the later stage. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0020] Figure 1 It is a flowchart of a data monitoring method provided in an embodiment of the present application;
[0021] Figure 2 It is a structural diagram of a data monitoring system provided in an embodiment of the present application;
[0022] Figure 3 It is a schematic diagram of group processing of message indicators provided in an embodiment of the present application;
[0023] Figure 4 It is a schematic diagram of redundant node processing provided by an embodiment of the present application;
[0024] Figure 5 is a schematic diagram of the structure of a data monitoring device provided in an embodiment of the present application;
[0025] Figure 6 It is a schematic diagram of the structure of the terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0026] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0027] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0028] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0029] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0030] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0031] Figure 1 FIG. 1 is a flow chart of a data monitoring method in an embodiment of the present application. The execution subject of the method may be a terminal device, such as Figure 1 As shown, the above data monitoring method may include the following steps:
[0032] Step S101: Acquire message data of a monitored object, split the message data, and obtain various message indicators of the monitored object.
[0033] In this embodiment, a writing program can be pre-set in at least one client corresponding to the monitoring object monitored by the terminal device, so that the writing program writes the message data existing in the client into the folder pre-set in the client, and after the monitoring program in the client reads the message data in the folder, the message data is sent to the terminal device, and the terminal device can obtain the message data of at least one client corresponding to the monitoring object, and the pre-set indicator splitting program splits the insulation data of at least one client obtained according to the preset rules, so as to obtain the various message indicators of the monitoring object. By splitting the indicators in the message data, a unified protocol can be used to uniformly monitor the split indicators, which can greatly improve the work efficiency of the later development and maintenance of SMS monitoring work. Among them, the above-mentioned monitoring object can correspond to at least one SMS sending account or at least one SMS sending channel, and accordingly, the message data of the above-mentioned monitoring object corresponds to the data in each client corresponding to the at least one SMS sending account or at least one SMS sending channel.
[0034] Specifically, when the above-mentioned message indicators are derived from the message data of the SMS sending account, the message indicators include but are not limited to the SMS sending volume, the number of successful SMS sending, the number of returns, etc. The above-mentioned return number is the number of SMS status reports returned by the SMS operator; when the above-mentioned message indicators are derived from the message data of the SMS sending channel, the message indicators include but are not limited to the downlink forwarding volume, downlink retention volume, downlink speed, uplink retention volume, status report retention volume, SMS sending success rate, status report return rate, etc. The downlink forwarding volume is the number of SMS that can be forwarded by a certain node at one time, and the corresponding downlink retention volume is the number of SMS remaining after a certain node forwards some SMS. In addition, the above-mentioned message indicators also include: the CPU usage rate, physical memory status, virtual memory status, disk usage status, etc. of the monitored client or monitored server.
[0035] In one embodiment, Figure 2As shown, in a monitoring system in which a terminal device monitors client data, the terminal device can use at least one server (such as Figure 2 Servers 1 to m in the monitoring object obtain the client corresponding to the monitoring object (such as Figure 2 In order to speed up the data acquisition, the indicator splitting program can be preset in the terminal device. After the server obtains the message data of the monitored object, the message data sent by the server is obtained, and the message data is split and processed by the preset indicator splitting program, thereby realizing the indicator splitting of the old version monitoring without changing the configuration. In addition, the indicator splitting program can also be preset in the server, so as to use the server to directly obtain the various message indicators of the monitored object, wherein, when there are at least two servers, the message data can be evenly distributed to the above-mentioned at least two servers for processing in a load balancing manner.
[0036] In one embodiment, the above indicators can be displayed in a graphical form, for example, in at least one of a pie chart, a bar chart, and a line chart, and can be sent to a front-end WEB page for display, thereby speeding up the response time when performing business data queries or trend chart data queries.
[0037] Step S102: group the message indicators to obtain at least one indicator group.
[0038] In this embodiment, the terminal device can use components to group the split message indicators to obtain at least one indicator group, wherein the above components can use Kafka components, that is, Figure 2 The middleware Kafka cluster shown. It is understandable that when the server performs the splitting of the message data, the terminal device can control the server to directly send the split message indicators to the Kafka component, so that the Kafka component feeds back at least one indicator group to the terminal device.
[0039] Specifically, the above-mentioned Kafka component can be connected to each processing node through the Transmission Control Protocol (TCP), so as to obtain the indicators of each message after splitting through the protocol, and send at least one indicator group after grouping processing to the indicator analysis module in the terminal device or the history writing library module in the terminal device through the protocol, so that the history writing library module directly stores the indicator group in the database.
[0040] Specifically, Figure 3As shown, each message indicator can be grouped and processed according to the partition number of each message indicator. The partition number of each message indicator can be obtained by obtaining the identification information of the monitored object. The identification information of the above-mentioned monitored object can be the identity ID of the SMS sending account corresponding to the currently calculated message indicator, or the identity ID of the SMS sending channel corresponding to the currently calculated message indicator; the indicator name and identification information of the message indicator are hashed, that is, the indicator name (denoted as met) and the identification information (denoted as val) are concatenated into a string, that is, Figure 3 met+val in the hash function, that is, Figure 3 Hash(met+val) in , performs modulus operation on the hash processing result, that is, Figure 3 Hash(met+val)mod 2n in the table is the partition number corresponding to the above message indicator. The partition where the message indicator is stored can be determined according to the obtained partition number. The message indicator is then grouped according to the number of pre-set partition indicator groups, that is, Figure 3 The partitions 0 to 2n-1 corresponding to the message indicators 1 to 2n are determined, and the partitions 0 to 2n-1 are evenly divided into the indicator groups 1 to n, that is, each indicator group contains two message indicators. The above calculation of the partition number can be performed by a hash modulo algorithm.
[0041] It can be understood that partition is a concept of Kafka components. Each partition is equivalent to a container for storing data, and the partition number is equivalent to the number of this data container. For example, if 100 partitions are set in advance, each partition can be numbered with 0-99 numbers. When we use the "hash modulo algorithm" to calculate the partition number corresponding to each message indicator, it must be within the range of partition number [0-99]. Therefore, the partition number can be used to obtain the corresponding communication data container for each message indicator. The above indicator group is equivalent to dividing the partition into several partitions. For example, 100 partitions are divided into 5 groups [0-19], [20-39], [40-59], [60-79], and [80-99]. According to the partition number of the message indicator, it can be determined which indicator group the message indicator belongs to.
[0042] Step S103: Analyze and process at least one indicator group to obtain an analysis result of at least one indicator group.
[0043] In this embodiment, the indicator analysis module in the terminal device can improve the indicator processing efficiency of the monitored object by analyzing and processing the indicators in groups, promptly respond to problems encountered in the processing of each group, and finally obtain analysis results corresponding to at least one indicator group through the indicator analysis program.
[0044] Specifically, Figure 2 The terminal device in the system includes the indicator analysis module, alarm notification module, history writing module, etc. Each module can be deployed separately and can be further expanded according to performance requirements. These modules can process data in a non-coupled manner. For example, sometimes it is not necessary to analyze and process the indicator group, so it can be directly Figure 2 The historical write module in the database stores the data of the corresponding indicator group in the database, which can query the relevant data when needed and further generate corresponding reports.
[0045] It can be understood that the above indicator group contains data sorted in a certain data queue order, that is, the order in which each partition enters the data container, and the sorted data corresponds to the corresponding partition number. When an analysis node in the indicator analysis module processes an indicator in the indicator group, the partition number corresponding to the indicator will be recorded. When the program crashes and restarts, it will read data directly from this number, and the recorded number is recorded under this indicator group.
[0046] In one embodiment, the analysis and processing of at least one indicator group in step S103 may include: the terminal device analyzes and processes at least one indicator group respectively through a preset analysis node, wherein the indicator analysis module of the terminal device may include at least one analysis node, and at least one analysis node is provided with an indicator analysis program, so that a group of indicators is analyzed and processed through the indicator analysis program in the analysis node. In addition, the number of indicator groups corresponding to the analysis nodes can be intelligently allocated according to the number of analysis nodes. For example, if the number of current analysis nodes is 1 / 2 of the number of indicator groups, one analysis node corresponds to analyzing 2 indicator groups; if the number of current analysis nodes is equal to the number of indicator groups, one analysis node corresponds to analyzing 1 indicator group, such as Figure 4 As shown, when there are n indicator groups and the number of analysis nodes is greater than n, each indicator group corresponds to one analysis node.
[0047] Furthermore, when the number of analysis nodes is greater than the number of indicator groups, redundant nodes can be further deployed in the terminal device, and a monitoring program can be set in the terminal device to monitor the processing status of the analysis node when performing analysis and processing, so as to detect abnormal conditions in real time. When the processing status is monitored to be consistent with the preset status, it means that the analysis node is currently down or in other abnormal conditions, and it is necessary to stop the work of the current analysis node, and control the preset redundant node to replace the analysis node to continue to analyze and process the indicator group corresponding to the analysis node, such as Figure 4As shown, after the analysis node 3 crashes or other abnormal conditions occur, the deployed redundant node n+1 is controlled to take over the work of the analysis node 3. The above processing status includes but is not limited to the index analysis speed and the number of unprocessed indicators in the index group corresponding to the analysis node. The above index analysis speed can be obtained by the number of analysis indicators at the first moment, the number of analysis indicators at the second moment, and the difference between the first moment and the second moment. It can be understood that if the index analysis speed is less than the speed threshold and the number of unprocessed indicators is greater than the number threshold, it means that the analysis node is currently down or in other abnormal conditions, and it will automatically switch to the preset redundant node for processing.
[0048] Specifically, the above-mentioned control of the preset redundant node to continue to analyze and process the indicator group corresponding to the analysis node may include: obtaining the partition number of the message indicator that has not been analyzed and processed in the indicator group corresponding to the analysis node; controlling the redundant node to analyze and process the message indicator that has not been analyzed and processed according to the partition number. It can be understood that by recording the partition number of each indicator when processing the indicator group, it is convenient for the redundant node to inherit the indicator group of the analysis node when the analysis node needs to be replaced by the redundant node, and it can prevent the loss or confusion of the intermediate data generated by the analysis node that meets the preset state in the previous analysis and collection process when the indicator group is redistributed due to the downtime switching of the analysis node. The intermediate data stored in the memory includes but is not limited to the intermediate results of the calculation, the number of times the alarm is triggered, the number of notifications sent and the latest notification time.
[0049] It is understandable that before obtaining the partition number of the message index that has not been analyzed and processed in the index group corresponding to the analysis node, the partition number of the message index that has not been analyzed and processed needs to be determined in advance. The specific determination method can refer to the above steps.
[0050] In one embodiment, because sometimes two indicators need to be used for comprehensive processing to obtain the analysis result, at least one indicator group is analyzed and processed in step S103, and the analysis result of at least one indicator group can include: the indicator analysis module in the terminal device aggregates and calculates at least two indicators in the indicator group according to the first preset monitoring target, and obtains the analysis result of the indicator group corresponding to the first preset monitoring target. Among them, the above-mentioned first monitoring target is the target to be monitored for the monitored object, such as the SMS sending success rate, return rate, etc., and the SMS sending success rate needs to be obtained by the SMS sending volume and the number of successful SMS sending, and the return rate needs to be obtained by the SMS sending volume and the number of returned SMS. Both require comprehensive processing of two indicators to obtain the target to be monitored for the monitored object.
[0051] For example, taking the host monitoring of the server as an example, the index group corresponding to the host includes disk usage, which includes C disk usage (denoted as CP), D disk usage (denoted as DP), E disk usage (denoted as EP), F disk usage (denoted as FP), and each drive letter is an index. When the above-mentioned aggregate calculation is a multi-index aggregate calculation, if the host disk usage (denoted as AllP) is calculated, the latest values of the four indicators of C disk, D disk, E disk, and F disk are added together, that is, AllP = CP + DP + EP + FP; if the C disk usage rate is calculated, the C disk usage (denoted as cpRate) is divided by the host disk usage, that is, cpRate = CP ÷ AllP * 100%.
[0052] Step S104: Determine the current status of the monitored object according to the analysis result of at least one indicator group.
[0053] In this embodiment, the terminal device can analyze the index group according to the analysis results and Figure 2 The threshold corresponding to the alarm rule in the alarm notification module is judged to determine the current status of the monitored object. If the current status is abnormal, it means that the analysis result meets the corresponding threshold, and the alarm notification module needs to issue an alarm reminder. The above alarm rules include but are not limited to alarms greater than the threshold, alarms less than the threshold, and alarms of abnormal range values. For example, when the CPU usage rate is greater than the preset CPU threshold, it means that the current status of the monitored object is abnormal, and an alarm is issued. When the SMS sending success rate is less than the preset success rate threshold, it means that the current status of the monitored object is abnormal, and an alarm is issued. It can be understood that if an alarm reminder is required for an abnormal situation, then Figure 2 As shown in the figure, the indicator analysis module needs to send the analysis results to the alarm notification module, and then the alarm notification module determines whether a high alarm reminder is needed, and then sends the analysis results to the history writing module; if there is no need to warn the abnormal situation at present, Figure 2 As shown, the indicator analysis module can directly send the analysis results to the history writing module.
[0054] In one embodiment, step S104 may include: when it is necessary to comprehensively judge the current status of the monitored object based on different indicators or different data sources, the terminal device needs to aggregate the analysis results of at least one indicator group according to the second preset monitoring target to obtain the analysis results corresponding to the second preset monitoring target; when the analysis results corresponding to the second preset monitoring target meet the preset abnormal threshold range, the current status is determined to be an abnormal status. Among them, the above-mentioned second monitoring target is the target that needs to be monitored for the monitored object, for example, the maximum value of the CPU usage in all hosts corresponding to the monitored object, and the maximum value of the CPU usage in all hosts needs to be jointly analyzed using message indicators obtained from different data sources, so it is necessary to aggregate the analysis results based on at least one indicator group. Accordingly, when the maximum value of the CPU usage meets the preset abnormal threshold range, it means that the current status is determined to be an abnormal status, and the terminal device can use Figure 2 The alarm notification module in the system will issue an alarm reminder.
[0055] Exemplarily, taking the host monitoring of the server as an example, it is assumed that there are currently three computer rooms, namely computer room 1, computer room 2, and computer room 3, each of which has 10 hosts. The indicator group corresponding to each host includes CPU usage, disk usage, and SMS downlink MT submission volume, among which the disk usage includes C disk usage (denoted as CP), D disk usage (denoted as DP), E disk usage (denoted as EP), and F disk usage (denoted as FP), and each drive letter is an indicator. It can be understood that the indicators collected and split by each server correspond to a data source, that is, the grouped indicator group also corresponds to a data source, and the server can bring the data source information every time it uploads the indicator. Each data source will upload data at a fixed frequency to maintain the real-time nature of the indicator data, and the aggregate calculation of data is performed based on the latest data.
[0056] When the above-mentioned aggregate calculation is an aggregate calculation of the same indicator across data sources, if the maximum CPU usage of all hosts in the three computer rooms is calculated, the CPU usage of all hosts in computer room 1, computer room 2, and computer room 3 is obtained, and the maximum value is determined from the CPU usage of all the hosts obtained. Since the CPU usage of each host comes from a different data source, an aggregate calculation is performed across data sources; if the physical memory status of computer room 1 is calculated, the physical memory status of all hosts in computer room 1 is queried and summed.
[0057] When the above-mentioned aggregate calculation is a multi-indicator cross-data source aggregate calculation, if the usage status of all disks in computer room 1 is known, first the total disk amount of each host in computer room 1 is summed (CP+DP+EP+FP), and then the total disk amount of each host is summed.
[0058] When the above-mentioned aggregate calculation is a sliding window aggregate calculation, for example, to calculate the SMS downlink MT submission volume within two hours, the SMS downlink MT submission volume corresponding to each indicator group within two hours is obtained and then summed.
[0059] In one embodiment, nodes can be added to expand data processing capabilities. In addition, new indicators can be added. The terminal device receives the basic indicator data from the client, which includes the indicator, at least one of the first monitoring target and the second monitoring target to be processed, and the alarm rules corresponding to the analysis results, so as to split out new indicators after obtaining the message data according to the basic indicator data to monitor the new indicators. It can be understood that in this embodiment, it is only necessary to configure the basic indicator data corresponding to the new indicator in the client, so that the new indicator can be added in the later SMS monitoring work to monitor the new indicator. The operation is convenient and there is no need to modify the corresponding monitoring code to realize the monitoring of the new indicator.
[0060] In the embodiment of the present application, message data of the monitored object is obtained, the above message data is split and processed to obtain the various message indicators of the above monitored object, thereby avoiding the process of processing different types of message data according to different types of protocols respectively by splitting the message indicators, and then the above various message indicators are grouped and processed to obtain at least one indicator group, and the above at least one indicator group is analyzed and processed to obtain the analysis result of the above at least one indicator group, thereby improving the analysis and processing efficiency of the message indicators by grouping the message indicators for analysis and processing, and finally determining the current status of the above monitored object according to the analysis result of the above at least one indicator group, thereby improving the work efficiency when developing and maintaining the SMS monitoring work in the later stage.
[0061] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0062] Corresponding to a data monitoring method described above, Figure 5 FIG. 1 is a schematic diagram of a data monitoring device according to an embodiment of the present application. Figure 5 As shown, the above data monitoring device may include:
[0063] The data acquisition module 501 is used to acquire the message data of the monitored object, split the message data, and obtain various message indicators of the monitored object.
[0064] The group processing module 502 is used to group the various message indicators to obtain at least one indicator group.
[0065] The analysis and processing module 503 is used to analyze and process at least one indicator group to obtain an analysis result of at least one indicator group.
[0066] The status determination module 504 is used to determine the current status of the monitored object according to the analysis result of at least one indicator group.
[0067] In one embodiment, the analysis and processing module 503 may include:
[0068] The analysis and processing unit is used to analyze and process at least one indicator group through preset analysis nodes.
[0069] In one embodiment, the analysis and processing module 503 may further include:
[0070] The monitoring unit is used to monitor the processing status of the analysis node when performing analysis processing.
[0071] The control unit is used to control the preset redundant node to continue analyzing and processing the indicator group corresponding to the analysis node when it is monitored that the processing state meets the preset state.
[0072] In one embodiment, the control unit may include:
[0073] The number acquisition subunit is used to obtain the partition number of the message indicator that has not been analyzed and processed in the indicator group corresponding to the analysis node.
[0074] The control subunit is used to control the redundant node to analyze and process the message indicators that have not been analyzed and processed according to the partition number.
[0075] In one embodiment, the data monitoring device may further include:
[0076] The information acquisition module is used to obtain the identification information of the monitored object.
[0077] The number determination module is used to perform hash processing on the indicator name and identification information of the message indicator to determine the partition number of the message indicator.
[0078] In one embodiment, the analysis and processing module 503 may further include:
[0079] The first aggregation calculation unit is used to perform aggregation calculation on at least two indicators in the indicator group according to the first preset monitoring target to obtain an analysis result of the indicator group corresponding to the first preset monitoring target.
[0080] In one embodiment, the status determination module 504 may include:
[0081] The second aggregation calculation unit is used to perform aggregation calculation on the analysis result of at least one indicator group according to the second preset monitoring target to obtain the analysis result corresponding to the second preset monitoring target.
[0082] The status determination unit is used to determine that the current status is an abnormal status when the analysis result corresponding to the second preset monitoring target meets the preset abnormal threshold range.
[0083] In the embodiment of the present application, message data of the monitored object is obtained, the above message data is split and processed to obtain the various message indicators of the above monitored object, thereby avoiding the process of processing different types of message data according to different types of protocols respectively by splitting the message indicators, and then the above various message indicators are grouped and processed to obtain at least one indicator group, and the above at least one indicator group is analyzed and processed to obtain the analysis result of the above at least one indicator group, thereby improving the analysis and processing efficiency of the message indicators by grouping the message indicators for analysis and processing, and finally determining the current status of the above monitored object according to the analysis result of the above at least one indicator group, thereby improving the work efficiency when developing and maintaining the SMS monitoring work in the later stage.
[0084] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned system embodiments and method embodiments, and will not be repeated here.
[0085] Figure 6 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. For ease of explanation, only the parts related to the embodiment of the present application are shown.
[0086] like Figure 6 As shown, the terminal device 6 of this embodiment includes: at least one processor 600 ( Figure 6 Only one is shown in the figure), a memory 601 connected to the processor 600, and a computer program 602 stored in the memory 601 and executable on the at least one processor 600, such as a data monitoring program. When the processor 600 executes the computer program 602, the steps in the above-mentioned data monitoring method embodiments are implemented, such as Figure 1 Alternatively, when the processor 600 executes the computer program 602, the functions of the modules in the above-mentioned device embodiments are realized, for example, Figure 5 Functions of modules 501 to 504 are shown.
[0087] Exemplarily, the computer program 602 may be divided into one or more modules, which are stored in the memory 601 and executed by the processor 600 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 602 in the terminal device 6. For example, the computer program 602 may be divided into a data acquisition module 501, a grouping processing module 502, an analysis processing module 503, and a status determination module 504, and the specific functions of each module are as follows:
[0088] The data acquisition module 501 is used to acquire the message data of the monitored object, split the message data, and obtain various message indicators of the monitored object;
[0089] A group processing module 502, used for grouping each message indicator to obtain at least one indicator group;
[0090] The analysis and processing module 503 is used to analyze and process at least one indicator group to obtain an analysis result of at least one indicator group;
[0091] The status determination module 504 is used to determine the current status of the monitored object according to the analysis result of at least one indicator group.
[0092] The terminal device 6 may include, but is not limited to, a processor 600 and a memory 601. Those skilled in the art will appreciate that Figure 6 It is only an example of the terminal device 6 and does not constitute a limitation on the terminal device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, buses, etc.
[0093] The processor 600 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0094] In some embodiments, the memory 601 may be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6. In other embodiments, the memory 601 may also be an external storage device of the terminal device 6, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 6. Further, the memory 601 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 601 is used to store an operating system, an application program, a boot loader, data, and other programs, such as the program code of the computer program. The memory 601 may also be used to temporarily store data that has been output or is to be output.
[0095] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the above-mentioned device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the above-mentioned method embodiment, which will not be repeated here. In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For the part that is not described or recorded in detail in a certain embodiment, refer to the relevant description of other embodiments.
[0096] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0097] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic. For example, the division of the above modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0098] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0099] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the above-mentioned computer program includes computer program code, and the above-mentioned computer program code can be in source code form, object code form, executable file or some intermediate form. The above-mentioned computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0100] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A data monitoring method, characterized in that: include: Acquire message data of the monitored object, split and process the message data, and obtain each message index of the monitored object; The monitored object corresponds to at least one SMS sending account or at least one SMS sending channel, and the message data of the monitored object corresponds to the data in each client corresponding to the at least one SMS sending account or at least one SMS sending channel; When the message indicators are derived from the message data of the SMS sending account, the message indicators include: the number of SMS sent, the number of successful SMS sent, and the number of returned SMS; when the message indicators are derived from the message data of the SMS sending channel, the message indicators include: the downlink forwarding volume, the downlink retention volume, the downlink speed, the uplink retention volume, the status report retention volume, the SMS sending success rate, and the status report return rate; The respective message indicators are grouped and processed to obtain at least one indicator group, including: performing aggregation calculation on at least two indicators in the indicator group according to a first preset monitoring target to obtain an analysis result of the indicator group corresponding to the first preset monitoring target; Analyzing and processing the at least one indicator group to obtain the analysis result of the at least one indicator group includes: performing aggregation calculation on the analysis result of the at least one indicator group according to a second preset monitoring target to obtain the analysis result corresponding to the second preset monitoring target; when the analysis result corresponding to the second preset monitoring target meets the preset abnormal threshold range, determining that the current situation is an abnormal situation; The current status of the monitored object is determined according to the analysis result of the at least one indicator group.
2. The data monitoring method according to claim 1, characterized in that: The analyzing and processing the at least one indicator group includes: The at least one indicator group is analyzed and processed respectively through preset analysis nodes.
3. The data monitoring method according to claim 2, characterized in that: Also includes: Monitoring the processing status of the analysis node when performing analysis processing; When it is monitored that the processing state meets the preset state, the preset redundant node is controlled to continue analyzing and processing the indicator group corresponding to the analysis node.
4. The data monitoring method according to claim 3, characterized in that: The control preset redundant node continues to analyze and process the indicator group corresponding to the analysis node, including: Obtaining the partition number of the message index that has not been analyzed and processed in the index group corresponding to the analysis node; The redundant node is controlled to analyze and process the message indicators that have not been analyzed and processed according to the partition number.
5. The data monitoring method according to claim 4, characterized in that: Before obtaining the partition number of the message index that has not been analyzed and processed in the index group corresponding to the analysis node, including: Obtaining identification information of the monitored object; Hash processing is performed on the indicator name of the message indicator and the identification information to determine the partition number of the message indicator.
6. A data monitoring device, characterized in that: include: A data acquisition module is used to acquire the message data of the monitored object, split the message data, and obtain various message indicators of the monitored object; The monitored object corresponds to at least one SMS sending account or at least one SMS sending channel, and the message data of the monitored object corresponds to the data in each client corresponding to the at least one SMS sending account or at least one SMS sending channel; When the message indicators are derived from the message data of the SMS sending account, the message indicators include: the number of SMS sent, the number of successful SMS sent, and the number of returned SMS; when the message indicators are derived from the message data of the SMS sending channel, the message indicators include: the downlink forwarding volume, the downlink retention volume, the downlink speed, the uplink retention volume, the status report retention volume, the SMS sending success rate, and the status report return rate; A group processing module, used for grouping the respective message indicators to obtain at least one indicator group; An analysis and processing module, configured to analyze and process the at least one indicator group to obtain an analysis result of the at least one indicator group; the analysis and processing module includes: a first aggregation calculation unit, configured to perform aggregation calculation on at least two indicators in the indicator group according to a first preset monitoring target to obtain an analysis result of the indicator group corresponding to the first preset monitoring target; A status determination module is used to determine the current status of the monitored object based on the analysis results of the at least one indicator group; the status determination module includes: a second aggregation calculation unit, used to perform aggregation calculation on the analysis results of at least one indicator group according to a second preset monitoring target to obtain the analysis results corresponding to the second preset monitoring target.
7. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of a data monitoring method as described in any one of claims 1 to 5 are implemented.
8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of a data monitoring method as claimed in any one of claims 1 to 5 are implemented.
Citation Information
Patent Citations
Processing method and device of monitoring data
CN107015872A
Data parsing method and system, device and storage medium
CN108540439A