Broadband network television network management monitoring system based on Zabbix

Abstract

The invention discloses a Zabbix-based broadband network television network management monitoring system which can quickly give an alarm and respond, is stable in monitoring data acquisition and is high in monitoring efficiency, and the system comprises an agent module which is used for being deployed on monitored equipment, applications or systems and acquiring local data in an active or passive mode; the Zabbix proxy servers jointly form a proxy server cluster and receive the local data, sent by the proxy module, of the preset area equipment; the at least one Zabbix server is used for receiving and processing the local data sent by the Zabbix proxy server and triggering an alarm when the processed local data meets an alarm rule; the database module is used for operating on the Zabbix server and storing the local data and the monitoring alarm information which are processed by the Zabbix server; and the network module is used for displaying data and monitoring alarm information.

Description

Technical Field

[0001] The present invention relates to the technical field of network monitoring, and particularly to a broadband network television network management monitoring system based on Zabbix. Background Art

[0002] Radio and television operators are enterprises that provide communication and media services based on radio and television networks, mainly operating radio and television, broadband networks, interactive television and other services. Among them, monitoring the service status of devices, applications and systems is an important means to ensure the normal operation of radio and television operation services. It monitors the operation of devices, port status, traffic monitoring, etc. in real time through a monitoring system to ensure the stable operation of services. At present, the industry mainly relies on open-source tools Cacti and Nagios to support the monitoring system, which can cover about 500 devices. However, with the expansion of business and the increase in the number of managed devices, the alarm response of the monitoring system will become slower, and the collection of monitoring data will become unstable, thus affecting the monitoring efficiency and system stability. Summary of the Invention

[0003] Based on this, it is necessary to provide a broadband network television network management monitoring system based on Zabbix that can quickly alarm, stably collect monitoring data, and has high monitoring efficiency in view of the above deficiencies.

[0004] A broadband network television network management monitoring system based on Zabbix includes: An agent module, which is used to be deployed on the monitored device, application or system, and collect local data actively or passively; Multiple Zabbix agent servers jointly form an agent server cluster and receive local data of devices in a preset area sent by the agent module; At least one Zabbix server, which is used to receive and process local data sent by the Zabbix agent server, and trigger an alarm when the processed local data meets the alarm rules; A database module, which is used to run on the Zabbix server and store local data and monitoring alarm information processed by the Zabbix server; A network module, which is used for data and monitoring alarm information display.

[0005] In one embodiment, the broadband network television network management monitoring system includes three Zabbix agent servers, which respectively receive local data of the metropolitan area network devices of their own department, local data of the export and network management devices of their own department, and local data of devices of other departments.

[0006] In one embodiment, the local data includes DHCP\DNS service data, interactive television data, and broadband network data.

[0007] In one embodiment, the Zabbix server includes: A data collection module for collecting local data from the Zabbix agent server; A data processing module for processing the original local data; An alarm trigger module for sending an alarm when the processed data triggers an alarm rule; A task scheduling module for adjusting the data collection period of the data collection module.

[0008] In one embodiment, the processing of the original local data by the data processing module includes aggregation, threshold checking, and comparison.

[0009] In one embodiment, according to the type of data to be processed, the original local data is aggregated in one of the ways of time dimension, space dimension, and business logic; the threshold checking of the data is achieved by setting a dynamic baseline, a static threshold, or a time-period threshold.

[0010] In one embodiment, the alarm trigger module sends an alarm in at least one of the ways of sound, light, SMS, WeChat, and email.

[0011] In one embodiment, the broadband network TV network management and monitoring system includes two Zabbix servers and two database modules. One Zabbix server is the main Zabbix server, and the other Zabbix server is the standby Zabbix server. One database module is the main database module running on the main Zabbix server, and the other database module is the slave database module running on the standby Zabbix server; the main Zabbix server is used to bind the VIP node and receive and process the local data sent by the Zabbix agent server, and trigger an alarm when the processed local data meets the alarm rule.

[0012] In one embodiment, the broadband network TV network management and monitoring system further includes: An availability maintenance module for monitoring the health status of the main Zabbix server and the standby Zabbix server through the VRRP protocol. When the main Zabbix server fails, the node VIP is drifted and switched to the standby Zabbix server, and the data of the main database module is copied to the slave database module.

[0013] Implementing the Zabbix-based broadband network TV network management and monitoring system of the present invention, which processes data and triggers alarms through a Zabbix server, can monitor relevant services in the broadband network TV system in real time and actively detect faults, and can quickly respond to alarms; it is deployed using a distributed architecture, and data of devices in a preset area is collected through multiple Zabbix proxy servers to share the collection pressure of the Zabbix server, enabling stable collection of monitoring data, improving the scalability, stability, and monitoring efficiency of the monitoring system to meet the needs of large-scale network environments and large-scale managed devices. Brief Description of the Drawings

[0014] Figure 1 It is a schematic diagram of the module structure of the broadband network TV network management and monitoring system in an embodiment of the present invention. Detailed Implementation Modes

[0015] To make the above objects, features, and advantages of the present invention more obvious and understandable, the following detailed description of the specific implementation modes of the present invention will be given in conjunction with the accompanying drawings. Many specific details are set forth in the following description to fully understand the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below.

[0016] Please refer to Figure 1The present invention discloses a broadband network television network management monitoring system based on Zabbix, which can quickly respond to alarms, collect stable monitoring data, and has high monitoring efficiency. The broadband network television network management monitoring system includes an agent module 100, multiple Zabbix agent servers 200, at least one Zabbix server 300, a database module 400, and a network module 500, wherein the agent module 100 is used to be deployed on the monitored device, application or system, and collect local data in an active or passive manner. Local data includes DHCP\DNS service data, interactive TV data, broadband network data, and of course, local data can also include other radio and television operation business data. Multiple Zabbix agent servers 200 together form a proxy server cluster, and receive local data of preset area devices sent by the agent module 100. At least one Zabbix server 300, the Zabbix server 300 is used to receive and process the local data sent by the Zabbix proxy server 200, and trigger an alarm when the processed local data meets the alarm rules; the Zabbix server 300 processes the collected data to determine whether the equipment, system or application in the broadband network TV system fails, so as to give a timely alarm. In this embodiment, the Zabbix server 300 is a server center node, and the Zabbix proxy server 200 is a proxy edge node. The proxy server cluster composed of multiple Zabbix proxy servers 200 shares the data collection pressure of the Zabbix server 300, so that the monitoring system can adapt to a larger number of managed devices. The database module 400 is used to run on the Zabbix server 300 and store the local data and monitoring alarm information processed by the Zabbix server 300. In this embodiment, the database module 400 is a database running on the Zabbix server 300. The network module 500 is used for displaying data and monitoring alarm information. In other words, the network module 500 is a display interface of the monitoring system of this embodiment so that users or operation and maintenance personnel can view relevant information in a timely manner.

[0017] The agent module 100 is used to monitor the resources of the broadband network television system. It is a lightweight client program deployed on the monitored device, application or system, including active mode and passive mode. In the active mode, the agent module 100 actively requests the Zabbix proxy server 200 for a list of monitoring items and reports data regularly to reduce the load of the Zabbix proxy server 200; in the passive mode, the Zabbix proxy server 200 actively initiates a data request to the agent module 100.

[0018] The Zabbix proxy server 200 is a distributed data collection node of Zabbix, which is used to share the load of the Server or monitor across regions, and is suitable for large-scale or complex network environments. The Zabbix proxy server 200 collects data from the proxy module 100 instead of the Zabbix server 300 (Server), temporarily stores it, and then batch forwards it to the Zabbix server 300 to achieve data transfer; secondly, the Zabbix proxy server 200 can cache data when the network is interrupted and automatically synchronize it to the Zabbix server 300 after recovery to support offline data collection; in addition, by deploying the Zabbix proxy server 200 in branch offices, it is possible to avoid directly connecting to the Zabbix server 300 across the public network to break geographical isolation. In this embodiment, the broadband network TV network management monitoring system includes three Zabbix proxy servers 200 (proxy1, proxy2, proxy3), and the three Zabbix proxy servers 200 respectively receive the local data of the local area network devices in their own departments, the local data of the export and network management devices in their own departments, and the local data of the devices in other departments. That is to say, proxy1 receives the local data of the local area network devices in its own department, proxy2 receives the local data of the export and network management devices in its own department, and proxy3 receives the local data of the devices in other departments. In other embodiments, the number of Zabbix proxy servers 200 can be further increased according to the business situation and the number of monitored devices, systems, and applications.

[0019] The Zabbix server 300 (Server server) is the core processing engine of the monitoring system in this embodiment, responsible for receiving, processing, storing monitoring data, and triggering alarms and automated actions. Specifically, in this embodiment, the Zabbix server 300 includes a data collection module, a data processing module, an alarm trigger module, and a task scheduling module. The data collection module is used to collect local data from the Zabbix proxy server 200; the data processing module is used to process the original local data; the alarm trigger module is used to send an alarm when the processed data triggers an alarm rule; the task scheduling module is used to adjust the data collection cycle of the data collection module. In this embodiment, the processing of the original local data by the data processing module includes aggregation, threshold checking, and comparison. The alarm trigger module sends an alarm in at least one of the ways of sound, light, text message, WeChat, and email, so that users or operation and maintenance personnel can quickly respond to faults or anomalies.

[0020] In this embodiment, by aggregating the original local data, the data is summarized so that the original data forms business metrics. According to the type of data to be processed, one of the time dimension, space dimension, and business logic can be selected to aggregate the original local data. Time dimension aggregation is suitable for statistical data metrics such as hourly / daily peak bandwidth and user online number trends, which can be achieved through functions such as avg(), max(), and min(). Space dimension aggregation is suitable for data metrics such as multi-region CDN node traffic summary (such as the total traffic in xx city), which can be achieved by summarizing and reporting through the Zabbix proxy server 200. Business logic aggregation is suitable for calculating data metrics such as user stuttering rate (number of stuttering times / total number of requests × 100%), which can be achieved through custom calculated items. The business metrics of broadband network TV include bandwidth metrics, service quality metrics, and user behavior metrics. Among them, bandwidth metrics include egress bandwidth utilization rate (interface traffic / total bandwidth × 100%) and average bandwidth per user (total traffic / number of online users); service quality metrics include video stuttering rate (number of buffering events / number of play requests) and first-frame delay (proportion of requests with first load time > 2 seconds); user behavior metrics include peak concurrent online user number and real-time number of viewers of popular channels.

[0021] By performing threshold checks on the data, corresponding thresholds can be set for each business metric. For example, when the bandwidth utilization rate exceeds 80%, a warning may be triggered, and when it exceeds 90%, a severe warning is triggered; or when the video stuttering rate exceeds 5%, the operation and maintenance personnel need to be notified. In this embodiment, threshold checks on the data are achieved by setting dynamic baselines, static thresholds, or time-segmented thresholds. Among them, static thresholds are suitable for business metrics with clear and fixed performance boundaries, such as the physical bandwidth upper limit. Dynamic baselines set adaptive thresholds to meet business metrics with large traffic fluctuations (such as holiday peaks) and the need to automatically adjust thresholds based on historical data. Specifically, the baseline is calculated by using the baseline() function or an external machine learning model to predict the normal range. Time-segmented thresholds are suitable for business metrics that distinguish peak / low periods (such as higher bandwidth thresholds during prime time in the evening).

[0022] By comparing the data, accurate alarm and linkage response of the monitoring system can be achieved. In this embodiment, under the condition of setting thresholds, the currently collected and aggregated business metrics are compared with the corresponding business metric thresholds. When the currently collected business metrics exceed the threshold by plus or minus a percentage n% (n is a number between 10 and 30), the currently collected business metrics trigger the alarm rule, so as to send a signal to the alarm trigger module, causing the alarm trigger module to issue an alarm. That is to say, the normal operation of the broadband network TV service is carried out within the range of the threshold ±n%.

[0023] In addition, under normal circumstances, each time the data processing module triggers an alarm rule, the alarm triggering module sends an alarm once. In other embodiments, after the data processing module continuously triggers the same type of alarm within a preset period, the alarm triggering module issues an alarm. For example, when the problem of sudden increase in the card lag rate occurs 5 times continuously within 10 minutes, the alarm triggering module issues an alarm to avoid false alarms of sudden increase and improve the reliability of system alarms.

[0024] Taking the sudden increase in the card lag rate as an example, the working process of the data processing module is described as follows: calculate the card lag rate (number of card lags / total number of requests) of each CDN node every 5 minutes to achieve data aggregation; set 2 times the standard deviation of the average card lag rate in the same period in the past 7 days through dynamic baseline setting as the card lag rate threshold. If the card lag rate of a certain node exceeds the threshold for 3 consecutive cycles, an alarm is triggered and marked as "suspected node failure", and then it is sent to the alarm triggering module for the alarm triggering module to issue an alarm.

[0025] In one embodiment, the broadband network TV network management monitoring system includes two Zabbix servers 300 and two database modules 400. That is to say, the entire monitoring system includes a total of five servers, among which three are Zabbix proxy servers 200 and two are Zabbix servers 300. In this embodiment, one Zabbix server 300 is the main Zabbix server, and the other Zabbix server 300 is the standby Zabbix server. One database module 400 is the main database module running on the main Zabbix server, and the other database module 400 is the slave database module running on the standby Zabbix server; the main Zabbix server is used to bind the VIP node (virtual IP node providing external services) and receive and process the local data sent by the Zabbix proxy server 200, and trigger an alarm when the processed local data meets the alarm rule. That is to say, database modules 400 are both running on the two Zabbix servers 300. One Zabbix server 300 is used to receive and process the local data sent by the Zabbix proxy server 200 in the monitoring system for a long time, and the other Zabbix server 300 is used as a standby when the Zabbix server 300 binding the VIP node breaks down.

[0026] Further, the broadband network TV network management and monitoring system further includes a Keepalived module, which is used to monitor the health status of the primary Zabbix server and the standby Zabbix server through the VRRP protocol. When the primary Zabbix server fails, it switches the node VIP to the standby Zabbix server and replicates the data of the primary database module to the slave database module. In this embodiment, the Keepalived module is used to achieve the failover between the primary Zabbix server and the standby Zabbix server and the replication of data from the primary database module to the slave database module, enabling the system to still operate and be used normally when the primary Zabbix server fails, realizing a seamless failover for faults and ensuring high availability of services.

[0027] Specifically, Keepalived is a Linux-based high availability (HA) and load balancing solution. The Keepalived module includes a core module, a VRRP module, a health check module, and an SMTP notification module. The core module is responsible for parsing the configuration file, coordinating the operation of each module under the Keepalived module, and managing the life cycle of the entire system, and is used to define global parameters, VRRP instances, and health check rules. The VRRP module is used to achieve the failover of the virtual IP (VIP) to ensure the high availability of services. Specifically, the primary and standby nodes (the primary Zabbix server and the standby Zabbix server) exchange heartbeat information through the VRRP protocol. When the primary node (the primary Zabbix server) fails, the standby node (the standby Zabbix server) takes over the virtual IP to ensure uninterrupted service. The health check module monitors the status of the primary Zabbix server and the standby Zabbix server and triggers failover or load balancing strategies. The SMTP notification module is used to send email notifications to administrators or operation and maintenance personnel during status switches (such as the switch between the primary Zabbix server and the standby Zabbix server).

[0028] The network module 500 is a browser-based graphical management interface that provides visualization configuration, monitoring data display, and user interaction functions. In this embodiment, the network module 500 can provide rich dashboards, charts, topology diagrams, aggregation views, etc. to display the monitoring data situation, including alarm information, device information, traffic conditions, etc. In addition, the network module 500 of this embodiment also supports multi-role access control (such as administrators, ordinary users), and provides functions such as viewing alarm history, confirming or closing alarms. Administrators or operation and maintenance personnel with management permissions can quickly add new monitoring devices through the interface of the network module, and operation and maintenance personnel can view the real-time monitoring dashboard.

[0029] Implementing the Zabbix-based broadband network TV network management monitoring system of the present invention, which processes data and triggers alarms through the Zabbix server 300, can monitor relevant services in the broadband network TV system in real time and actively detect faults, and can quickly respond to alarms; it is deployed using a distributed architecture, and data of devices in a preset area is collected through multiple Zabbix proxy servers 200 to share the collection pressure of the Zabbix server 300, enabling stable collection of monitoring data, improving the scalability, stability, and monitoring efficiency of the monitoring system to meet the requirements of large-scale network environments and large-scale managed devices.

[0030] The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0031] The above-described embodiments only represent several implementation manners of the present invention, and the description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can still be made, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the invention patent should be subject to the appended claims.

Claims

1. A broadband network television network management monitoring system based on Zabbix, characterized in that: include: The agent module is used to be deployed on the monitored device, application or system to collect local data in an active or passive manner; Multiple Zabbix proxy servers together form a proxy server cluster and receive local data of preset area devices sent by the proxy module; At least one Zabbix server, which is used to receive and process local data sent by the Zabbix proxy server and trigger alarms when the processed local data meets the alarm rules; Database module, used to run on the Zabbix server and store local data and monitoring alarm information processed by the Zabbix server; Network module, used for displaying data and monitoring alarm information.

2. The broadband network television network management monitoring system according to claim 1, characterized in that: The broadband network television network management monitoring system includes three Zabbix proxy servers, which respectively receive the local data of the department's metropolitan area network equipment, the local data of the department's export and network management equipment, and the local data of external department equipment.

3. The broadband network television network management monitoring system according to claim 1, characterized in that: The local data includes DHCP\DNS service data, interactive television data, and broadband network data.

4. The broadband network television network management monitoring system according to claim 1, characterized in that: The Zabbix server includes: Data collection module, used to collect local data from Zabbix proxy server; A data processing module, used for processing original local data; The alarm trigger module is used to send an alarm when the processed data triggers the alarm rule; The task scheduling module is used to adjust the data collection cycle of the data collection module.

5. The broadband network television network management monitoring system according to claim 4, characterized in that: The data processing module processes the original local data including aggregation, threshold checking and comparison.

6. The broadband network television network management monitoring system according to claim 5, characterized in that: According to the type of data to be processed, choose to aggregate the original local data in one of the time dimension, space dimension and business logic; the threshold check of the data is achieved by setting a dynamic baseline or static threshold or time period threshold.

7. The broadband network television network management monitoring system according to claim 4, characterized in that: The alarm trigger module sends an alarm through at least one of sound, light, text message, WeChat, and email.

8. The broadband network television network management monitoring system according to claim 1, characterized in that: The broadband network TV network management monitoring system includes two Zabbix servers and two database modules. One Zabbix server is the main Zabbix server, and the other Zabbix server is the backup Zabbix server. One database module is the main database module running on the main Zabbix server, and the other database module is the slave database module running on the backup Zabbix server. The main Zabbix server is used to bind the VIP node and receive and process the local data sent by the Zabbix proxy server, and trigger an alarm when the processed local data meets the alarm rules.

9. The broadband network television network management monitoring system according to claim 8, characterized in that: Broadband Internet TV network management monitoring system also includes: The keep-alive module is used to monitor the health status of the primary Zabbix server and the backup Zabbix server through the VRRP protocol. When the primary Zabbix server fails, the node VIP drift is switched to the backup Zabbix server, and the data of the primary database module is copied to the slave database module.

Images