A broadband network television network management and monitoring system based on Zabbix

Abstract

The present invention discloses a Zabbix-based broadband network television network management and monitoring system with rapid alarm response, stable monitoring data collection and high monitoring efficiency. The system comprises an agent module, which is used to be deployed on a monitored device, application or system and collect local data in an active or passive manner; a plurality of Zabbix agent servers, which together form a agent server cluster and receive local data of devices in a preset area sent by the agent module; at least one Zabbix server, which is used to receive and process local data sent by the Zabbix agent server and trigger an alarm when the processed local data meets an alarm rule; a database module, which is used to run on the Zabbix server and store local data and monitoring alarm information processed by the Zabbix server; and a network module, which is used to display data and monitoring alarm information.

Description

Technical Field

[0001] The present invention relates to the technical field of network monitoring, and in particular to a broadband network television network management and monitoring system based on Zabbix. Background Art

[0002] Broadcasting and television operators are companies that provide communications and media services based on broadcasting and television networks. They primarily operate broadcasting, broadband networks, and interactive television services. Monitoring the operational status of equipment, applications, and systems is crucial for ensuring the smooth operation of broadcasting and television operations. Monitoring systems provide real-time monitoring of device operation, port status, and traffic flow to ensure stable service operations. Currently, the industry primarily relies on open-source tools such as Cacti and Nagios to support monitoring systems, which can cover approximately 500 devices. However, as business expands and the number of managed devices increases, monitoring system alarm responses slow and data collection becomes unstable, impacting monitoring efficiency and system stability. Summary of the Invention

[0003] Based on this, it is necessary to address the above shortcomings and provide a broadband network television network management monitoring system based on Zabbix that can quickly respond to alarms, collect stable monitoring data, and has high monitoring efficiency.

[0004] A broadband network television network management and monitoring system based on Zabbix, comprising:

[0005] The agent module is deployed on the monitored device, application or system to collect local data in an active or passive manner;

[0006] Multiple Zabbix proxy servers form a proxy server cluster and receive local data of devices in the preset area sent by the proxy module;

[0007] At least one Zabbix server, which receives and processes local data sent by the Zabbix proxy server and triggers alarms when the processed local data meets the alarm rules;

[0008] The database module is used to run on the Zabbix server and store local data and monitoring alarm information processed by the Zabbix server;

[0009] Network module, used for displaying data and monitoring alarm information.

[0010] In one embodiment, the broadband network television network management and monitoring system includes three Zabbix proxy servers, which respectively receive local data from the department's metropolitan area network equipment, local data from the department's exports and network management equipment, and local data from external department equipment.

[0011] In one embodiment, the local data includes DHCP\DNS service data, interactive television data, and broadband network data.

[0012] In one embodiment, the Zabbix server includes:

[0013] Data collection module, used to collect local data from Zabbix proxy server;

[0014] Data processing module, used for processing original local data;

[0015] The alarm trigger module is used to send an alarm when the processed data triggers the alarm rule;

[0016] The task scheduling module is used to adjust the data collection cycle of the data collection module.

[0017] In one embodiment, the processing of the raw local data by the data processing module includes aggregation, threshold checking, and comparison.

[0018] In one embodiment, based on the type of data to be processed, the original local data is aggregated according to one of the time dimension, space dimension and business logic; the threshold check of the data is achieved by setting a dynamic baseline or a static threshold or a time period threshold.

[0019] In one embodiment, the alarm trigger module sends the alarm through at least one of sound, light, text message, WeChat, and email.

[0020] In one embodiment, a broadband network television network management and monitoring system includes two Zabbix servers and two database modules, one Zabbix server is a master Zabbix server, and the other Zabbix server is a backup Zabbix server. One database module is a master database module running on the master Zabbix server, and the other database module is a slave database module running on the backup Zabbix server; the master Zabbix server is used to bind a VIP node and receive and process local data sent by the Zabbix proxy server, and trigger an alarm when the processed local data meets the alarm rules.

[0021] In one embodiment, the broadband network television network management and monitoring system further includes:

[0022] The keep-alive module is used to monitor the health status of the primary and backup Zabbix servers through the VRRP protocol. When the primary Zabbix server fails, it will switch the node VIP drift to the backup Zabbix server and copy the data of the primary database module to the slave database module.

[0023] The broadband network television network management and monitoring system based on Zabbix of the present invention processes data and triggers alarms through the Zabbix server, can monitor the relevant services in the broadband network television system in real time, actively discover faults, and respond to alarms quickly; it adopts a distributed architecture deployment, and uses multiple Zabbix proxy servers to collect data from devices in preset areas to share the collection pressure of the Zabbix server, so that monitoring data can be collected stably, thereby improving the scalability, stability and monitoring efficiency of the monitoring system to meet the needs of large-scale network environments and large-scale managed devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 The figure is a schematic diagram of the module structure of a broadband network television network management and monitoring system in one embodiment of the present invention. DETAILED DESCRIPTION

[0025] To make the above-mentioned objects, features, and advantages of the present invention more readily apparent, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings. The following description sets forth numerous specific details to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways than those described herein, and those skilled in the art may make similar modifications without departing from the scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0026] See also Figure 1The present invention discloses a Zabbix-based broadband network television network management and monitoring system that can quickly respond to alarms, collect stable monitoring data, and has high monitoring efficiency. The broadband network television network management and monitoring system includes an agent module 100, multiple Zabbix agent servers 200, at least one Zabbix server 300, a database module 400, and a network module 500. The agent module 100 is used to be deployed on the monitored device, application, or system to collect local data in an active or passive manner. Local data includes DHCP\DNS service data, interactive TV data, broadband network data, and of course, local data can also include other radio and television operation service data. Multiple Zabbix agent servers 200 together form a proxy server cluster and receive local data of preset area devices sent by the agent module 100. At least one Zabbix server 300 is configured to receive and process local data sent by the Zabbix proxy server 200 and trigger an alarm when the processed local data meets the alarm rules. The Zabbix server 300 processes the collected data to determine whether a device, system, or application in the broadband network television system has failed, so as to issue a timely alarm. In this embodiment, the Zabbix server 300 is a server center node, and the Zabbix proxy server 200 is a proxy edge node. A proxy server cluster consisting of multiple Zabbix proxy servers 200 shares the data collection pressure of the Zabbix server 300, allowing the monitoring system to adapt to a larger number of managed devices. The database module 400 is configured to run on the Zabbix server 300 and store local data processed by the Zabbix server 300 and monitoring alarm information. In this embodiment, the database module 400 is a database running on the Zabbix server 300. The network module 500 is used for displaying data and monitoring alarm information. In other words, the network module 500 is a display interface of the monitoring system of this embodiment so that users or operation and maintenance personnel can view relevant information in a timely manner.

[0027] The agent module 100 is used to monitor the resources of the broadband Internet TV system. It is a lightweight client program deployed on the monitored device, application or system, including active mode and passive mode. In active mode, the agent module 100 actively requests a list of monitoring items from the Zabbix proxy server 200 and reports data regularly to reduce the load of the Zabbix proxy server 200; in passive mode, the Zabbix proxy server 200 actively initiates data requests to the agent module 100.

[0028] The Zabbix proxy server 200 (proxy) is a distributed data collection node for Zabbix, used to offload the server or facilitate cross-regional monitoring. It is suitable for large-scale or complex network environments. The Zabbix proxy server 200 collects data from the proxy module 100 on behalf of the Zabbix server 300 (Server), temporarily stores it, and then forwards it in batches to the Zabbix server 300, enabling data transfer. Furthermore, the Zabbix proxy server 200 caches data during network outages and automatically synchronizes it with the Zabbix server 300 upon recovery, supporting offline data collection. Furthermore, deploying the Zabbix proxy server 200 in branch offices eliminates the need for direct connections to the Zabbix server 300 across the public network, thus breaking geographic isolation. In this embodiment, the broadband network television network management and monitoring system includes three Zabbix proxy servers 200 (proxy1, proxy2, and proxy3). These three Zabbix proxy servers 200 receive local data from the department's metropolitan area network devices, local data from the department's outlets and network management devices, and local data from external department devices, respectively. Specifically, proxy1 receives local data from the department's metropolitan area network devices, proxy2 receives local data from the department's outlets and network management devices, and proxy3 receives local data from external department devices. In other embodiments, the number of Zabbix proxy servers 200 can be further increased based on business conditions and the number of monitored devices, systems, and applications.

[0029] The Zabbix server 300 (Server) is the core processing engine of the monitoring system in this embodiment. It is responsible for receiving, processing, and storing monitoring data, as well as triggering alarms and automated actions. Specifically, in this embodiment, the Zabbix server 300 includes a data collection module, a data processing module, an alarm triggering module, and a task scheduling module. The data collection module collects local data from the Zabbix proxy server 200; the data processing module processes the raw local data; the alarm triggering module sends alarms when the processed data triggers an alarm rule; and the task scheduling module adjusts the data collection cycle of the data collection module. In this embodiment, the data processing module processes the raw local data through aggregation, threshold checking, and comparison. The alarm triggering module sends alarms via at least one of sound, light, SMS, WeChat, and email, enabling users or maintenance personnel to quickly respond to faults or anomalies.

[0030] In this embodiment, raw local data is aggregated to achieve data aggregation, so that the raw data forms business indicators. Depending on the type of data to be processed, the raw local data can be aggregated according to one of the time dimension, spatial dimension, and business logic. Time dimension aggregation is suitable for statistical data indicators such as hourly / daily peak bandwidth and user online number trends, and can be implemented through functions such as avg(), max(), and min(); spatial dimension aggregation is suitable for data indicators such as multi-region CDN node traffic aggregation (such as the total traffic in City XX), and can be implemented by Zabbix proxy server 200 after aggregation and reporting; business logic aggregation is suitable for calculating data indicators such as user freeze rate (number of freezes / total number of requests × 100%), and can be implemented through custom calculated items. The business indicators of broadband Internet TV include bandwidth indicators, service quality indicators and user behavior indicators. Among them, bandwidth indicators include export bandwidth utilization (interface traffic / total bandwidth × 100%) and average bandwidth per user (total traffic / number of online users); service quality indicators include video freeze rate (number of buffering events / number of playback requests) and first frame delay (the proportion of requests with the first loading time > 2 seconds); user behavior indicators include the peak number of concurrent online users and the real-time number of viewers of popular channels.

[0031] By performing threshold checks on the data, corresponding thresholds can be set for each business indicator. For example, bandwidth utilization exceeding 80% may trigger a warning, and exceeding 90% may trigger a serious alarm; or when the video freeze rate exceeds 5%, the operation and maintenance personnel need to be notified. In this embodiment, threshold checks on data are implemented by setting dynamic baselines or static thresholds or time-segment thresholds. Static thresholds are applicable to business indicators with clear and fixed performance boundaries, such as the upper limit of physical bandwidth; dynamic baselines are implemented by setting adaptive thresholds to meet the needs of business indicators with large traffic fluctuations (such as holiday peaks) and the need to automatically adjust thresholds based on historical data. Specifically, the baseline is calculated by using the baseline() function or an external machine learning model to predict the normal range. Time-segment thresholds are applicable to business indicators that distinguish between peak / valley periods (such as higher bandwidth thresholds during prime time in the evening).

[0032] By comparing data, the monitoring system can achieve precise alarms and coordinated responses. In this embodiment, when thresholds are set, the collected and aggregated current service indicators are compared with the corresponding service indicator thresholds. When the current service indicator exceeds the threshold by a percentage n% (n is a number between 10-30), the current service indicator triggers an alarm rule, sending a signal to the alarm trigger module, causing it to issue an alarm. In other words, the normal operation of the broadband Internet TV service is within the range of ±n% of the threshold.

[0033] Furthermore, under normal circumstances, the alarm triggering module issues an alarm each time the data processing module triggers an alarm rule. In other embodiments, the alarm triggering module issues an alarm only after the data processing module triggers the same alarm type repeatedly within a preset interval. For example, the alarm triggering module will only issue an alarm if the lag rate suddenly increases five times in a 10-minute period. This avoids false alarms due to sudden increases and improves the reliability of system alarms.

[0034] Taking a sudden spike in the jam rate as an example, the data processing module explains how it works: The jam rate (number of jams / total requests) for each CDN node is calculated every five minutes to aggregate data. A dynamic baseline is set, using a threshold of two standard deviations of the jam rate average over the past seven days. If a node's jam rate exceeds the threshold for three consecutive periods, an alarm is triggered and marked as a "suspected node failure." This alarm is then sent to the alarm trigger module, which issues an alert.

[0035] In one embodiment, a broadband network television network management and monitoring system includes two Zabbix servers 300 and two database modules 400. That is, the entire monitoring system includes five servers: three Zabbix proxy servers 200 and two Zabbix servers 300. In this embodiment, one Zabbix server 300 is a primary Zabbix server, another Zabbix server 300 is a backup Zabbix server, one database module 400 is a master database module running on the primary Zabbix server, and another database module 400 is a slave database module running on the backup Zabbix server. The primary Zabbix server is used to bind to a VIP node (a virtual IP node that provides external services) and receive and process local data sent by the Zabbix proxy server 200. Alarms are triggered when the processed local data meets alarm rules. That is to say, a database module 400 is running on both Zabbix servers 300, one of which is used in the monitoring system to receive and process local data sent by the Zabbix proxy server 200 for a long time, and the other Zabbix server 300 is used as a backup when the Zabbix server 300 bound to the VIP node goes down.

[0036] Furthermore, the broadband network television network management and monitoring system also includes a keep-alive module (Keepalived module), which is used to monitor the health status of the primary Zabbix server and the backup Zabbix server through the VRRP protocol. When the primary Zabbix server fails, the node VIP is drifted and switched to the backup Zabbix server, and the data of the primary database module is copied to the slave database module. In this embodiment, the keep-alive module is used to achieve drift switching between the primary Zabbix server and the backup Zabbix server, and to achieve data replication from the primary database module to the slave database module. This allows the system to continue to operate and be used normally when the primary Zabbix server fails, achieving imperceptible switching of the failure and ensuring high availability of the service.

[0037] Keepalived is a Linux-based high availability (HA) and load balancing solution. Its keepalived modules include the core module, VRRP module, health check module, and SMTP notification module. The core module parses the configuration file, coordinates the operation of modules under the keepalived module, and manages the entire system lifecycle. It defines global parameters, VRRP instances, and health check rules. The VRRP module implements virtual IP (VIP) failover to ensure high service availability. Specifically, the active and standby nodes (primary and standby Zabbix servers) exchange heartbeat information using the VRRP protocol. If the active node (primary Zabbix server) fails, the standby node (standby Zabbix server) takes over the virtual IP, ensuring uninterrupted service. The health check module monitors the status of the active and standby Zabbix servers and triggers failover or load balancing policies. The SMTP notification module sends email notifications to administrators or maintenance personnel when a state switchover occurs, such as when the active and standby Zabbix servers switch.

[0038] The network module 500 is a browser-based graphical management interface that provides visual configuration, monitoring data display, and user interaction. In this embodiment, the network module 500 can provide a rich set of dashboards, charts, topology maps, aggregated views, etc. to display monitoring data, including alarm information, device information, and traffic conditions. In addition, the network module 500 of this embodiment supports multi-role access control (e.g., administrator, general user) and provides functions such as viewing alarm history and confirming or closing alarms. Administrators or operations and maintenance personnel with administrative privileges can quickly add new monitoring devices through the network module interface, and operations and maintenance personnel can view real-time monitoring dashboards.

[0039] The broadband network television network management and monitoring system based on Zabbix of the present invention processes data and triggers alarms through the Zabbix server 300, can monitor the relevant services in the broadband network television system in real time, actively discover faults, and respond to alarms quickly; it adopts a distributed architecture deployment, and uses multiple Zabbix proxy servers 200 to collect data from devices in preset areas to share the collection pressure of the Zabbix server 300, so that monitoring data can be collected stably, thereby improving the scalability, stability and monitoring efficiency of the monitoring system to meet the needs of large-scale network environments and large-scale managed devices.

[0040] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0041] The above-described embodiments merely illustrate several implementations of the present invention, and while their descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, all of which fall within the scope of protection of the present invention. Therefore, the scope of protection of the patent for this invention shall be determined by the appended claims.

Claims

1. A broadband network television network management and monitoring system based on Zabbix, characterized in that: include: An agent module is deployed on a monitored device, application, or system to collect local data in an active or passive manner; the local data includes DHCP\DNS service data, interactive TV data, and broadband network data; Multiple Zabbix proxy servers form a proxy server cluster and receive local data of devices in preset areas sent by the proxy module. They are also used to cache data when the network is interrupted and automatically synchronize it to the Zabbix server after recovery to support offline data collection. At least one Zabbix server, which receives and processes local data sent by the Zabbix proxy server and triggers alarms when the processed local data meets the alarm rules; The database module is used to run on the Zabbix server and store local data and monitoring alarm information processed by the Zabbix server; Network module, used for displaying data and monitoring alarm information; The Zabbix server includes a data processing module for processing original local data; The data processing module processes raw local data through aggregation, threshold checking, and comparison. Depending on the type of data to be processed, the module aggregates the raw local data using a combination of time, space, and business logic. Data threshold checking is performed by setting dynamic baselines, static thresholds, or time-based thresholds. The broadband network TV network management and monitoring system includes two Zabbix servers and two database modules. One Zabbix server is the primary Zabbix server, and the other Zabbix server is the backup Zabbix server. One database module is the master database module running on the primary Zabbix server, and the other database module is the slave database module running on the backup Zabbix server. The primary Zabbix server is used to bind VIP nodes and receive and process local data sent by the Zabbix proxy server. It triggers alarms when the processed local data meets the alarm rules. broadband The IPTV network management and monitoring system also includes: The keep-alive module is used to monitor the health status of the primary and backup Zabbix servers through the VRRP protocol. When the primary Zabbix server fails, it will switch the node VIP drift to the backup Zabbix server and copy the data of the primary database module to the slave database module.

2. The broadband network television network management and monitoring system according to claim 1, characterized in that: The broadband network television network management and monitoring system includes three Zabbix proxy servers, which respectively receive local data from the department's metropolitan area network equipment, the department's export and network management equipment, and the local data from external department equipment.

3. The broadband network television network management and monitoring system according to claim 1, characterized in that: The Zabbix server also includes: Data collection module, used to collect local data from Zabbix proxy server; The alarm trigger module is used to send an alarm when the processed data triggers the alarm rule; The task scheduling module is used to adjust the data collection cycle of the data collection module.

4. The broadband network television network management and monitoring system according to claim 3, characterized in that: The alarm trigger module sends an alarm through at least one of sound, light, text message, WeChat, and email.

Images