A method and system for automatically collecting network router data based on resource management

Abstract

The application discloses a kind of based on resource management's automatic acquisition network management router data method and system, belong to communication network resource management technical field, including determining acquisition target, construction acquisition system, acquisition system includes data acquisition module, data processing module, data display module and alarm and notification module;First, determine the data type range of acquisition router, construct acquisition system;Router information is directly collected from IP network management by data acquisition module, and is stored in temporary table with UUID as unique identifier;Then, the correlation between devices is converted by data processing module in the form of intermediate table to the original data collected, and is stored in formal table;Finally, abnormal data conditions are monitored in real time by alarm and notification module.The application can improve data acquisition efficiency and accuracy, solve the problem that, in resource management, due to the large amount of router device data and the difficulty of maintaining part of the data manually, the accuracy of the data is easily affected.

Description

Technical Field

[0001] This invention relates to the field of communication network resource management technology, specifically a method and system for automatically collecting network management router data based on resource management. Background Technology

[0002] With the rapid development of network technology, routers, as a core component of network devices, play a crucial role in ensuring network stability and security through monitoring their operational status and collecting data. However, traditional router data collection methods often rely on manual operation, which is inefficient, error-prone, and cannot meet the needs of large-scale network management. Summary of the Invention

[0003] The technical objective of this invention is to address the above-mentioned shortcomings by providing a method and system for automated data collection from network management routers based on resource management. This method can improve data collection efficiency and accuracy, and solve the problem that in resource management, the large amount of data from router devices and the difficulty in manually maintaining some data can easily affect the accuracy of the data and seriously impact the normal use by customers.

[0004] The technical solution adopted by this invention to solve its technical problem is:

[0005] A method for automating the collection of network management router data based on resource management includes determining the collection target and constructing a collection system, which includes a data collection module, a data processing module, a data display module, and an alarm and notification module.

[0006] First, determine the data type range of the routers to be collected and build the collection system. Then, collect router information directly from the IP network management system through the data collection module and store it in a temporary table using UUID as the unique identifier. Next, the data processing module transforms the collected raw data into the relationship between devices in the form of an intermediate table and stores it in the formal table. Finally, the alarm and notification module monitors abnormal data in real time, so that customers can keep abreast of the operating status of routers and other devices.

[0007] This method uses a process-driven approach to push collected data to manual processing before it is entered into a formal table. It is primarily used to address the management issues of resource data for host devices such as routers, boards, ports, chassis, and slots in resource management.

[0008] Preferably, the data processing module stores the relationships in a formal table through a process-driven, automatically updated manner.

[0009] Furthermore, the relationships between the devices include the relationships between devices, boards, ports, chassis, and slots.

[0010] Furthermore, the step of determining the collection target involves determining the router data types and collection frequency to be collected based on network management requirements.

[0011] Furthermore, the data acquisition module directly connects to the network management system via a REST interface, collecting full and incremental data daily at set times. The collected data is uniquely identified by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it.

[0012] Furthermore, the data processing module preprocesses the collected raw data, escapes and stores the association relationships between the router device and the board, port, slot, and chassis. The association relationships are linked in the form of Snowflake algorithm IDs and stored in the database in the form of an intermediate table, effectively avoiding pollution of the formal table data.

[0013] When data changes or is added, such as when new equipment is added to the network or when the capacity of a circuit board is expanded, the equipment network access process or the circuit board adjustment process can be automatically triggered. The process will be notified to the relevant personnel in the form of a work order. After the process is completed, the data will be entered into the official table to ensure the accuracy and timeliness of data maintenance.

[0014] Furthermore, the data display module presents the processed data to the user in the form of reports and graphs, making it convenient for the user to understand the network operation status in real time;

[0015] The alarm and notification module detects and alerts for abnormal data in real time according to preset alarm rules. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS, email, or other means to ensure timely processing of abnormal data and guarantee the normal operation of the network.

[0016] This invention also claims a system for automatically collecting network management router data based on resource management, including a target acquisition module and a data acquisition system construction module, wherein the data acquisition system includes data acquisition, data processing, data display, and alarm and notification.

[0017] The first step in determining the target data acquisition module is to define the data type range of the acquisition router, and then construct the acquisition system using the acquisition system building module.

[0018] The data acquisition system directly collects router information from the IP network management system and stores it in a temporary table using UUID as a unique identifier. Then, through data processing, the collected raw data is transformed into the relationship between devices in the form of an intermediate table and stored in the formal table. Finally, abnormal data is monitored in real time through alarms and notifications.

[0019] The present invention also claims a device for automatically collecting network management router data based on resource management, comprising: at least one memory and at least one processor;

[0020] The at least one memory is used to store a machine-readable program;

[0021] The at least one processor is used to call the machine-readable program to implement the above method.

[0022] The present invention also claims protection for a computer-readable medium having computer instructions stored thereon, which, when executed by a processor, implement the above-described method.

[0023] The method and system for automated data collection from network management routers based on resource management, as described in this invention, have the following advantages compared to existing technologies:

[0024] 1. Improve data collection efficiency: Automated collection methods replace traditional manual operations, greatly improving data collection efficiency and reducing labor costs.

[0025] 2. Improve data accuracy: Automated data collection and processing methods reduce human error and improve the accuracy and reliability of data.

[0026] 3. Optimize network resource management: By conducting in-depth analysis of the collected data, we can gain a more accurate understanding of the network's operating status, providing strong support for network optimization and troubleshooting. Attached Figure Description

[0027] Figure 1 This is a diagram illustrating the implementation of a method for automatically collecting network management router data based on resource management, as provided in an embodiment of the present invention. Detailed Implementation

[0028] The present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0029] A method for automating the collection of network management router data based on resource management includes determining the collection target and constructing a collection system, which includes a data collection module, a data processing module, a data display module, and an alarm and notification module.

[0030] First, determine the data type range of the routers to be collected and build the collection system. Then, the data collection module directly collects router information from the IP network management system, storing it in a temporary table using UUID as the unique identifier. Next, the data processing module transforms the collected raw data into an intermediate table representing the relationships between devices, including those between devices, boards, ports, chassis, and slots, storing this information in a formal table using process-driven and automatic update methods. Finally, the alarm and notification module monitors abnormal data in real time, allowing customers to promptly grasp the operating status of routers and other devices.

[0031] This method uses a process-driven approach to push collected data to manual processing before it is entered into a formal table. It is primarily used to address the management issues of resource data for host devices such as routers, boards, ports, chassis, and slots in resource management.

[0032] The step of determining the collection target involves determining the types of router data to be collected and the collection frequency based on network management requirements.

[0033] Build a data acquisition system: Build an automated data acquisition router system based on resource management, including a data acquisition module, a data processing module, a data storage module, a data display module, and an alarm notification module.

[0034] The data acquisition module is responsible for directly connecting to the network management system. It collects full and incremental data daily via a REST interface. The collected data is identified globally by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it.

[0035] The data processing module is responsible for preprocessing the collected raw data, escaping and storing the association relationships between the router device and the board, port, slot, and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm and stored in the database as an intermediate table, effectively avoiding pollution of the formal table data.

[0036] When data changes or is added, such as when new equipment is added to the network or when the capacity of a circuit board is expanded, the equipment network access process or the circuit board adjustment process can be automatically triggered. The process will be notified to the relevant personnel in the form of a work order. After the process is completed, the data will be entered into the official table to ensure the accuracy and timeliness of data maintenance.

[0037] The data display module is responsible for presenting the processed data to users in the form of reports, graphs, etc., so that users can understand the network operation status in real time.

[0038] The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS, email, etc., to ensure the timely processing of abnormal data and guarantee the normal operation of the network.

[0039] This invention also provides a system for automatically collecting network management router data based on resource management, including a target acquisition module and a data acquisition system construction module. The data acquisition system includes data acquisition, data processing, data display, and alarm and notification functions.

[0040] The first step in determining the target data acquisition module is to define the data type range of the acquisition router, and then construct the acquisition system using the acquisition system building module.

[0041] The data acquisition system directly collects router information from the IP network management system and stores it in a temporary table using UUID as a unique identifier. Then, through data processing, the collected raw data is transformed into the relationship between devices in the form of an intermediate table and stored in the formal table. Finally, abnormal data is monitored in real time through alarms and notifications.

[0042] The module for determining the collection target: Based on network management requirements, determines the data types of routers to be collected and the collection frequency.

[0043] The data acquisition system construction module consists of an automated data acquisition router system based on resource management, including a data acquisition submodule, a data processing submodule, a data storage submodule, a data display submodule, and an alarm notification submodule.

[0044] The data acquisition submodule is responsible for directly connecting to the network management system. It collects full and incremental data daily via a REST interface. The collected data is identified globally by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it.

[0045] The data processing submodule is responsible for preprocessing the collected raw data, escaping and storing the association relationships between the router device and the board, port, slot, and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm and stored in the database as an intermediate table, effectively avoiding pollution of the formal table data.

[0046] When data changes or is added, such as when new equipment is added to the network or when the capacity of a circuit board is expanded, the equipment network access process or the circuit board adjustment process can be automatically triggered. The process will be notified to the relevant personnel in the form of a work order. After the process is completed, the data will be entered into the official table to ensure the accuracy and timeliness of data maintenance.

[0047] The data display submodule is responsible for displaying the processed data to users in the form of reports, graphs, etc., so that users can understand the network operation status in real time.

[0048] The alarm and notification submodule is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS, email, etc., to ensure timely processing of abnormal data and guarantee the normal operation of the network.

[0049] This invention also provides an apparatus for automatically collecting network management router data based on resource management, comprising: at least one memory and at least one processor;

[0050] The at least one memory is used to store a machine-readable program;

[0051] The at least one processor is used to call the machine-readable program to implement the method for automatically collecting network management router data based on resource management as described in the above embodiments.

[0052] This invention also provides a computer-readable medium storing computer instructions. When executed by a processor, these computer instructions implement the method for automatically collecting network management router data based on resource management as described in the above embodiments. Specifically, a system or apparatus equipped with a storage medium storing software program code that implements the functions of any of the embodiments described above, and enabling the computer (or CPU or MPU) of the system or apparatus to read and execute the program code stored in the storage medium.

[0053] In this case, the program code read from the storage medium can itself implement the function of any of the above embodiments, and therefore the program code and the storage medium storing the program code constitute part of the present invention.

[0054] Examples of storage media used to provide program code include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Alternatively, program code can be downloaded from a server computer via a communication network.

[0055] Furthermore, it should be clear that not only can the program code read by the computer be executed, but also the operating system or other components operating on the computer can be instructed based on the program code to perform some or all of the actual operations, thereby achieving the function of any of the embodiments described above.

[0056] Furthermore, it is understood that the program code read from the storage medium is written to the memory set in the expansion board inserted into the computer or to the memory set in the expansion unit connected to the computer. Then, based on the instructions of the program code, the CPU or other components installed on the expansion board or expansion unit execute some and all of the actual operations, thereby realizing the function of any of the embodiments described above.

[0057] The present invention has been shown and described in detail above with reference to the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above embodiments, those skilled in the art will know that more embodiments of the present invention can be obtained by combining the code review methods in the different embodiments. These embodiments are also within the protection scope of the present invention.

Claims

1. A method for automatically collecting data from a network management router based on resource management, characterized in that, This includes defining the data collection targets and constructing a data collection system, which includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module. First, determine the data type range of the routers to be collected and build the collection system; then, collect router information directly from the IP network management system through the data collection module and store it in a temporary table using UUID as the unique identifier. Then, the data processing module transforms the collected raw data into the relationship between devices in the form of an intermediate table and stores it in the formal table; finally, the alarm and notification module monitors abnormal data in real time. Specifically: The data acquisition module is responsible for directly connecting to the network management system. It collects full and incremental data daily via a REST interface. The collected data is identified globally by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it. The data processing module is responsible for preprocessing the collected raw data, escaping and storing the association relationships between the router device and the board, port, slot, and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm and stored in the database as an intermediate table, effectively avoiding pollution of the formal table data. When data changes or is added, such as when new equipment is added to the network or when the capacity of the circuit board is expanded, the equipment network access process or the circuit board adjustment process can be automatically triggered. The process is then notified to the relevant personnel in the form of a work order. After the process is completed, the data is entered into the official table to ensure the accuracy and timeliness of data maintenance. The data display module is responsible for displaying the processed data to users in the form of reports and graphs, so that users can understand the network operation status in real time. The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS and email to ensure timely processing of abnormal data and guarantee the normal operation of the network.

2. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The data processing module stores the relationships into the formal table through a process-driven, automatic update mechanism.

3. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The relationships between devices include those between devices, boards, ports, chassis, and slots.

4. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The process involves determining the data collection target, and based on network management requirements, identifying the router data types and collection frequency to be collected.

5. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The data acquisition module directly connects to the network management system via a REST interface. It collects full and incremental data daily at set times. The collected data is identified globally by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it.

6. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The data processing module preprocesses the collected raw data, escapes and stores the association relationships between the router device and the board, port, slot and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm and stored in the database in the form of an intermediate table. When data changes or new data is added, the device network access process or board adjustment process is automatically triggered, and a work order is issued to the relevant person for processing. After processing, the data is entered into the official table to ensure the accuracy and timeliness of data maintenance.

7. The method for automatically collecting network management router data based on resource management according to claim 1, characterized in that, The data display module presents the processed data to the user in the form of reports and graphs; The alarm and notification module detects and alerts for abnormal data in real time according to preset alarm rules; when abnormal data is detected, it promptly notifies the relevant responsible persons.

8. A system for automatically collecting data from network management routers based on resource management, characterized in that, It includes a module for determining the data collection target and a module for building the data collection system. The data collection system includes data collection, data processing, data display, and alarm and notification functions. The first step in determining the target data acquisition module is to define the data type range of the acquisition router, and then construct the acquisition system using the acquisition system building module. The data collection system directly collects router information from the IP network management system and stores it in a temporary table using UUID as a unique identifier. Then, through data processing, the collected raw data is transformed into the relationship between devices in the form of an intermediate table and stored in the formal table; finally, abnormal data is monitored in real time through alarms and notifications. Specifically: The data acquisition module is responsible for directly connecting to the network management system. It collects full and incremental data daily via a REST interface. The collected data is identified globally by a UUID, entered into a temporary table in the database, and the data processing module is notified to process it. The data processing module is responsible for preprocessing the collected raw data, escaping and storing the association relationships between the router device and the board, port, slot, and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm and stored in the database as an intermediate table, effectively avoiding pollution of the formal table data. When data changes or is added, such as when new equipment is added to the network or when the capacity of the circuit board is expanded, the equipment network access process or the circuit board adjustment process can be automatically triggered. The process is then notified to the relevant personnel in the form of a work order. After the process is completed, the data is entered into the official table to ensure the accuracy and timeliness of data maintenance. The data display module is responsible for displaying the processed data to users in the form of reports and graphs, so that users can understand the network operation status in real time. The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS and email to ensure timely processing of abnormal data and guarantee the normal operation of the network.

9. A device for automatically collecting data from network management routers based on resource management, characterized in that, include: At least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is configured to invoke the machine-readable program to implement the method according to any one of claims 1 to 7.

10. A computer-readable medium, characterized in that, The computer-readable medium stores computer instructions that, when executed by a processor, implement the method described in any one of claims 1 to 7.

Images