A method and system for automated acquisition of OTN data from network management systems based on resource management.

Abstract

This invention discloses a method and system for automated acquisition of OTN (Online Transmission Network) data based on resource management, belonging to the field of communication network resource management technology. It includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module. The data acquisition module directly collects raw data from the transmission network management system and stores it in a temporary database table. The data processing module then preprocesses the raw data, storing it in intermediate and final tables. The data display module presents the network operation status of the OTN devices. Finally, the alarm module monitors abnormal data in real time and notifies relevant personnel for handling. This invention directly interfaces with the transmission network management system, solving the problems in resource management where the large volume of device data and the difficulty of manually maintaining some data easily affect data accuracy and seriously impact normal customer use.

Description

Technical Field

[0001] This invention relates to the field of communication network resource management technology, specifically a method and system for automatically collecting OTN data based on resource management. Background Technology

[0002] With the rapid development of communication technology, the scale and complexity of communication networks are constantly increasing, and traditional OTN data acquisition methods can no longer meet the needs of modern communication networks. Traditional methods usually adopt indirect acquisition, that is, data is relayed through other intermediate devices or systems, which affects the real-time performance, accuracy and efficiency of data transmission, and cannot meet the high requirements of modern communication networks. Summary of the Invention

[0003] The technical objective of this invention is to address the above-mentioned shortcomings by providing a method and system for automated acquisition of OTN data from a resource management network. This system directly connects to the transmission network management system, solving the problems in resource management where the large volume of device data and the difficulty in manually maintaining some data easily affect data accuracy and severely impact normal customer use.

[0004] The technical solution adopted by this invention to solve its technical problem is:

[0005] A method for automated collection of OTN data based on resource management includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module.

[0006] The data acquisition module directly collects raw data from the transmission network management system and stores it in a temporary table in the database. Then, the data processing module preprocesses the raw data and stores it in intermediate and final tables. The data display module presents the network operation status of the OTN device. Finally, the alarm module monitors abnormal data in real time and notifies relevant personnel to handle the issue via SMS, email, etc.

[0007] According to the solution, collected data is stored in temporary, intermediate, and final tables, and processed in a workflow-driven manner. This solution is primarily used to address the management issues of data related to transmission equipment OTN, boards, ports, chassis, and slots in resource management.

[0008] Preferably, data is stored in intermediate and formal tables through a process-driven, automatic update method.

[0009] Furthermore, the data acquisition module is responsible for directly connecting to the network management system via the ACTN standard REST interface; it includes a module for collecting full data on a daily schedule and a module for collecting incremental data on a schedule to ensure the real-time performance and accuracy of the data. The collected data is entered into a temporary table in the database using the collected UUID as a globally unique identifier and stored in the database in the native data format.

[0010] Furthermore, the data processing module is responsible for preprocessing the collected raw data, including full data and incremental data, extracting valuable information, especially escaping and storing the association relationships between transmission devices and transmission boards, ports, slots, and chassis. The association relationships are linked in the form of Snowflake algorithm IDs. The storage module adopts distributed storage technology and stores the data in the database in the form of intermediate tables to ensure data security and reliability, while effectively avoiding pollution of the formal table data.

[0011] Furthermore, when the data changes or is added, such as when a new device is added to the network or when the board is expanded, the data processing module can automatically trigger the network element access process or the board adjustment process, and notify the person to handle it in the form of a work order. After the processing is completed, the data is entered into the formal table to ensure the accuracy and real-time nature of data maintenance.

[0012] Furthermore, the data display module presents the processed data to users in the form of reports and graphs, allowing users to understand the network operation status in real time. At the same time, it can perform network shutdown, capacity expansion, migration, etc. through different processes. Based on different display formats, it is convenient for users to quickly grasp and report various statuses of the equipment.

[0013] The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS, email, etc., to ensure the timely processing of abnormal data and guarantee the normal operation of the network.

[0014] Furthermore, the specific implementation process of this method is as follows:

[0015] 1) Collect native data through the network management system using the ACTN standard REST interface, including full and incremental interfaces. Use UUID as the unique identifier and collect distributed storage technology to store the native data in a temporary table in the database.

[0016] 2) The collected OTN devices, boards, ports, chassis, and slots are associated with IDs generated by the snowflake algorithm, and the pre-processed data is stored in the database in the form of an intermediate table;

[0017] 3) New data automatically initiates the network entry process, changed data automatically initiates the adjustment process, and data withdrawn from the network automatically initiates the withdrawal process; relevant personnel are notified to handle the data in the form of a work order, and the data is entered into the official form after the data is processed.

[0018] 4) Present official data to users in the form of reports and graphs to help them monitor network status in real time;

[0019] 5) Set up an abnormal data alarm module to promptly notify relevant responsible persons of abnormal data via SMS and email.

[0020] This invention also claims a system for automatically collecting OTN data based on resource management, comprising a data acquisition module, a data processing module, a data display module, and an alarm and notification module.

[0021] The data acquisition module is used to directly collect raw data from the transmission network management system and store it in a temporary table in the database.

[0022] The data processing module is used to preprocess the raw data and store it in intermediate and final tables.

[0023] The data display module is used to present the network operating status of OTN devices;

[0024] The alarm and notification module is used to monitor abnormal data in real time and notify relevant responsible persons to handle the situation via SMS, email, etc.

[0025] The present invention also claims a device for automatically acquiring network management OTN data based on resource management, comprising: at least one memory and at least one processor;

[0026] The at least one memory is used to store a machine-readable program;

[0027] The at least one processor is used to call the machine-readable program to implement the above method.

[0028] The present invention also claims protection for a computer-readable medium having computer instructions stored thereon, which, when executed by a processor, implement the above-described method.

[0029] Compared with existing technologies, the method and system for automated acquisition of OTN data based on resource management of the present invention have the following advantages:

[0030] 1. Real-time performance: By directly connecting to the network management system, the collected raw data is processed, reducing data transfer links and improving the real-time performance of data transmission.

[0031] 2. Accuracy: The system adopts a REST interface based on the ACTN standard, using both full and incremental methods, and employs distributed storage of temporary and intermediate tables to improve data accuracy.

[0032] 3. High efficiency: By monitoring for anomaly alarms and automatically initiating processes based on incremental changes, the efficiency of data processing and analysis is greatly improved.

[0033] 4. Flexibility: It has the ability to establish hierarchical relationships between devices and customize display functions, which can adapt to communication networks of different sizes and needs, fully demonstrating the flexibility of data. Attached Figure Description

[0034] Figure 1 This is a diagram illustrating the implementation of the method for automated collection of OTN data based on resource management provided in this embodiment of the invention. Detailed Implementation

[0035] The present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0036] A method for automated collection of OTN data based on resource management includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module.

[0037] The data acquisition module directly collects raw data from the transmission network management system and stores it in a temporary table in the database. Then, the data processing module preprocesses the raw data and stores it in intermediate and final tables through process-driven and automatic updates. The data display module presents the network operation status of the OTN device in the form of reports and graphs. Finally, the alarm module monitors abnormal data in real time and notifies the relevant responsible persons for handling via SMS, email, etc.

[0038] According to the solution, collected data is stored in temporary, intermediate, and final tables, and processed in a workflow-driven manner. This solution is primarily used to address the management issues of data related to transmission equipment OTN, boards, ports, chassis, and slots in resource management.

[0039] The data acquisition module is responsible for directly connecting to the network management system using the ACTN standard REST interface. It includes a module for collecting full data on a daily schedule and a module for collecting incremental data on a schedule to ensure the real-time performance and accuracy of the data. The collected data is entered into a temporary table in the database using the collected UUID as a globally unique identifier and stored in the database in the native data format.

[0040] The data processing module is responsible for preprocessing the collected raw data, including full data and incremental data, extracting valuable information, and especially escaping and storing the association relationships between transmission devices and transmission boards, ports, slots, and chassis. The association relationships are linked in the form of Snowflake algorithm IDs. The storage module adopts distributed storage technology and stores the data in the database in the form of intermediate tables to ensure data security and reliability, while effectively avoiding pollution of the formal table data.

[0041] When data changes or is added, such as when new equipment is added to the network or when the capacity of the circuit board is expanded, the transmission network element network access process or the circuit board adjustment process can be automatically triggered. The process is then notified to the relevant personnel in the form of a work order. After the process is completed, the data is entered into the official table to ensure the accuracy and timeliness of data maintenance.

[0042] The data display module is responsible for presenting the processed data to users in the form of reports and graphs, so that users can understand the network operation status in real time. At the same time, it can perform network shutdown, capacity expansion, migration, etc. through different processes. Based on different display formats, it is convenient for users to quickly grasp and report various statuses of the equipment.

[0043] The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it will promptly notify the relevant responsible persons via SMS, email, etc., to ensure the timely processing of abnormal data and guarantee the normal operation of the network.

[0044] like Figure 1 As shown, the specific implementation process of this method is as follows:

[0045] 1) Collect native data through the network management system using the ACTN standard REST interface, including full and incremental interfaces. Use UUID as the unique identifier and collect distributed storage technology to store the native data in a temporary table in the database.

[0046] 2) The collected OTN devices, boards, ports, chassis, and slots are associated with IDs generated by the snowflake algorithm, and the pre-processed data is stored in the database in the form of an intermediate table;

[0047] 3) New data automatically initiates the network entry process, changed data automatically initiates the adjustment process, and data withdrawn from the network automatically initiates the withdrawal process; relevant personnel are notified to handle the data in the form of a work order, and the data is entered into the official form after the data is processed.

[0048] 4) Present official data to users in the form of reports and graphs to help them monitor network status in real time;

[0049] 5) Set up an abnormal data alarm module to promptly notify relevant responsible persons of abnormal data via SMS and email.

[0050] This invention also provides a system for automatically collecting OTN data based on resource management, including a data acquisition module, a data processing module, a data display module, and an alarm and notification module.

[0051] The data acquisition module is used to directly collect raw data from the transmission network management system and store it in a temporary table in the database.

[0052] The data processing module is used to preprocess the raw data and store it in intermediate and final tables.

[0053] The data display module is used to present the network operating status of OTN devices;

[0054] The alarm and notification module is used to monitor abnormal data in real time and notify relevant responsible persons to handle the situation via SMS, email, etc.

[0055] 1. Data Acquisition Module:

[0056] This module is responsible for directly connecting to the network management system using the ACTN standard REST interface. It includes modules for collecting full data daily and incremental data on a scheduled basis to ensure the real-time performance and accuracy of the data. The collected data is entered into a temporary table in the database using the collected UUID as a globally unique identifier and stored in the database in the native data format.

[0057] 2. Data Processing Module:

[0058] This module is responsible for preprocessing the collected raw data, including both full and incremental data, extracting valuable information, and especially translating and storing the relationships between transmission equipment and transmission boards, ports, slots, and chassis. These relationships are linked using Snowflake Algorithm IDs. The storage module employs distributed storage technology, storing the data in the database as an intermediate table to ensure data security and reliability, while effectively preventing contamination of the final data table. When data changes or is added, such as new equipment joining the network or board expansion, the module automatically triggers the transmission network element network access process or board adjustment process, notifying the relevant personnel in the form of a work order for processing. After processing, the data is entered into the final table, ensuring the accuracy and real-time nature of data maintenance.

[0059] 3. Data Display Module:

[0060] This module is responsible for displaying the processed data to users in the form of reports, graphs, etc., so that users can understand the network operation status in real time. At the same time, it can perform data decommissioning, expansion, migration, etc. through different processes. Based on different display formats, it is convenient for users to quickly grasp and report various statuses of the equipment.

[0061] 4. Alarm and Notification Module:

[0062] This module is responsible for alerting on abnormal data. Based on preset alert rules, it performs real-time detection and alerts for abnormal data. When abnormal data is detected, it promptly notifies relevant personnel via SMS, email, or other means to ensure timely handling of abnormal data and guarantee the normal operation of the network.

[0063] The process by which this system achieves automated acquisition of OTN data based on resource management is as follows:

[0064] 1) Collect native data through the network management system using the ACTN standard REST interface, including full and incremental interfaces. Use UUID as the unique identifier and collect distributed storage technology to store the native data in a temporary table in the database.

[0065] 2) The collected OTN devices, boards, ports, chassis, and slots are associated with IDs generated by the snowflake algorithm, and the pre-processed data is stored in the database in the form of an intermediate table;

[0066] 3) New data automatically initiates the network entry process, changed data automatically initiates the adjustment process, and data withdrawn from the network automatically initiates the withdrawal process; relevant personnel are notified to handle the data in the form of a work order, and the data is entered into the official form after the data is processed.

[0067] 4) Present official data to users in the form of reports and graphs to help them monitor network status in real time;

[0068] 5) Set up an abnormal data alarm module to promptly notify relevant responsible persons of abnormal data via SMS and email.

[0069] This invention also provides an automated acquisition device for OTN data based on resource management, comprising: at least one memory and at least one processor;

[0070] The at least one memory is used to store a machine-readable program;

[0071] The at least one processor is used to call the machine-readable program to implement the method for automated collection of OTN data based on resource management as described in the above embodiments.

[0072] This invention also provides a computer-readable medium storing computer instructions. When executed by a processor, these computer instructions implement the method for automated acquisition of OTN data based on resource management as described in the above embodiments. Specifically, a system or apparatus equipped with a storage medium storing software program code that implements the functions of any of the embodiments described above, and enabling the computer (or CPU or MPU) of the system or apparatus to read and execute the program code stored in the storage medium.

[0073] In this case, the program code read from the storage medium can itself implement the function of any of the above embodiments, and therefore the program code and the storage medium storing the program code constitute part of the present invention.

[0074] Examples of storage media used to provide program code include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Alternatively, program code can be downloaded from a server computer via a communication network.

[0075] Furthermore, it should be clear that not only can the program code read by the computer be executed, but also the operating system or other components operating on the computer can be instructed based on the program code to perform some or all of the actual operations, thereby realizing the function of any of the embodiments described above.

[0076] Furthermore, it is understood that the program code read from the storage medium is written to the memory set in the expansion board inserted into the computer or to the memory set in the expansion unit connected to the computer. Then, based on the instructions of the program code, the CPU or other components installed on the expansion board or expansion unit execute some and all of the actual operations, thereby realizing the function of any of the embodiments described above.

[0077] The present invention has been shown and described in detail above with reference to the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above embodiments, those skilled in the art will know that more embodiments of the present invention can be obtained by combining the code review methods in the different embodiments. These embodiments are also within the protection scope of the present invention.

Claims

1. A method for automatically collecting OTN data based on resource management, characterized in that, It includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module. The data acquisition module directly collects raw data from the transmission network management system and stores it in a temporary table in the database. Then, the data processing module preprocesses the raw data and stores it in intermediate and final tables. The data display module presents the network operation status of the OTN device. Finally, the alarm module monitors abnormal data in real time and notifies the relevant responsible persons for handling. The specific implementation process of this method is as follows: 1) Collect native data through the network management system using the ACTN standard REST interface, including full and incremental interfaces. Use UUID as the unique identifier and collect distributed storage technology to store the native data in a temporary table in the database. 2) The collected OTN devices, boards, ports, chassis, and slots are associated with IDs generated by the snowflake algorithm, and the pre-processed data is stored in the database in the form of an intermediate table; 3) New data automatically initiates the network entry process, changed data automatically initiates the adjustment process, and data that is deregistered automatically initiates the network exit process; Notify relevant personnel to handle the matter in the form of a work order, and enter it into the official form after the matter is handled. 4) Present official data to users in the form of reports and graphs to help them monitor network status in real time; 5) Set up an abnormal data alarm module to promptly notify relevant responsible persons of abnormal data via SMS and email.

2. The method for automated acquisition of OTN data based on resource management according to claim 1, characterized in that, Data is stored in intermediate and formal tables through a process-driven, automatic update method.

3. The method for automated acquisition of OTN data based on resource management according to claim 1, characterized in that, The data acquisition module is responsible for directly connecting to the network management system via the ACTN standard REST interface. It includes a module for collecting full data on a daily schedule and a module for collecting incremental data on a schedule. The collected data is entered into a temporary table in the database using the collected UUID as a globally unique identifier and stored in the database in the native data format.

4. The method for automated acquisition of OTN data based on resource management according to claim 1, characterized in that, The data processing module is responsible for preprocessing the collected raw data, including full data and incremental data, extracting valuable information, and converting and storing the association relationships between the transmission device and the transmission board, port, slot, and chassis. The association relationships are linked in the form of IDs using the Snowflake algorithm. The storage module adopts distributed storage technology and stores the data in the database in the form of an intermediate table.

5. The method for automated acquisition of OTN data based on resource management according to claim 4, characterized in that, When data changes or new data is added, the data processing module automatically triggers the network access process for transmission network elements or the board adjustment process, notifying the relevant personnel to handle the data in the form of a work order. After the data is processed, it is entered into the official table, ensuring the accuracy and real-time nature of data maintenance.

6. The method for automated acquisition of OTN data based on resource management according to claim 1, characterized in that, The data display module presents the processed data to users in the form of reports and graphs, and performs data decommissioning, expansion, and migration through different processes. The alarm and notification module is responsible for alarming abnormal data. According to the preset alarm rules, it performs real-time detection and alarming of abnormal data. When abnormal data is detected, it promptly notifies the relevant responsible persons to ensure timely processing of abnormal data and guarantee the normal operation of the network.

7. A system for automatically collecting OTN data based on resource management, characterized in that, It includes a data acquisition module, a data processing module, a data display module, and an alarm and notification module. The data acquisition module is used to directly collect raw data from the transmission network management system and store it in a temporary table in the database. The data processing module is used to preprocess the raw data and store it in intermediate and final tables. The data display module is used to present the network operating status of OTN devices; The alarm and notification module is used to monitor abnormal data in real time and notify the relevant responsible persons for handling via SMS and email. The process by which this system achieves automated acquisition of OTN data based on resource management is as follows: 1) Collect native data through the network management system using the ACTN standard REST interface, including full and incremental interfaces. Use UUID as the unique identifier and collect distributed storage technology to store the native data in a temporary table in the database. 2) The collected OTN devices, boards, ports, chassis, and slots are associated with IDs generated by the snowflake algorithm, and the pre-processed data is stored in the database in the form of an intermediate table; 3) New data automatically initiates the network entry process, changed data automatically initiates the adjustment process, and data that is deregistered automatically initiates the network exit process; Notify relevant personnel to handle the matter in the form of a work order, and enter it into the official form after the matter is handled. 4) Present official data to users in the form of reports and graphs to help them monitor network status in real time; 5) Set up an abnormal data alarm module to promptly notify relevant responsible persons of abnormal data via SMS and email.

8. A device for automatically acquiring OTN data based on resource management, characterized in that, include: At least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is configured to invoke the machine-readable program to implement the method according to any one of claims 1 to 6.

9. A computer-readable medium, characterized in that, The computer-readable medium stores computer instructions that, when executed by a processor, cause the processor to perform the method described in any one of claims 1 to 6.

Images