OTN intelligent link construction and auditing method and device, equipment and storage medium

Abstract

This invention relates to the field of information processing technology, and in particular to an OTN intelligent link construction and auditing method, apparatus, device, and storage medium. Based on a multi-layer association mapping model, it associates business logic information and physical resource information in a distributed data lake using service identifiers as key keys. It then uses a cross-connection tracing algorithm to trace connection segments hop-by-hop, automatically generating a multi-layer network topology map based on the connection segment sequence. Each business link in the multi-layer network topology map undergoes multi-dimensional auditing. When the audit results are satisfactory, it identifies the common ports of the business links, creates unique SNC monitoring entities for these common ports, and generates a business-level SNC logical identifier for each business link. It establishes an association between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation, comprehensively improving the automation, data accuracy, and operational efficiency of OTN network operation and maintenance, reducing reliance on manual labor, and enhancing network reliability and manageability.

Description

Technical Field

[0001] This invention relates to the field of information processing technology, and in particular to a method, apparatus, device, and storage medium for constructing and auditing OTN smart links. Background Technology

[0002] With the deepening of 5G services, access-type OTN (Optical Transport Network) networks, with their advantages of high bandwidth, low latency, and hard-pipe isolation, have been deployed on a large scale in scenarios such as enterprise private lines, base station backhaul, and data center interconnection. The rapid expansion of network scale and the exponential growth in the number of services have presented unprecedented challenges to network operation and maintenance management. Currently, operators mainly rely on traditional Network Management Systems (NMS) and manual ledgers for managing OTN service links, which has the following significant drawbacks: 1. Severe data fragmentation and reliance on manual labor: Service configuration information (such as customer information, bandwidth, etc.) is usually stored in Customer Relationship Management Systems (CRM) or Integrated Resource Systems; device port and cross-connection configuration information exists in Element Management Systems (EMS); and end-to-end physical and logical topology relationships largely depend on manually maintained Excel ledgers or Visio drawings by maintenance personnel. Inconsistencies and delayed updates between multiple systems are common, leading to low efficiency in querying and verification. 2. Poor Link Status Visibility: Traditional network management systems primarily manage network elements and single-segment connections. They lack intuitive and complete visualization of end-to-end customer service links spanning multiple devices and network domains (such as core, aggregation, and access layers). Maintenance personnel must manually piece together and analyze data across multiple systems to determine service continuity, path nodes, and status—a time-consuming and error-prone process. 3. Shared Port Service Confusion and Duplicate Subnet Connection Statistics: In actual network deployments, a single physical port often carries multiple low-speed customer services through the ODUk channel, resulting in port reuse. Traditional methods struggle to automatically identify such reuse relationships, easily miscounting the capacity of a single physical port as the sum of multiple independent link capacities. This leads to distorted port utilization, inflated resource reports, and numerous redundant subnet connection alarms during monitoring, severely interfering with fault location. 4. Delayed Change Management: Link changes caused by network optimization, service adjustments, or fault repairs are difficult to synchronize to relevant systems and ledgers in a timely manner, resulting in discrepancies between the actual data and the actual situation. This forces subsequent expansion planning and fault analysis decisions to be based on erroneous data. Summary of the Invention

[0003] To overcome the shortcomings of existing technologies, the present invention aims to provide an OTN intelligent link construction and auditing method, apparatus, device, and storage medium that comprehensively improves the automation, data accuracy, and operational efficiency of OTN network operation and maintenance through multi-source data fusion, intelligent topology construction, multi-dimensional auditing, and monitoring entity optimization, reduces reliance on manual labor, and enhances the reliability and manageability of the network.

[0004] The first aspect of this invention provides an OTN intelligent link construction and auditing method, comprising: collecting raw data from multiple heterogeneous data sources; preprocessing the raw data to obtain preprocessed data; and storing the preprocessed data in a distributed data lake; based on a preset multi-layer association mapping model, associating business logic information and physical resource information in the distributed data lake with business identifiers as key keys, and tracing connection segments hop-by-hop using a cross-connection tracing algorithm to form a complete connection segment sequence; automatically generating a multi-layer network topology graph based on the connection segment sequence, and aggregating the multi-layer network using a graph search algorithm. The network topology diagram includes physical layer topology, channel layer topology, and service layer topology. Each service link in the multi-layer network topology diagram undergoes multi-dimensional auditing to verify configuration integrity, resource consistency, performance reachability, and policy compliance, and the audit results are output. When the audit results pass, the common port of the service link is identified, a unique SNC monitoring entity is created for the common port, and a service-level SNC logical identifier is generated for each service link. The association between the service-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation.

[0005] Optionally, in a first implementation of the first aspect of the present invention, the step of collecting raw data from multiple heterogeneous data sources, preprocessing the raw data to obtain preprocessed data, and storing the preprocessed data in a distributed data lake includes: asynchronously collecting raw data from multiple heterogeneous data sources in parallel, wherein the data sources include the northbound interface of the network element management system, the integrated resource management system, the database interface of the customer relationship management system, and the network configuration file backup server; cleaning, formatting, and standardizing the raw data, wherein cleaning includes deduplication and filling in missing values, formatting includes unifying timestamps and rate units, and standardization includes mapping the private attributes of different vendors' devices to a standard information model; and storing the processed preprocessed data in a unified distributed data lake.

[0006] Optionally, in the second implementation of the first aspect of the present invention, the step of associating business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using the business identifier as the key, and tracing connection segments hop-by-hop through a cross-connection tracing algorithm to form a complete connection segment sequence includes: associating business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using the business identifier as the key; parsing cross-connection configuration data, and starting from the business terminal port, tracing the flow relationship between the source port, time slot to the destination port and time slot hop-by-hop through a cross-connection tracing algorithm until the peer terminal port; identifying and recording the input and output ports, ODUk channel type, time slot number, and network elements traversed for each hop during the tracing process to form a complete connection segment sequence; and injecting the business logic information as a tag onto all connection segment resources it occupies.

[0007] Optionally, in a third implementation of the first aspect of the present invention, the step of automatically generating a multi-layer network topology diagram based on the connection segment sequence and aggregating the paths of the multi-layer network topology diagram using a graph search algorithm, wherein the multi-layer network topology diagram includes physical layer topology, channel layer topology, and service layer topology, includes: abstracting the network elements of the connection segment sequence as topology nodes and abstracting port pairs with cross-connection relationships as topology edges; constructing a multi-layer network topology diagram based on the topology nodes and the topology edges; aggregating all connection segments corresponding to a customer service in the multi-layer network topology diagram in sequence using a graph search algorithm, wherein the multi-layer network topology diagram includes physical layer topology, channel layer topology, and service layer topology; and using force-directed graph or tree diagram visualization technology to display the physical layer topology, channel layer topology, and service layer topology in layers or in a fusion manner.

[0008] Optionally, in the fourth implementation of the first aspect of the present invention, the step of performing multi-dimensional audits on each service link in the multi-layer network topology to audit configuration integrity, resource consistency, performance reachability, and policy compliance, and outputting audit results, includes: checking whether each service link in the multi-layer network topology has a complete end-to-end cross-connection configuration to obtain a configuration integrity check result; verifying whether the port and time slot resources actually occupied by the link are consistent with the pre-occupied resource records in the integrated resource system to obtain a resource consistency check result; judging whether the performance of each physical channel segment on each service link in the multi-layer network topology is within the normal threshold based on near real-time collected optical power and bit error rate performance data to obtain a performance reachability judgment result; checking whether the link path conforms to the predetermined policy according to the service level agreement requirements to obtain a policy compliance check result; and merging the integrity check result, the resource consistency check result, the performance reachability judgment result, and the policy compliance check result into an audit result.

[0009] Optionally, in a fifth implementation of the first aspect of the present invention, when the audit result passes, identifying the common port of the business link, creating a unique SNC monitoring entity for the common port, generating a business-level SNC logical identifier for each business link, and establishing an association between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation includes: when the audit result passes, identifying the common port of the business link and creating a unique SNC monitoring entity for the common port; generating a business-level SNC logical identifier for each business link and establishing an association between the business-level SNC logical identifier and the unique SNC monitoring entity; when the unique SNC monitoring entity fails, locating a list of all affected customer services through the association and merging them to generate a root cause alarm.

[0010] Optionally, in the sixth implementation of the first aspect of the present invention, after the audit result passes, the common port of the business link is identified, a unique SNC monitoring entity is created for the common port, and a business-level SNC logical identifier is generated for each business link, and the association between the business-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation, the method further includes: establishing an event-driven incremental update mechanism; monitoring network change events based on the incremental update mechanism; automatically triggering link rediscovery, topology update and data synchronization processes according to the network change events to maintain data consistency among multiple systems; recording change logs and uploading the change logs to the blockchain.

[0011] A second aspect of this invention provides an OTN intelligent link construction and auditing device, comprising: a data acquisition and preprocessing storage module, used to acquire raw data from multiple heterogeneous data sources, perform data preprocessing on the raw data to obtain preprocessed data, and store the preprocessed data in a distributed data lake; an association tracing module, used to associate business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using business identifiers as key keys, and tracing connection segments hop-by-hop through a cross-connection tracing algorithm to form a complete connection segment sequence; and a generation and aggregation module, used to automatically generate a multi-layer network topology graph based on the connection segment sequence, and aggregate the data using a graph search algorithm. The document describes the paths in a multi-layer network topology diagram, which includes physical layer topology, channel layer topology, and service layer topology. An audit output module performs multi-dimensional audits on each service link in the multi-layer network topology diagram to verify configuration integrity, resource consistency, performance reachability, and policy compliance, and outputs the audit results. An identification, creation, and generation module identifies the common ports of the service links when the audit results are passed, creates a unique SNC monitoring entity for the common ports, generates a service-level SNC logical identifier for each service link, and establishes the association between the service-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation.

[0012] Optionally, in a first implementation of the second aspect of the present invention, the acquisition, preprocessing, and storage module includes: an acquisition unit for asynchronously acquiring raw data from multiple heterogeneous data sources in parallel, the data sources including the northbound interface of the network element management system, the integrated resource management system, the database interface of the customer relationship management system, and a network configuration file backup server; a cleaning, transformation, and standardization unit for cleaning, formatting, and standardizing the raw data, the cleaning including deduplication and filling in missing values, the formatting including unifying timestamps and rate units, and the standardization including mapping the private attributes of different vendors' devices to a standard information model; and a storage unit for storing the processed preprocessed data in a unified distributed data lake.

[0013] Optionally, in a second implementation of the second aspect of the present invention, the association tracing module includes: an association unit, used to associate business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using the business identifier as the key; a parsing tracing unit, used to parse cross-connect configuration data, and starting from the business terminal port, to trace the flow relationship between the source port, time slot to the destination port and time slot hop by hop through the cross-connect tracing algorithm, until the peer terminal port; an identification and recording unit, used to identify and record the input and output ports, ODUk channel type, time slot number and network elements passed through each hop during the tracing process, forming a complete connection segment sequence; and an injection unit, used to inject business logic information as a tag into all connection segment resources it occupies.

[0014] Optionally, in a third implementation of the second aspect of the present invention, the generation aggregation module includes: an abstraction unit, used to abstract the network elements of the connection segment sequence into topology nodes, and to abstract port pairs with cross-connection relationships into topology edges; a construction unit, used to construct a multi-layer network topology graph based on the topology nodes and the topology edges; an aggregation unit, used to aggregate all connection segments corresponding to a customer service in the multi-layer network topology graph in sequence using a graph search algorithm, wherein the multi-layer network topology graph includes physical layer topology, channel layer topology, and service layer topology; and a display unit, used to display the physical layer topology, channel layer topology, and service layer topology in layers or in a fusion using force-directed graph or tree diagram visualization technology.

[0015] Optionally, in the fourth implementation of the second aspect of the present invention, the audit output module includes: a first checking unit, used to check whether each service link in the multi-layer network topology diagram has a complete end-to-end cross-connection configuration, and obtain a configuration integrity check result; a verification unit, used to verify whether the port and time slot resources actually occupied by the link are consistent with the resource records pre-occupied in the integrated resource system, and obtain a resource consistency verification result; a judgment unit, used to judge whether the performance of each physical channel segment on each service link in the multi-layer network topology diagram is within the normal threshold based on the optical power and bit error rate performance data collected in near real-time, and obtain a performance reachability judgment result; a second checking unit, used to check whether the link path conforms to the predetermined strategy according to the service level agreement requirements, and obtain a strategy compliance check result; and a merging unit, used to merge the integrity check result, the resource consistency verification result, the performance reachability judgment result, and the strategy compliance check result into an audit result.

[0016] Optionally, in a fifth implementation of the second aspect of the present invention, the identification, creation, generation, and establishment module includes: an identification and creation unit, configured to identify the common port of the business link and create a unique SNC monitoring entity for the common port when the audit result passes; a generation and establishment unit, configured to generate a business-level SNC logical identifier for each business link and establish an association between the business-level SNC logical identifier and the unique SNC monitoring entity; and a location and merging generation unit, configured to locate a list of all affected customer services through the association when the unique SNC monitoring entity fails, and merge them to generate a root cause alarm.

[0017] Optionally, in the sixth implementation of the second aspect of the present invention, it further includes: an establishment module for establishing an event-driven incremental update mechanism; a listening module for listening to network change events based on the incremental update mechanism; a triggering module for automatically triggering link rediscovery, topology update and data synchronization processes according to the network change events, so as to maintain data consistency among multiple systems; and a record uploading module for recording change logs and uploading the change logs to the blockchain.

[0018] A third aspect of the present invention provides an OTN intelligent link construction and auditing device, the OTN intelligent link construction and auditing device comprising: a memory and at least one processor, the memory storing instructions; at least one processor calling the instructions in the memory to cause the OTN intelligent link construction and auditing device to perform the various steps of the OTN intelligent link construction and auditing method described in any of the preceding claims.

[0019] A fourth aspect of the present invention provides a computer-readable storage medium storing instructions that, when executed by a processor, implement the steps of the OTN smart link construction and auditing method described in any of the preceding claims.

[0020] In the technical solution of this invention, a multi-layer association mapping model is used to associate business logic information and physical resource information in a distributed data lake with business identifiers as key keys. A cross-connection tracing algorithm is used to trace connection segments hop-by-hop, forming a complete sequence of connection segments. A multi-layer network topology map is automatically generated based on this sequence, and a graph search algorithm is used to aggregate the paths in the multi-layer network topology map. Each business link in the multi-layer network topology map undergoes multi-dimensional auditing to verify configuration integrity, resource consistency, performance reachability, and policy compliance. When the audit results pass, the common ports of the business links are identified, a unique SNC monitoring entity is created for the common ports, and a business-level SNC logical identifier is generated for each business link. An association is established between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation. Furthermore, through multi-source data fusion, intelligent topology construction, multi-dimensional auditing, and monitoring entity optimization, the automation, data accuracy, and operational efficiency of OTN network operation and maintenance are comprehensively improved, reducing reliance on manual labor and enhancing network reliability and manageability. Attached Figure Description

[0021] Figure 1 This is a first flowchart of the OTN intelligent link construction and auditing method provided in an embodiment of the present invention; Figure 2 This is a second flowchart of the OTN intelligent link construction and auditing method provided in the embodiments of the present invention; Figure 3 This is a third flowchart of the OTN intelligent link construction and auditing method provided in the embodiments of the present invention; Figure 4 This is a fourth flowchart of the OTN intelligent link construction and auditing method provided in the embodiments of the present invention; Figure 5 A schematic diagram of the structure of the OTN intelligent link construction and auditing device provided in an embodiment of the present invention; Figure 6 This is another structural schematic diagram of the OTN intelligent link construction and auditing device provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of the structure of the OTN intelligent link construction and auditing device provided in an embodiment of the present invention. Detailed Implementation

[0022] This invention provides an OTN intelligent link construction and auditing method, device, equipment, and storage medium. Through multi-source data fusion, intelligent topology construction, multi-dimensional auditing, and monitoring entity optimization, it comprehensively improves the automation, data accuracy, and operational efficiency of OTN network operation and maintenance, reduces reliance on manual labor, and enhances network reliability and manageability.

[0023] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" or "having" and any variations thereof are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0024] For ease of understanding, the specific process of the embodiments of the present invention is described below. Please refer to [link / reference]. Figure 1 One embodiment of the OTN intelligent link construction and auditing method in this invention includes: 101. Collect raw data from multiple heterogeneous data sources, perform data preprocessing on the raw data to obtain preprocessed data, and store the preprocessed data in a distributed data lake; In this embodiment, the system asynchronously retrieves raw data from multiple heterogeneous data sources, including the northbound interface of the Element Management System (EMS), the Integrated Resource Management System (IRMS), the database interface of the Customer Relationship Management System (CRM), and the network configuration file backup server, through parallel data acquisition interfaces. The raw data includes network element configurations, cross-connection data, customer business orders, port resource information, and performance data. Subsequently, the collected raw data is cleaned to remove duplicate records and fill in missing values ​​in key fields; it is formatted and converted to unify the timestamp format and rate unit (e.g., unifying Mbps and Gbps into Gbps); and it is standardized to map the private management information base (MIB) attributes or command line (CLI) outputs of different vendors' devices to a unified OTN standard information model (e.g., a hierarchical model based on ITU-T G.709). The processed standardized and structured data is stored in a unified distributed data lake (e.g., based on Hadoop or a data lake warehouse integrated architecture), providing a high-quality and scalable data foundation for subsequent correlation analysis.

[0025] 102. Based on a pre-defined multi-layer association mapping model, business logic information and physical resource information in the distributed data lake are associated with business identifiers as key keys, and the connection segments are traced hop by hop through the cross-connection tracing algorithm to form a complete sequence of connection segments. In this embodiment, the system, based on a preset multi-layer association mapping model, uses a unique customer service identifier (such as a service work order number) as the key to associate business logic information (such as customer information, bandwidth requirements, and service level agreements, SLAs) stored in the data lake with physical resource information (such as network elements, ports, and time slots). Then, the system parses the cross-connect configuration data collected from the EMS and, starting from the terminal port (UNI port) of the service on the access device, uses a cross-connect tracing algorithm to hop-by-hop trace the signal from the source port, source time slot through the optical cross-connect (OXC) or... The system traces the flow of electrical cross-connect (ODUk cross-connect) to the destination port and destination timeslot, all the way to the terminal port at the other end. During the tracing process, the system identifies and records the input port, output port, ODUk channel type (such as ODU0 / 1 / 2 / 2e / 4), timeslot number, and network element devices traversed by each hop, thus forming a complete sequence of connection segments that spans multiple network layers (physical layer and channel layer). At the same time, business logic information (such as service ID and customer name) is injected as a tag into all connection segment resources it occupies, realizing full-link binding of services and resources.

[0026] 103. Automatically generate a multi-layer network topology map based on the connection segment sequence, and use a graph search algorithm to aggregate the paths of the multi-layer network topology map. The multi-layer network topology map includes physical layer topology, channel layer topology and service layer topology. In this embodiment, the system abstracts the network element devices involved in the connection segment sequence as nodes in the topology graph, and the port pairs with cross-connection relationships as edges in the topology graph. Based on these nodes and edges, the system automatically constructs a multi-layer network topology graph, including: a physical layer topology with device and fiber optic connections as the core; a channel layer topology with ODUk channel connections as the core; and a service layer topology with end-to-end customer service paths as the core. Using graph search algorithms (such as depth-first search (DFS) or breadth-first search (BFS), the system aggregates all connection segments (which may span multiple devices and multiple channels) corresponding to the same customer service in sequence to form a complete service path. Finally, using visualization technologies such as force-directed graphs and tree diagrams, the physical layer, channel layer, and service layer topologies are displayed independently or integrated and overlaid, providing operation and maintenance personnel with an intuitive and clear end-to-end link view.

[0027] 104. Conduct multi-dimensional audits on each service link in the multi-layer network topology diagram to audit configuration integrity, resource consistency, performance reachability, and policy compliance, and output the audit results; In this embodiment, the system performs automated, multi-dimensional audit checks on each automatically constructed service link. These checks include: configuration integrity audit: verifying whether the service link has a complete end-to-end cross-connect configuration from the source UNI to the destination UNI, without interruptions or missing configurations; resource consistency audit: verifying whether the physical ports and ODUk time slots actually occupied by the link are completely consistent with the pre-allocated or recorded resource information in the integrated resource management system; performance reachability audit: based on near real-time collected performance data such as optical power and bit error rate (BER), determining whether the performance indicators of each physical channel or optical path (such as fiber segment or amplifier segment) on the link are within the normal threshold range to ensure signal transmission quality; and policy compliance audit: according to the requirements of the service level agreement (SLA) (such as latency, path separation, and protection method), checking whether its actual path (such as the nodes and areas traversed) conforms to the predetermined routing policy or constraints. The system merges the results of the above four dimensions and outputs the comprehensive audit result for each service link, marking it as passed, alarmed, or failed, and attaching a detailed explanation of the non-compliance items.

[0028] 105. When the audit results are passed, the common ports of the business links are identified, a unique SNC monitoring entity is created for the common ports, and a business-level SNC logical identifier is generated for each business link. The association between the business-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation. In this embodiment, for service links that pass the audit, the system further analyzes their physical resource usage and identifies physical ports (shared ports) that are reused by multiple low-speed customer services (such as multiple VC services). The system creates a globally unique Subnet Connection (SNC) monitoring entity for each identified shared port to monitor the overall status of the physical port (such as port up / down, abnormal optical power). At the same time, the system generates a service-level SNC logical identifier for each customer service link carried on the shared port. By establishing the association between the service-level SNC logical identifier and the unique SNC monitoring entity of the physical port, a mapping is formed where N logical service identifiers correspond to one physical monitoring entity. When the shared port fails, the monitoring system only needs to report one root cause alarm for the unique SNC monitoring entity and automatically and quickly locate the list of all affected customer services through the association, thereby achieving accurate alarm aggregation and root cause location, greatly reducing alarm storms and improving fault handling efficiency.

[0029] In this embodiment of the invention, a unified data lake is constructed by collecting and preprocessing data from multi-source heterogeneous systems. Based on the business identifier and associated logical and physical information, an end-to-end connection segment sequence is intelligently constructed using a cross-connection tracing algorithm. Based on this, a multi-layer network topology diagram is automatically generated. Then, multi-dimensional automated audits of configuration, resources, performance, and policies are performed on each business link in the diagram. Based on the audit results, a unique monitoring entity is created for the physical shared port and associated with the business logic identifier. This process constructs a complete closed loop from data fusion, intelligent discovery, comprehensive auditing to precise monitoring, realizing end-to-end visualization, automated auditing, and intelligent operation and maintenance of OTN business links. It fundamentally solves the pain points of traditional operation and maintenance such as data fragmentation, reliance on manual labor, poor visualization, and alarm storms, significantly improving operation and maintenance efficiency, data accuracy, and network reliability.

[0030] Please see Figure 2 In the second embodiment of the OTN intelligent link construction and auditing method of the present invention, steps 101 and 102 include: 201. Asynchronously collect raw data from multiple heterogeneous data sources in parallel. The data sources include the northbound interface of the network element management system, the integrated resource management system, the database interface of the customer relationship management system, and the network configuration file backup server. In this embodiment, the system deploys multiple independent data collectors to collect data from different types of sources in an asynchronous and parallel manner: network element configuration, alarm, performance, and cross-connection data are collected from the network element management systems (EMS) of various vendors via northbound interface protocols such as TL1, CORBA, or NETCONF / YANG; pre-allocated and allocated resource records are collected from the integrated resource management system (IRMS) via database connections (such as JDBC) or APIs; customer orders and service activation information are collected from the database of the customer relationship management system (CRM); and full or incremental configuration files (such as CLI configuration text) of network devices are collected from the configuration file backup server. This parallel and asynchronous collection mode improves data collection efficiency and adapts to the characteristics of multi-system heterogeneity and large network scale.

[0031] 202. Clean, format, transform and standardize the raw data. Cleaning includes deduplication and filling in missing values. Formatting includes unifying timestamps and rate units. Standardization includes mapping the proprietary attributes of different manufacturers' devices to a standard information model. In this embodiment, a data quality processing flow is performed on the collected raw data stream. The cleaning phase involves comparing key fields (such as device ID, port ID, and timestamp) to remove duplicate reports; filling missing fields for critical resources (such as port rate and timeslot number) using interpolation, context-based inference, or setting default values. The formatting and conversion phase involves converting all timestamps to ISO 8601 format and all bandwidth and rate units to Gbps. The standardization phase involves establishing a mapping dictionary from vendor-specific attributes to a standard information model (such as based on TMF MTOSI or a proprietary standard), converting and mapping object identifiers (OIDs), parameter names, and enumeration values ​​unique to different vendors' devices to standardized attribute names and value ranges, thus eliminating vendor differences.

[0032] 203. Store the preprocessed data in a unified distributed data lake; In this embodiment, the high-quality preprocessed data, after cleaning, transformation, and standardization, is written into a unified distributed data lake storage. The data lake can adopt a technical architecture based on HDFS, object storage (such as S3), or integrated data lake warehouse (such as Delta Lake, Iceberg), and is partitioned and stored according to data domains (such as resource domains, configuration domains, performance domains, and business domains) and ingestion time. This storage method provides high-throughput write capabilities, low-cost massive data storage capabilities, and computing capabilities that support SQL and complex analysis (such as through Spark, Flink), providing a unified and reliable data foundation for upper-layer correlation analysis, topology construction, and auditing applications.

[0033] 204. Based on a pre-defined multi-layer association mapping model, business logic information and physical resource information in the distributed data lake are associated using business identifiers as key keys; In this embodiment, the system builds and applies a pre-defined multi-layer association mapping model on top of the data lake. This model defines the object mapping relationships and association rules from the business layer to the channel layer and then to the physical layer. The system takes the customer business identifier as the core and performs association queries by connecting tables of different data domains in the data lake. For example, it finds customer information and SLA in the CRM business table by business ID, finds the list of reserved ports and time slots in the IRMS resource table, and finds the cross-connection entries actually created on these ports in the EMS configuration table. Through this association from a business perspective, the originally scattered business intentions, resource records and network configurations are woven into a logical whole.

[0034] 205. Parse the cross-connect configuration data, and starting from the service terminal port, use the cross-connect tracing algorithm to trace the flow relationship between the source port, time slot to the destination port and time slot hop by hop until the peer terminal port. In this embodiment, the cross-connect configuration data collected by the system from the EMS is usually in list form. The algorithm starts from a terminal port of a service (such as Port A, ODUk slot X) and uses it as the current tracking point. It searches for configuration items with the current port and slot as the source in the cross-connect list, finds the corresponding destination port and slot, and then uses this destination port and slot as the new current tracking point. The above search process is repeated to simulate the actual cross-connect path of the signal in the network. This process is performed hop by hop until the tracked port is the terminal port of another service (such as Port Z), thus completing the complete path tracking from one end to the other. The algorithm needs to handle complex situations such as ODUk multi-level multiplexing and cascaded connection monitoring (TCM).

[0035] 206. During the tracing process, identify and record the input and output ports, ODUk channel type, timeslot number, and network elements traversed for each hop to form a complete connection segment sequence; In this embodiment, during the execution of the cross-connection tracing algorithm, the system not only focuses on end-to-end connectivity but also records the details of each hop on the path. For each hop, it records the input network element, input port, input ODUk channel type, and timeslot number; and the output network element, output port, output ODUk channel type, and timeslot number. This information accurately describes the signal processing on each device. Finally, the records of all hops are combined sequentially to form a structured sequence of connection segments. This sequence is the precise basis for constructing an end-to-end link view and performing resource verification.

[0036] 207. Inject business logic information as tags into all the connection segment resources it occupies; In this embodiment, after completing path tracing and sequence recording, the system injects or associates business logic information (such as business ID, business name, customer name, A-end / Z-end information) as metadata tags onto each connection segment record occupied by the business. This means that each record representing physical / channel resources in the data lake may carry one or more business tags. This resource tagging mechanism greatly enhances the queryability of the data, making it easy to answer key operation and maintenance questions later.

[0037] In this embodiment of the invention, multi-source heterogeneous data is efficiently acquired through a parallel asynchronous acquisition mechanism. After rigorous cleaning, formatting, and standardization, a high-quality data foundation is laid for subsequent analysis. Then, with business identifiers as the core, a multi-layer association mapping model is used to closely link the dispersed business logic with physical resource information. The cross-connection tracing algorithm is used to reconstruct the signal path hop by hop, forming an accurate sequence of connection segments and resource labels. This process realizes the deep integration and standardization of data from multiple systems, as well as the accurate insight and tracing of physical network connection relationships from a business perspective. It provides core support for building a real and dynamic network knowledge graph and realizing refined resource management.

[0038] Please see Figure 3 In the third embodiment of the OTN intelligent link construction and auditing method of the present invention, steps 103 and 104 include: 301. Abstract the network elements of the connection segment sequence as topology nodes, and abstract the port pairs with cross-connection relationships as topology edges; In this embodiment, the system abstracts all unique network element devices (such as ROADM and OTN switches) extracted from the connection segment sequence into nodes in the network topology graph. Each node has attributes such as ID, name, type, and geographical location. At the same time, port pairs with direct cross-connection relationships (i.e., input ports and output ports on the same hop, which are usually located in the same device or directly connected between adjacent devices via optical fiber) are abstracted into edges in the topology graph. Each edge is associated with the source node, source port, destination node, destination port, and the channel type and timeslot information it carries. This abstraction lays the foundation for subsequent graph calculation and visualization.

[0039] 302. Construct a multi-layer network topology graph based on topological nodes and topological edges; In this embodiment, based on the set of nodes and edges abstracted in the previous step, the system uses a graph database (such as Neo4j) or an in-memory graph computing framework (such as NetworkX) to construct a multi-layered network topology graph model. This graph model typically contains three subgraphs: a physical layer subgraph (nodes are network elements, and edges are fiber optic connections); a channel layer subgraph (nodes are network elements or line ports, and edges are ODUk channel connections); and a service layer subgraph (nodes are service endpoints, and edges are complete service paths). The subgraphs are associated with each other to form a three-dimensional, interconnected network resource model.

[0040] 303. Use graph search algorithms to aggregate all connection segments corresponding to a customer service in a multi-layer network topology graph in sequence. The multi-layer network topology graph includes physical layer topology, channel layer topology, and service layer topology. In this embodiment, to present a complete customer service path, the system executes a graph search algorithm in the graph model. Taking service A and service Z as the starting and ending nodes, in the channel layer subgraph, the shortest path algorithm or a path search algorithm based on label constraints is used to find a path that sequentially connects all the connection segments (edges) related to the service. This path clearly shows the entire process of the service from access device A, through which intermediate devices and which channels, and finally to access device Z. After the searched path results are associated with the physical layer topology, each fiber segment traversed can be drilled down to view; after being associated with the service layer, a logical topology view of the service is formed.

[0041] 304. Use force-directed graph or tree diagram visualization technology to display the physical layer topology, channel layer topology and business layer topology in a layered or integrated manner; In this embodiment, the system transmits the constructed multi-layer topology map data to the front-end visualization engine. Using a force-directed graph layout algorithm, the node positions can be automatically adjusted to present a clear network topology with clear connections. This is suitable for displaying physical devices and fiber optic connections. Using a tree diagram or hierarchical layout, the system can effectively display the hierarchical path of services from the core to the access point, making it suitable for displaying business logic topology. Operation and maintenance personnel can control the interface to select and view the topology of a specific layer independently. They can also use penetration or overlay methods to integrate physical layer, channel layer, and service layer information into a single diagram. For example, different colors can be used to indicate the health status of the physical optical fibers that the service path passes through.

[0042] 305. Check whether each service link in the multi-layer network topology diagram has a complete end-to-end cross-connection configuration and obtain the configuration integrity check results; In this embodiment, the configuration integrity audit module traverses each discovered business link and checks whether there are any breakpoints in its connection sequence. Specifically, it verifies whether the output of each hop in the sequence can be found as the input of the next hop, and that the entire path starts and ends at the client terminal port. If a cross-connection configuration of a certain link is found to be missing, or the path terminates at an intermediate device, it is marked as incomplete configuration and the breakpoint location is recorded.

[0043] 306. Verify whether the actual port and time slot resources occupied by the link are consistent with the pre-allocated resource records in the integrated resource system, and obtain the resource consistency verification results; In this embodiment, the resource consistency audit module will automatically discover the list of physical ports and ODUk timeslots actually occupied by the link and compare them with the list of resources reserved or allocated for the service queried from the Integrated Resource Management System (IRMS). The check items include: whether the resource objects are consistent (such as port ID), whether the quantity is consistent, and whether the status matches. Any inconsistency (such as the actual use of unreserved resources or the unused reserved resources) will be recorded as a resource inconsistency item and classified as resource conflict or resource idleness.

[0044] 307. Based on near real-time acquired optical power and bit error rate performance data, determine whether the performance of each physical channel segment on each service link in the multi-layer network topology is within the normal threshold, and obtain the performance reachability judgment result. In this embodiment, the performance reachability audit module collects performance data such as optical power, optical signal-to-noise ratio (OSNR), and bit error rate (BER) monitored in the optical amplifier board, optical monitoring channel (OSC), or OTN frame overhead in near real-time (e.g., every minute). The system locates each physical optical path it passes through (e.g., between two amplifiers or between two ROADMs) according to the service link topology. Then, it compares the current performance value of each optical path with a pre-set engineering acceptance threshold or dynamic baseline threshold. If the performance degradation of any optical path exceeds the threshold (e.g., optical power is too low or BER is too high), it is determined that the performance of that segment is unreachable and may lead to the performance degradation of the entire service link. The audit result is performance abnormality.

[0045] 308. Check whether the link path conforms to the predetermined policy according to the service level agreement requirements, and obtain the policy compliance check result; In this embodiment, the policy compliance audit module reads the Service Level Agreement (SLA) or preset routing policy for the service. The policy may include: latency requirements (total path length or number of nodes limited), path separation requirements (cannot share fiber or equipment with another important service), security area requirements (must or must not pass through certain areas), and protection method requirements (must be a 1+1 or shared ring protection path). The system compares the actual path of the service with these policies one by one. For example, it calculates the total physical distance or total number of hops to assess latency; it analyzes the path overlap with other services to check separation. Any violation of the policy will be recorded as a policy non-compliance item.

[0046] 309. Combine the integrity check results, resource consistency verification results, performance reachability judgment results, and policy compliance check results into a single audit result; In this embodiment, the system summarizes and merges the audit results of the above four independent dimensions to generate a comprehensive audit report for each business link. The overall status of the report is: pass (all dimensions pass), warning (there are anomalies that do not affect the current business but require attention, such as idle resources), or failure (there are anomalies that seriously affect the business, such as configuration interruption or performance degradation). The report details the pass status of each dimension, the description of the problems found, the resource objects involved, and the suggested handling measures. This audit result provides authoritative data support for network health assessment, fault diagnosis, and optimization.

[0047] In this embodiment of the invention, by abstracting the sequence of connection segments into a graph model, a multi-layered network topology containing physical, channel, and service layers is automatically constructed and visualized, providing an intuitive end-to-end link view. On this basis, automated and multi-dimensional audits of configuration integrity, resource consistency, performance reachability, and policy compliance are performed on each service link, and a comprehensive audit report is generated. This process transforms complex network connection relationships into computable, analyzable, and visual objects, and through systematic audit checks, proactively discovers problems such as configuration errors, resource conflicts, performance degradation, and policy violations, realizing a shift from a passive response to a proactive insight operation and maintenance mode, and ensuring the health and compliance of service links.

[0048] Please see Figure 4 In the fourth embodiment of the OTN intelligent link construction and auditing method of the present invention, steps 105 and 105 thereafter include: 401. When the audit results are approved, the common port of the business link is identified, and a unique SNC monitoring entity is created for the common port; In this embodiment, for service links whose audit status is passed, the system further performs port reuse analysis. By analyzing resource occupancy relationships, it identifies scenarios where a physical port (and its higher-order ODUk channel) is simultaneously occupied by multiple lower-order customer services (such as multiple VC or ODU0 services). These ports are marked as shared ports. For each identified shared port, the system creates a unique, physical-level Subnet Connection (SNC) monitoring entity in the network element management system or upper-layer integrated network management system. This SNC monitoring entity is used to represent the overall operating status of the port, and its alarms will directly reflect the faults of the physical port (such as LOS, LOF, signal degradation).

[0049] 402. Generate a business-level SNC logical identifier for each business link, and establish an association between the business-level SNC logical identifier and the unique SNC monitoring entity; In this embodiment, the system generates a service-level SNC logical identifier for each independent customer service link carried on the shared port. This logical identifier represents the connection status of the customer service in the monitoring logic, but it does not directly generate independent physical port alarms. The key step is to establish an association between the service-level SNC logical identifier and the unique physical port SNC monitoring entity in the association database of the management system. This is usually achieved through an N:1 mapping table, which records which physical SNC monitors which service logic SNCs.

[0050] 403. When a unique SNC monitoring entity fails, locate all affected customer business lists through association relationships and merge them to generate a root cause alarm. In this embodiment, when a network failure occurs, such as the optical module of a physical port failing, the unique SNC monitoring entity corresponding to that port will generate a root cause alarm. After receiving this alarm, the upper-layer alarm association engine immediately queries the aforementioned association mapping table to quickly locate the list of all service-level SNC logical identifiers associated with this physical SNC. Then, it finds the customer information, service level, etc., corresponding to all these services. Subsequently, the system suppresses (or marks as derivative alarms) the repetitive alarms that these service logical SNCs may generate, and instead merges them to generate a clear root cause alarm. This achieves the aggregation from N service alarms to 1 root cause alarm plus a list of affected services, greatly improving alarm readability and fault location efficiency.

[0051] 404. Establish an event-driven incremental update mechanism; In this embodiment, in order to keep the data synchronized with the actual network situation, the system establishes an event-driven incremental update mechanism. This mechanism defines a series of event types that can trigger data updates, such as new service activation, service bandwidth adjustment, network expansion, configuration changes after fault repair, etc. These events can come from the operation logs of the network management system, the status flow of the work order system, or change notifications from the configuration management database.

[0052] 405. Monitor network change events based on incremental update mechanism; In this embodiment, the system deploys an event listener to continuously monitor network change events from various sources (such as configuration change notifications from the EMS northbound interface, work order system API, and resource system message queue). Once a predefined relevant event is captured, the listener will parse the event content, extract key information (such as the changed service ID, the network element involved, the port, etc.), and put it into an event processing queue to trigger the subsequent update process.

[0053] 406. Automatically trigger link rediscovery, topology update, and data synchronization processes based on network change events to maintain data consistency among multiple systems; In this embodiment, the event processing engine retrieves change events from the queue and automatically triggers the corresponding data update process according to the event type. For example, for a new service activation event, the system will re-execute the link discovery, topology construction, and audit process starting from step 102 for that service, and update the results to the topology library and audit report. At the same time, the system will write back the confirmed accurate resource usage information to the Integrated Resource Management System (IRMS) through the standard interface to ensure that the resource records in the IRMS are consistent with the actual network configuration. The entire process is executed automatically, ensuring that data across multiple systems can quickly converge to a consistent state after a change.

[0054] 407. Record change logs and upload them to the blockchain; In this embodiment, all network change operations triggered by automated processes, including key actions such as link discovery, topology updates, and data synchronization, are recorded in detail in an immutable change log. The operation content, operation time, operation result (success / failure), and the triggered event ID are recorded in detail. To further enhance the authority and auditability of the log, the system periodically uploads the hash value of the change log (or the log itself after de-identification and encryption) to a preset blockchain network (such as a consortium blockchain). By utilizing the distributed ledger and immutability of the blockchain, a reliable record is provided for network operation and maintenance operations, facilitating post-event auditing, accountability, and compliance verification.

[0055] In this embodiment of the invention, based on the successful audit, by identifying shared ports and creating unique monitoring entities and associated business logic identifiers, accurate mapping and alarm aggregation of physical faults to business impacts are achieved. Simultaneously, an event-driven incremental update and blockchain-based evidence storage mechanism is established to ensure real-time synchronization and reliable auditing of topology, data, and monitoring policies after network changes. This process optimizes the monitoring system, significantly reduces the number of alarms, and improves fault location efficiency. Furthermore, through automated and traceable closed-loop updates, the continuous consistency between operational data and the actual network state is ensured, constructing an intelligent operational closed loop with self-awareness and self-optimization capabilities, comprehensively enhancing network reliability and manageability.

[0056] The OTN smart link construction and auditing method in the embodiments of the present invention has been described above. The OTN smart link construction and auditing apparatus in the embodiments of the present invention is described below. Please refer to [link to description]. Figure 5 One embodiment of the OTN intelligent link construction and auditing device in this invention includes: The data acquisition, preprocessing, and storage module 501 is used to acquire raw data from multiple heterogeneous data sources, perform data preprocessing on the raw data to obtain preprocessed data, and store the preprocessed data in a distributed data lake. The association tracing module 502 is used to associate business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using business identifiers as key keys, and to trace the connection segments hop by hop through the cross-connection tracing algorithm to form a complete sequence of connection segments. The aggregation generation module 503 is used to automatically generate a multi-layer network topology map based on the connection segment sequence, and to aggregate the paths of the multi-layer network topology map using a graph search algorithm. The multi-layer network topology map includes physical layer topology, channel layer topology and service layer topology. Audit output module 504 is used to perform multi-dimensional audits on each service link in the multi-layer network topology diagram to audit configuration integrity, resource consistency, performance reachability and policy compliance, and output audit results. The identification, creation, and establishment module 505 is used to identify the common ports of the business links when the audit results are passed, create a unique SNC monitoring entity for the common ports, generate a business-level SNC logical identifier for each business link, and establish the association between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation.

[0057] In this embodiment, a multi-layer association mapping model is used to associate business logic information and physical resource information in the distributed data lake with business identifiers as the key. A cross-connection tracing algorithm is used to trace connection segments hop-by-hop, forming a complete sequence of connection segments. A multi-layer network topology map is automatically generated based on this sequence, and a graph search algorithm is used to aggregate the paths in the multi-layer network topology map. Each business link in the multi-layer network topology map undergoes multi-dimensional auditing to verify configuration integrity, resource consistency, performance reachability, and policy compliance. When the audit results are satisfactory, the common ports of the business links are identified, a unique SNC monitoring entity is created for each common port, and a business-level SNC logical identifier is generated for each business link. An association is established between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation. Through multi-source data fusion, intelligent topology construction, multi-dimensional auditing, and monitoring entity optimization, the automation, data accuracy, and operational efficiency of OTN network operation and maintenance are comprehensively improved, reducing reliance on manual labor and enhancing network reliability and manageability.

[0058] Please see Figure 6 Another embodiment of the OTN intelligent link construction and auditing device in this invention includes: The data acquisition, preprocessing, and storage module 501 is used to acquire raw data from multiple heterogeneous data sources, perform data preprocessing on the raw data to obtain preprocessed data, and store the preprocessed data in a distributed data lake. The association tracing module 502 is used to associate business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using business identifiers as key keys, and to trace the connection segments hop by hop through the cross-connection tracing algorithm to form a complete sequence of connection segments. The aggregation generation module 503 is used to automatically generate a multi-layer network topology map based on the connection segment sequence, and to aggregate the paths of the multi-layer network topology map using a graph search algorithm. The multi-layer network topology map includes physical layer topology, channel layer topology and service layer topology. Audit output module 504 is used to perform multi-dimensional audits on each service link in the multi-layer network topology diagram to audit configuration integrity, resource consistency, performance reachability and policy compliance, and output audit results. The identification, creation, and establishment module 505 is used to identify the common ports of the business links when the audit results are passed, create a unique SNC monitoring entity for the common ports, generate a business-level SNC logical identifier for each business link, and establish the association between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation. In this embodiment, the data acquisition, preprocessing, and storage module 501 includes: an acquisition unit 5011, used to asynchronously acquire raw data from multiple heterogeneous data sources in parallel, including the northbound interface of the network element management system, the integrated resource management system, the database interface of the customer relationship management system, and the network configuration file backup server; a cleaning, transformation, and standardization unit 5012, used to clean, format, transform, and standardize the raw data, including deduplication and filling in missing values, formatting and transformation including unifying timestamps and rate units, and standardization including mapping the private attributes of different vendors' devices to a standard information model; and a storage unit 5013, used to store the processed preprocessed data in a unified distributed data lake.

[0059] In this embodiment, the association tracing module 502 includes: an association unit 5021, used to associate business logic information and physical resource information in the distributed data lake with the business identifier as the key based on a preset multi-layer association mapping model; a parsing tracing unit 5022, used to parse the cross-connect configuration data and, starting from the business terminal port, trace the flow relationship from the source port and time slot to the destination port and time slot hop by hop through the cross-connect tracing algorithm until the peer terminal port; an identification and recording unit 5023, used to identify and record the input and output ports, ODUk channel type, time slot number and network elements passed through each hop during the tracing process, forming a complete connection segment sequence; and an injection unit 5024, used to inject the business logic information as a tag onto all the connection segment resources it occupies.

[0060] In this embodiment, the aggregation generation module 503 includes: an abstraction unit 5031, used to abstract network elements of the connection segment sequence into topology nodes and port pairs with cross-connection relationships into topology edges; a construction unit 5032, used to construct a multi-layer network topology graph based on topology nodes and topology edges; an aggregation unit 5033, used to aggregate all connection segments corresponding to a customer service in the multi-layer network topology graph in sequence using a graph search algorithm, wherein the multi-layer network topology graph includes physical layer topology, channel layer topology, and service layer topology; and a display unit 5034, used to display the physical layer topology, channel layer topology, and service layer topology in layers or in a fusion using force-directed graph or tree diagram visualization technology.

[0061] In this embodiment, the audit output module 504 includes: a first inspection unit 5041, used to check whether each service link in the multi-layer network topology diagram has a complete end-to-end cross-connect configuration, and obtain a configuration integrity check result; a verification unit 5042, used to verify whether the port and time slot resources actually occupied by the link are consistent with the pre-occupied resource records in the integrated resource system, and obtain a resource consistency verification result; a judgment unit 5043, used to judge whether the performance of each physical channel segment on each service link in the multi-layer network topology diagram is within the normal threshold based on the optical power and bit error rate performance data collected in near real-time, and obtain a performance reachability judgment result; a second inspection unit 5044, used to check whether the link path conforms to the predetermined policy according to the service level agreement requirements, and obtain a policy compliance check result; and a merging unit 5045, used to merge the integrity check result, resource consistency verification result, performance reachability judgment result, and policy compliance check result into an audit result.

[0062] In this embodiment, the identification, creation, generation, and establishment module 505 includes: an identification and creation unit 5051, used to identify the common port of the business link and create a unique SNC monitoring entity for the common port when the audit result is passed; a generation and establishment unit 5052, used to generate a business-level SNC logical identifier for each business link and establish the association relationship between the business-level SNC logical identifier and the unique SNC monitoring entity; and a location, merging, and generation unit 5053, used to locate all affected customer business lists through the association relationship and merge them to generate a root cause alarm when the unique SNC monitoring entity fails.

[0063] In this embodiment, the system further includes: a setup module 506 for establishing an event-driven incremental update mechanism; a monitoring module 507 for monitoring network change events based on the incremental update mechanism; a triggering module 508 for automatically triggering link rediscovery, topology update, and data synchronization processes based on network change events to maintain data consistency among multiple systems; and a record upload module 509 for recording change logs and uploading the change logs to the blockchain.

[0064] above Figure 5 and Figure 6 The OTN intelligent link construction and auditing device in this embodiment of the invention is described in detail from the perspective of modular functional entities. The OTN intelligent link construction and auditing device in this embodiment of the invention is described in detail from the perspective of hardware processing.

[0065] Figure 7 This is a schematic diagram of the structure of an OTN smart link construction and auditing device 600 provided in an embodiment of the present invention. The OTN smart link construction and auditing device 600 can vary significantly due to different configurations or performance. It may include one or more central processing units (CPUs) 610 (e.g., one or more processors) and a memory 620, and one or more storage media 630 (e.g., one or more mass storage devices) for storing application programs 633 or data 632. The memory 620 and storage media 630 can be temporary or persistent storage. The program stored in the storage media 630 may include one or more modules (not shown in the diagram), each module may include a series of instruction operations on the OTN smart link construction and auditing device 600. Furthermore, the processor 610 may be configured to communicate with the storage media 630 and execute the series of instruction operations in the storage media 630 on the OTN smart link construction and auditing device 600 to implement the steps of the OTN smart link construction and auditing methods provided in the above-described method embodiments.

[0066] The OTN smart link construction and auditing device 600 may also include one or more power supplies 640, one or more wired or wireless network interfaces 650, one or more input / output interfaces 660, and / or one or more operating systems 631, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc. Those skilled in the art will understand that... Figure 7 The OTN smart link construction and auditing equipment structure shown does not constitute a limitation on OTN smart link construction and auditing equipment. It may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0067] The present invention also provides a computer-readable storage medium, which can be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium, wherein the computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the steps of the OTN smart link construction and auditing method.

[0068] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system, device, or unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0069] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0070] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for constructing and auditing OTN intelligent links, characterized in that, include: Raw data is collected from multiple heterogeneous data sources, the raw data is preprocessed to obtain preprocessed data, and the preprocessed data is stored in a distributed data lake; Based on a pre-defined multi-layer association mapping model, business logic information and physical resource information in the distributed data lake are associated with business identifiers as key keys, and the connection segments are traced hop by hop through a cross-connection tracing algorithm to form a complete sequence of connection segments. A multi-layer network topology map is automatically generated based on the connection segment sequence, and the paths of the multi-layer network topology map are aggregated using a graph search algorithm. The multi-layer network topology map includes physical layer topology, channel layer topology, and service layer topology. Perform multi-dimensional audits on each service link in the multi-layer network topology diagram to audit configuration integrity, resource consistency, performance reachability, and policy compliance, and output the audit results; When the audit result is passed, the common port of the business link is identified, a unique SNC monitoring entity is created for the common port, and a business-level SNC logical identifier is generated for each business link. The association between the business-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation.

2. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, The process of collecting raw data from multiple heterogeneous data sources, preprocessing the raw data to obtain preprocessed data, and storing the preprocessed data in a distributed data lake includes: Raw data is collected asynchronously from multiple heterogeneous data sources in parallel. These data sources include the northbound interface of the network element management system, the integrated resource management system, the database interface of the customer relationship management system, and the network configuration file backup server. The raw data is cleaned, formatted, and standardized. The cleaning includes deduplication and filling in missing values. The formatting includes unifying timestamps and rate units. The standardization includes mapping the proprietary attributes of different manufacturers' devices to a standard information model. The preprocessed data is stored in a unified distributed data lake.

3. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, The pre-defined multi-layer association mapping model associates business logic information and physical resource information in the distributed data lake using business identifiers as key keys, and traces connection segments hop-by-hop through a cross-connection tracing algorithm to form a complete sequence of connection segments, including: Based on a pre-defined multi-layer association mapping model, business logic information and physical resource information in the distributed data lake are associated using business identifiers as key keys. Parse the cross-connect configuration data, and starting from the service terminal port, use the cross-connect tracing algorithm to trace the flow relationship between the source port, time slot to the destination port and time slot hop by hop, until the peer terminal port; During the tracing process, the input and output ports, ODUk channel type, timeslot number, and network elements traversed by each hop are identified and recorded to form a complete sequence of connection segments. The business logic information is injected as a tag into all the connection segment resources it occupies.

4. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, The process involves automatically generating a multi-layer network topology map based on the connection segment sequence, and aggregating the paths in the multi-layer network topology map using a graph search algorithm. The multi-layer network topology map includes physical layer topology, channel layer topology, and service layer topology, and includes: The network elements of the connection segment sequence are abstracted as topology nodes, and the port pairs with cross-connection relationships are abstracted as topology edges; Construct a multi-layer network topology graph based on the topology nodes and topology edges; A graph search algorithm is used to aggregate all connection segments corresponding to a customer service in the multi-layer network topology graph in sequence. The multi-layer network topology graph includes physical layer topology, channel layer topology, and service layer topology. Force-directed graph or tree diagram visualization technology is used to display the physical layer topology, channel layer topology and business layer topology in layers or in a fusion.

5. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, The process involves multi-dimensional auditing of each service link in the multi-layer network topology to assess configuration integrity, resource consistency, performance reachability, and policy compliance, and outputs audit results, including: Check whether each service link in the multi-layer network topology has a complete end-to-end cross-connect configuration, and obtain the configuration integrity check result; Verify whether the actual port and time slot resources occupied by the link are consistent with the pre-allocated resource records in the integrated resource system, and obtain the resource consistency verification results; Based on the optical power and bit error rate performance data collected in near real-time, it is determined whether the performance of each physical channel segment on each service link in the multi-layer network topology is within the normal threshold, and the performance reachability judgment result is obtained. According to the service level agreement requirements, check whether the link path conforms to the predetermined policy and obtain the policy compliance check result; The integrity check result, the resource consistency verification result, the performance reachability judgment result, and the policy compliance check result are combined into an audit result.

6. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, When the audit result passes, the common port of the business link is identified, a unique SNC monitoring entity is created for the common port, and a business-level SNC logical identifier is generated for each business link. The association between the business-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation, including: When the audit result is passed, the common port of the business link is identified, and a unique SNC monitoring entity is created for the common port; A business-level SNC logical identifier is generated for each of the aforementioned business links, and an association is established between the business-level SNC logical identifier and the unique SNC monitoring entity. When the unique SNC monitoring entity fails, the list of all affected customer services is located through the association relationship, and a root cause alarm is generated.

7. The OTN intelligent link construction and auditing method according to claim 1, characterized in that, When the audit result passes, the common port of the business link is identified, a unique SNC monitoring entity is created for the common port, and a business-level SNC logical identifier is generated for each business link. The association between the business-level SNC logical identifier and the unique SNC monitoring entity is established to achieve alarm aggregation. The process also includes: Establish an event-driven incremental update mechanism; Monitor network change events based on the aforementioned incremental update mechanism; The network change event automatically triggers link rediscovery, topology update, and data synchronization processes to maintain data consistency among multiple systems. Record change logs and upload them to the blockchain.

8. An OTN intelligent link construction and auditing device, characterized in that, include: The data acquisition, preprocessing, and storage module is used to acquire raw data from multiple heterogeneous data sources, perform data preprocessing on the raw data to obtain preprocessed data, and store the preprocessed data in a distributed data lake. The association tracing module is used to associate business logic information and physical resource information in the distributed data lake based on a preset multi-layer association mapping model, using business identifiers as key keys, and to trace connection segments hop by hop through a cross-connection tracing algorithm to form a complete sequence of connection segments. An aggregation generation module is used to automatically generate a multi-layer network topology map based on the connection segment sequence, and to aggregate the paths of the multi-layer network topology map using a graph search algorithm. The multi-layer network topology map includes physical layer topology, channel layer topology, and service layer topology. The audit output module is used to perform multi-dimensional audits on each service link in the multi-layer network topology diagram to audit configuration integrity, resource consistency, performance reachability and policy compliance, and output the audit results. The identification, creation, and establishment module is used to identify the common port of the business link when the audit result is passed, create a unique SNC monitoring entity for the common port, generate a business-level SNC logical identifier for each business link, and establish the association between the business-level SNC logical identifier and the unique SNC monitoring entity to achieve alarm aggregation.

9. An OTN intelligent link construction and auditing device, characterized in that, The OTN intelligent link construction and auditing device includes: a memory and at least one processor, wherein the memory stores instructions; At least one of the processors invokes the instructions in the memory to cause the OTN smart link construction and auditing device to perform the steps of the OTN smart link construction and auditing method as described in any one of claims 1-7.

10. A computer-readable storage medium storing instructions thereon, characterized in that, When the instructions are executed by the processor, they implement the various steps of the OTN smart link construction and auditing method as described in any one of claims 1-7.

Images