Heterogeneous backup method and system for high-speed data transmission

Abstract

According to the heterogeneous backup method and system for high-speed data transmission provided by the invention, the optical fiber topology and the TLK2711 topology are optimized, and the optical fiber topology and the TLK2711 topology are used as heterogeneous backups to ensure that transmission is not interrupted during fault restart. The method comprises the following steps: identifying nodes and paths in an optical fiber topology through signal transmission characteristics, recording attribute information, and performing optimization through a genetic algorithm; dynamically adjusting the flow of the optical fiber topology node through a load balancing algorithm; tLK2711 is identified through comprehensive use of various measuring tools, and optimization is carried out through DQN; software is used for dynamically displaying the topology analysis chart, and the path is backed up; if a certain node of one topology is detected to be invalid due to single event upset, marking red at the position by software, and switching to another topology structure for transmission; and restarting the topology with the problem, detecting the node, and summarizing detailed processes to an administrator. And the overall performance and reliability of high-speed data transmission are greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of topology optimization switching, and in particular to a heterogeneous backup method and system for high-speed data transmission, and more particularly to a method for heterogeneous backup of optical fiber topology and TLK2711 topology. Background Art

[0002] With the rapid development of information technology and the rapid growth of data volume, high-speed data transmission has become a key requirement of modern communication networks. As a high-speed data transmission medium, optical fiber is widely used in various transmission environments due to its advantages such as high bandwidth, low latency and strong anti-interference ability.

[0003] Current high-speed data transmission relies primarily on fiber optic networks. While fiber optics excel in many areas, they are insufficient to meet all requirements due to the limitations of the transmission environment. Furthermore, fiber optic networks have a relatively simple topology. A failure in the fiber optic network severely impacts data transmission, making data continuity and smoothness impossible to guarantee. Furthermore, the current lack of alternative high-speed topologies to complement fiber optic networks makes the overall transmission system vulnerable to unexpected issues.

[0004] The lack of a load balancing mechanism makes certain nodes and paths prone to overload. When network traffic is concentrated on a few paths, the transmission performance of these paths will be significantly reduced, and in severe cases, the network will even be paralyzed. Other unsaturated paths will remain idle, failing to fully utilize network resources.

[0005] When troubleshooting, the typical approach is to restart the relevant nodes or paths. This approach is not only time-consuming but also interrupts data transmission during the restart, impacting the user experience. Furthermore, the network state after the restart is rarely restored to its pre-fault optimal state, leaving room for improvement in both the efficiency and effectiveness of troubleshooting.

[0006] The lack of effective dynamic monitoring and early warning mechanisms makes it impossible to detect and predict status changes of nodes and paths in real time. Once a node fails due to a single-event upset or other cause, the system struggles to respond in a timely manner, leading to fault propagation and data interruption.

[0007] In summary, current high-speed data transmission networks have significant shortcomings in terms of transmission environment diversity, topology optimization, load balancing, and fault handling. These issues not only limit network performance but also, to a certain extent, affect the reliability and continuity of data transmission. Therefore, a heterogeneous backup method that can dynamically optimize topology, achieve load balancing, and provide efficient fault handling mechanisms is urgently needed to improve the overall performance and reliability of high-speed data transmission.

[0008] Patent document CN114244721A (application number: 202111573822.5) discloses a method for automatic discovery and maintenance of optical fiber topology. The invention is based on a reciprocal optical fiber ring network composed of several multi-service transmission equipment simulators. The master station updates and maintains the network topology in real time according to the main fiber and backup fiber status information reported by each slave station, and sends a full network topology message when the topology changes. After receiving the message, the slave station maintains the local optical fiber forwarding path in real time and records the network topology, thereby realizing automatic discovery and maintenance of the optical fiber topology.

[0009] Patent document CN116338950A (application number: 202310370474.4) discloses a fiber path arrangement method and system based on an OXC all-optical backplane. The method includes: obtaining the size information of a target OXC all-optical backplane and a fiber data description of the fiber line; constructing an objective function based on the fiber data description, using the fiber arrangement path as the independent variable and the size information of the target OXC all-optical backplane as the dependent variable, and using the objective function to obtain multiple groups of fiber topologies; assigning values ​​to each group of fiber topologies based on preset prerequisites, and obtaining fiber arrangement parameters for each group of fiber topologies based on the assignment results; spatially mapping the fiber arrangement parameters of each group of fiber topologies through a virtual mapping space, selecting the optimal fiber topology based on the mapping results, and arranging the fibers according to the target fiber design path of the optimal fiber topology. This achieves size compression of the optical backplane to make it more adaptable and compatible.

[0010] Patent document CN105681093A (application number: 201610057832.6) discloses a protocol for displaying the fiber topology of an MSTP fiber ring network. When deploying an MSTP fiber ring network, MSTP devices are often located far apart, making it difficult to determine device connectivity and faults. By using this protocol, network administrators can access the master station of the MSTP fiber ring network through the network management system and obtain the topology of the MSTP fiber ring network. This allows them to accurately determine station and fiber breaks, accurately locate faults, and quickly commission the MSTP fiber ring network.

[0011] Patent document CN110617912A (application number: 201910908458.X) discloses a gas pressure monitoring system based on fiber-optic white-light interferometry technology, comprising a white-light interferometer demodulator, a fiber-optic topological network, and a pressure sensor group. The white-light interferometer demodulator includes a white-light light source, a first fiber-optic circulator, a second fiber-optic circulator, a first fiber-optic half-mirror, a reflector, a first self-focusing lens, a stepper motor, a data acquisition card, a photodetector, and a computer. The fiber-optic topological network is composed of optical switches or demultiplexers and connected in a tree-like structure. The pressure sensor group includes multiple identical pressure sensors, each comprising an elastic membrane, a reflective coating, a sensor housing, a standard pressure inert gas, transparent glass, a second fiber-optic half-mirror, and a second self-focusing lens. This system uses optical sensors to monitor the internal pressure of a pressure vessel and is particularly suitable for pressure monitoring of gas pressure vessels under harsh conditions.

[0012] Patent document CN118300688A (application number: 202311288186.0) discloses a system and method for establishing an information transmission channel based on an optical fiber link, including an optical transmission unit, an optical branching unit, an optical interception and analysis unit, an information access / forwarding unit, an optical modulation injection unit and an optical receiving unit; this invention establishes an information transmission channel based on an optical fiber link and can temporarily establish a real-time, convenient, and high-speed information transmission channel at any point where the optical fiber link passes, providing technical means for emergency communications and temporary high-traffic transmission on private networks. Summary of the Invention

[0013] In view of the defects in the prior art, the present invention aims to provide a heterogeneous backup method and system for high-speed data transmission.

[0014] A heterogeneous backup method for high-speed data transmission provided by the present invention includes:

[0015] Step S1: Identify nodes and paths in the fiber topology and optimize the fiber topology using a genetic algorithm;

[0016] Step S2: Dynamically adjust the fiber topology node traffic through a load balancing algorithm;

[0017] Step S3: Identify the nodes and paths of the TLK2711 topology and optimize the TLK2711 topology structure through DQN;

[0018] Step S4: The optimized optical fiber topology and the optimized TLK2711 topology are set to a redundant relationship, and the optimized optical fiber topology and the optimized TLK2711 topology are monitored in real time. When the optimized optical fiber topology or the optimized TLK2711 topology fails, the path of the other topology is switched for data transmission.

[0019] Preferably, the step S1 includes:

[0020] Step S1.1: Using an optical time domain reflectometer, optical spectrum analyzer, optical power meter, phase measurement equipment, and dispersion meter, a test signal is sent and its reflection and scattering in the optical fiber is detected to obtain information including optical fiber signal strength, wavelength, phase change, attenuation coefficient, dispersion characteristics, scattering characteristics, path length, and transmission delay;

[0021] Step S1.2: Analyze the signal transmission characteristics between two nodes in the optical fiber topology, including signal attenuation, dispersion, and phase variation, to determine the existence of a path and its attributes, including path length, bandwidth, and transmission quality.

[0022] Step S1.3: Generate an initial population by encoding the topology structure into chromosomes, where each chromosome represents a network configuration. Each individual in the population is evaluated for its performance using a fitness function. Through operations including selection, crossover, and mutation, continuous iterations are performed to gradually optimize the topology of the optical fiber and obtain the optimized optical fiber topology.

[0023] Preferably, step S2 includes: monitoring the traffic conditions of each node and path in real time through a load balancing algorithm, and dynamically adjusting the transmission path of the data flow based on the current network status and a preset load threshold;

[0024] When the traffic on a certain path approaches its maximum carrying capacity, and the difference between the traffic on the path and its maximum carrying capacity meets the preset requirements, the load balancing algorithm will redistribute the preset data flow to other unsaturated paths, thereby evenly distributing the data traffic to multiple paths.

[0025] Preferably, step S2 includes:

[0026] Build a prediction model based on a deep learning network and use historical traffic data to train the prediction model to obtain a trained prediction model;

[0027] Use the trained prediction model to predict the traffic on the path in the topology structure;

[0028] When the predicted traffic exceeds the maximum carrying capacity, the traffic on the current path is redistributed to other paths through the load balancing algorithm.

[0029] Preferably, step S3 includes:

[0030] Step S3.1: Use an oscilloscope to measure the voltage waveform at each node in the circuit, use a multimeter to measure the voltage, current, and resistance, use a network analyzer to measure the frequency response characteristics, use a spectrum analyzer to measure the signal spectrum, use a logic analyzer to capture the timing relationship of the digital signal, and use a circuit tracer to trace the physical connection path of the wire;

[0031] Step S3.2: Preprocessing the collected data and extracting key features based on the preprocessed data, the key features including: voltage waveform features, voltage, current and resistance features, frequency response features, signal spectrum features, timing relationship features, and physical connection path features;

[0032] Step S3.3: constructing a preliminary topology map of the circuit based on the extracted key features;

[0033] Step S3.4: Use the data from the circuit tracer to determine the physical connection status of each node and wire; combine it with the data from other measurement tools to verify and correct the connection relationships and parameters in the topology diagram.

[0034] Preferably, the step S3 further includes:

[0035] Step S3.1: defining a spatial state S representing specific parameters of the TLK2711 topology under different configurations and operating conditions of the TLK2711, and an action space A including methods for adjusting or configuring the above-collected TLK2711 topology parameters;

[0036] Step S3.2: Construct the network Q(s,a;θ); where the current state s is the input of the network Q, a is the action performed, Q(s,a) is the cumulative reward obtained, and θ represents the weight of the network;

[0037] Step S3.3: Initialize θ, initialize the weights θ' of the target network and make them the same as the weights of the Q network;

[0038] Step S3.4: Starting from the initial state S0, use the ε-greedy strategy to select actions: when the action is randomly selected with probability ε, the action is selected with probability 1-ε according to arg max a Q(s,a;θ) performs actions; where ε is the exploration rate, which gradually decreases as the training process progresses;

[0039] Step S3.5: After executing action a, the system enters a new state s` and obtains an immediate reward r that reflects the specific performance of the TLK2711 topology network;

[0040] Step S3.6: continuously store (s, a, r, s`) generated in the process of steps S3.2 to S3.5 into the buffer;

[0041] Step S3.7: Sample a preset number of (s j ,a j ,r j ,s` j ), where j represents the jth sample sampled in batches, and the Q value of the target is calculated:

[0042]

[0043] Among them, γ is the discount factor, which indicates the importance of future rewards;

[0044] Calculate the loss function L(θ):

[0045]

[0046] Where N is the specific size of the mini-batch;

[0047] Step S3.8: Update θ using gradient descent:

[0048]

[0049] Among them, α is the learning degree; and θ is updated to the target network regularly;

[0050] Repeat steps S3.1 to S3.8 until the overall performance of the TLK2711 topology meets the preset requirements.

[0051] Preferably, step S4 includes: continuously monitoring the status of all nodes in the optimized optical fiber topology and the optimized TLK2711 topology through a monitoring tool; the node status includes the real-time working status, signal strength and error type of the node; when an abnormality is detected in a node, an alarm mechanism is immediately triggered, and the node is marked red on the topology map and displayed through the interface.

[0052] Preferably, before switching to another topology path for data transmission, the status of each node and link in the normally working path is detected in real time, wherein the link status includes checking the health status of the node, the signal strength and bandwidth of the link; and a path of a topology structure that meets the preset requirements is selected for data transmission;

[0053] For the switch from fiber topology to TLK2711 topology, the routing table is dynamically modified to reroute the data packet from the upstream node of the fiber path to the corresponding node of the TLK2711 path, and the data continues to be transmitted through the TLK2711 path until it reaches the target node;

[0054] For the switch from TLK2711 topology to fiber topology, the routing table is dynamically modified to reroute the data packet from the upstream node of the TLK2711 path to the corresponding node of the fiber path, and the data continues to be transmitted through the fiber path until it reaches the destination node;

[0055] After the switch, the system checks whether data packets can be transmitted correctly through the new path and verifies whether the new path has sufficient bandwidth and low latency to meet current network requirements. If the verification passes, the system confirms that the switch is successful and continues to monitor the status of the new path.

[0056] Preferably, the method further comprises:

[0057] Isolate topology fault nodes and mark them as pending for repair. Restart is prioritized, including attempting to restart failed nodes, recording status changes before and after the restart, and performing hardware and software tests on the nodes. The test results are recorded and automatically generated into a report.

[0058] Use monitoring tools to confirm that previously failed nodes have resumed normal operation; after restarting the node, record the status changes of the restarted node; before switching paths, suspend the transmission of new data flows through the temporary path; and perform a status backup of the currently used path, including the status of currently transmitted data packets and routing table configuration;

[0059] Dynamically modify the network routing table to reroute data packets from the temporarily used upstream nodes of the topology to the corresponding nodes of the restarted and recovered topology. After modifying the routing table, send test data packets through the network testing tool to check whether the test data packets can be correctly transmitted to the target node through the restored path. Then verify whether the new path has sufficient bandwidth and low latency to meet the current network requirements.

[0060] A high-speed data transmission heterogeneous backup system provided by the present invention includes:

[0061] Module M1: Identify nodes and paths in the fiber topology and optimize the fiber topology using genetic algorithms;

[0062] Module M2: Dynamically adjusts the traffic of fiber topology nodes through load balancing algorithm;

[0063] Module M3: Identify the nodes and paths of the TLK2711 topology and optimize the TLK2711 topology structure through DQN;

[0064] Module M4: Sets the optimized optical fiber topology and the optimized TLK2711 topology to a redundant relationship, and monitors the optimized optical fiber topology and the optimized TLK2711 topology in real time. When the optimized optical fiber topology or the optimized TLK2711 topology fails, switches to another topology path for data transmission.

[0065] Compared with the prior art, the present invention has the following beneficial effects:

[0066] 1. This invention significantly improves the reliability and stability of high-speed topology data transmission by dynamically optimizing the topology structure, achieving load balancing, and using heterogeneous backup with an efficient fault handling mechanism;

[0067] 2. The present invention identifies nodes and paths in the optical fiber topology based on signal transmission characteristics, records their attribute information, and then optimizes them through genetic algorithms. This allows for precise identification of each node and path in the network, ensuring the accuracy and optimization efficiency of the network topology. The application of genetic algorithms further enhances the optimization of the network structure, ensuring the optimal selection of data transmission paths, thereby significantly improving overall network performance and transmission efficiency. In addition, detailed analysis of signal transmission characteristics can identify and resolve potential transmission issues, such as signal attenuation and dispersion, thereby improving the quality and stability of data transmission.

[0068] 3. This invention dynamically adjusts fiber topology node traffic through a load balancing algorithm, enabling real-time monitoring and adjustment of traffic flow at each node and path, preventing overload on certain paths and ensuring efficient utilization of network resources. The dynamic adjustment function of the load balancing algorithm can redistribute data flows to unsaturated paths, avoiding single points of failure and network congestion, thereby improving the overall transmission efficiency and reliability of the network.

[0069] 4. The present invention uses a combination of multiple measurement tools to identify the basic situation of the TLK2711 topology structure, and then optimizes it through the Deep Q network. This process can comprehensively obtain circuit characteristic data, ensuring accurate identification and modeling of the TLK2711 topology structure. The application of the Deep Q network has significant advantages in optimizing transmission paths in complex circuit environments, and can find the optimal transmission path, improving the stability and efficiency of data transmission.

[0070] 5. This invention uses advanced data analysis and visualization algorithms to generate a topology analysis diagram, which is dynamically displayed on the interface. This process provides an intuitive display of network status, helping administrators understand network status and performance changes in real time. The dynamic display function ensures that administrators can promptly discover and address potential problems, reducing troubleshooting time. The real-time monitoring function continuously monitors the status of all nodes in the network to ensure the continuous and stable data transmission.

[0071] 6. If a topology node is detected to have failed due to a single-particle upset, the system can automatically switch to the backup topology to ensure uninterrupted data transmission. This mechanism greatly improves the reliability and availability of the network. The restart and detailed detection process of the faulty node can help identify and solve the problem, and a detailed report will be summarized to the administrator to facilitate subsequent maintenance and optimization. Through the synergy of these steps, the system can ensure high reliability and stability of the topology while ensuring high-speed data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] Other features, objects and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments with reference to the following drawings:

[0073] Figure 1 It is a flow chart of the heterogeneous backup method for high-speed data transmission of the present invention. DETAILED DESCRIPTION

[0074] The present invention will be described in detail below with reference to specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those skilled in the art, several changes and improvements can be made without departing from the scope of the present invention. These all fall within the scope of protection of the present invention.

[0075] Example 1

[0076] The purpose of the present invention is to provide a heterogeneous backup method and system for high-speed data transmission, which optimizes the optical fiber topology and the TLK2711 topology respectively. When one of the topologies fails, the data is temporarily transmitted through the other topology. The failed topology is restored by restarting, thereby ensuring the uninterrupted and reliable high-speed data transmission.

[0077] The heterogeneous backup method of high-speed data transmission, such as Figure 1 As shown, including:

[0078] Step S1: Identify nodes and paths in the optical fiber topology based on signal transmission characteristics, record attribute information, and optimize using a genetic algorithm;

[0079] Step S2: Dynamically adjust the fiber topology node traffic through a load balancing algorithm;

[0080] Step S3: A variety of measurement tools are used to identify the basic situation of the TLK2711 topology, and then optimized through DQN;

[0081] Step S4: Using the software, through advanced data analysis and visualization algorithms, a topology analysis diagram is generated, which is dynamically displayed on the interface, and the path is backed up;

[0082] Step S5: If it is detected that a node in one of the topologies fails due to a single event upset, the software will mark the location in red and switch to another topology for transmission;

[0083] Step S6: The topology with the problem is restarted and the node is tested, and the detailed process is summarized to the administrator.

[0084] Specifically, step S1 includes: for the optical fiber topology, through the comprehensive use of a high-precision optical time domain reflectometer, an optical spectrum analyzer, an optical power meter, a phase measurement device and a dispersion tester, sending a test signal and detecting its reflection and scattering in the optical fiber, thereby obtaining detailed information on the optical fiber signal intensity, wavelength, phase change, attenuation coefficient, dispersion characteristics, scattering characteristics, path length and transmission delay.

[0085] By analyzing the signal transmission characteristics between two nodes, including signal attenuation, dispersion, and phase change, the existence of a path and its properties, such as path length, bandwidth, and transmission quality, can be determined.

[0086] A genetic algorithm is used to optimize the topology. This algorithm encodes the topology as chromosomes, each representing a possible network configuration, to generate an initial population. Each individual in the population is evaluated using a fitness function designed based on network performance requirements, such as transmission latency, bandwidth utilization, and redundancy. Through operations such as selection, crossover, and mutation, the algorithm continuously iterates and gradually optimizes the fiber topology, ultimately converging to an optimal or near-optimal topology.

[0087] Specifically, step S2 involves using a load balancing algorithm to monitor the traffic flow of each node and path in real time, and dynamically adjust the data flow transmission path based on the current network status and a preset load threshold. When the traffic flow on a path approaches its maximum carrying capacity, the algorithm automatically reallocates part of the data flow to other less-saturated paths, thereby evenly distributing the data flow across multiple paths.

[0088] Load balancing algorithms also consider the network topology and connectivity between nodes to prevent overloading of certain paths. If a node's load is detected to be increasing, the algorithm can proactively shift some traffic to less-loaded nodes. Historical traffic data and forecasting models are often combined to predict future traffic trends, allowing for proactive optimization of network resource allocation.

[0089] Specifically, step S3 includes: for the TLK2711 topology, using an oscilloscope to measure the voltage waveform of each node in the circuit, using a multimeter to measure the voltage, current and resistance values, using a network analyzer to measure the frequency response characteristics, using a spectrum analyzer to measure the signal spectrum, using a logic analyzer to capture the timing relationship of the digital signal, and using a circuit tracer to trace the physical connection path of the wire.

[0090] The collected data is standardized to remove noise and outliers. Data from different measurement tools is then fused and integrated to form a comprehensive dataset containing all measurement information. Key features are extracted from this comprehensive dataset, including voltage waveform characteristics, voltage, current, and resistance characteristics, frequency response characteristics, signal spectrum characteristics, timing relationship characteristics, and physical connection path characteristics.

[0091] Generate a preliminary topology diagram of the circuit based on the feature extraction results. Use data from the circuit tracer to determine the physical connections of each node and wire. Combined with data from other measurement tools, verify and correct the connections and parameters in the topology diagram.

[0092] Specifically, step S3 further includes:

[0093] Define a state space S representing the specific parameters of the TLK2711 topology under different configurations and operating conditions, and an action space A containing methods for adjusting or configuring the collected TLK2711 topology parameters. The following s and a are the specific contents contained in these two spaces.

[0094] Construct a Q network Q(s,a;θ), where the current state s is the input of the network, a is the action performed, Q(s,a) is the cumulative reward obtained, and θ represents the weight of the network.

[0095] Initialize θ, initialize the weights θ' of the target network, and make them the same as the weights of the Q network.

[0096] Starting from the initial state S0, use the ε-greedy strategy to select actions: when the probability ε is randomly selected, the action is selected with probability 1-ε according to arg max a Q(s,a;θ) performs actions. Where ε is the exploration rate, which gradually decreases as the training process progresses.

[0097] By executing action a, the system enters a new state s` and obtains an immediate reward r that reflects the specific performance of the TLK2711 topology network.

[0098] Store (s,a,r,s`) generated by the above process into the buffer.

[0099] Sample a small batch (s) from the bufferj ,a j ,r j ,s` j ), where j represents the jth sample sampled in the mini-batch, and the Q value of the target is calculated:

[0100]

[0101] Where γ is a discount factor, which indicates the importance of future rewards.

[0102] Calculate the loss function L(θ):

[0103]

[0104] Here, N is the specific size of the mini-batch.

[0105] Update θ using gradient descent:

[0106]

[0107] Among them, α is the learning degree, and θ is updated to the target network periodically.

[0108] Repeat the above steps to optimize the overall performance of the TLK2711 topology.

[0109] Specifically, step S4 includes: after topology optimization, using software to generate a network analysis diagram using advanced data analysis and visualization algorithms, dynamically displaying the diagram on the interface, and backing up the path. The software integrates machine learning and big data processing technologies, enabling real-time acquisition and analysis of various network performance indicators. Through a built-in visualization module, the software automatically generates a netlist that dynamically reflects the optimized network status and performance changes.

[0110] The background color, grid switch, grid color, grid type, grid size, grid thickness, and single-machine background color of the drawing page can all be set. The user interface adopts responsive design and combines real-time streaming technology to achieve dynamic update and interactive display of data.

[0111] When the network status changes, the software automatically refreshes the relevant charts to ensure that users always see the latest network information. Users can customize the display of charts through interactive controls on the interface, selecting different time ranges and performance indicators for analysis.

[0112] The system continuously monitors the status of all nodes in the fiber and TLK2711 topologies through built-in monitoring tools. This tool detects the real-time operating status, signal strength, and potential errors of nodes. If a node fails due to a single-event upset (SEE), the system immediately triggers an alarm and marks the node in red on the topology map to draw the administrator's attention.

[0113] Specifically, step S5 includes the following: once a node failure is detected, the system automatically initiates a switching mechanism. This mechanism predefines the redundant relationship between the optical fiber and the TLK2711 topology. When a problem with the optical fiber topology occurs, the TLK2711 path is temporarily used for data transmission. The system dynamically modifies the routing table, rerouting data packets from the upstream node of the optical fiber path to the corresponding node of the TLK2711 path. Data transmission continues through the TLK2711 path until it reaches the target node, and vice versa. The switching mechanism includes a set of predefined routing rules, which are configured based on the network topology and traffic requirements. Before switching, the status of each node and link in the normally functioning path is monitored in real time, specifically checking the health of the node, the signal strength of the link, and the bandwidth.

[0114] When switching from fiber topology to TLK2711 topology, the system dynamically modifies the routing table, rerouting data packets from the upstream node of the fiber path to the corresponding node of the TLK2711 path, and continuing to transmit data through the TLK2711 path until it reaches the destination node. And vice versa.

[0115] After the switchover, the system checks whether data packets can be transmitted correctly through the new path and verifies whether the new path has sufficient bandwidth and low latency to meet current network requirements. If the verification is successful, the system will confirm the switchover is successful and continue to monitor the status of the new path.

[0116] Specifically, step S6 includes isolating the topologically faulty node and marking it for repair. Restarting the node is prioritized, including attempting to restart the failed node, recording state changes before and after the restart, and performing detailed hardware and software testing on the node. The test results are recorded in detail and automatically generated into a report, which is summarized and sent to the network administrator.

[0117] Use the system's monitoring tools to confirm that the previously failed node has resumed normal operation. The monitoring tools monitor the node's real-time operating status, signal strength, and possible errors. After the node is restarted, the system must record its status changes and perform detailed hardware and software testing. Before switching paths, pause new data flows through the temporary path. Perform a status backup of the currently used TLK2711 path. This includes the status of currently transmitted packets and routing table configuration.

[0118] Dynamically modify the network routing table to reroute packets from the temporarily used upstream node to the corresponding node in the restarted and restored topology. After modifying the routing table, send test packets using a network testing tool. Verify that the test packets can be transmitted correctly to the target node along the restored path. Verify that the new path has sufficient bandwidth and low latency to meet current network requirements.

[0119] Throughout the entire process, the system maintains real-time communication with administrators, notifying them of key developments and important events through a notification system. If administrator intervention is required, the system provides detailed instructions and recommended solutions. All relevant operations and test results are backed up in the system log.

[0120] The present invention also provides a heterogeneous backup system for high-speed data transmission. The heterogeneous backup system for high-speed data transmission can be implemented by executing the process steps of the heterogeneous backup method for high-speed data transmission. That is, those skilled in the art can understand the heterogeneous backup method for high-speed data transmission as a preferred implementation of the heterogeneous backup system for high-speed data transmission.

[0121] Those skilled in the art will appreciate that, in addition to implementing the system, device, and various modules provided by the present invention in purely computer-readable program code, it is entirely possible to implement the same program in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, and the like by logically programming the method steps. Therefore, the system, device, and various modules provided by the present invention can be considered a hardware component, and the modules included therein for implementing various programs can also be considered structures within the hardware component; the modules for implementing various functions can also be considered both software programs for implementing the method and structures within the hardware component.

[0122] The above describes specific embodiments of the present invention. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art may make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. The embodiments of this application and the features in the embodiments may be combined with each other in any manner unless there is a conflict.

Claims

1. A heterogeneous backup method for high-speed data transmission, characterized in that: include: Step S1: Identify nodes and paths in the fiber topology and optimize the fiber topology using a genetic algorithm; Step S2: Dynamically adjust the fiber topology node traffic through a load balancing algorithm; Step S3: Identify the nodes and paths of the TLK2711 topology and optimize the TLK2711 topology structure through DQN; Step S4: The optimized optical fiber topology and the optimized TLK2711 topology are set to a redundant relationship, and the optimized optical fiber topology and the optimized TLK2711 topology are monitored in real time. When the optimized optical fiber topology or the optimized TLK2711 topology fails, the path of the other topology is switched for data transmission.

2. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The step S1 comprises: Step S1.1: Using an optical time domain reflectometer, optical spectrum analyzer, optical power meter, phase measurement equipment, and dispersion meter, a test signal is sent and its reflection and scattering in the optical fiber is detected to obtain information including optical fiber signal strength, wavelength, phase change, attenuation coefficient, dispersion characteristics, scattering characteristics, path length, and transmission delay; Step S1.2: Analyze the signal transmission characteristics between two nodes in the optical fiber topology, including signal attenuation, dispersion, and phase variation, to determine the existence of a path and its attributes, including path length, bandwidth, and transmission quality. Step S1.3: Generate an initial population by encoding the topology structure into chromosomes, where each chromosome represents a network configuration. Each individual in the population is evaluated for its performance using a fitness function. Through operations including selection, crossover, and mutation, continuous iterations are performed to gradually optimize the topology of the optical fiber and obtain the optimized optical fiber topology.

3. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: Step S2 includes: monitoring the traffic conditions of each node and path in real time through a load balancing algorithm, and dynamically adjusting the transmission path of the data flow based on the current network status and a preset load threshold; When the traffic on a certain path approaches its maximum carrying capacity, and the difference between the traffic on the path and its maximum carrying capacity meets the preset requirements, the load balancing algorithm will redistribute the preset data flow to other unsaturated paths, thereby evenly distributing the data traffic to multiple paths.

4. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The step S2 comprises: Build a prediction model based on a deep learning network and use historical traffic data to train the prediction model to obtain a trained prediction model; Use the trained prediction model to predict the traffic on the path in the topology structure; When the predicted traffic exceeds the maximum carrying capacity, the traffic on the current path is redistributed to other paths through the load balancing algorithm.

5. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The step S3 comprises: Step S3.1: Use an oscilloscope to measure the voltage waveform at each node in the circuit, use a multimeter to measure the voltage, current, and resistance, use a network analyzer to measure the frequency response characteristics, use a spectrum analyzer to measure the signal spectrum, use a logic analyzer to capture the timing relationship of the digital signal, and use a circuit tracer to trace the physical connection path of the wire; Step S3.2: Preprocessing the collected data and extracting key features based on the preprocessed data, the key features including: voltage waveform features, voltage, current and resistance features, frequency response features, signal spectrum features, timing relationship features, and physical connection path features; Step S3.3: constructing a preliminary topology map of the circuit based on the extracted key features; Step S3.4: Use the data from the circuit tracer to determine the physical connection status of each node and wire; combine it with the data from other measurement tools to verify and correct the connection relationships and parameters in the topology diagram.

6. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The step S3 further includes: Step S3.1: defining a spatial state S representing specific parameters of the TLK2711 topology under different configurations and operating conditions of the TLK2711, and an action space A including methods for adjusting or configuring the above-collected TLK2711 topology parameters; Step S3.2: Construct the network Q(s,a;θ); where the current state s is the input of the network Q, a is the action performed, Q(s,a) is the cumulative reward obtained, and θ represents the weight of the network; Step S3.3: Initialize θ, initialize the weights θ' of the target network and make them the same as the weights of the Q network; Step S3.4: Starting from the initial state S0, use the ε-greedy strategy to select actions: when the action is randomly selected with probability ε, the action is selected with probability 1-ε according to arg max a Q(s,a;θ) performs actions; where ε is the exploration rate, which gradually decreases as the training process progresses; Step S3.5: After executing action a, the system enters a new state s` and obtains an immediate reward r that reflects the specific performance of the TLK2711 topology network; Step S3.6: continuously store (s, a, r, s`) generated in the process of steps S3.2 to S3.5 into the buffer; Step S3.7: Sample a preset number of (s j ,a j ,r j ,s` j ), where j represents the jth sample sampled in batches, and the Q value of the target is calculated: Among them, γ is the discount factor, which indicates the importance of future rewards; Calculate the loss function L(θ): Where N is the specific size of the mini-batch; Step S3.8: Update θ using gradient descent: Among them, α is the learning degree; and θ is updated to the target network regularly; Repeat steps S3.1 to S3.8 until the overall performance of the TLK2711 topology meets the preset requirements.

7. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The step S4 includes: continuously monitoring the status of all nodes in the optimized optical fiber topology and the optimized TLK2711 topology through a monitoring tool; the node status includes the real-time working status, signal strength and error type of the node; when an abnormality is detected in a node, an alarm mechanism is immediately triggered, and the node is marked in red on the topology map and displayed through the interface.

8. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: Before switching to another topology path for data transmission, the state of each node and link in the normally working path is detected in real time, wherein the link state includes checking the health state of the node, the signal strength and bandwidth of the link; and a path of a topology structure that meets the preset requirements is selected for data transmission; For the switch from fiber topology to TLK2711 topology, the routing table is dynamically modified to reroute the data packet from the upstream node of the fiber path to the corresponding node of the TLK2711 path, and the data continues to be transmitted through the TLK2711 path until it reaches the target node; For the switch from TLK2711 topology to fiber topology, the routing table is dynamically modified to reroute the data packet from the upstream node of the TLK2711 path to the corresponding node of the fiber path, and the data continues to be transmitted through the fiber path until it reaches the destination node; After the switch, the system checks whether data packets can be transmitted correctly through the new path and verifies whether the new path has sufficient bandwidth and low latency to meet current network requirements. If the verification passes, the system confirms that the switch is successful and continues to monitor the status of the new path.

9. The heterogeneous backup method for high-speed data transmission according to claim 1, characterized in that: The method further comprises: Isolate topology fault nodes and mark them as pending for repair. Restart is prioritized, including attempting to restart failed nodes, recording status changes before and after the restart, and performing hardware and software tests on the nodes. The test results are recorded and automatically generated into a report. Use monitoring tools to confirm that previously failed nodes have resumed normal operation; after restarting the node, record the status changes of the restarted node; before switching paths, suspend the transmission of new data flows through the temporary path; and perform a status backup of the currently used path, including the status of currently transmitted data packets and routing table configuration; Dynamically modify the network routing table to reroute data packets from the temporarily used upstream nodes of the topology to the corresponding nodes of the restarted and recovered topology. After modifying the routing table, send test data packets through the network testing tool to check whether the test data packets can be correctly transmitted to the target node through the restored path. Then verify whether the new path has sufficient bandwidth and low latency to meet the current network requirements.

10. A heterogeneous backup system for high-speed data transmission, characterized in that: include: Module M1: Identify nodes and paths in the fiber topology and optimize the fiber topology using genetic algorithms; Module M2: Dynamically adjusts the traffic of fiber topology nodes through load balancing algorithm; Module M3: Identify the nodes and paths of the TLK2711 topology and optimize the TLK2711 topology structure through DQN; Module M4: Sets the optimized optical fiber topology and the optimized TLK2711 topology to a redundant relationship, and monitors the optimized optical fiber topology and the optimized TLK2711 topology in real time. When the optimized optical fiber topology or the optimized TLK2711 topology fails, switches to another topology path for data transmission.

Images