Intelligent operation and maintenance method, system and device for heterogeneous system based on LSTM (Long Short Term Memory)

Abstract

The invention relates to the technical field of disaster recovery intelligent operation and maintenance, and discloses a heterogeneous system intelligent operation and maintenance method, system and device based on LSTM. The method comprises the following steps: collecting heterogeneous system data of a plurality of data sources; classifying the plurality of heterogeneous system data into first data and second data; performing anomaly prediction on the first data at the center node by using a first anomaly detection model to generate a first prediction result; performing anomaly prediction on the second data at the edge node by using a second anomaly detection model to generate a second prediction result; determining abnormal data in combination with the first prediction result and the second prediction result; performing synchronous processing on the abnormal data based on a preset network requirement; and performing backup processing on the abnormal data based on a preset network demand and the importance of the abnormal data. According to the invention, fault prediction and intelligent disaster recovery are realized, and the accuracy and real-time performance of data processing and prediction can be improved.

Description

Technical Field

[0001] The present invention relates to the field of disaster recovery intelligent operation and maintenance technology, and in particular to an LSTM-based heterogeneous system intelligent operation and maintenance method, system and device. Background Art

[0002] Distributed heterogeneous system is a complex system widely used in large-scale data management and processing. The system is mainly composed of multiple subsystems of different types and functions. These subsystems are distributed in different physical locations within the province. Through network connection and collaborative work, they jointly realize data collection, processing, storage and transmission. The heterogeneity of distributed heterogeneous systems is reflected in the diversity of their hardware and software, including different computing devices (such as servers, edge devices, sensors, etc.) and a variety of operating systems and application software. Such a system design can make full use of the computing resources and storage capabilities of different devices to achieve efficient data processing and resource optimization configuration. Provincial distributed heterogeneous systems have important advantages and challenges in practical applications. Its advantage is that the distributed architecture can effectively share the computing and storage loads, avoid single point failures, and improve the robustness and scalability of the system. At the same time, heterogeneous systems can flexibly adapt to different types of data and application requirements and provide efficient resource utilization.

[0003] However, distributed heterogeneous systems are currently facing problems such as complex data synchronization and difficult disaster recovery management. Due to the differences in data formats and communication protocols between subsystems, achieving data consistency and real-time synchronization has become a major technical difficulty. In addition, how to quickly restore data and services to ensure the continuity and reliability of the system when a system failure or disaster occurs is also an urgent problem to be solved in provincial distributed heterogeneous systems. These challenges provide a realistic background and technical basis for the proposal of this invention. Therefore, it is of great practical significance to study the data synchronization and disaster recovery intelligent operation and maintenance system of provincial distributed heterogeneous systems based on LSTM. Summary of the invention

[0004] The present invention provides a LSTM-based intelligent operation and maintenance method, system and device for heterogeneous systems, which realizes fault prediction and intelligent disaster recovery, and can improve the accuracy and real-time performance of data processing and prediction.

[0005] In order to solve the above technical problems, the present invention provides a heterogeneous system intelligent operation and maintenance method based on LSTM, comprising:

[0006] Collect heterogeneous system data from several data sources;

[0007] Classifying a plurality of the heterogeneous system data into first data and second data;

[0008] Performing anomaly prediction on the first data using a first anomaly detection model at a central node to generate a first prediction result;

[0009] Performing anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result;

[0010] Determine abnormal data by combining the first prediction result and the second prediction result;

[0011] Based on preset network requirements, synchronously process the abnormal data;

[0012] Based on preset network requirements and the importance of the abnormal data, the abnormal data is backed up.

[0013] Furthermore, the collection of heterogeneous system data from multiple data sources is specifically:

[0014] Identify a plurality of data sources of a heterogeneous system and establish a connection to each of the data sources;

[0015] Collecting a number of raw data from each of the data sources respectively;

[0016] Performing format unification processing on the original data;

[0017] Preprocess the data after format unification;

[0018] Use encrypted transmission protocol to encrypt pre-processed data;

[0019] Determine the encrypted data as heterogeneous system data

[0020] Further, the classifying of the plurality of heterogeneous system data into first data and second data is specifically:

[0021] Performing data size analysis and computational complexity analysis on the data of the plurality of heterogeneous systems;

[0022] Determine the heterogeneous system data whose data size does not exceed the preset first data range and whose calculation complexity does not exceed the preset first calculation range as the first data;

[0023] The heterogeneous system data whose data size exceeds a preset first data range or whose calculation complexity exceeds a preset first calculation range is determined as the second data.

[0024] Further, the first data is predicted abnormally by using a first abnormality detection model at the central node to generate a first prediction result, specifically:

[0025] Normalizing the first data to obtain normalized data;

[0026] Performing feature extraction on the normalized data to obtain first feature data;

[0027] A first anomaly detection model is used to perform anomaly prediction on the first feature data to obtain a first prediction result.

[0028] Furthermore, the first anomaly detection model is specifically:

[0029] Use the LSTM model to learn historical heterogeneous system data and form a time series prediction model;

[0030] Introducing an Attention mechanism into the time series prediction model, training the time series prediction model, and adjusting the attention of the time series prediction model;

[0031] The trained time series prediction model is determined as the first anomaly detection model.

[0032] Further, the edge node uses a second anomaly detection model to perform anomaly prediction on the second data to generate a second prediction result, specifically:

[0033] Performing data preprocessing on the second data to obtain preprocessed data;

[0034] Performing feature extraction on the preprocessed data to obtain second feature data;

[0035] A second anomaly detection model is used to perform anomaly prediction on the second feature data to obtain a second prediction result; wherein the second anomaly detection model is an LSTM model.

[0036] Furthermore, the abnormal data is synchronously processed based on the preset network requirements, specifically:

[0037] Detect the real-time network status of heterogeneous systems;

[0038] Determine a data synchronization strategy according to preset network requirements and the real-time network status; wherein the data synchronization strategy includes a timestamp synchronization strategy, an event-driven synchronization strategy, and a scheduled task synchronization strategy;

[0039] Based on the data synchronization strategy, a distributed computing framework is used to synchronize the abnormal data to each system node of the heterogeneous system.

[0040] Furthermore, the abnormal data is backed up based on the preset network requirements and the importance of the abnormal data, specifically:

[0041] Performing importance analysis on the abnormal data to generate importance analysis results;

[0042] Based on the importance analysis result, screening important abnormal data from the abnormal data;

[0043] Determine a data backup strategy based on preset network requirements; wherein the data backup strategy includes full backup and incremental backup;

[0044] Based on the data backup strategy, the abnormal data is backed up to a backup heterogeneous system.

[0045] The present invention provides a heterogeneous system intelligent operation and maintenance method based on LSTM, which collects heterogeneous system data from several data sources; classifies several heterogeneous system data into first data and second data; uses a first anomaly detection model at a central node to predict anomalies of the first data and generate a first prediction result; uses a second anomaly detection model at an edge node to predict anomalies of the second data and generate a second prediction result; determines abnormal data by combining the first prediction result and the second prediction result; performs synchronous processing on abnormal data based on preset network requirements; and performs backup processing on abnormal data based on preset network requirements and the importance of abnormal data. The present invention realizes fault prediction and intelligent disaster recovery; combines edge computing technology to delegate part of the data processing tasks to edge nodes, thereby reducing the load of the central node, reducing the occupation of network bandwidth, and improving the efficiency of data transmission; and improves the accuracy and real-time performance of data processing and prediction.

[0046] The present invention also provides a heterogeneous system intelligent operation and maintenance system based on LSTM, which is used to execute the above-mentioned heterogeneous system intelligent operation and maintenance method based on LSTM, including: a collection module, a classification module, a first prediction module, a second prediction module, a data determination module, a synchronization module and a backup module;

[0047] The data acquisition module is used to collect heterogeneous system data from various data sources in the heterogeneous system;

[0048] The data processing module is used to perform in-depth analysis and processing on the heterogeneous system data;

[0049] The data synchronization module is used to perform data synchronization processing on the heterogeneous system data;

[0050] The disaster recovery management module is used to perform data backup processing on the heterogeneous system data;

[0051] The edge computing module is used to perform edge computing processing on the heterogeneous system data using edge nodes.

[0052] The present invention provides a heterogeneous system intelligent operation and maintenance system based on LSTM, including a data acquisition module, a data processing module, a data synchronization module, a disaster recovery management module and an edge computing module. By introducing an LSTM network with an Attention mechanism, the accuracy and real-time performance of data processing and prediction are significantly improved; a distributed training and reasoning framework is adopted to make full use of the computing resources within the province to improve the training and reasoning efficiency of the model; and in combination with edge computing technology, some data processing tasks are delegated to edge nodes, thereby reducing the load on central nodes. The present invention not only realizes fault prediction and intelligent disaster recovery, but also ensures the transparent migration of data and computing services through efficient data management technology, and improves the resilience and post-disaster recovery capabilities of heterogeneous systems.

[0053] The present invention also provides a heterogeneous system intelligent operation and maintenance device based on LSTM, comprising: an extraction module, a sending module, a receiving module and a replacement module;

[0054] The acquisition module is used to collect heterogeneous system data from several data sources;

[0055] The classification module is used to classify a plurality of the heterogeneous system data into first data and second data;

[0056] The first prediction module is used to perform anomaly prediction on the first data using a first anomaly detection model at the central node to generate a first prediction result;

[0057] The second prediction module is used to perform anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result;

[0058] The data determination module is used to determine abnormal data by combining the first prediction result and the second prediction result;

[0059] The synchronization module is used to synchronize the abnormal data based on preset network requirements;

[0060] The backup module is used to perform backup processing on the abnormal data based on preset network requirements and the importance of the abnormal data.

[0061] The present invention provides a heterogeneous system intelligent operation and maintenance device based on LSTM, which collects heterogeneous system data from several data sources based on the organic combination between modules; classifies several heterogeneous system data into first data and second data; uses a first anomaly detection model at a central node to predict anomalies of the first data and generates a first prediction result; uses a second anomaly detection model at an edge node to predict anomalies of the second data and generates a second prediction result; determines abnormal data by combining the first prediction result and the second prediction result; performs synchronous processing on abnormal data based on preset network requirements; and performs backup processing on abnormal data based on preset network requirements and the importance of abnormal data. The present invention realizes fault prediction and intelligent disaster recovery; combines edge computing technology to delegate part of the data processing tasks to edge nodes, thereby reducing the load of the central node, reducing the occupation of network bandwidth, and improving the efficiency of data transmission; and improves the accuracy and real-time performance of data processing and prediction. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 A flowchart of an embodiment of the LSTM-based intelligent operation and maintenance method for heterogeneous systems provided by the present invention;

[0063] Figure 2 A schematic diagram of the structure of an embodiment of the LSTM-based intelligent operation and maintenance system for heterogeneous systems provided by the present invention;

[0064] Figure 3 A structural schematic diagram of an embodiment of a data acquisition module provided by the present invention;

[0065] Figure 4 A schematic diagram of the structure of an embodiment of a data processing module provided by the present invention;

[0066] Figure 5 A schematic diagram of the structure of an embodiment of a data synchronization module provided by the present invention;

[0067] Figure 6 A schematic diagram of the structure of an embodiment of a disaster recovery management module provided by the present invention;

[0068] Figure 7 A prediction accuracy mean square error comparison diagram provided by the present invention;

[0069] Figure 8 A model loss mean absolute error convergence diagram provided by the present invention;

[0070] Fig. 9 A load distribution comparison diagram provided by the present invention;

[0071] Fig.10 A processing time comparison diagram provided by the present invention;

[0072] Fig.11 A fault response time comparison diagram provided by the present invention;

[0073] Fig.12 A data recovery time comparison diagram provided by the present invention;

[0074] Fig.13 A system availability comparison diagram provided by the present invention;

[0075] Fig.14 A schematic diagram of the structure of an embodiment of the LSTM-based intelligent operation and maintenance device for heterogeneous systems provided by the present invention. DETAILED DESCRIPTION

[0076] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0077] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0078] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0079] Example 1

[0080] See also Figure 1 , is a flow chart of an embodiment of the LSTM-based intelligent operation and maintenance method for heterogeneous systems provided by the present invention, the method includes steps 101 to 107, and each step is specifically as follows:

[0081] Step 101: Collect heterogeneous system data from multiple data sources.

[0082] Furthermore, in the first embodiment of the present invention, heterogeneous system data from several data sources are collected, specifically:

[0083] Identify a plurality of data sources of a heterogeneous system and establish a connection to each of the data sources;

[0084] Collecting a number of raw data from each of the data sources respectively;

[0085] Performing format unification processing on the original data;

[0086] Preprocess the data after format unification;

[0087] Use encrypted transmission protocol to encrypt pre-processed data;

[0088] The encrypted data is determined to be heterogeneous system data.

[0089] In the first embodiment of the present invention, there are data sources of different types of devices in the heterogeneous system, including sensors, servers, edge computing nodes, databases, etc. When collecting data from heterogeneous systems, first identify various types of data sources in the heterogeneous system, establish a stable connection, and collect raw data from different data sources. Based on the different data formats of different data sources, the acquired raw data is converted into a unified internal format for subsequent processing. The collected data may contain noise, incomplete or redundant information, so the raw data needs to be preprocessed, and the preprocessing operations include noise filtering, data imputation, and redundancy elimination. Since the processed data needs to be efficiently and reliably transmitted to the data processing module, the data is encrypted to ensure that the data is not tampered with or leaked during transmission, and the integrity and security of the data are ensured during transmission.

[0090] The present invention provides stable and reliable data support for the complex and changeable heterogeneous system environment by collecting data corresponding to multiple data sources in the heterogeneous system, thereby ensuring the efficient operation of the heterogeneous system.

[0091] Step 102: Classify the plurality of heterogeneous system data into first data and second data.

[0092] Further, in the first embodiment of the present invention, a plurality of the heterogeneous system data are classified into first data and second data, specifically:

[0093] Performing data size analysis and computational complexity analysis on the data of the plurality of heterogeneous systems;

[0094] Determine the heterogeneous system data whose data size does not exceed the preset first data range and whose calculation complexity does not exceed the preset first calculation range as the first data;

[0095] The heterogeneous system data whose data size exceeds a preset first data range or whose calculation complexity exceeds a preset first calculation range is determined as the second data.

[0096] In the first embodiment of the present invention, after obtaining the processed heterogeneous system data, in order to effectively improve the efficiency of data processing and the overall performance of the system, the heterogeneous system data is analyzed, and larger data or data that requires complex calculations are placed on edge nodes. The edge nodes are used for preliminary data processing and analysis, thereby reducing the load on the central node and achieving optimal configuration of system resources.

[0097] Step 103: Perform anomaly prediction on the first data using a first anomaly detection model at the central node to generate a first prediction result.

[0098] Further, in the first embodiment of the present invention, the first anomaly detection model is used at the central node to perform anomaly prediction on the first data to generate a first prediction result, specifically:

[0099] Normalizing the first data to obtain normalized data;

[0100] Performing feature extraction on the normalized data to obtain first feature data;

[0101] A first anomaly detection model is used to perform anomaly prediction on the first feature data to obtain a first prediction result.

[0102] In the first embodiment of the present invention, after the heterogeneous system data is classified into the first data and the second data, the first data is deeply analyzed and processed by the central node to generate valuable information and prediction results. In order to ensure that the data from different data sources are processed at the same scale, the data needs to be normalized first. In order to improve the processing efficiency and effect of the subsequent first anomaly detection model, the data is feature extracted to form the first feature data. Among them, the feature extraction method includes time series features, frequency domain features and statistical features. Based on the first anomaly detection model, the first feature data is predicted to be abnormal, and the first prediction result is obtained, and the processed data and the first prediction result are stored in the database.

[0103] Furthermore, in the first embodiment of the present invention, the first anomaly detection model is specifically:

[0104] Use the LSTM model to learn historical heterogeneous system data and form a time series prediction model;

[0105] Introducing an Attention mechanism into the time series prediction model, training the time series prediction model, and adjusting the attention of the time series prediction model;

[0106] The trained time series prediction model is determined as the first anomaly detection model. In the first embodiment of the present invention, the LSTM model is trained using historical heterogeneous system data to obtain a first anomaly detection model. First, the LSTM model establishes a time series prediction model by learning historical heterogeneous system data. Among them, the input of the LSTM model is the feature data in the historical heterogeneous system data, and the output is the anomaly prediction result. The LSTM model is trained by the back propagation algorithm to optimize the loss function. In order to further improve the accuracy of anomaly prediction, the Attention mechanism is introduced. The Attention mechanism dynamically adjusts the model's attention to different parts of the input data by calculating the attention weight. The newly input feature data is predicted by the trained LSTM model and the Attention mechanism to generate a prediction result. At the same time, the heterogeneous system detects the actual abnormal situation corresponding to the prediction result in real time, sets a first threshold, and when the deviation between the prediction result and the actual abnormal situation exceeds the first threshold, it is determined to be abnormal.

[0107] Through processes such as data normalization, feature extraction, LSTM model training, Attention mechanism fusion, data prediction and anomaly detection, the present invention realizes in-depth processing and analysis of heterogeneous system data, improves the accuracy of data processing and prediction, and provides reliable data support for data synchronization and disaster recovery management of heterogeneous systems.

[0108] Step 104: Perform anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result.

[0109] Further, in the first embodiment of the present invention, the second data is predicted to be abnormal by using a second abnormality detection model at the edge node to generate a second prediction result, specifically:

[0110] Performing data preprocessing on the second data to obtain preprocessed data;

[0111] Performing feature extraction on the preprocessed data to obtain second feature data;

[0112] A second anomaly detection model is used to perform anomaly prediction on the second feature data to obtain a second prediction result; wherein the second anomaly detection model is an LSTM model.

[0113] In a first embodiment of the present invention, an edge node is used to process second data that is large in size or requires complex calculations. First, the edge node preprocesses the second data collected locally, including data cleaning, format conversion, and preliminary analysis. The edge node extracts features from the second data after data preprocessing, and converts the second data into second feature data for subsequent analysis and processing. The edge node can train and predict local models, such as using an LSTM model for time series prediction to form a second anomaly detection model. After the model training is completed, the second anomaly detection model is used to perform anomaly detection on the second feature data to generate a second prediction result. The edge node aggregates the processed and analyzed data to form simplified data and transmit it to the central node.

[0114] The present invention utilizes edge nodes to process data with large size or data that requires complex calculations, can effectively process and analyze local data, and send simplified data to the central node, thereby reducing the burden on the central node.

[0115] Step 105: Determine abnormal data by combining the first prediction result and the second prediction result.

[0116] In the first embodiment of the present invention, after processing the second data, the edge node transmits the data and the corresponding second prediction result to the central node, so that the central node combines the first prediction result and the second prediction result to obtain the abnormal data in the heterogeneous system data, thereby facilitating subsequent data synchronization and data backup processing based on the abnormal data.

[0117] Step 106: Based on preset network requirements, the abnormal data is synchronously processed.

[0118] Furthermore, in the first embodiment of the present invention, based on the preset network requirements, the abnormal data is synchronously processed, specifically:

[0119] Detect the real-time network status of heterogeneous systems;

[0120] Determine a data synchronization strategy according to preset network requirements and the real-time network status; wherein the data synchronization strategy includes a timestamp synchronization strategy, an event-driven synchronization strategy, and a scheduled task synchronization strategy;

[0121] Based on the data synchronization strategy, a distributed computing framework is used to synchronize the abnormal data to each system node of the heterogeneous system.

[0122] In the first embodiment of the present invention, after obtaining the abnormal data, data anomaly processing is performed based on the abnormal data. First, according to the actual needs of the heterogeneous system and the real-time network conditions, a suitable data synchronization strategy is selected. The data synchronization strategy includes timestamp synchronization, event-driven synchronization and scheduled task synchronization. After determining the data synchronization strategy, data synchronization processing is performed based on timestamp synchronization, event-driven synchronization and scheduled task synchronization. Specifically, in the timestamp synchronization strategy, each piece of data is timestamped to ensure data consistency of each node at the same time point. In the event-driven synchronization strategy, ensure that the synchronization operation is triggered immediately when the data changes. In the scheduled task synchronization strategy, the system periodically synchronizes incremental data to other nodes. After data synchronization, the synchronized data is stored in the database.

[0123] Optionally, during the data synchronization process, the data needs to be verified and errors corrected to ensure data consistency and integrity.

[0124] Optionally, in order to improve the efficiency of data synchronization, a distributed computing framework is used to assign data synchronization tasks to various nodes, process them in parallel, reduce synchronization delays, and make full use of computing resources within the province.

[0125] The present invention can provide stable and reliable data synchronization support in a complex and changeable heterogeneous system environment by performing data synchronization processing, thereby ensuring efficient operation of the system.

[0126] Step 107: Based on the preset network requirements and the importance of the abnormal data, the abnormal data is backed up.

[0127] Further, in the first embodiment of the present invention, based on the preset network requirements and the importance of the abnormal data, the abnormal data is backed up, specifically:

[0128] Performing importance analysis on the abnormal data to generate importance analysis results;

[0129] Based on the importance analysis result, screening important abnormal data from the abnormal data;

[0130] Determine a data backup strategy based on preset network requirements; wherein the data backup strategy includes full backup and incremental backup;

[0131] Based on the data backup strategy, the abnormal data is backed up to a backup heterogeneous system.

[0132] In the first embodiment of the present invention, by constructing a highly available backup and recovery strategy, combined with time series analysis technology and LSTM model, the disaster recovery management capability of the system can be improved. After obtaining the abnormal data, a reasonable data backup strategy is determined according to the business needs of the heterogeneous system and the data importance of the abnormal data. Among them, the backup strategy includes full backup and incremental backup. Full backup is a complete backup of all data on a regular basis, while incremental backup backs up the changed data. The backup data is stored in a secure backup center and effectively managed. To ensure the security and availability of the data, encryption, compression and version control of the backup data are required. When a fault is detected, the present invention can respond quickly, start the fault handling and data recovery mechanism, and ensure the rapid recovery of data and services. Among them, the recovery strategy includes full recovery and incremental recovery. When a fault is detected, the present invention can automatically switch to a backup heterogeneous system containing backup data to ensure business continuity.

[0133] In summary, the first embodiment of the present invention provides a LSTM-based intelligent operation and maintenance method for heterogeneous systems, which collects heterogeneous system data from several data sources; classifies several heterogeneous system data into first data and second data; uses a first anomaly detection model at a central node to predict anomalies of the first data and generate a first prediction result; uses a second anomaly detection model at an edge node to predict anomalies of the second data and generate a second prediction result; determines abnormal data by combining the first prediction result and the second prediction result; performs synchronous processing on abnormal data based on preset network requirements; and performs backup processing on abnormal data based on preset network requirements and the importance of abnormal data. The present invention realizes fault prediction and intelligent disaster recovery; combines edge computing technology to delegate part of the data processing tasks to edge nodes, thereby reducing the load of the central node, reducing the occupancy of network bandwidth, and improving the efficiency of data transmission; and improves the accuracy and real-time performance of data processing and prediction.

[0134] Example 2

[0135] See also Figure 2 , is a structural diagram of an embodiment of a heterogeneous system intelligent operation and maintenance system based on LSTM provided by the present invention, the system includes a data acquisition module, a data processing module, a data synchronization module, a disaster recovery management module and an edge computing module;

[0136] The data acquisition module is used to collect heterogeneous system data from various data sources in the heterogeneous system;

[0137] The data processing module is used to perform in-depth analysis and processing on the heterogeneous system data;

[0138] The data synchronization module is used to perform data synchronization processing on the heterogeneous system data;

[0139] The disaster recovery management module is used to perform data backup processing on the heterogeneous system data;

[0140] The edge computing module is used to perform edge computing processing on the heterogeneous system data using edge nodes.

[0141] In the second embodiment of the present invention, see Figure 3 , is a structural diagram of an embodiment of the data acquisition module provided by the present invention. The data acquisition module needs to process data sources from different types of devices and systems, including sensors, servers, edge computing nodes, databases, etc. The data format and communication protocol of each data source may be different, and the data acquisition module must have strong compatibility and adaptability. In order to achieve this, the data acquisition module adopts a variety of data acquisition technologies and communication protocols, such as HTTP, MQTT, CoAP, SNMP, etc., and designs a universal data interface to ensure that the data can be efficiently and securely transmitted to the data processing module. Among them, the LSTM-based heterogeneous system intelligent operation and maintenance system also includes a data storage module for storing data collected by the data acquisition module.

[0142] The key steps in the data collection process are as follows:

[0143] 1. Data source identification and connection: The data acquisition module first identifies various data sources in the heterogeneous system and establishes a stable connection. Set each data source as S i , whose data transmission protocol is P i The data acquisition module connects to each data source through a protocol adapter to establish a connection C i :C i =connect(S i ,P i ).

[0144] 2. Data format conversion: Since the data formats of different data sources are different, the data acquisition module needs to convert these data into a unified internal format for subsequent processing. Set the original data to D raw , the target format is D fmt , the conversion function is T, then: D fmt =T(D raw ).

[0145] 3. Data preprocessing: The collected data may contain noise, incomplete or redundant information. The data collection module cleans and filters the data through preprocessing steps. The preprocessing steps include noise filtering, data imputation and redundancy elimination. Set the processed data as D clean , the preprocessing function is F, then: Dclean =F(D fmt ).

[0146] 4. Data transmission and storage: In order to efficiently and reliably transmit the processed data to the data processing module and ensure the integrity and security of the data during the transmission process, data transmission adopts encrypted transmission protocols (such as TLS / SSL) to ensure that the data is not tampered with or leaked during the transmission process. The data transmission function is T trans , the data after transmission is D trans , then: D trans =T trans (D clean ).

[0147] 5. Real-time monitoring and exception handling: The data acquisition module needs to monitor the data acquisition process in real time and promptly detect and handle abnormal situations, such as connection interruption, data loss, etc. Therefore, by setting the monitoring function M and the exception handling mechanism H, the continuity and reliability of data acquisition are ensured. The relationship between monitoring and exception handling is:

[0148] M(D trans )=status

[0149] if status≠normal,thenH(status)

[0150] Through the above-mentioned data source identification and connection, data format conversion, data preprocessing, data transmission and storage, and real-time monitoring and exception handling, the data acquisition module can provide stable and reliable data support in a complex and changeable heterogeneous system environment to ensure the efficient operation of the system.

[0151] In the second embodiment of the present invention, see Figure 4 , is a structural diagram of an embodiment of the data processing module provided by the present invention. Data processing is the core link of the provincial distributed heterogeneous system data synchronization and disaster recovery intelligent operation and maintenance system. It generates valuable information and prediction results by acquiring the collected and pre-processed data in the data storage module for in-depth analysis and processing. After the prediction results are obtained by the result prediction module, the prediction results are transmitted to the data analysis module for the next step of analysis. The data processing module of the present invention adopts an improved LSTM network combined with the Attention mechanism to improve the accuracy of data processing and prediction. The specific steps in the data processing process are:

[0152] 1. Data normalization: To ensure that data from different data sources are processed at the same scale, the data must first be normalized. Set the input data to D trans , the normalized data is D norm , the normalized function is N, then: Among them, μ and σ are the mean and standard deviation of the data respectively.

[0153] 2. Feature extraction: In order to improve the processing efficiency and effect of the model, it is necessary to extract features from the data. The feature extraction function is F, and the extracted feature data is F feat , then: F feat =F(D norm ). Among them, feature extraction methods include time series features, frequency domain features and statistical features.

[0154] 3. LSTM model training: The LSTM model builds a time series prediction model by learning historical data. The input of LSTM is feature data F feat , the output is the prediction result The LSTM model training process is:

[0155] The LSTM model is trained by the back-propagation algorithm to optimize the loss function L, which is defined as:

[0156]

[0157] Where N is the number of samples, Y i is the actual value, is the predicted value.

[0158] 4. Attention mechanism fusion: To further improve the accuracy of prediction, the Attention mechanism is introduced. The Attention mechanism dynamically adjusts the model's attention to different parts of the input data by calculating the attention weight.

[0159] 5. LSTM model anomaly detection training: Train the LSTM model based on the Attention mechanism and generate anomaly detection results based on historical data At the same time, the system detects anomalies in the prediction results in real time and sets anomaly detection function D. When the deviation between the anomaly detection result and the actual value exceeds the threshold ∈, it is judged as an anomaly: if Then anomaly detected.

[0160] 6. Result prediction: Based on the trained LSTM model, the newly input data is predicted and the prediction results are generated. The processed data and prediction results are stored in the database and fed back to other modules of the system for subsequent operations. For example, the prediction results are fed back to the data synchronization module and the disaster recovery management module for corresponding processing and adjustment. The storage function is S and the stored data is D. store ,but:

[0161] The data processing module realizes in-depth processing and analysis of collected data, improves the accuracy of data processing and prediction, and provides reliable data support for the system's data synchronization module and disaster recovery management.

[0162] In the second embodiment of the present invention, see Figure 5 , is a structural diagram of an embodiment of the data synchronization module provided by the present invention. When abnormal data is detected, the data stored in the central node and the data stored in the edge node are synchronized using the data synchronization module. The data synchronization module can achieve efficient and accurate data synchronization through an improved LSTM network and a distributed computing framework. The specific steps of the data synchronization process are:

[0163] 1. Data synchronization strategy selection: Select an appropriate data synchronization strategy based on the actual needs of the system and network conditions. Data synchronization strategies include timestamp synchronization, event-driven synchronization, and scheduled task synchronization. Set the timestamp synchronization strategy to S t , the event-driven synchronization strategy is S e , the scheduled task synchronization strategy is S d , then the final synchronization strategy is: S = (S t ,S e ,S d ).

[0164] 2. Timestamp synchronization: In the timestamp synchronization strategy, each piece of data is timestamped to ensure data consistency of each node at the same time point.

[0165] 3. Event-driven synchronization: In the event-driven synchronization strategy, the synchronization operation is triggered immediately when the data changes.

[0166] 4. Scheduled task synchronization: In the scheduled task synchronization strategy, the system periodically synchronizes incremental data to other nodes.

[0167] 5. Data verification and error correction: During the data synchronization process, data verification and error correction are required to ensure data consistency and integrity.

[0168] 6. Application of distributed computing framework: In order to improve the efficiency of data synchronization, the present invention adopts a distributed computing framework to make full use of the computing resources within the province. The distributed computing framework distributes data synchronization tasks to each node, processes them in parallel, and reduces synchronization delays.

[0169] 7. Storage and feedback of data synchronization results: The synchronized data needs to be stored in the database, and the synchronization results need to be fed back to other modules of the system.

[0170] The data synchronization module ensures data consistency and integrity through timestamp synchronization, event-driven synchronization and scheduled task synchronization strategies, combined with data verification and error correction; the data synchronization module can provide stable and reliable data synchronization support in complex and changeable heterogeneous system environments to ensure efficient operation of the system.

[0171] In the second embodiment of the present invention, see Figure 6 , is a structural diagram of an embodiment of the disaster recovery management module provided by the present invention. The disaster recovery management module improves the disaster recovery management capability of the system by building a highly available backup and recovery strategy, combining time series analysis technology and LSTM model. After obtaining the abnormal prediction result according to the data analysis module, the disaster recovery response module is started based on the prediction result, and the response data backup module is started, so that the disaster recovery management module starts the backup heterogeneous system under the abnormal fault state, and transmits the recovery data to the data recovery module to realize data recovery. Among them, the specific technical implementation steps of the disaster recovery management module are as follows:

[0172] 1. Formulate a data backup strategy: formulate a reasonable data backup strategy based on the business needs of the system and the importance of the data. The backup strategy includes full backup and incremental backup. Full backup regularly backs up all data in full, while incremental backup backs up the changed data. Set the full backup cycle to T f , the incremental backup cycle is T i , the full backup function is B f , the incremental backup function is B i , the backed-up data is:

[0173] 2. Storage and management of backup data: The backup data needs to be stored in a secure backup center and managed effectively. The backup data storage function is S b , the backup data after storage is D store , then: D store =S b (D backup ).

[0174] Among them, backup management includes encryption, compression and version control of backup data to ensure data security and availability.

[0175] 3. Fault prediction and detection: Through time series analysis technology and LSTM model, the potential fault points of the system are predicted, and timely detection and warning are given. Set the historical data as H and the fault prediction model as P f , the predicted fault point is F p , then: F p =P f (H).

[0176] The fault detection function is Df , the detected fault point is F d , then: F d =D f (D current ).

[0177] Among them, D current The current system data.

[0178] 4. Fast fault response: When a fault is detected, the disaster recovery management module needs to respond quickly and start the fault handling and data recovery mechanism. The fault handling function is R f , the data after fault processing is D recover , then: D recover =R f (F d ).

[0179] 5. Execution of data recovery strategy: After a disaster or failure occurs, execute the data recovery strategy to ensure the rapid recovery of data and services. The recovery strategy includes full recovery and incremental recovery. The full recovery function is R full , the incremental recovery function is R inc , the restored data is:

[0180] 6. System disaster recovery design: System disaster recovery design includes active / standby switching and multiple redundant configurations. When the primary system fails, it automatically switches to the standby system to ensure business continuity. Set the active / standby switching function to S switch , the system state after switching is S new , then: S new =S switch (S current ).

[0181] Multiple redundant configurations improve system reliability and availability by deploying redundant systems in multiple physical locations.

[0182] 7. Disaster recovery drills and evaluation: Conduct disaster recovery drills regularly to evaluate the effectiveness of the disaster recovery strategy and the system's recovery capabilities. The disaster recovery drill function is T d , the exercise evaluation function is E d , the drill and evaluation results are:

[0183] R drill =T d (S current )

[0184] R eval =E d (R drill )

[0185] The disaster recovery management module achieves efficient and reliable disaster recovery management by formulating reasonable data backup strategies, combining fault prediction and detection, rapid fault response, data recovery strategies and system disaster recovery design.

[0186] In the second embodiment of the present invention, in a distributed heterogeneous system, the introduction of edge computing effectively improves the efficiency of data processing and the overall performance of the system. By delegating part of the data processing tasks to the edge nodes, the load on the central node can be reduced and optimal allocation of system resources can be achieved. Data processing at the edge nodes is the core task of edge computing. By performing preliminary data processing and analysis at the edge nodes, the computing burden of the central node can be greatly reduced.

[0187] The process steps of the edge computing module are as follows:

[0188] 1. Data preprocessing: The edge node first preprocesses the data collected locally, including data cleaning, format conversion and preliminary analysis. Set the original data as D raw , the preprocessing function is P, then the preprocessed data is: D prep =P(D raw ).

[0189] 2. Feature extraction: The edge node performs feature extraction and converts the raw data into feature vectors for subsequent analysis and processing. The feature extraction function is F, and the extracted feature vector is F feat , then: F feat =F(D prep ).

[0190] 3. Local model training and prediction: Edge nodes can perform local model training and prediction, such as using the LSTM model for time series prediction. Set the LSTM model to M and the input feature vector to F. feat The output prediction result is but:

[0191] 4. Preliminary data aggregation: The edge node aggregates the processed and analyzed data to form simplified data for transmission to the central node. The aggregation function is A, and the aggregated data is D agg ,but:

[0192] By performing preliminary data processing at the edge node, the computing and storage pressure of the central node can be significantly reduced. Specifically, the edge node transmits the preprocessed and aggregated data to the central node, reducing the amount of transmitted data; by reducing the amount of transmitted data, the network bandwidth is reduced, the efficiency of data transmission is improved, and data transmission is optimized. After the central node receives the aggregated data from the edge node, it performs further processing and analysis. The processing tasks of the central node are reduced, and it can focus on complex data analysis and global optimization. Through edge computing, some computing tasks are delegated to the edge node, realizing the load balancing of the system. The edge node processes data nearby, improving the real-time response capability of the system. By introducing edge computing, the present invention realizes data preprocessing and local analysis of the edge node, significantly reducing the load of the central node. Through data transmission optimization, task allocation and load balancing, the overall performance and real-time response capability of the system are improved.

[0193] As an example of the second embodiment of the present invention, the technical effect of the present invention can be verified by designing a test. To improve the comprehensiveness and accuracy of the test, the test environment includes hardware configuration and software tools.

[0194] In terms of hardware, the test hardware environment consists of multiple heterogeneous nodes, including high-performance servers, edge computing nodes, and sensor devices. Servers are mainly used for centralized data processing and storage, edge computing nodes are used for distributed data processing, and sensor devices are used for data collection. The specific configuration is as follows: 8 high-performance servers, each equipped with 2 Intel Xeon E5-2690 v4 processors, 128GB memory, and 1TB SSD storage; 20 edge computing nodes, each equipped with 1 Intel Core i7-8550U processor, 16GB memory, and 256GB SSD storage; 50 sensor nodes, distributed in different physical locations, collect environmental data and equipment operation status in real time.

[0195] In terms of operating system, the server and edge computing nodes run the Ubuntu 20.04 LTS operating system, and the sensor nodes run the embedded Linux system; the data acquisition software is written in Python and supports multiple protocols (such as HTTP, MQTT, CoAP) to achieve real-time collection of sensor data; the data processing platform uses the TensorFlow framework to implement the improved LSTM model and Attention mechanism for data processing and prediction; the data synchronization service is based on Apache Kafka and Apache Pulsar to achieve real-time synchronization and transmission of data to ensure data consistency between nodes in the system; the disaster recovery management system uses Ansible and Terraform to write disaster recovery management scripts to automate backup and recovery operations to ensure high availability of data and services.

[0196] For example, under the simulation parameters set in Table 1, comprehensive performance testing and functional verification are carried out. The test content includes the accuracy of data processing and prediction, the real-time and consistency of data synchronization, the response speed and recovery capability of disaster recovery management, and the optimization effect of edge computing on system load and efficiency. Through the setting and adjustment of these test parameters, we can comprehensively evaluate the performance of the present invention in practical applications and verify its effectiveness in improving data synchronization and disaster recovery intelligent operation and maintenance in provincial distributed heterogeneous systems.

[0197] Table 1: Parameter settings

[0198]

[0199] See also Figure 7 , is a prediction accuracy mean square error comparison diagram provided by the present invention. By making a detailed comparison of the improved LSTM model (combined with the Attention mechanism), the traditional LSTM model and the GRU model in terms of data processing and prediction accuracy, the change trend of the mean square error (MSE) of each model during the training process can be obtained. The MSE of the improved LSTM model (combined with the Attention mechanism) decreases significantly faster than that of the traditional LSTM model and the GRU model in the early stage of training. This shows that the Attention mechanism has obvious advantages in improving the model's attention to important data fragments, enabling the model to learn key features in the data more quickly and reduce prediction errors. With the increase in the number of training rounds, the MSE of the three models all show a trend of gradually decreasing and stabilizing. Among them, the final MSE of the improved LSTM model is the lowest, followed by the traditional LSTM model, and the MSE of the GRU model is the highest. This further verifies the effectiveness of the Attention mechanism in enhancing the LSTM model in processing long sequence data, so that it can achieve higher prediction accuracy under the same training conditions.

[0200] See also Figure 8, a model loss mean absolute error convergence diagram provided by the present invention. By making a detailed comparison of the improved LSTM model (combined with the Attention mechanism), the traditional LSTM model and the GRU model in terms of data processing and prediction accuracy, the changing trend of the mean absolute error (MAE) of each model during the training process can be obtained. The improved LSTM model (combined with the Attention mechanism) always maintains a low MAE during the training process, and the convergence speed is significantly faster than the traditional LSTM model and the GRU model. This shows that the Attention mechanism can not only improve the prediction accuracy of the model, but also accelerate the convergence process of the model and improve the training efficiency. When the number of training rounds reaches 100 times, the MAE of the improved LSTM model is the lowest, followed by the traditional LSTM model, and the MAE of the GRU model is the highest. The improved LSTM model shows a relatively stable error decline trend throughout the training process, and finally converges to a lower MAE value, showing its superior performance in processing complex time series data.

[0201] A detailed comparison was made on the changes in load distribution of central nodes and edge nodes before and after the introduction of edge computing, as well as the overall data processing time of the system with and without the introduction of edge computing under different load conditions. It can be concluded that the changes in load distribution of central nodes and edge nodes before and after the introduction of edge computing, as well as the comparison of the overall data processing time of the system with and without the introduction of edge computing under different load conditions.

[0202] See also Fig. 9 , is a load distribution comparison diagram provided by the present invention, which shows the changes in the load distribution of the central node and the edge node before and after the introduction of edge computing. Before the introduction of edge computing, the load of the central node was very high, with a load percentage of about 90%, and gradually decreased with the increase of the node number, but the overall load was still heavy. In this case, the central node is overloaded, which can easily lead to system bottlenecks and performance degradation. After the introduction of edge computing, the load of the central node was significantly reduced, and the load percentage dropped to below 30%. At the same time, the load of the edge node remained at a relatively stable level of about 30%. This shows that edge computing effectively disperses part of the data processing tasks to the edge nodes, reduces the burden on the central nodes, thereby optimizing the load distribution of the system and improving the overall operating efficiency.

[0203] See also Fig.10, is a processing time comparison diagram provided by the present invention, which shows the overall data processing time comparison of the system under different load conditions, with and without the introduction of edge computing. It can be seen that with the increase of load conditions (number of nodes), the processing time of the centralized data processing method increases significantly, and the processing time increases from the initial 100 seconds to about 90 seconds. In contrast, the processing time after the introduction of edge computing is significantly reduced, and the processing time is reduced from the initial 70 seconds to about 50 seconds. In addition, compared with the traditional centralized data processing method, the distributed computing framework based on Hadoop and Spark also has certain advantages in processing time, but it is still higher than the processing time of introducing edge computing. Specifically, the processing time of Hadoop is reduced from the initial 85 seconds to about 63 seconds, and the processing time of Spark is reduced from the initial 80 seconds to about 58 seconds. This result shows that edge computing has significant advantages in processing efficiency. By distributing data processing tasks to edge nodes, the processing time of the central node can be greatly reduced, and the overall processing efficiency of the system can be improved. Compared with traditional centralized data processing methods and other distributed computing frameworks (Hadoop and Spark), edge computing has shorter processing time and better performance.

[0204] See also Fig.11 , is a fault response time comparison chart provided by the present invention, which shows the comparison of fault response time between the traditional disaster recovery management method and the method of the present invention. After a fault occurs, the response time of the traditional disaster recovery management method is relatively long, and as time goes by, the fault response time gradually decreases, but still remains at a high level (approximately between 70 and 90 seconds). In contrast, the fault response time of the method of the present invention is significantly shorter, with a response time of between 30 and 50 seconds, and the response time is more stable over time. This shows that the present invention has significant advantages in improving fault response speed, can detect and handle faults faster, reduce system downtime, and improve system reliability and availability.

[0205] See also Fig.12 , is a data recovery time comparison chart provided by the present invention, which shows the comparison of data recovery time between the traditional disaster recovery management method and the method of the present invention in different disaster scenarios. The results show that the data recovery time of the traditional disaster recovery management method is relatively long, the recovery time is approximately between 90 and 120 seconds, and it fluctuates greatly with the changes in the disaster scene. The data recovery time of the method of the present invention is significantly shorter, the recovery time is between 40 and 60 seconds, and it shows higher stability in different disaster scenarios. This shows that the present invention has significant advantages in reducing data recovery time, can restore system data more quickly, ensure data integrity and consistency, and improve the system's post-disaster recovery capabilities.

[0206] See also Fig.13 , is a system availability comparison chart provided by the present invention, which shows the availability comparison between the traditional disaster recovery management method and the method of the present invention when the system is running for a long time. It can be seen that the system availability of the traditional disaster recovery management method is low, approximately between 90% and 95%, and the availability gradually increases with the passage of time, but the increase is small. In contrast, the system availability of the method of the present invention is significantly higher, approximately between 95% and 99.8%, and it shows high stability and consistency during long-term operation. This shows that the present invention has significant advantages in improving system reliability and availability, can better ensure the continuous operation of the system, reduce the risk of system downtime, and improve user experience and service quality.

[0207] In summary, the second embodiment of the present invention provides a heterogeneous system intelligent operation and maintenance system based on LSTM, including a data acquisition module, a data processing module, a data synchronization module, a disaster recovery management module and an edge computing module. By introducing the LSTM network of the Attention mechanism, the accuracy and real-time performance of data processing and prediction are significantly improved; a distributed training and reasoning framework is adopted to make full use of the computing resources within the province to improve the training and reasoning efficiency of the model; combined with edge computing technology, some data processing tasks are delegated to edge nodes, thereby reducing the load on the central node. The present invention not only realizes fault prediction and intelligent disaster recovery, but also ensures the transparent migration of data and computing services through efficient data management technology, and improves the resilience and post-disaster recovery capabilities of heterogeneous systems.

[0208] Example 3

[0209] See also Fig.14 , is a structural diagram of an embodiment of a heterogeneous system intelligent operation and maintenance device based on LSTM provided by the present invention, the device includes a collection module 201, a classification module 202, a first prediction module 203, a second prediction module 204, a data determination module 205, a synchronization module 206 and a backup module 207;

[0210] The collection module 201 is used to collect heterogeneous system data from several data sources;

[0211] The classification module 202 is used to classify a plurality of the heterogeneous system data into first data and second data;

[0212] The first prediction module 203 is used to perform anomaly prediction on the first data using a first anomaly detection model at the central node to generate a first prediction result;

[0213] The second prediction module 204 is used to perform anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result;

[0214] The data determination module 205 is used to determine abnormal data by combining the first prediction result and the second prediction result;

[0215] The synchronization module 206 is used to synchronize the abnormal data based on the preset network requirements;

[0216] The backup module 207 is used to perform backup processing on the abnormal data based on preset network requirements and the importance of the abnormal data.

[0217] Furthermore, in the third embodiment of the present invention, heterogeneous system data from several data sources are collected, specifically:

[0218] Identify a plurality of data sources of a heterogeneous system and establish a connection to each of the data sources;

[0219] Collecting a number of raw data from each of the data sources respectively;

[0220] Performing format unification processing on the original data;

[0221] Preprocess the data after format unification;

[0222] Use encrypted transmission protocol to encrypt pre-processed data;

[0223] Determine the encrypted data as heterogeneous system data

[0224] Furthermore, in the third embodiment of the present invention, a plurality of the heterogeneous system data are classified into first data and second data, specifically:

[0225] Performing data size analysis and computational complexity analysis on the data of the plurality of heterogeneous systems;

[0226] Determine the heterogeneous system data whose data size does not exceed the preset first data range and whose calculation complexity does not exceed the preset first calculation range as the first data;

[0227] The heterogeneous system data whose data size exceeds a preset first data range or whose calculation complexity exceeds a preset first calculation range is determined as the second data.

[0228] Further, in a third embodiment of the present invention, a first anomaly detection model is used at a central node to perform anomaly prediction on the first data to generate a first prediction result, specifically:

[0229] Normalizing the first data to obtain normalized data;

[0230] Performing feature extraction on the normalized data to obtain first feature data;

[0231] A first anomaly detection model is used to perform anomaly prediction on the first feature data to obtain a first prediction result.

[0232] Furthermore, in the third embodiment of the present invention, the first anomaly detection model is specifically:

[0233] Use the LSTM model to learn historical heterogeneous system data and form a time series prediction model;

[0234] Introducing an Attention mechanism into the time series prediction model, training the time series prediction model, and adjusting the attention of the time series prediction model;

[0235] The trained time series prediction model is determined as the first anomaly detection model.

[0236] Further, in a third embodiment of the present invention, an abnormality prediction is performed on the second data using a second abnormality detection model at the edge node to generate a second prediction result, specifically:

[0237] Performing data preprocessing on the second data to obtain preprocessed data;

[0238] Performing feature extraction on the preprocessed data to obtain second feature data;

[0239] A second anomaly detection model is used to perform anomaly prediction on the second feature data to obtain a second prediction result; wherein the second anomaly detection model is an LSTM model.

[0240] Furthermore, in a third embodiment of the present invention, the abnormal data is synchronously processed based on preset network requirements, specifically:

[0241] Detect the real-time network status of heterogeneous systems;

[0242] Determine a data synchronization strategy according to preset network requirements and the real-time network status; wherein the data synchronization strategy includes a timestamp synchronization strategy, an event-driven synchronization strategy, and a scheduled task synchronization strategy;

[0243] Based on the data synchronization strategy, a distributed computing framework is used to synchronize the abnormal data to each system node of the heterogeneous system.

[0244] Further, in a third embodiment of the present invention, based on preset network requirements and the importance of the abnormal data, the abnormal data is backed up, specifically:

[0245] Performing importance analysis on the abnormal data to generate importance analysis results;

[0246] Based on the importance analysis result, screening important abnormal data from the abnormal data;

[0247] Determine a data backup strategy based on preset network requirements; wherein the data backup strategy includes full backup and incremental backup;

[0248] Based on the data backup strategy, the abnormal data is backed up to a backup heterogeneous system.

[0249] In summary, the third embodiment of the present invention provides a heterogeneous system intelligent operation and maintenance device based on LSTM, which collects heterogeneous system data from several data sources based on the organic combination of modules; classifies several heterogeneous system data into first data and second data; uses the first anomaly detection model at the central node to predict anomalies of the first data and generate a first prediction result; uses the second anomaly detection model at the edge node to predict anomalies of the second data and generate a second prediction result; determines the abnormal data by combining the first prediction result and the second prediction result; performs synchronous processing on the abnormal data based on preset network requirements; and performs backup processing on the abnormal data based on preset network requirements and the importance of the abnormal data. The present invention realizes fault prediction and intelligent disaster recovery; combines edge computing technology to delegate part of the data processing tasks to the edge nodes, thereby reducing the load of the central node, reducing the occupancy of the network bandwidth, and improving the efficiency of data transmission; and improves the accuracy and real-time performance of data processing and prediction.

[0250] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.

Claims

1. An intelligent operation and maintenance method for heterogeneous systems based on LSTM, characterized in that: include: Collect heterogeneous system data from several data sources; Classifying a plurality of the heterogeneous system data into first data and second data; Performing anomaly prediction on the first data using a first anomaly detection model at a central node to generate a first prediction result; Performing anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result; Determine abnormal data by combining the first prediction result and the second prediction result; Based on preset network requirements, synchronously process the abnormal data; Based on preset network requirements and the importance of the abnormal data, the abnormal data is backed up.

2. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 1, characterized in that: The collecting of heterogeneous system data from several data sources is specifically as follows: Identify a plurality of data sources of a heterogeneous system and establish a connection to each of the data sources; Collecting a number of raw data from each of the data sources respectively; Performing format unification processing on the original data; Preprocess the data after format unification; Use encrypted transmission protocol to encrypt pre-processed data; The encrypted data is determined to be heterogeneous system data.

3. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 2 is characterized in that: The classifying the plurality of heterogeneous system data into first data and second data is specifically: Performing data size analysis and computational complexity analysis on the data of the plurality of heterogeneous systems; Determine the heterogeneous system data whose data size does not exceed the preset first data range and whose calculation complexity does not exceed the preset first calculation range as the first data; The heterogeneous system data whose data size exceeds a preset first data range or whose calculation complexity exceeds a preset first calculation range is determined as the second data.

4. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 3 is characterized in that: The first anomaly detection model is used at the central node to perform anomaly prediction on the first data to generate a first prediction result, specifically: Normalizing the first data to obtain normalized data; Performing feature extraction on the normalized data to obtain first feature data; A first anomaly detection model is used to perform anomaly prediction on the first feature data to obtain a first prediction result.

5. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 4 is characterized in that: The first anomaly detection model is specifically: Use the LSTM model to learn historical heterogeneous system data and form a time series prediction model; Introducing an Attention mechanism into the time series prediction model, training the time series prediction model, and adjusting the attention of the time series prediction model; The trained time series prediction model is determined as the first anomaly detection model.

6. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 3 is characterized in that: The using the second anomaly detection model at the edge node to perform anomaly prediction on the second data to generate a second prediction result is specifically: Performing data preprocessing on the second data to obtain preprocessed data; Performing feature extraction on the preprocessed data to obtain second feature data; A second anomaly detection model is used to perform anomaly prediction on the second feature data to obtain a second prediction result; wherein the second anomaly detection model is an LSTM model.

7. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 1, characterized in that: The synchronous processing of the abnormal data based on the preset network requirements is specifically as follows: Detect the real-time network status of heterogeneous systems; Determine a data synchronization strategy according to preset network requirements and the real-time network status; wherein the data synchronization strategy includes a timestamp synchronization strategy, an event-driven synchronization strategy, and a scheduled task synchronization strategy; Based on the data synchronization strategy, a distributed computing framework is used to synchronize the abnormal data to each system node of the heterogeneous system.

8. The LSTM-based intelligent operation and maintenance method for heterogeneous systems according to claim 1, characterized in that: The backing up of the abnormal data based on the preset network requirements and the importance of the abnormal data is specifically as follows: Performing importance analysis on the abnormal data to generate importance analysis results; Based on the importance analysis result, screening important abnormal data from the abnormal data; Determine a data backup strategy based on preset network requirements; wherein the data backup strategy includes full backup and incremental backup; Based on the data backup strategy, the abnormal data is backed up to a backup heterogeneous system.

9. An LSTM-based intelligent operation and maintenance system for heterogeneous systems, characterized in that: A heterogeneous system intelligent operation and maintenance method based on LSTM for executing any one of claims 1 to 8, comprising: a data acquisition module, a data processing module, a data synchronization module, a disaster recovery management module and an edge computing module; The data acquisition module is used to collect heterogeneous system data from various data sources in the heterogeneous system; The data processing module is used to perform in-depth analysis and processing on the heterogeneous system data; The data synchronization module is used to perform data synchronization processing on the heterogeneous system data; The disaster recovery management module is used to perform data backup processing on the heterogeneous system data; The edge computing module is used to perform edge computing processing on the heterogeneous system data using edge nodes.

10. An LSTM-based intelligent operation and maintenance device for heterogeneous systems, characterized in that: include: A collection module, a classification module, a first prediction module, a second prediction module, a data determination module, a synchronization module and a backup module; The acquisition module is used to collect heterogeneous system data from several data sources; The classification module is used to classify a plurality of the heterogeneous system data into first data and second data; The first prediction module is used to perform anomaly prediction on the first data using a first anomaly detection model at the central node to generate a first prediction result; The second prediction module is used to perform anomaly prediction on the second data using a second anomaly detection model at the edge node to generate a second prediction result; The data determination module is used to determine abnormal data by combining the first prediction result and the second prediction result; The synchronization module is used to synchronize the abnormal data based on preset network requirements; The backup module is used to perform backup processing on the abnormal data based on preset network requirements and the importance of the abnormal data.

Images