Sea surface temperature prediction method based on multi-scale frequency domain enhancement

Abstract

The invention relates to the technical field of sea surface temperature prediction, and discloses a sea surface temperature prediction method based on multi-scale frequency domain enhancement, which comprises the following steps: preprocessing a sea surface temperature data set obtained by ERA5 reanalysis data, and dividing the sea surface temperature data set into a training set, a verification set and a test set; inputting data of the training set into a deep learning model MFE-ConvLSTM for training, adjusting parameters by using the verification set, and finally performing evaluation by using the test set; the deep learning model MFE-ConvLSTM is composed of a multi-scale frequency domain enhancement module and a convolutional long and short term memory network module; and preprocessing sea surface temperature data of a sea area to be predicted, and inputting the sea surface temperature data into the qualified model for sea surface temperature prediction. According to the method disclosed by the invention, the complex spatial-temporal change characteristics of the sea-land junction are effectively captured through a multi-scale frequency domain enhancement mechanism, so that the prediction stability in the whole sea area range is remarkably improved while the local prediction precision is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of sea surface temperature prediction, and particularly relates to a sea surface temperature prediction method based on multi-scale frequency domain enhancement. Background Art

[0002] As a core parameter of the interaction between the ocean and the atmosphere, sea surface temperature (SST) plays a crucial role in the global weather and climate system. It is closely related to the formation conditions of extreme weather and affects the structure and function of the marine ecosystem. Predicting SST can not only prevent meteorological disasters such as droughts and floods in a timely manner, but also ensure the safety and stability of the marine ecosystem, and is also helpful for studying climate events such as the Southern Oscillation and the Indian Ocean Dipole. It plays a decisive role in fields such as tropical cyclone generation, El Niño phenomenon prediction, and fishery resource distribution, and has now become a key indicator for marine environmental monitoring and climate research.

[0003] Current SST prediction methods are mainly divided into two types, namely numerical models based on physical mechanisms and numerical-driven methods based on statistics. The former relies on reliable physical prior knowledge and has clear physical interpretability, but involves many parameters and has a high computational cost; the latter is represented by traditional machine learning algorithms such as support vector machine (SVM) and random forest. Although it can mine statistical laws through historical data, it is difficult to capture non-linear spatio-temporal coupling characteristics when dealing with high-dimensional and multi-scale SST spatio-temporal data, and traditional methods cannot adaptively focus on key regions and are difficult to extract long-term dependence relationships of SST, resulting in low prediction accuracy.

[0004] In recent years, deep learning technology has opened up a new way for SST prediction. Typical time series models such as long short-term memory network (LSTM) and its spatial extension variant ConvLSTM can model time dependence through the memory gating mechanism, but the local receptive field of its convolution kernel also limits the ability to capture large-scale spatial correlations. Such methods often decouple spatio-temporal features, first extract spatial patterns through convolution, and then model time evolution through the network. This serial architecture is difficult to depict the co-evolution law of spatio-temporal dynamics in the ocean temperature field, and blindly stacking feature extraction layers (ConvLSTM layers) not only has low efficiency, but also leads to data redundancy, thus limiting the prediction accuracy. In order to more comprehensively analyze the spatio-temporal laws of SST data, it is necessary to develop a deep learning model that can simultaneously consider time and space features and can effectively process multi-channel information. Summary of the Invention

[0005] To solve the above technical problems, the present invention provides a sea surface temperature prediction method based on multi-scale frequency domain enhancement, which effectively captures the complex spatio-temporal variation characteristics at the land-sea boundary through a multi-scale frequency domain enhancement mechanism, thereby improving the local prediction accuracy while significantly enhancing the prediction stability across the entire sea area.

[0006] To achieve the above object, the technical solution of the present invention is as follows: A sea surface temperature prediction method based on multi-scale frequency domain enhancement, comprising the following steps: Step 1, preprocess the sea surface temperature dataset obtained from the ERA5 reanalysis data of the European Centre for Medium-Range Weather Forecasts, and divide it into a training set, a validation set, and a test set; Step 2, input the data of the training set into the deep learning model MFE-ConvLSTM for training, use the validation set to adjust the parameters, and finally evaluate the model accuracy with the data of the test set; The deep learning model MFE-ConvLSTM consists of two parts: a multi-scale frequency domain enhancement module and a convolutional long short-term memory network module; The multi-scale frequency domain enhancement module includes three parallel branches, and each branch contains a main branch and a sub-branch; each main branch is sequentially composed of a multi-scale cyclic dilated convolution module and a frequency domain-spatial joint attention module; the three main branches are respectively configured with cyclic dilated convolutions with dilation rates of 1, 2, and 4; the sub-branch adjusts the channel dimension through a 3D convolution kernel with a kernel size of 1×1×1; the output of the sub-branch and the main branch are added element by element, and then feature fusion and non-linear enhancement are performed through a ReLU activation function; the channel features output by the three parallel branches are concatenated along the channel dimension to form a composite multi-scale feature tensor, and then a 3D convolution kernel with a size of 1×1×1 is used to project the concatenated high-dimensional features to the target dimension, and after ReLU activation, it is input into a 3D convolution kernel with a size of 1×1×1 and then output; The convolutional long short-term memory network module includes two key parts: a ConvLSTM2D layer and a 1×1 two-dimensional convolutional layer; inside the ConvLSTM2D layer, multiple ConvLSTM units are recursively unfolded through the time dimension to process the input sequence. Each ConvLSTM unit contains an input gate, a forget gate, an output gate, and a candidate memory unit, and the output channel is 24. All of them achieve gating and state update through convolution operations with a kernel size of 3×3 and a stride of 1, and complete temporal modeling while maintaining the input spatial resolution; the 1×1 convolutional layer is used to achieve the fusion and output of multi-channel features; Step 3, after preprocessing the sea surface temperature data of the sea area to be predicted, input it into the qualified model for sea surface temperature prediction.

[0007] In the above solution, the multi-scale cyclic dilated convolution module expands the data dimension to three dimensions, uses cyclic data padding at the start and end of the time series, and sets the cyclic padding to be performed only at the head and tail in the time dimension; the padding amount is calculated as follows: ; In the formula, is the dilation rate, which controls the sampling interval between the internal elements of the convolution kernel; is the size of the convolution kernel, that is, the kernel size for expanding the receptive field in the time dimension.

[0008] In the above solution, in the parallel structure of the multi-scale cyclic dilated convolution module, weight normalization is used to wrap the multi-scale cyclic dilated convolution module to normalize the weights of the convolution kernel, and the normalized weights are decomposed into a direction vector and a scaling factor : ; In the formula, is the normalized weight, is the unnormalized weight vector, representing the direction of the weight, is the learnable scaling factor, representing the magnitude of the weight, is 's L2 norm.

[0009] In the above solution, the frequency-domain spatial joint attention module is composed of a channel attention module and a spatial attention module, and feature calibration is achieved through frequency-domain to spatial-domain joint modeling; The channel attention module includes a frequency-domain feature selection module and a weight generation module. The frequency-domain feature selection module, i.e., the DCT layer, constructs a multi-spectrum filter through discrete cosine transform basis functions to select different frequency components, obtains the frequency-domain coordinates from a predefined mapping table, and dynamically generates filter weights; the weight generation module performs feature compression and weight recovery through two fully connected layers; The spatial attention module consists of two convolutional layers. The convolution kernel size of the first convolutional layer is 3×3, and the output channels are the original number of channels divided by the spatial compression rate. The ReLU activation function is used to capture the local spatial context and reduce the channel dimension; the convolution kernel size of the second convolutional layer is 3×3, and the output channels are 1. The Sigmoid activation function is used to generate a spatial attention mask. There is a batch normalization layer after each convolutional layer. This weight map is multiplied element-wise with the feature map processed by the channel attention module to achieve re-weighting of the features, and finally a fused output feature map is generated.

[0010] In a further technical solution, in the frequency domain feature selection module, after the input features retain the original information through residual connection, they sequentially enter the frequency domain feature selection module and the weight generation module for feature enhancement: First, the key frequency components are screened through the DCT layer, then the dimensionality is reduced through the first fully connected layer, and the output channels are the original number of channels divided by the channel compression ratio, and ReLU activation is used; then the channel dimension is restored through the second fully connected layer, and the unnormalized attention weights are output; finally, the Sigmoid function is applied to generate the channel attention map, and through the feature reshaping operation, it is broadcast to the size of the original feature map. After the input features extract multi-spectrum components through the DCT layer, the channel attention weights are generated through the compression-expansion structure, and finally, they are multiplied with the original features channel by channel to achieve re-weighting of the features.

[0011] In the above solution, the formula of the frequency domain spatial joint attention module is as follows: ; ; ; Among them, is the input tensor, is the channel attention module, is the spatial attention module, is the output of the channel attention module, is the output of the spatial attention module, is the output of the frequency domain spatial joint attention module; is the element-wise multiplication. In a further technical solution, the discrete cosine transform basis function is as follows: ; In the formula, is the frequency index, is the height and width of the feature map, is the spatial position.

[0012] In a further technical solution, the formula of the channel attention module is as follows: ; The formula of the spatial attention module: ; In the formula, is the output of the channel attention module, represents the output of the spatial attention module, represents the Sigmoid activation function, and Both represent the Conv2D function with a convolution kernel size of 3×3. The former has a stride of 1, and the latter has a stride of , and both use the same padding method; B represents the batch normalization layer.

[0013] In a further technical solution, in the ConvLSTM cell, the forget gate determines which information in the cell state of the previous time step needs to be forgotten. The output of the forget gate is a value between 0 and 1, representing the proportion of retention or discard at each position; the input gate controls the update degree of the input of the current time step to the cell state. The output of the input gate determines which parts in the candidate cell state will be written into the current cell state ; the output gate determines the hidden state of the current time step and decides which information should be extracted from the cell state , that is, the final hidden state is the result obtained by filtering a part of the cell state through the output gate.

[0014] In a further technical solution, in the ConvLSTM cell, the output of the forget gate is: ; In the formula, is the output of the forget gate, is the Sigmoid activation function, is the weight matrix input to the forget gate, is the input of the current time step, is the weight matrix from the hidden state of the previous time step to the forget gate, is the hidden state of the previous time step, is the weight matrix from the cell state of the previous time step to the forget gate, is the cell state of the previous time step, is the bias term of the forget gate, is the convolution operation, is the Hadamard product; the output of the input gate is: ; In the formula, is the output of the input gate, is the weight matrix input to the input gate, is the weight matrix from the hidden state of the previous time step to the input gate, is the weight matrix from the cell state of the previous time step to the input gate, is the bias term of the input gate; The candidate cell state is: ; Wherein, is the candidate cell state, is the hyperbolic tangent activation function, is the weight matrix input to the candidate cell state, is the weight matrix from the hidden state at the previous time step to the candidate cell state, is the bias term of the candidate cell state; The cell state at the current time step is: ; Wherein, is the cell state at the current time step; The output of the output gate is: ; Wherein, is the output of the output gate, is the weight matrix input to the output gate, is the weight matrix from the hidden state at the previous time step to the output gate, is the weight matrix from the cell state at the current time step to the output gate, is the bias term of the output gate; The hidden state at the current time step is: ; Wherein, is the hidden state at the current time step.

[0015] Through the above technical solutions, a sea surface temperature prediction method based on multi-scale frequency domain enhancement provided by the present invention has the following beneficial effects: 1. The present invention adopts a multi-scale cyclic dilated convolution module (CDIL-T). Through the cyclic padding strategy in the time dimension and the exponential dilation rate design, it can capture the daily variation, weekly fluctuation and seasonal cycle characteristics of the ocean temperature field at the same time, and can effectively improve the time feature extraction ability of the model in the 20-day prediction task; 2. The present invention proposes a frequency domain space joint attention module (FCSA). Through the frequency domain decomposition of the discrete cosine transform (DCT) and the hierarchical convolution space focusing, it realizes high-frequency noise suppression and low-frequency signal enhancement. It not only weakens the short-term turbulence interference, but also strengthens the characteristics of long-term climate events such as ENSO, enabling the model to more finely control the type of frequency information used for attention calculation, so as to better capture the basic structure and gradual change characteristics of the sea surface temperature; 3. The present invention introduces a weight normalization dynamic adjustment strategy. By decoupling the convolutional kernel direction vector and the scaling factor, the model not only greatly compresses the number of parameters while ensuring accuracy, but also enables the convolutional branches with different dilation rates to automatically learn the feature importance weights, significantly improving the training stability. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art.

[0017] Figure 1 Schematic flowchart of a sea surface temperature prediction method based on multi-scale frequency domain enhancement disclosed in an embodiment of the present invention; Figure 2 Overall architecture diagram of the MFE-ConvLSTM model; Figure 3 Structural diagram of the MFEM module; Figure 4 Structural diagrams of CDIL-T modules with different dilation rates; (a) is the structural diagram with a dilation rate of 1; (b) is the structural diagram with a dilation rate of 2; (c) is the structural diagram with a dilation rate of 4; Figure 5 Structural diagram of the FCSA attention mechanism module; Figure 6 Schematic diagram of the convolutional long short-term memory network module; Figure 7 Average RMSE and MAE of each model predicting for 1 - 20 days, (a) is RMSE; (b) is MAE; Figure 8 RMSE error distribution diagrams of different models predicting on the 20th day; (a) is LSTM; (b) is ConvLSTM; (c) is MFE-ConvLSTM; Figure 9 MAE error distribution diagrams of different models predicting on the 20th day; (a) is LSTM; (b) is ConvLSTM; (c) is MFE-ConvLSTM. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0018] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention.

[0019] The present invention provides a sea surface temperature prediction method based on multi-scale frequency domain enhancement, as Figure 1 shown, including the following steps: Step 1, preprocess the sea surface temperature dataset obtained from the ERA5 reanalysis data of the European Centre for Medium-Range Weather Forecasts, and divide it into a training set, a validation set, and a test set.

[0020] The SST data used in this embodiment is sourced from the ERA5 reanalysis dataset of the European Centre for Medium-Range Weather Forecasts (ECMWF). The data has a time span from January 1, 2014, to December 31, 2023, and a spatial coverage range from to east longitude and from to north latitude of the sea area. The original data has an hourly time resolution. To meet the requirements of medium- and long-term sea surface temperature prediction, the present invention preprocesses the data through the following standardization process: a: For the original hourly continuous observation data, the arithmetic mean method is used to calculate the daily average sea surface temperature value to retain the seasonal and synoptic scale change characteristics while eliminating short-term fluctuations; b: For the invalid observation units marked as "NaN" in the ERA5 data (mainly distributed in the nearshore shallow water area and extreme weather periods), a zero-value substitution strategy is adopted to avoid the gradient anomaly problem caused by missing values in the model; c: The thermodynamic temperature of the SST dataset after daily averaging is converted to Celsius to eliminate the potential bias of the absolute temperature scale on model training. Subsequently, the data format is uniformly converted to 32-bit floating-point type for subsequent normalization and sliding window construction processing: ; d: The preprocessed SST reanalysis dataset is divided into continuous subsets in chronological order. The data from January 1, 2014, to December 31, 2022, is divided into a training set and a validation set in a ratio of 8:2. The training set is used for model parameter optimization, and the validation set is used for hyperparameter tuning and early stopping mechanism monitoring; The data for the whole year from January 1, 2023, to December 31, 2023, is divided into a test set to evaluate the generalization performance of the model. The dimension of the model input tensor , including the SST sequence of continuous time steps, where is the batch size, is the time step (observation window size), is the spatial dimension, is the number of channels (set to 1 for the univariate SST prediction task). The dimension of the label tensor , representing the true value of the SST one day after the end time step of the input sequence. This design captures the spatio-temporal evolution characteristics through a five-dimensional input tensor and realizes the single-step prediction task through a four-dimensional output tensor, thus achieving accurate SST prediction; e: After dividing the dataset, the values are mapped to the interval [0,1] through linear normalization. The normalization formula is: ; In the formula, Represents the SST value in the original data, Represents the normalized SST value, Represents the minimum value of SST in the original data, Represents the maximum value of SST in the original data.

[0021] Step 2: Input the data of the training set into the deep learning model MFE-ConvLSTM for training, use the validation set to adjust the parameters, and finally evaluate the model accuracy with the data of the test set.

[0022] S1. Construct the deep learning model MFE-ConvLSTM As Figure 2 shown, the deep learning model MFE-ConvLSTM consists of two parts: a multi-scale frequency domain enhancement module and a convolutional long short-term memory network module.

[0023] 1. Multi-scale frequency domain enhancement module As Figure 3 shown, the multi-scale frequency domain enhancement module (Multi-Scale Frequency Enhanced Mechanism, MFEM) includes three parallel branches, and each branch contains a main branch and a sub-branch; each main branch is sequentially connected by a multi-scale cyclic dilated convolution module (CDIL-T) wrapped by weight normalization and a frequency domain-spatial joint attention module (FCSA); the three main branches are respectively configured with cyclic dilated convolutions with dilation rates of 1, 2, and 4 to capture spatio-temporal features at different time scales through exponential expansion of the receptive field. The number of output channels for each group is 64, 128, and 256 in sequence to achieve complementary expression of multi-scale features. The FCSA attention mechanism, as the post-processing of each CDIL-T, realizes the collaborative enhancement of local spatio-temporal feature extraction and global dynamic calibration through the cascade optimization of frequency domain channel attention and spatial attention. The sub-branch adjusts the channel dimension through a 3D convolution kernel with a size of 1×1×1 to achieve residual connection of different numbers of channels. The sub-branch adds the output of the main branch element by element, retains the key features of the original input, and the output result cooperates with the ReLU activation function to achieve feature fusion and non-linear enhancement. The channel features output by the three parallel branches are concatenated along the channel dimension to form a composite multi-scale feature tensor. Subsequently, a 3D convolution kernel with a size of 1×1×1 is used to project the concatenated high-dimensional features to the target dimension, reduce redundant information and retain key spatio-temporal patterns. After being activated by ReLU and then input into a 3D convolution kernel with a size of 1×1×1, the computational efficiency of the model can be effectively optimized.

[0024] First, input data with 1 channel is simultaneously sent into Figure 4The three CDIL-T modules shown in (a), (b), and (c) of the figure each independently process the temporal features of different dilation rates. After being processed by each module, the data output channels sequentially become 64, 128, and 256. The increasing number of channels is combined with the dilation rate expansion, enabling different parallel blocks to focus on complementary spatio-temporal patterns and avoiding redundant features. Then, the data output from each block is fed into the FCSA attention mechanism module, which performs channel weighting on different frequency components simultaneously to retain multi-scale features. As the post-processing of each CDIL-T module, FCSA can achieve the cascaded optimization of local convolution combined with global attention. Subsequently, the residual output is added element-wise to the data output from the attention mechanism module, activated by the ReLU function, and then concatenated in the channel dimension. The total number of channels is compressed to 64 through a 3D convolution with a kernel size of 1×1×1, so as to project the multi-scale features into a unified low-dimensional space while reducing the number of parameters, facilitating the processing of subsequent modules. Finally, the output after being activated by the ReLU function is compressed to 1 in terms of the total number of channels through a 3D convolution with a kernel size of 1×1×1 and then fed into the convolutional long short-term memory network module to reduce the computational burden of the model.

[0025] (1) Multi-scale Circular Dilated Convolution Module (CDIL-T) The CDIL-CNN (Circular Dilated Convolutional Neural Network) architecture adopts a special design of splicing both ends of a one-dimensional long sequence. The receptive field is increased through dilated convolutions with different dilation rates, and the ring structure is used to reduce feature loss, enabling subsequent modules to obtain more global feature information. However, the original CDIL-CNN architecture is mainly designed for one-dimensional data, with relatively limited applications. In order to adapt to the particularity of temporal information, the present invention improves on the basis of the CDIL-CNN module by combining a parallel structure, and proposes a multi-scale circular dilated convolution module (CDIL-T). This module expands the data dimension to three dimensions, and uses circular data padding at the start and end of the time series, with circular padding only at the head and tail in the time dimension, maintaining the periodic characteristics of the sea surface temperature data. The setting of the padding amount is as follows: ; where is the dilation rate, controlling the sampling interval between elements inside the convolutional kernel; is the convolutional kernel size, that is, the kernel size for expanding the receptive field in the time dimension. Dilated convolution expands the receptive field through interval sampling, but may cause the loss of edge information of the input sequence. Through circular padding that connects the head and tail, it can ensure that the convolutional kernel can completely cover the start and end regions of the input sequence, thus keeping the length of the output in the time dimension consistent with the input.

[0026] Ocean temperature data has periodicity (such as seasonal changes and diurnal temperature differences). Compared with zero-padding in traditional convolution, it will destroy the edge continuity. The circular convolution scheme performs circular padding in the time dimension, enabling the sequence to be connected end to end, preserving the complete periodic pattern of the time series, and avoiding edge mutations during prediction. At the same time, a 3D dilated convolution kernel is adopted, and the size of the convolution kernel is , and only the dilation setting of dilated convolution is performed in the time dimension. The dilation rate increases exponentially according to . is the hidden layer index, enabling the model to capture both short-term local fluctuations and long-term periodic patterns. Furthermore, while capturing changes at weekly, semi-monthly, monthly, and annual scales, it preserves local spatial features (such as temperature correlations in adjacent sea areas), avoiding the destruction of locality by dilated convolution. In terms of parameters, the traditional Inception multi-branch structure increases the number of channels through parallel convolutional layers to capture features at different time scales. However, its number of parameters grows linearly with the number of channels, resulting in high computational complexity and significant parameter redundancy. In addition, stacking convolutional layers can only linearly expand the receptive field and it is difficult to efficiently integrate global features across time scales. In contrast, CDIL-T covers the complete time series cycle through a single convolution kernel combined with a circular padding mechanism, and uses dilated convolution to dynamically adjust the dilation rate, achieving an exponential expansion of the receptive field without increasing the number of parameters, greatly improving the computational efficiency.

[0027] In the circular dilated convolution parallel structure of the present invention, weight normalization is used to wrap the CDIL-T module to normalize the weights of the convolution kernel, enhancing the training stability. By decomposing the normalized weights into a direction vector ( ) and a scaling factor ( ), the direction and magnitude of the weights are explicitly decoupled: ; In the formula, is the normalized weight, is the unnormalized weight vector, representing the direction of the weight, is the learnable scaling factor, representing the magnitude of the weight, is 's L2 norm.

[0028] This decoupling makes the gradient direction more stable during backpropagation, especially suitable for the gradient aggregation scenario of multiple branches in deep parallel structures, and can effectively alleviate the gradient dispersion problem caused by the receptive field jump of dilated convolutions. The scaling factor g, as a learnable parameter, enables each convolutional kernel to have the ability to adaptively adjust the feature response intensity. Before the attention mechanism intervenes, this design allows the convolutional branches with different dilation rates to automatically learn the feature importance weights, forming a complementary enhancement with the subsequent attention mechanism. In the parallel multi-branch structure, the convolutional kernels with different dilation rates are calibrated through independent weight normalization layers, which can automatically balance the magnitude differences of features at each scale.

[0029] (2)FCSA module The present invention proposes a frequency-domain spatial joint attention module (Frequency Channel-Spatial Attention, FCSA) based on multi-spectrum analysis and spatial feature enhancement. Its core consists of channel attention (FrequencyChannel Attention, FCA) and spatial attention (Spatial Attention, SA), and realizes feature calibration through frequency-domain to spatial-domain joint modeling (see Figure 5 ). It enables the model to more precisely control the type of frequency information used for attention calculation, thereby better capturing the basic structure and gradual change characteristics of sea surface temperature.

[0030] Channel attention usually extracts global information based on global average pooling (GAP). Global average pooling assumes that all spatial positions are equally important and learns channel weights through fully connected layers. However, it may ignore the importance differences of different frequency components, and temporal averaging cannot distinguish high-frequency (vortices, fronts) and low-frequency (ENSO) signals, and cannot effectively capture the changes in frequency components in signals or satellite images, treating all types of information equally, especially those low-frequency components that reflect large-scale structures or slow-changing trends and the noise in the image. The FCSA module extracts feature information from the frequency domain perspective by introducing multi-spectrum DCT transform (discrete cosine transform). GAP is only the lowest frequency component of DCT, eliminating a large amount of other effective frequency domain information, and the features lack diversity. DCT enhances the channel feature representation by introducing multiple frequency components instead of GAP. The input is mapped to the frequency domain through DCT basis functions, explicitly separating different frequency components, and extracting features from the frequency domain perspective. The frequency domain compression (channel compression rate, r) and parameter sharing mechanism (reusing DCT filter weights) can maintain good performance while effectively reducing FLOPs compared to traditional channel attention.

[0031] The channel attention module is divided into a frequency-domain feature selection module and a weight generation module. The frequency-domain feature selection module, i.e., the DCT layer, constructs a multi-spectrum filter through discrete cosine transform (DCT) basis functions to select different frequency components, obtains the frequency-domain coordinates from a predefined mapping table, and dynamically generates filter weights. The weight generation module performs feature compression and weight recovery through two fully connected layers. After the input features retain the original information through residual connection, they sequentially enter the frequency-domain feature selection module and the weight generation module for feature enhancement. First, the DCT layer filters the key frequency components, and then the first fully connected layer reduces the dimension. The output channels are the original number of channels divided by the channel compression rate (the channel compression rate is set to 16 in the experiment), and ReLU activation is used. Then, the second fully connected layer restores the channel dimension and outputs the unnormalized attention weights. Finally, the Sigmoid function is applied to generate the channel attention map, and through the feature reshaping operation, it is broadcast to the size of the original feature map. After the input features are extracted with multi-spectrum components by the DCT layer, the channel attention weights are generated through a compression-expansion structure, and finally, they are multiplied element-wise with the original features to achieve re-weighting of the features. By this method, the problem of spectral information smoothing of traditional global average pooling (GAP) is overcome.

[0032] The spatial attention module adopts a hierarchical convolutional structure to generate spatial dimension weights, expands the receptive field through cascaded convolutions, and balances local details and global context modeling. This part consists of two convolutional layers. The first convolutional layer has a kernel size of 3×3, and the output channels are the original number of channels divided by the spatial compression rate (the spatial compression rate is set to 2 in the experiment). The ReLU activation function is used to capture local spatial context and reduce the channel dimension to save computational effort. The second convolutional layer has a kernel size of 3×3, and the output channels are 1. The Sigmoid activation function is used to generate the spatial attention mask to highlight important spatial regions. There is a batch normalization (Batch Normalization, abbreviated as BN) layer behind each convolutional layer to improve the stability and convergence speed of the model. This weight map is then multiplied element-wise with the feature map processed by the channel attention to achieve re-weighting of the features, and finally, a fused output feature map is generated. Channel attention focuses on the importance of frequency-domain features, and spatial attention strengthens the spatial position correlation. The two achieve joint calibration, strengthen the important feature response, suppress redundant information, and improve the model's feature selective attention ability.

[0033] In the sea surface temperature prediction task, FCSA significantly improves the model's ability to model complex ocean thermal features by introducing frequency-domain feature enhancement and dynamic frequency selection.

[0034] The FCSA formula is as follows: ; ; ; Among them, is the input tensor, is the channel attention module, is the spatial attention module, is the output of the channel attention module, is the output of the spatial attention module, is the output of the frequency-domain and spatial joint attention module; is the element-wise multiplication.

[0035] For the input of the model, the frequency-domain feature selection module realizes frequency-domain feature selection through the discrete cosine transform (DCT). The experiment realizes the screening of different frequency components through a predefined mapping table, and dynamically calculates the weight values position by position according to the frequency selection strategy. Define the DCT basis function: ; In the formula, is the frequency index, is the height and width of the feature map, is the spatial position.

[0036] After grouping the input feature map by channels, perform element-wise multiplication with the predefined DCT filter, and then sum along the spatial dimension. Define the frequency-domain feature weighted sum: ; In the formula, represents the channel grouping index, each group contains channels ( is the number of frequency components).

[0037] Concatenate the spectral values of different frequency components into a complete spectral vector. Define the spectral concatenation operation: ; In the formula, through operation, concatenate the spectral values of each group of channels to generate the global frequency feature .

[0038] Map the spectral vector to the attention weights through two fully connected layers, and use the Sigmoid activation function to limit the weights within the range of [0,1]. Define the attention weight generation formula: ; In the formula, represents the Sigmoid activation function, represents two fully connected layers.

[0039] Multiply the attention weights with the original input feature map channel by channel to enhance important features and suppress redundant information. Define the feature map weighting formula: ; In the formula, is the original input tensor, is the attention weight, represents channel-wise multiplication.

[0040] Obtain the channel attention module formula: ; Spatial attention module formula: ; In the formula, is the output of the channel attention module, represents the output of the spatial attention module, represents the Sigmoid activation function, and both represent the Conv2D function with a convolution kernel size of 3×3. The former has a stride of 1, and the latter has a stride of , and both use the same padding method; B represents the batch normalization layer.

[0041] Activation function formula: ReLU: ; Sigmoid: ; In the formula, represents the input SST data, represents the activation function.

[0042] 2. Convolutional Long Short-Term Memory Network Module The convolutional long short-term memory network module uses the ConvLSTM2D layer as the core component. Its network architecture includes two key parts: the ConvLSTM2D layer and the 1×1 convolutional layer (see Figure 6). Inside the ConvLSTM2D layer, multiple ConvLSTM units are recursively unfolded along the time dimension to process the input sequence. Each unit contains an input gate, a forget gate, an output gate, and a candidate memory unit. The output channels are set to 24, and both the gating and state updates are achieved through convolutional operations with a kernel size of 3×3 and a stride of 1, while maintaining the input spatial resolution and completing the temporal modeling; the 1×1 convolutional layer realizes the efficient fusion of multi-channel features. Compared with the limitation of traditional LSTM that can only process one-dimensional time series signals, ConvLSTM, through the local receptive field characteristics of the convolutional kernel, retains the two-dimensional spatial structure information while modeling in the time dimension. The input gate, forget gate, and output gate of ConvLSTM are all realized through convolutional operations (time dimension + spatial dimension), enabling the network to capture spatio-temporal correlations synchronously. This characteristic makes it suitable for tasks with significant spatio-temporal correlations such as sea surface temperature prediction. Through the feature transfer mechanism of consecutive time steps, ConvLSTM can generate multi-channel feature maps containing spatio-temporal dynamic features, greatly improving its ability to extract spatial features compared with the flattened time series processing method of ordinary LSTM. The subsequent 1×1 convolutional layer then performs non-linear combination on the multi-channel feature maps output by ConvLSTM through the cross-channel parameter sharing mechanism, projects the high-dimensional features to the single-channel space while maintaining the spatial resolution, effectively eliminates redundant features, and enhances the representation ability of key information, reflecting the superiority of spatio-temporal joint modeling. Finally, the future 20-day SST is predicted through rolling prediction.

[0043] ; In the formula, is the output of the forget gate, is the Sigmoid activation function, is the weight matrix input to the forget gate, is the input at the current time step, is the weight matrix from the hidden state of the previous time step to the forget gate, is the hidden state of the previous time step, is the weight matrix from the cell state of the previous time step to the forget gate, is the cell state of the previous time step, is the bias term of the forget gate, is the convolutional operation, is the Hadamard product.

[0044] ; In the formula, is the output of the input gate, is the weight matrix input to the input gate, The weight matrix from the hidden state of the previous time step to the input gate, is the weight matrix from the cell state at the previous time step to the input gate, and is the bias term of the input gate.

[0045] ; In the formula, is the candidate cell state, is the hyperbolic tangent activation function, is the weight matrix input to the candidate cell state, is the weight matrix from the hidden state at the previous time step to the candidate cell state, and is the bias term of the candidate cell state.

[0046] ; In the formula, is the cell state at the current time step.

[0047] ; In the formula, is the output of the output gate, is the weight matrix input to the output gate, is the weight matrix from the hidden state at the previous time step to the output gate, is the weight matrix from the cell state at the current time step to the output gate, and is the bias term of the output gate.

[0048] ; In the formula, is the hidden state at the current time step.

[0049] In ConvLSTM, the forget gate determines which information in the cell state at the previous time step needs to be forgotten, and the output of the forget gate is a value between 0 and 1, representing the proportion of retention or discard at each position; the input gate controls the update degree of the input to the cell state at the current time step, and the output of the input gate determines which parts in the candidate cell state will be written into the current cell state ; the output gate determines which information in the cell state should be extracted for the hidden state at the current time step, that is, the final hidden state is the result obtained by filtering a part of the cell state through the output gate.

[0050] S2. Model Training and Testing The deep learning model is trained using the training set, the parameters are adjusted using the validation set, and finally the model is evaluated using the test set. Spatiotemporal sequence samples are constructed through the sliding window algorithm. With a 40-day time step as the input, the SST distribution on the 41st day is predicted. Then, the SST on the 41st day is added to the end of this 40-day sequence, and the SST on the 1st day is removed to form a new 40-day sequence to predict the SST data on the 42nd day. This cycle is repeated to achieve rolling prediction of the SST data for the next 20 days, ensuring effective modeling of time continuity and spatial correlation. A comparison chart of the predicted values and true values of each model for the 20th day is plotted, and the average RMSE and average MAE for predicting the next 1 - 20 days are calculated. The RMSE and MAE formulas are as follows: ; ; Among them, represents the predicted SST value, represents the actually observed SST value, refers to the number of grid points in this dataset. The smaller the values of RMSE and MAE, the better the prediction performance of the model.

[0051] The deep learning model of the present invention adopts a systematic hyperparameter optimization strategy to achieve efficient training and stable convergence of the model on complex spatiotemporal data. In this embodiment, the batch size is set to 4. The noise perturbation brought by mini-batch gradient descent can make the loss surface escape from local minima. The training epoch size is 90. The optimal model is saved through a callback function, and the weight file is stored in the HDF5 format to ensure the reproducibility of the experiment. For the characteristics of the regression task, the mean squared error (MSE) is selected as the loss function. Combining data normalization processing can effectively eliminate the interference of dimensional differences on gradient update. Using the ReLU and Sigmoid activation functions can effectively alleviate the gradient vanishing problem and constrain the predicted values within a reasonable temperature range. A learning rate decay strategy is introduced for adaptive adjustment of the learning rate. When the validation set loss does not decrease for 5 consecutive epochs, the learning rate decays by a factor of . At the same time, the early stopping method is set as a regularization means. If the validation set loss does not improve for 20 consecutive epochs, the training is terminated and rolled back to the historical optimal weights. This strategy dynamically evaluates the generalization ability of the model and intervenes in a timely manner before the risk of overfitting increases, enabling the model to obtain better prediction results.

[0052] The generalization ability and prediction accuracy of the model are evaluated on the test set: Figure 7Figures (a) and (b) respectively show the comparison of the average RMSE and MAE predicted by different models for 1 - 20 days. Table 1 calculates the average RMSE and MAE of different models for predicting 1 day, 5 days, 10 days, 15 days, and 20 days in the test set. As can be seen from Figure 7 and Table 1, from LSTM, ConvLSTM to MFE - ConvLSTM, the average RMSE and average MAE for predicting the 20th day have been decreasing, and the prediction effect is getting better and better.

[0053] Table 1 Average RMSE and MAE

[0054] Figure 8 and Figure 9 are the RMSE distribution map and MAE distribution map for different models to predict the 20th day. The RMSE (MAE) distribution map is an error distribution map drawn by averaging the RMSE (MAE) predicted for 20 days at each point in the test set. The experimental results show that Figure 8 and Figure 9 the traditional LSTM shown in Figure (a) and Figure 8 and Figure 9 the ConvLSTM model shown in Figure (b) have significant error accumulation phenomena in the prediction of the land - edge sea area. In contrast, the MFE - ConvLSTM of the present invention ( Figure 8 and Figure 9 shown in Figure (c)) model shows better prediction performance and achieves better results in the prediction of the land - edge sea area; in terms of the prediction accuracy of the entire sea area, the error of the model is lower. This model effectively captures the complex spatio - temporal variation characteristics at the land - sea junction through a multi - scale frequency - domain enhancement mechanism, thereby improving the local prediction accuracy while significantly enhancing the prediction stability across the entire sea area.

[0055] Step 3, after pre - processing the sea surface temperature data of the sea area to be predicted, input it into the qualified model for sea surface temperature prediction.

[0056] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown herein, but rather to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A sea surface temperature prediction method based on multi-scale frequency domain enhancement, characterized in that, It includes the following steps: Step 1: Preprocess the sea surface temperature dataset obtained from the ERA5 reanalysis data of the European Centre for Medium-Range Weather Forecasts, and divide it into a training set, a validation set, and a test set; Step 2: Input the data of the training set into the deep learning model MFE-ConvLSTM for training, use the validation set to adjust the parameters, and finally evaluate the model accuracy with the data of the test set; The deep learning model MFE-ConvLSTM consists of two parts: a multi-scale frequency domain enhancement module and a convolutional long short-term memory network module; The multi-scale frequency domain enhancement module includes three parallel branches, and each branch contains a main branch and a sub-branch; each main branch is sequentially composed of a multi-scale cyclic dilated convolution module and a frequency domain-spatial joint attention module; the three main branches are respectively configured with cyclic dilated convolutions with dilation rates of 1, 2, and 4; the sub-branch adjusts the channel dimension through a 3D convolution kernel with a kernel size of 1×1×1; the output of the sub-branch and the main branch are added element by element, and then feature fusion and non-linear enhancement are performed through the ReLU activation function; the channel features output by the three parallel branches are concatenated along the channel dimension to form a composite multi-scale feature tensor, and then a 3D convolution kernel with a size of 1×1×1 is used to project the concatenated high-dimensional features to the target dimension, and after ReLU activation, it is input to a 3D convolution kernel with a size of 1×1×1 and then output; The convolutional long short-term memory network module includes two key parts: a ConvLSTM2D layer and a 1×1 two-dimensional convolutional layer; inside the ConvLSTM2D layer, multiple ConvLSTM units are recursively expanded through the time dimension to process the input sequence. Each ConvLSTM unit contains an input gate, a forget gate, an output gate, and a candidate memory unit, and the output channel is 24. All are realized through convolution operations with a kernel size of 3×3 and a stride of 1 to achieve gating and state update, and complete temporal modeling while maintaining the input spatial resolution; the 1×1 convolutional layer is used to achieve the fusion and output of multi-channel features; Step 3: After preprocessing the sea surface temperature data of the sea area to be predicted, input it into the qualified model for sea surface temperature prediction.

2. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 1, characterized in that, The multi-scale cyclic dilation convolution module expands the data dimension to three dimensions, uses cyclic data padding at the start and end of the time series, and sets the cyclic padding to be performed only at the head and tail in the time dimension; the padding amount is calculated as follows: ； In the formula, is the dilation rate, which controls the sampling interval between the internal elements of the convolutional kernel; is the size of the convolutional kernel, that is, the kernel size for expanding the receptive field in the time dimension.

3. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 1, characterized in that, In the parallel structure of the multi-scale cyclic dilated convolution module, weight normalization is used to wrap the multi-scale cyclic dilated convolution module to normalize the weights of the convolution kernels, and the normalized weights are decomposed into a direction vector and a scaling factor : ； wherein, is the normalized weight, is the unnormalized weight vector, representing the direction of the weight, is the learnable scaling factor, representing the magnitude of the weight, is the L2 norm of.

4. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 1, characterized in that, The frequency domain-spatial joint attention module is composed of a channel attention module and a spatial attention module, and realizes feature calibration through frequency domain-spatial joint modeling; The channel attention module includes a frequency domain feature selection module and a weight generation module. The frequency domain feature selection module, that is, the DCT layer, constructs a multi-spectrum filter through discrete cosine transform basis functions to select different frequency components, obtains the frequency domain coordinates from a predefined mapping table, and dynamically generates filter weights; the weight generation module performs feature compression and weight recovery through two fully connected layers; The spatial attention module consists of two convolutional layers. The first convolutional layer has a kernel size of 3×3, and the number of output channels is the original number of channels divided by the spatial compression rate. The ReLU activation function is used to capture local spatial context and reduce the channel dimension. The second convolutional layer has a kernel size of 3×3 and the number of output channels is 1. The Sigmoid activation function is used to generate the spatial attention mask. There is a batch normalization layer after each convolutional layer. This weight map is element-wise multiplied with the feature map processed by the channel attention module to achieve re-weighting of the features, and finally a fused output feature map is generated.

5. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 4, characterized in that, In the frequency domain feature selection module, after the input features retain the original information through residual connections, they sequentially enter the frequency domain feature selection module and the weight generation module for feature enhancement: First, the DCT layer is used to filter out key frequency components, then the first fully connected layer is used for dimensionality reduction, and the number of output channels is the original number of channels divided by the channel compression rate, and ReLU activation is used; then the second fully connected layer is used to restore the channel dimension, and the unnormalized attention weights are output; finally, the Sigmoid function is applied to generate the channel attention map, and through the feature reshaping operation, it is broadcast to the size of the original feature map. After the input features extract multi-spectrum components through the DCT layer, the channel attention weights are generated through the compression-expansion structure, and finally, they are multiplied with the original features channel by channel to achieve re-weighting of the features.

6. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 1, characterized in that, The formula of the frequency domain spatial joint attention module is as follows: ； ； ； Among them, is the input tensor, is the channel attention module, is the spatial attention module, is the output of the channel attention module, is the output of the spatial attention module, is the output of the frequency-domain and spatial joint attention module; is element-wise multiplication.

7. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 4, characterized in that, The discrete cosine transform basis function is shown as follows: ； In the formula, is the frequency index, is the height and width of the feature map, is the spatial position.

8. The sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 4, characterized in that, The formula of the channel attention module is as follows: ； The formula of the spatial attention module: ； In the formula, is the output of the channel attention module, represents the output of the spatial attention module, represents the Sigmoid activation function, and both represent the Conv2D function with a convolution kernel size of 3×3. The former has a stride of 1, and the latter has a stride of , and both use the same padding method; B represents the batch normalization layer.

9. A sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 1, characterized in that, In the described ConvLSTM cell, the forget gate determines which information in the cell state of the previous time step needs to be forgotten, and the output of the forget gate is a value between 0 and 1, representing the proportion of retention or discard at each position; The input gate controls the input at the current time step The degree of update to the cell state, the output of the input gate Determines which parts of the candidate cell state will be written into the current cell state The output gate determines the hidden state at the current time step Which information should be extracted from the cell state That is, the final hidden state Is the result obtained after filtering a part of the cell state through the output gate.

10. A sea surface temperature prediction method based on multi-scale frequency domain enhancement according to claim 9, characterized in that, In the ConvLSTM cell, the output of the forget gate is: ； wherein, is the output of the forget gate, is the Sigmoid activation function, is the weight matrix input to the forget gate, is the input at the current time step, is the weight matrix from the hidden state of the previous time step to the forget gate, is the hidden state of the previous time step, is the weight matrix from the cell state of the previous time step to the forget gate, is the cell state of the previous time step, is the bias term of the forget gate, is the convolution operation, is the Hadamard product; The output of the input gate is: ； Wherein, is the output of the input gate, is the weight matrix input to the input gate, is the weight matrix from the hidden state of the previous time step to the input gate, is the weight matrix from the cell state of the previous time step to the input gate, is the bias term of the input gate; The candidate cell state is: ； Wherein, is the candidate cell state, is the hyperbolic tangent activation function, is the weight matrix input to the candidate cell state, is the weight matrix from the hidden state of the previous time step to the candidate cell state, is the bias term of the candidate cell state; The cell state at the current time step is: ； In the formula, is the cell state at the current time step; The output of the output gate is: ； Wherein, is the output of the output gate, is the weight matrix input to the output gate, is the weight matrix from the hidden state of the previous time step to the output gate, is the weight matrix from the cell state of the current time step to the output gate, is the bias term of the output gate; The hidden state at the current time step is: ； wherein, is the hidden state at the current time step.

Images