A multi-step prediction method for sintering endpoint based on spatiotemporal encoding and task decoding

Abstract

This paper discloses a multi-step prediction method for sintering endpoints based on spatiotemporal encoding and task decoding. The method comprises the following steps: preprocessing historical industrial process production data; constructing a spatiotemporal encoder composed of multiple stacked temporal convolutional modules enhanced with spatial attention; constructing a task-specific decoder that uses a temporal attention mechanism to adaptively extract relevant information from the output of the entire spatiotemporal encoder at each prediction step, capturing hidden states that are more closely related to the prediction target; training a prediction model composed of the spatiotemporal encoder and task-specific decoder; and preprocessing real-time industrial process production data, inputting the trained prediction model to obtain prediction results. This method can handle nonlinear and high-dimensional data in the sintering process and fully utilize the historical information and dependencies in time series data to improve the performance of multi-step prediction tasks.

Description

Technical Field

[0001] The present invention relates to the field of industrial process monitoring, and in particular to a multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding. Background Art

[0002] In the modern steel industry's sintering process, accurate prediction of the sintering endpoint is crucial for improving production efficiency and reducing energy consumption. The primary challenge in predicting the sintering endpoint lies in handling the high-dimensional, nonlinear, and dynamically changing data generated during the process. Traditional prediction methods, such as empirical judgment and simple statistical models, often fail to effectively handle these complexities.

[0003] In recent years, deep learning has demonstrated remarkable performance in various data-driven predictive models, particularly in feature extraction and processing nonlinear data. However, the application of deep learning models in industrial process control still faces several challenges, particularly in multi-step prediction tasks. While traditional deep learning models have achieved some success in single-step prediction, they often perform poorly when handling continuous multi-step predictions and are unable to fully utilize the historical information and dependencies in time series data. Furthermore, data from the sintering process exhibits strong spatiotemporal characteristics, making it difficult for traditional models to effectively capture and utilize this temporal and spatial information. Summary of the Invention

[0004] In view of the shortcomings of the existing technology, the present invention proposes a multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding.

[0005] The specific technical solutions are as follows:

[0006] A multi-step prediction method for sintering endpoint based on spatiotemporal encoding and task decoding includes the following steps:

[0007] S1: extracting historical industrial process production data within a period of time from the database of the sintering plant, performing data preprocessing on the data, and obtaining preprocessed historical industrial process production data;

[0008] S2: Construct a spatiotemporal encoder composed of multiple spatial attention enhanced temporal convolution modules stacked together. Each spatial attention enhanced temporal convolution module includes a causal expansion convolution module and a spatial attention module. The causal expansion convolution module inputs x tThe outputs of the spatial attention module are connected through a one-dimensional convolution residual; the causal expansion convolution module has several layers, and its input is the preprocessed production data. Each layer includes: a causal expansion convolution layer, a weight normalization layer, a nonlinear activation function layer and a dropout layer; the input data of each layer passes through the causal expansion convolution layer to obtain its temporal features and expand the receptive field, and after weight normalization, it is activated by the nonlinear activation function layer and output after the Hadamard product with the mask vector, and finally the output feature map O of time step t is obtained. t The spatial attention module includes: a global attention layer, a fully connected layer, a PReLU activation function and a sigmoid activation function; the input of the spatial attention module is O t , the output is the output feature map z after spatial attention adjustment t ;

[0009] S3: Build a task-specific decoder and use a temporal attention mechanism to adaptively extract relevant information from the entire spatiotemporal encoder output at each prediction step, capturing hidden states that are more closely related to the prediction target. Use independently weighted memory units in the final output layer, with each prediction step having an independent set of parameters. Finally, output a multi-step prediction result.

[0010] S4: Use the preprocessed historical industrial process production data obtained in S1 to train a prediction model consisting of a spatiotemporal encoder and a task-specific decoder to obtain a trained prediction model;

[0011] S5: Obtain real-time industrial process production data, pre-process it using the method of S1, and input it into the trained prediction model to obtain the prediction results.

[0012] Furthermore, the S1 is specifically implemented through the following sub-steps:

[0013] (1.1) obtaining production data within a period of time as raw data from a time series database of a sintering plant, wherein the production data includes material variables and process variables;

[0014] (1.2) Use the isolation forest method to detect outliers in the original data. For outliers, execute step (1.3); for other data, jump to step (1.4);

[0015] (1.3) Use local linear regression method to deal with abnormal data to maintain the continuity of time series data;

[0016] (1.4) Integrate the normal data and the data obtained in step (1.3), and use wavelet decomposition denoising technology to filter out the noise;

[0017] (1.5) Apply the sliding window method to the time series data obtained in step (1.4) to generate a set of time series data with a specific time step and prediction range, that is, the preprocessed historical production data.

[0018] Furthermore, in S2, the causal dilation convolution layer obtains the temporal feature F(t) in the input data through causal convolution, which is expressed as:

[0019]

[0020] In the formula, w represents the weight vector, x represents the input data, and w i represents the i-th component of w, x t-d*i Represents the input data of the td*ith time step; k represents the convolution kernel size, t represents the current time step; d represents the expansion coefficient.

[0021] Furthermore, in S2, the calculation expression of the weight normalization layer is as follows:

[0022]

[0023] Where W′ represents the normalized weight, g represents the learnable scaling parameter, and W d represents the original dilated convolution weight, ‖W d ‖ represents the L2 norm of the original dilated convolution weights;

[0024] When the causal expansion convolution module has two layers, its input and output relationship is expressed as follows:

[0025]

[0026] Where, represents the output feature map of the causal expansion convolution module at time step t, represents the input feature vector of the causal expansion convolution module at time step t, C is the number of channels, and T is the time step; * represents the causal expansion convolution operation; W′ d1 Represents the normalized causal expansion convolution weight matrix of the first causal expansion convolution layer, W′ d2 represents the normalized causal dilated convolution weight matrix of the second causal dilated convolution layer; PReLU(·) represents the parameterized linear unit activation function; m1 and m2 are two randomly generated mask vectors used to implement the dropout operation; ⊙ represents the Hadamard product, which is used to apply the mask vector to the output of the causal dilated convolution layer.

[0027] Furthermore, in S2, the input of the spatial attention module is the output of the causal expansion convolution module. t , O tAfter the global attention layer extracts the global information of each channel, it is input into the first fully connected layer and activated by the PReLU function. The result is input into the second fully connected layer and activated by the sigmoid function. The output feature map after spatial attention adjustment is output. Its expression is as follows:

[0028]

[0029] z t =O t ⊙σ(W2PReLU(W1I));

[0030] Where, Represents the global information of each channel c, c = 1, 2, 3, ..., C, C is the number of channels; O t,c represents the output of the causal expansion convolution module at channel c; T is the time step, I represents a vector with C dimensions, and the value corresponding to each dimension is I c ; W1 represents the weight matrix of the first fully connected layer, W2 represents the weight matrix of the second fully connected layer; σ represents the sigmoid activation function.

[0031] Furthermore, in S2, the expression for the one-dimensional convolution residual connection between the input of the causal dilation convolution module and the output of the spatial attention module is as follows:

[0032]

[0033] Where, Represents the output feature map after 1×1 convolution, W 1*1 represents the weight matrix of 1×1 convolution, represents the input feature vector of the causal expansion convolution module at time step t, C is the number of channels, and T is the time step; represents the bias vector of 1×1 convolution, Represents the final output feature map of the temporal convolution module with spatial attention enhancement, that is, the output of the temporal convolution module with spatial attention enhancement for all C channels at time step t.

[0034] Furthermore, the S3 is specifically as follows:

[0035] The context feature matrix S output by the spatiotemporal encoder t , divided into T context vectors s from the time dimension t-T+1 ,s t-T+2 ,…,s t , these context vectors are input into each time step of the task-specific decoder one by one, where corresponding to the input to the task-specific decoder s t-T+k In the time step;

[0036] The temporal attention value of the hidden state of each task-specific decoder at time step t is expressed as follows:

[0037]

[0038]

[0039] Where, represents the temporal attention value of the k-th context vector at time step t, is the overall weight matrix, tanh represents the hyperbolic tangent activation function; c t-1 The weight matrix, c t-1 represents the hidden state of the task-specific decoder at time step t-1; For s t-T+k The weight matrix, s t-T+k represents the output of the spatiotemporal encoder at time step t-T+k; is the bias term; express The weight value after softmax normalization at the same time step t, N represents the maximum prediction step length;

[0040] The input θ at each prediction step t It is calculated by weighing the state variables of the corresponding step and the output of all time steps of the spatiotemporal encoder part, and is combined with the predicted label y of the previous time step before being input into the memory unit. t-1 Splicing, the expression is as follows:

[0041]

[0042] θ t =concatenate(u t ,y t-1 );

[0043] The independent weight memory units in the task-specific decoder generate the final multi-step prediction results as follows:

[0044]

[0045]

[0046]

[0047] Where, represents the forget gate of the mth memory unit at time step t, The weight matrix representing the input data of the forget gate, The weight matrix representing the hidden state of the previous memory unit of the forget gate, Represents the bias term of the forget gate; represents the input gate of the mth memory unit at time step t, The weight matrix representing the input data of the input gate, The weight matrix representing the hidden state of the previous memory unit of the input gate, Represents the bias term of the input gate; represents the candidate cell state of the mth memory unit at time step t, The weight matrix representing the input data of the candidate cell state, The weight matrix representing the hidden state of the previous memory unit of the candidate cell state, A bias term representing the candidate cell state; represents the cell state of the mth memory unit at time step t, represents the cell state of the mth memory unit at time step t-1; o m t represents the output gate of the mth memory unit at time step t, The weight matrix representing the input data of the output gate, The weight matrix representing the hidden state of the previous memory unit of the output gate, Represents the bias term of the output gate; h t represents the hidden state of the last memory unit at time step t, c t represents the cell state of the last memory unit of the decoder at time step t; Represents the prediction result of the last memory unit at time step t; FC represents the fully connected layer, and each memory unit outputs h t After the fully connected layer, the predicted value corresponding to the prediction step length is finally obtained

[0048] Furthermore, the industrial process production data includes material variables and process variables.

[0049] A multi-step prediction device for sintering endpoint based on spatiotemporal coding and task decoding comprises a memory and one or more processors. The memory stores executable code. When the one or more processors execute the executable code, they are used to implement the multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding.

[0050] A computer-readable storage medium stores a program, which, when executed by a processor, implements the multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding.

[0051] The beneficial effects of the present invention are:

[0052] The present invention obtains the temporal features of historical data through causal dilation convolution and captures the correlation of temporal features over a long period of time; it uses the spatial attention mechanism to more accurately capture and emphasize feature information that contributes more to the prediction target, and adds residual connections to solve the gradient vanishing problem of deep networks; it stacks multiple temporal convolution layers with spatial attention enhancement through a spatiotemporal encoder to capture dependencies on different time scales from short-term to long-term; it uses the temporal attention mechanism to adaptively extract relevant information output by the encoder in each prediction step, thereby capturing hidden states that are more closely related to the prediction target and outputting more accurate multi-step prediction results. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 This is a flow chart of a multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding in an embodiment of the present invention.

[0054] Figure 2 4 is a flow chart of data preprocessing in an embodiment of the present invention.

[0055] Figure 3 2 is a schematic diagram of the structure of the temporal convolution module with spatial attention enhancement in an embodiment of the present invention.

[0056] Figure 4 It is a structural schematic diagram of a multi-step prediction device for sintering endpoint based on spatiotemporal coding-task decoding in an embodiment of the present invention. DETAILED DESCRIPTION

[0057] The present invention will be described in detail below based on the accompanying drawings and preferred embodiments. The purpose and effects of the present invention will become more apparent. The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining the present invention and are not intended to limit the present invention.

[0058] like Figure 1 As shown, a multi-step prediction method for sintering endpoint based on spatiotemporal encoding and task decoding includes the following steps:

[0059] S1: Extract historical industrial process production data within a period of time from the sintering plant database, perform data preprocessing on these data, and obtain preprocessed historical production data. Figure 2 The specific implementation process is as follows:

[0060] (1.1) Sensors collect production data from the sintering process and transmit it to a time series database through a programmable logic controller. The production data over a period of time is obtained from the sintering plant's time series database as raw data. The production data includes material variables (such as iron ore mixing ratio, quicklime ratio, etc.) and process variables (such as ignition temperature, material layer thickness, etc.).

[0061] (1.2) Use the isolation forest method to detect outliers in the original data to identify and isolate abnormal data that may affect model performance. For abnormal data, execute step (1.3); for other data, skip to step (1.4).

[0062] (1.3) Local linear regression method is used to process abnormal data to maintain the continuity of time series data.

[0063] (1.4) Integrate the normal data with the data obtained in step (1.3) and use wavelet decomposition denoising technology to filter out the noise in the data. This step helps to preserve the main structure of the data while minimizing the impact of random noise.

[0064] (1.5) Apply the sliding window method to the time series data obtained in step (1.4) to generate a set of time series data with a specific time step and prediction range, that is, the preprocessed historical production data, which is used for subsequent training, verification and testing of the prediction model.

[0065] S2: Build a spatiotemporal encoder. This encoder is constructed by stacking multiple temporal convolutional modules with spatial attention enhancement. This allows the model to capture dependencies across different time scales, from short-term to long-term, improving the prediction performance of sequence tasks. In this embodiment, there are six temporal convolutional modules with spatial attention enhancement.

[0066] like Figure 3 As shown in Figure 1, the temporal convolution module with spatial attention enhancement consists of a causal dilation convolution module and a spatial attention module, whose input and output are connected via a one-dimensional convolution residual. This module uses the spatial attention mechanism to more accurately capture and emphasize features that contribute most to target prediction, while using residual connections to address the vanishing gradient problem in deep networks. The following describes the architecture of the temporal convolution module with spatial attention enhancement in three parts.

[0067] (1) The causal expansion convolution module has several layers (two layers in this embodiment), each of which includes: a causal expansion convolution layer, a weight normalization layer, a nonlinear activation function layer (specifically the PReLU function in this embodiment) and a dropout layer.

[0068] The causal dilated convolution layer uses causal convolution to obtain the temporal features of preprocessed historical production data. Dilated convolution expands the receptive field and captures the correlation of temporal features over a longer timeframe. By combining dilated convolution with causal convolution, the resulting causal dilated convolution can cover longer input sequences without increasing parameters.

[0069] Specifically, the temporal feature F(t) in the preprocessed data is obtained through causal convolution, which is expressed as follows:

[0070]

[0071] In the formula, w represents the weight vector, x represents the input time series data (preprocessed data), w i represents the i-th component of w, x t-d*i Represents the input data of the td*ith time step; k represents the size of the convolution kernel, t represents the current time step; d represents the dilation coefficient, which determines the distance between adjacent elements in the convolution kernel. In dilated convolution, this distance expands exponentially with the increase in the number of layers.

[0072] The calculation expression of the weight normalization layer is as follows:

[0073]

[0074] Where W′ represents the normalized weight, g represents the learnable scaling parameter, and W d represents the original dilated convolution weight, ‖W d ‖ represents the L2 norm of the original dilated convolution weights.

[0075] The input-output relationship of the two-layer stacked causal expansion convolution module is expressed as follows:

[0076]

[0077] Where, represents the output feature map of the causal expansion convolution module at time step t, represents the input feature vector of the causal dilation convolution module at time step t, C is the number of channels, and T is the time step; * represents the causal dilation convolution operation; represents the normalized causal expansion convolution weight matrix of the first causal expansion convolution layer, represents the normalized causal dilated convolution weight matrix of the second causal dilated convolution layer; PReLU(·) represents the parameterized linear unit activation function; m1 and m2 are two randomly generated mask vectors used to implement the dropout operation; ⊙ represents the Hadamard product, which is used to apply the mask vector to the output of the causal dilated convolution layer.

[0078] (2) The spatial attention module includes: global attention layer, fully connected layer, PReLU activation function and sigmoid activation function. The output of the causal expansion convolution module O tAfter the global attention layer extracts the global information of each channel, it is input into the first fully connected layer and activated by the PReLU function. The result is input into the second fully connected layer and activated by the sigmoid function. The output feature map after spatial attention adjustment is output. Its expression is as follows:

[0079]

[0080] z t =O t ⊙σ(W2PReLU(W1I))

[0081] Where, Represents the global information of each channel c, c=1,2,3,…,C; O t,c Indicates that the causal expansion convolution module is in the channel

[0082] Output of channel c; Represents the output feature map after spatial attention adjustment, I represents a vector with C dimensions, and the value corresponding to each dimension is I c ; W1 represents the weight matrix of the first fully connected layer, W2 represents the weight matrix of the second fully connected layer; σ represents the sigmoid activation function.

[0083] (3) The expression of the convolution residual connection between the input and output of the temporal convolution module with spatial attention enhancement is as follows:

[0084]

[0085] Where, Represents the output feature map after 1×1 convolution, W 1*1 represents the weight matrix of 1×1 convolution, represents the bias vector of 1×1 convolution, Represents the final output feature map of the temporal convolution module with spatial attention enhancement, that is, the output of the temporal convolution module with spatial attention enhancement for all C channels at time step t.

[0086] When six spatial attention-enhanced temporal convolutional modules are stacked to form the spatiotemporal encoder, a single spatial attention-enhanced temporal convolutional module uses a 1D kernel to perform convolution operations in the time dimension, increasing the number of channels from 12 to 40, 80, and 160 to capture finer-grained features, and then reducing them to 160, 80, and 40 to form the encoder output. This multi-scale design enables the spatiotemporal encoder to capture dependencies at different time scales, from short-term to long-term, improving the prediction performance of sequence tasks.

[0087] Define a set representing different number of channels in Represents the number of channels of each temporal convolution module with spatial attention enhancement in the spatiotemporal encoder. The output of the entire spatiotemporal encoder can be expressed as:

[0088]

[0089] Where, represents the stacking operation, which is used to stack the output of each spatial attention-enhanced temporal convolution module along the channel dimension to form the final output of the spatiotemporal encoder; represents the output of the temporal convolutional module with spatial attention enhancement of c channels at time step t; represents the output of the spatiotemporal encoder at time step t, and C′ is the final number of channels output by the spatiotemporal encoder.

[0090] Through this structure, the spatiotemporal encoder effectively integrates long-term dependencies and spatial attention mechanisms, providing rich and effective spatiotemporal feature representations for the prediction model, thereby significantly improving the performance of multi-step prediction tasks.

[0091] S3: Build a task-specific decoder and use a temporal attention mechanism to adaptively extract relevant information from the entire spatiotemporal encoder output at each prediction step, thereby capturing hidden states that are more closely related to the prediction target and outputting more accurate multi-step prediction results. The specific implementation process is as follows:

[0092] A temporal attention mechanism is used to adaptively extract relevant information from the entire spatiotemporal encoder output in each prediction step, thereby capturing hidden states that are more closely related to the prediction target. Memory units with independent weights are used in the final output layer, and each prediction step has an independent set of parameters, enabling the prediction model to more effectively learn and adapt to the specific features of each prediction step.

[0093] Using M t represents the context feature matrix from the spatiotemporal encoder (i.e., the output of the last temporal convolution module), M t It can be divided into T context vectors s from the time dimension t-T+1 ,s t-T+2 ,…,s t , these context vectors are input into each time step of the task-specific decoder one by one, where corresponding to the input to the task-specific decoder s t-T+k In order to effectively capture the temporal patterns associated with each prediction step, we first compute the temporal attention value of the hidden state of each task-specific decoder at time step t:

[0094]

[0095]

[0096] Where N represents the maximum prediction step size, represents the temporal attention value of the k-th context vector at time step t, is the overall weight matrix; c t-1 The weight matrix, c t-1 represents the hidden state of the task-specific decoder at time step t-1; For s t-T+k The weight matrix, s t-T+k represents the output of the spatiotemporal encoder at time step t-T+k; is the bias term, tanh represents the hyperbolic tangent activation function; express The weight value after softmax normalization at the same time step t.

[0097] The input θ at each prediction step t It is calculated by weighing the state variables of the corresponding step and the output of all time steps of the spatiotemporal encoder part, and is combined with the predicted label y of the previous time step before being input into the memory unit. t-1 Splicing, the expression is as follows:

[0098]

[0099] θ t =concatenate(u t ,y t-1 )

[0100] The independent weight memory units in the task-specific decoder generate the final multi-step prediction results as follows:

[0101]

[0102]

[0103]

[0104] Where, represents the forget gate of the mth memory unit at time step t, The weight matrix representing the input data of the forget gate, The weight matrix representing the hidden state of the previous memory unit of the forget gate, Represents the bias term of the forget gate; represents the input gate of the mth memory unit at time step t, The weight matrix representing the input data of the input gate, The weight matrix representing the hidden state of the previous memory unit of the input gate, Represents the bias term of the input gate; represents the candidate cell state of the mth memory unit at time step t, The weight matrix representing the input data of the candidate cell state, The weight matrix representing the hidden state of the previous memory unit of the candidate cell state, A bias term representing the candidate cell state; represents the cell state of the mth memory unit at time step t, represents the cell state of the mth memory unit at time step t-1; o m t represents the output gate of the mth memory unit at time step t, The weight matrix representing the input data of the output gate, The weight matrix representing the hidden state of the previous memory unit of the output gate, Represents the bias term of the output gate; h t represents the hidden state of the last memory unit at time step t, c t represents the cell state of the last memory unit of the decoder at time step t; Represents the prediction result of the last memory unit at time step t; FC represents the fully connected layer, and each memory unit outputs h t After the fully connected layer, the predicted value corresponding to the prediction step length is finally obtained

[0105] S4: Use the data from S1 to train the prediction model consisting of the spatiotemporal encoder and the task-specific decoder to obtain a trained prediction model.

[0106] S5: Obtain real-time industrial process production data, pre-process it using the method of S1, and input it into the trained prediction model to obtain the prediction results.

[0107] like Figure 4 As shown, an embodiment of the present invention provides a multi-step prediction device for a sintering endpoint based on spatiotemporal coding and task decoding, based on a multi-step prediction method for a sintering endpoint based on spatiotemporal coding and task decoding. The device includes a memory and one or more processors. The memory stores executable code. When the one or more processors execute the executable code, they are used to implement the multi-step prediction method for a sintering endpoint based on spatiotemporal coding and task decoding in the above embodiment.

[0108] The multi-step prediction device for sintering endpoint based on spatiotemporal coding-task decoding can be applied to any device with data processing capability, and the device with data processing capability can be a device or apparatus such as a computer. The multi-step prediction device for sintering endpoint based on spatiotemporal coding-task decoding can be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of any device with data processing capability in which it is located, reading the corresponding computer program instructions in the non-volatile memory into the memory for execution. From the hardware level, if Figure 4 The figure shows a hardware structure diagram of a sintering endpoint multi-step prediction device based on spatiotemporal coding and task decoding according to the present invention, in which any device with data processing capability is located. Figure 4 In addition to the processor, memory, network interface, and non-volatile memory shown, any device with data processing capabilities in which the apparatus of the present invention is located in the embodiments may also include other hardware based on the actual functions of the device with data processing capabilities, which will not be described in detail.

[0109] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0110] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present invention. A person of ordinary skill in the art can understand and implement the present invention without making any creative efforts.

[0111] An embodiment of the present invention further provides a computer-readable storage medium having a program stored thereon. When the program is executed by a processor, the multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding in the above embodiment is implemented.

[0112] The computer-readable storage medium can be an internal storage unit of any device with data processing capabilities in any of the aforementioned embodiments, such as a hard disk or memory. The computer-readable storage medium can also be an external storage device of any device with data processing capabilities, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash card, etc. equipped on the device. Furthermore, the computer-readable storage medium can also include both an internal storage unit and an external storage device of any device with data processing capabilities. The computer-readable storage medium is used to store computer programs and other programs and data required by any device with data processing capabilities, and can also be used to temporarily store data that has been output or is to be output.

[0113] The following is a combination of a specific industrial case of a sintering process to verify the effectiveness of the present invention. The data of this case was obtained from a sintering plant between December 8 and December 29, 2021, with a collection interval of one minute. Six input features were selected from the material variables and process variables in the sintering plant database, for a total of 12 feature input variables (ie, the number of channels C = 12). After preprocessing the original data, 31,049 data were obtained, the time step was set to 60 time steps (ie, T = 60), and the prediction range was 7 steps (ie, the maximum prediction step N = 7). The data set is divided into a training set, a validation set, and a test set in chronological order, where the training set contains the first 24,839 data, the validation set contains the next 3,104 data, and the last 3,106 data are assigned to the test set. The training set and validation set are used to train the prediction model, and the test set is used as an online sample to detect the model training effect.

[0114] In order to illustrate the prediction effect of the method of the present invention, other existing prediction methods are also used for prediction. The models used for comparison include: Autoregressive Integrated Moving Average (ARIMA), Long Short Term Memory (LSTM), Long-and Short-term Time-series network (LSTNet), and Time Attention-Long Short Term Memory (TA-LSTM). Model evaluation indicators include Root Mean Square Error (RMSE), Coefficient of Determination (TA-LSTM), and Root Mean Square Error (RMSE). ) and Mean Absolute Percentage Error (MAPE). The prediction results of each model on online samples (test set data) are shown in Table 1:

[0115] Table 1 Comparison of multi-step prediction effects of various methods on real sintering datasets

[0116]

[0117] From the results in Table 1, it can be seen that the present invention shows the highest performance in all evaluation indicators, and the prediction accuracy of the 7th step and the average is significantly higher than that of other methods, thereby confirming the effectiveness and superiority of the present invention in predicting the multi-step sintering endpoint.

[0118] Those skilled in the art will understand that the foregoing descriptions are merely preferred embodiments of the invention and are not intended to limit the invention. Although the invention has been described in detail with reference to the foregoing examples, those skilled in the art will still be able to modify the technical solutions described in the foregoing examples or substitute equivalents for some of the technical features therein. Any modifications, equivalent substitutions, etc. made within the spirit and principles of the invention shall be included within the scope of protection of the invention.

Claims

1. A multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding, characterized in that: The following steps are involved: S1: extracting historical industrial process production data within a period of time from the database of the sintering plant, performing data preprocessing on the data, and obtaining preprocessed historical industrial process production data; S2: Construct a spatiotemporal encoder composed of multiple spatial attention enhanced temporal convolution modules stacked together. Each spatial attention enhanced temporal convolution module includes a causal expansion convolution module and a spatial attention module. The causal expansion convolution module inputs x t The outputs of the spatial attention module are connected through a one-dimensional convolution residual; the causal expansion convolution module has several layers, and its input is the preprocessed production data. Each layer includes: a causal expansion convolution layer, a weight normalization layer, a nonlinear activation function layer and a dropout layer; the input data of each layer passes through the causal expansion convolution layer to obtain its temporal features and expand the receptive field, and after weight normalization, it is activated by the nonlinear activation function layer and output after the Hadamard product with the mask vector, and finally the output feature map O of time step t is obtained. t The spatial attention module includes: a global attention layer, a fully connected layer, a PReLU activation function and a sigmoid activation function; the input of the spatial attention module is O t , the output is the output feature map z after spatial attention adjustment t ; S3: Build a task-specific decoder and use a temporal attention mechanism to adaptively extract relevant information from the entire spatiotemporal encoder output at each prediction step, capturing hidden states that are more closely related to the prediction target. Use independently weighted memory units in the final output layer, with each prediction step having an independent set of parameters. Finally, output a multi-step prediction result. S4: Use the preprocessed historical industrial process production data obtained in S1 to train a prediction model consisting of a spatiotemporal encoder and a task-specific decoder to obtain a trained prediction model; S5: Obtain real-time industrial process production data, pre-process it using the method of S1, and input it into the trained prediction model to obtain the prediction results.

2. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1 is characterized in that: The S1 is specifically implemented through the following sub-steps: (1.1) obtaining production data within a period of time as raw data from a time series database of a sintering plant, wherein the production data includes material variables and process variables; (1.2) Use the isolation forest method to detect outliers in the original data. For outliers, execute step (1.3); for other data, jump to step (1.4); (1.3) Use local linear regression method to deal with abnormal data to maintain the continuity of time series data; (1.4) Integrate the normal data and the data obtained in step (1.3), and use wavelet decomposition denoising technology to filter out the noise; (1.5) Apply the sliding window method to the time series data obtained in step (1.4) to generate a set of time series data with a specific time step and prediction range, that is, the preprocessed historical production data.

3. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1 is characterized in that: In S2, the causal expansion convolution layer obtains the temporal features F(t) in the input data through causal convolution, which is expressed as: In the formula, w represents the weight vector, x represents the input data, and w i represents the i-th component of w, x t-d*i Represents the input data of the td*ith time step; k represents the convolution kernel size, t represents the current time step; d represents the expansion coefficient.

4. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1, characterized in that: In S2, the calculation expression of the weight normalization layer is as follows: Where W′ represents the normalized weight, g represents the learnable scaling parameter, and W d represents the original dilated convolution weight, ‖W d ‖ represents the L2 norm of the original dilated convolution weights; When the causal expansion convolution module has two layers, its input and output relationship is expressed as follows: Where, represents the output feature map of the causal expansion convolution module at time step t, represents the input feature vector of the causal dilation convolution module at time step t, C is the number of channels, and T is the time step; * represents the causal dilation convolution operation; represents the normalized causal expansion convolution weight matrix of the first causal expansion convolution layer, represents the normalized causal dilated convolution weight matrix of the second causal dilated convolution layer; PReLU(·) represents the parameterized linear unit activation function; m1 and m2 are two randomly generated mask vectors used to implement the dropout operation; ⊙ represents the Hadamard product, which is used to apply the mask vector to the output of the causal dilated convolution layer.

5. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1, characterized in that: In S2, the input of the spatial attention module is the output of the causal expansion convolution module O t , O t After the global attention layer extracts the global information of each channel, it is input into the first fully connected layer and activated by the PReLU function. The result is input into the second fully connected layer and activated by the sigmoid function. The output feature map after spatial attention adjustment is output. Its expression is as follows: from t =O t ⊙σ(W2PReLU(W1I)); Where, Represents the global information of each channel c, c = 1, 2, 3, ..., C, C is the number of channels; O t,c represents the output of the causal expansion convolution module at channel c; T is the time step, I represents a vector with C dimensions, and the value corresponding to each dimension is I c ; W1 represents the weight matrix of the first fully connected layer, W2 represents the weight matrix of the second fully connected layer; σ represents the sigmoid activation function.

6. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 5, characterized in that: In S2, the expression of the one-dimensional convolution residual connection between the input of the causal expansion convolution module and the output of the spatial attention module is as follows: Where, Represents the output feature map after 1×1 convolution, W 1*1 represents the weight matrix of 1×1 convolution, represents the input feature vector of the causal expansion convolution module at time step t, C is the number of channels, and T is the time step; represents the bias vector of 1×1 convolution, Represents the final output feature map of the temporal convolution module with spatial attention enhancement, that is, the output of the temporal convolution module with spatial attention enhancement for all C channels at time step t.

7. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1 is characterized in that: The S3 is as follows: The context feature matrix S output by the spatiotemporal encoder t , divided into T context vectors s from the time dimension t-T+1 ,s t-T+2 ,…,s t , these context vectors are input into each time step of the task-specific decoder one by one, where corresponding to the input to the task-specific decoder s t-T+k In the time step; The temporal attention value of the hidden state of each task-specific decoder at time step t is expressed as follows: Where, represents the temporal attention value of the k-th context vector at time step t, is the overall weight matrix, tanh represents the hyperbolic tangent activation function; c t-1 The weight matrix, c t-1 represents the hidden state of the task-specific decoder at time step t-1; For s t-T+k The weight matrix, s t-T+k represents the output of the spatiotemporal encoder at time step t-T+k; is the bias term; express The weight value after softmax normalization at the same time step t, N represents the maximum prediction step length; The input θ at each prediction step t It is calculated by weighing the state variables of the corresponding step and the output of all time steps of the spatiotemporal encoder part, and is combined with the predicted label y of the previous time step before being input into the memory unit. t-1 Splicing, the expression is as follows: θ t =concatenate(u t ,y t-1 ); The independent weight memory units in the task-specific decoder generate the final multi-step prediction results as follows: Where, represents the forget gate of the mth memory unit at time step t, The weight matrix representing the input data of the forget gate, The weight matrix representing the hidden state of the previous memory unit of the forget gate, Represents the bias term of the forget gate; represents the input gate of the mth memory unit at time step t, The weight matrix representing the input data of the input gate, The weight matrix representing the hidden state of the previous memory unit of the input gate, Represents the bias term of the input gate; represents the candidate cell state of the mth memory unit at time step t, The weight matrix representing the input data of the candidate cell state, The weight matrix representing the hidden state of the previous memory unit of the candidate cell state, A bias term representing the candidate cell state; represents the cell state of the mth memory unit at time step t, represents the cell state of the mth memory unit at time step t-1; o m t represents the output gate of the mth memory unit at time step t, The weight matrix representing the input data of the output gate, The weight matrix representing the hidden state of the previous memory unit of the output gate, Represents the bias term of the output gate; h t represents the hidden state of the last memory unit at time step t, c t represents the cell state of the last memory unit of the decoder at time step t; Represents the prediction result of the last memory unit at time step t; FC represents the fully connected layer, and each memory unit outputs h t After the fully connected layer, the predicted value corresponding to the prediction step length is finally obtained 8. The multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to claim 1 is characterized in that: The industrial process production data includes material variables and process variables.

9. A multi-step prediction device for sintering endpoint based on spatiotemporal coding and task decoding, characterized in that: The method comprises a memory and one or more processors, wherein the memory stores executable code, and when the one or more processors execute the executable code, the method is used to implement the multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that A program is stored thereon, and when the program is executed by a processor, the multi-step prediction method for sintering endpoint based on spatiotemporal coding and task decoding according to any one of claims 1 to 8 is implemented.

Images