Fermentation process soft measurement method based on space-time attention

Abstract

The invention discloses a fermentation process soft measurement method based on space-time attention, and belongs to the field of industrial fermentation production process soft measurement modeling and application. Firstly, a time attention mechanism and a space attention mechanism are fused, different batches of space-time fusion feature representations are obtained, then the obtained different batches of fusion feature representations are input into an LSTM layer to obtain a long-term dependency relationship, and soft measurement prediction output is achieved. Compared with the prior art, the model has the capacity of recognizing the hidden states of the input variables and the quality variables, modeling is conducted according to the relation between the small batches, the time-space interaction and the long-term dependency relation between the input variables are considered, the prediction precision of the model is improved, quick response is achieved, and the method is suitable for large-scale popularization and application. The maintenance cost is minimum, the prediction result is accurate, and the method has a wide application prospect in the field of batch fermentation.

Description

Technical Field

[0001] The present invention relates to the field of deep learning and soft measurement modeling of fermentation process, and in particular to a soft measurement method of fermentation process based on spatiotemporal attention. Background Art

[0002] During the fermentation process, the real-time acquisition of important biochemical parameters (such as bacterial concentration, substrate concentration, product concentration, etc.) is of great significance for process control and optimization. However, the fermentation process has the characteristics of time-varying, strong nonlinearity, and strong coupling. It is difficult to establish an accurate mechanism model to analyze and correct process measurement data, which brings great difficulties to the optimization control of dynamic processes. The quality of key products cannot be detected online due to the lack of reliable sensors. In addition, manual sampling and offline analysis have a large time delay, which often takes several hours; on the other hand, too many sampling times can easily increase the probability of contamination of bacteria and even fermentation failure, which also makes it difficult to apply advanced control and optimization strategies in fermentation.

[0003] Soft sensor technology is an important branch in the field of industrial automation and process control. Soft sensor modeling is generally divided into two main methods, theoretical methods and empirical methods. Theoretical models are modeled through an in-depth understanding of the complex operations of industrial processes. Empirical models mainly use data-driven methods, using algorithms such as machine learning and statistical analysis to learn and extract information from a large amount of historical data, and build models to predict and estimate process variables. In contrast, empirical soft sensor models rely on analyzing data sets without in-depth research on the underlying physical and chemical processes. Empirical models use advanced statistical methods to provide predictions by identifying patterns and inferring correlations from collected data.

[0004] Although deep learning technology has made remarkable achievements in soft sensor modeling, it still has certain limitations in the industrial fermentation process. In order to more effectively obtain deeper information and improve the prediction accuracy of the soft sensor model. The present invention discloses a fermentation process soft sensor method based on spatiotemporal attention, and proposes an attention mechanism network based on spatiotemporal fusion. The network has the ability to identify the hidden states of input variables and quality variables, which improves the prediction accuracy of the model. Summary of the invention

[0005] The present invention discloses a fermentation process soft measurement method based on spatiotemporal attention, which belongs to the field of soft measurement modeling and application of industrial fermentation production process. First, the temporal attention mechanism is fused with the spatial attention mechanism to obtain the spatiotemporal fusion feature representation of different batches, and then the obtained fusion feature representation of different batches is input into the LSTM layer to obtain long-term dependencies, thereby realizing soft measurement prediction output. The model has the ability to identify the hidden state of input variables and quality variables, and is modeled according to the relationship between each small batch. By considering the spatiotemporal interaction and long-term dependencies between input variables, the prediction accuracy of the model is improved, and rapid response, minimum maintenance cost and accurate prediction results are achieved. To achieve the above purpose, the following steps are implemented:

[0006] Step 1: Preprocess the original time series data of the industrial process to obtain a refined data set. ,in, is the process variable, is the output variable, Represents time, is the input window size, is the output window size.

[0007] Step 2: To learn the complex spatial dependencies between process variables and output variables, a spatial convolutional attention mechanism is proposed to encode the obtained dataset.

[0008] Step 2.1: To reduce the significant feature mapping and the amount of calculation to prevent overfitting, feature extraction is performed through the convolution layer and the maximum pooling layer, and scanning is performed along the time dimension through the kth CNN filter:

[0009] ,

[0010] in, represents the weight parameter, represents the offset, It is time series, , including process variables and quality variables, for simplicity, Represents the target sequence , is the activation function.

[0011] Step 2.2: Integrate the generated vectors into matrix form , in order to capture the most important features, maximum pooling is performed on each row of the matrix and Integrate into matrix form:

[0012] ,

[0013] ,

[0014] in, Represents the features obtained after processing the original data. represents the integrated matrix.

[0015] Step 2.3: Input the integrated matrix into the spatial attention module. The spatial attention mechanism is as follows:

[0016] ,

[0017] ,

[0018] ,

[0019] ,

[0020] ,

[0021] in, is the input matrix after data processing, are learnable parameters, is the process variable dimension, is the number of convolution kernels, is the feature matrix With the input matrix The transformed matrix, is the scaled dot product output, is the matrix after projecting the output.

[0022] Step 3: After extracting features from the encoder, a temporal convolutional attention mechanism is introduced to learn temporal dependencies. The temporal attention mechanism is as follows:

[0023] ,

[0024] ,

[0025] ,

[0026] ,

[0027] ,

[0028] in, Yes The matrix converted using the multi-head mechanism, is the scaled dot product output, is the matrix after projecting the output.

[0029] Step 4: In order to better learn spatiotemporal dependencies, the spatial attention mechanism is integrated with the temporal attention mechanism:

[0030] ,

[0031] in, , is a learning parameter.

[0032] Step 5: To capture the long-term dependencies between different batches, the spatiotemporal features of different batches are fused (B is the batch size) is sent to the LSTM layer to get the predicted output. The LSTM mechanism is as follows:

[0033] ,

[0034] ,

[0035] ,

[0036] ,

[0037] ,

[0038] ,

[0039] in, They are forget gate, output gate and output gate respectively. is the cell memory state at time t, is the candidate state of the cell at time t, is the current hidden state, is the activation function, is the dot multiplication operation, is the activation function, is the weight parameter, is the offset.

[0040] Step 6: By the mean square error and Test the modeling results:

[0041] ,

[0042] ,

[0043] in, is the true value, is the predicted value, yes The average value of .

[0044] This method can be applied to the field of intermittent fermentation. Through small batches of different batch data, the spatiotemporal attention and spatial attention fusion mechanism and LSTM module are used to perform batch modeling of the intermittent fermentation process. The model has the ability to identify the hidden state of input variables and quality variables, and is modeled according to the relationship between each small batch. By considering the spatiotemporal interaction and long-term dependency between input variables, the prediction accuracy of the model is improved, rapid response is achieved, the time cost and maintenance cost of industrial fermentation are reduced, and accurate prediction results are obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is an overall flow chart of an embodiment of the present invention.

[0046] Figure 2 This is a model structure diagram of an embodiment of the present invention. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0048] Figure 1 This is a flow chart of an embodiment. This embodiment provides a deep learning soft measurement method based on spatiotemporal attention. The specific process includes: collecting original data and normalizing the data; establishing a spatiotemporal attention fusion model through the spatiotemporal attention mechanism; obtaining spatiotemporal fusion features of different batches through the fusion model; inputting the fusion features of different batches into the LSTM layer to obtain soft measurement output; and performing model verification on the prediction results.

[0049] Figure 2 It is a soft measurement model structure constructed by the present invention, which is composed of a spatiotemporal attention fusion network and a long short-term memory gate.

[0050] A fermentation process soft sensing method based on spatiotemporal attention includes the following steps:

[0051] Step 1: Preprocess the original time series data of the fermentation process to obtain a refined data set. ,in, is the process variable, is the output variable, Represents time, is the input window size, is the output window size.

[0052] Step 2: To learn the complex spatial dependencies between process variables and output variables, a spatial convolutional attention mechanism is proposed to encode the obtained dataset.

[0053] Step 2.1: To reduce the significant feature mapping and the amount of calculation to prevent overfitting, feature extraction is performed through the convolution layer and the maximum pooling layer, and scanning is performed along the time dimension through the kth CNN filter:

[0054] ,

[0055] in, represents the weight parameter, represents the offset, It is time series, , including process variables and quality variables, for simplicity, Represents the target sequence , is the activation function.

[0056] Step 2.2: Integrate the generated vectors into matrix form , in order to capture the most important features, maximum pooling is performed on each row of the matrix and Integrate into matrix form:

[0057] ,

[0058] ,

[0059] in, Represents the features obtained after processing the original data. represents the integrated matrix.

[0060] Step 2.3: Input the integrated matrix into the spatial attention module. The spatial attention mechanism is as follows:

[0061] ,

[0062] ,

[0063] ,

[0064] ,

[0065] ,

[0066] in, is the input matrix after data processing, are learnable parameters, is the process variable dimension, is the number of convolution kernels, is the feature matrix With the input matrix The transformed matrix, is the scaled dot product output, is the matrix after projecting the output.

[0067] Step 3: After extracting features from the encoder, a temporal convolutional attention mechanism is introduced to learn temporal dependencies. The temporal attention mechanism is as follows:

[0068] ,

[0069] ,

[0070] ,

[0071] ,

[0072] ,

[0073] in, Yes The matrix converted using the multi-head mechanism, is the scaled dot product output, is the matrix after projecting the output.

[0074] Step 4: In order to better learn spatiotemporal dependencies, the spatial attention mechanism is integrated with the temporal attention mechanism:

[0075] ,

[0076] in, , is a learning parameter.

[0077] Step 5: To capture the long-term dependencies between different batches, the spatiotemporal features of different batches are fused (B is the batch size) is sent to the LSTM layer to get the predicted output. The LSTM mechanism is as follows:

[0078] ,

[0079] ,

[0080] ,

[0081] ,

[0082] ,

[0083] ,

[0084] in, They are forget gate, output gate and output gate respectively. is the cell memory state at time t, is the candidate state of the cell at time t, is the current hidden state, is the activation function, is the dot multiplication operation, is the activation function, is the weight parameter, is the offset.

[0085] Step 6: By the mean square error and Test the modeling results:

[0086] ,

[0087] ,

[0088] in, is the true value, is the predicted value, yes The average value of .

Claims

1. A fermentation process soft sensing method based on spatiotemporal attention, characterized in that: The steps include: Step 1: Preprocess the original time series data of the fermentation process; Step 2: To learn the complex spatial dependencies between process variables and output variables, a spatial convolutional attention mechanism is proposed to encode the obtained dataset; Step 3: After extracting features from the encoder, a temporal convolutional attention mechanism is introduced to learn temporal dependencies; Step 4: In order to better learn spatiotemporal dependencies, the spatial attention mechanism is integrated with the temporal attention mechanism; Step 5: To capture the long-term dependencies of different batches, the spatiotemporal fusion features of different batches are sent to the LSTM layer to obtain the prediction output; Step 6: By the mean square error and Verify the modeling results.

2. A fermentation process soft sensing method based on spatiotemporal attention according to claim 1, characterized in that: Step 2 describes a spatial convolution attention mechanism to learn the complex spatial dependencies between process variables and output variables and encode the obtained data set. The specific implementation steps are as follows: Step 2.1: To reduce the significant feature mapping and prevent overfitting, feature extraction is performed through the convolution layer and the maximum pooling layer, and scanning is performed along the time dimension through the kth CNN filter: ， in, represents the weight parameter, represents the offset, It is time series, , including process variables and quality variables, for simplicity, Represents the target sequence , is the activation function; Step 2.2: Integrate the generated vectors into matrix form , in order to capture the most important features, maximum pooling is performed on each row of the matrix and Integrate into matrix form: ， ， in, Represents the features obtained after processing the original data. represents the integrated matrix; Step 2.3: Input the integrated matrix into the spatial attention module. The spatial attention mechanism is as follows: ， ， ， ， ， in, is the input matrix after data processing, are learnable parameters, is the process variable dimension, is the number of convolution kernels, is the feature matrix With the input matrix The transformed matrix, is the scaled dot product output, is the matrix after projecting the output.

3. The fermentation process soft sensing method based on spatiotemporal attention according to claim 1, characterized in that: After extracting features from the encoder as described in step 3, in order to learn temporal dependencies, a temporal convolutional attention mechanism is introduced, which is implemented as follows: The temporal attention mechanism is as follows: ， ， ， ， ， in, Yes The matrix converted using the multi-head mechanism, is the scaled dot product output, is the matrix after projecting the output.

4. The fermentation process soft sensing method based on spatiotemporal attention according to claim 1, characterized in that: Step 4 describes the fusion of spatial attention mechanism and temporal attention mechanism to better learn spatiotemporal dependencies. The specific implementation steps are as follows: Combining spatial attention mechanism with temporal attention mechanism: ， in, , is a learning parameter.

5. The fermentation process soft sensing method based on spatiotemporal attention according to claim 1, characterized in that: In step 5, in order to capture the long-term dependencies between different batches, the spatiotemporal fusion features of different batches are sent to the LSTM layer to obtain the prediction output. The specific steps are as follows: Fusing spatiotemporal features of different batches (B is the batch size) is sent to the LSTM layer to get the predicted output. The LSTM mechanism is as follows: , , , , , , in, They are forget gate, output gate and output gate respectively. is the cell memory state at time t, is the candidate state of the cell at time t, is the current hidden state, is the activation function, is the dot multiplication operation, is the activation function, is the weight parameter, is the offset.

Images