Controllable source electromagnetic data strong interference suppression method and system
By introducing SC-UNet networks optimized by dimensional conversion and discrete wavelet transform into the electromagnetic signal processing of controllable source, combined with the space and channel attention mechanism, the problem of difficulty in signal feature extraction in a strong noise environment is solved, and efficient denoising and accuracy improvement is achieved.
Patent Information
- Application Number
- CN202510614657.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-14
- Publication Date
- 2025-06-13
- Estimated Expiration
- 2045-05-14
AI Technical Summary
It is difficult for the controllable source electromagnetic signals to accurately capture the complete characteristics of useful signals in highly noisy environments, resulting in overfitting or underfitting, thereby reducing denoising accuracy.
The SC-UNet network optimized based on dimensional conversion and discrete wavelet transformation is adopted to perform denoising processing by converting the controllable source electromagnetic data into two-dimensional image data and combining the spatial attention mechanism and the channel attention mechanism.
Effectively suppress strong interference in the electromagnetic data of the controllable source, improve the denoising accuracy, and make the apparent resistivity curve of the denoising data smoother and more continuous, reducing the dependence on manual intervention and experience requirements.
Smart Images

Figure CN120144929A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the cross - field of electronic information, artificial intelligence and geophysics. More specifically, it relates to a method and system for suppressing strong interference of controlled - source electromagnetic data (Controlled - Source Electromagnetic Method, CSEM) based on a SC - UNet (Discrete Wavelet Transform optimized Spatial and Channel Attention Mechanism U - shaped Neural Network, DWTSC - UNet) network optimized by dimension transformation and discrete wavelet transform. Background Art
[0002] The controlled - source electromagnetic method is an electromagnetic sounding method widely used in fields such as near - surface geophysical exploration and engineering investigation. Currently, it has been increasingly widely used in fields such as shale gas exploration, metal ore exploration, and engineering geophysical prospecting. Its essence is to deduce the distribution of underground media by using the different responses generated by the electrical property structure differences of underground media. The controlled - source electromagnetic method has a known frequency and a controllable field source, and has a higher anti - interference ability compared with the natural - field - source electromagnetic method. With the continuous increase of the proportion of urbanization and industrialization, the distribution of human - made noise is becoming wider. Since the controlled - source electromagnetic signal is extremely vulnerable to human - made noise, with the continuous improvement of the requirements for exploration depth and accuracy, suppressing the noise in the controlled - source electromagnetic signal has become increasingly important.
[0003] In the face of severe human - made noise pollution, the commonly used method is the data screening method. Given the periodic characteristics of the controlled - source electromagnetic signal, the simplest method is to screen and remove the segments containing strong human - made interference in units of periods. The data screening method can improve the data quality to a certain extent and extract effective signals. However, there are still its limitations: First, the traditional manual selection of high - quality data not only requires certain prior knowledge, but also has low efficiency and is prone to subjective factors; Second, a single data statistical feature is difficult to distinguish noise segments and effective signals in a complex noise environment; if multiple groups of data statistical features are used, the mutual influence between feature parameters needs to be considered; Third, there is still residual noise (such as harmonics and Gaussian white noise, etc.) in the screened data.
[0004] In recent years, deep learning technology has developed rapidly and is increasingly widely used in the electromagnetic field. The application of deep learning algorithms in electromagnetic signal processing has gradually increased. However, due to the complexity and variability of controlled-source electromagnetic signals, when the signals are strongly interfered by noise, it is difficult for the learning model to accurately capture the complete features of useful signals, and overfitting or underfitting may occur. In addition, the deep learning networks adopted by existing methods have been proposed for decades, and there are problems such as vanishing or exploding gradients, excessive number of parameters, excessive memory occupation, and the need to improve denoising accuracy. Summary of the Invention
[0005] Aiming at the defects of the prior art, the purpose of this application is to provide a method and system for suppressing strong interference in controlled-source electromagnetic data, aiming to solve the problem that due to the complexity and polygon of controlled-source electromagnetic signals, when the signals are strongly interfered by noise, it is difficult for the learning model to accurately capture the complete features of useful signals, and overfitting or underfitting may occur, thus resulting in insufficient denoising accuracy.
[0006] To achieve the above purpose, in the first aspect, this application provides a method for suppressing strong interference in controlled-source electromagnetic data, including the following steps: Input the to-be-processed controlled-source electromagnetic data into the controlled-source electromagnetic data classification model to obtain the first noise-free controlled-source electromagnetic data and the noise-containing controlled-source electromagnetic data; Convert the noise-containing controlled-source electromagnetic data into two-dimensional image data through a dimension conversion function and input it into the DWTSC-UNet denoising network model to obtain the denoising data result; Perform an inverse dimension conversion on the denoising data result using the dimension conversion function to obtain the second noise-free controlled-source electromagnetic data; Combine the first noise-free controlled-source electromagnetic data and the second noise-free controlled-source electromagnetic data to obtain the complete noise-free controlled-source electromagnetic data; Among them, the DWTSC-UNet denoising network model is a U-shaped structure network that combines discrete wavelet transform, spatial attention mechanism, and channel attention mechanism; The discrete wavelet transform is used to provide high-frequency signals and low-frequency signals, perform weighted learning on different frequency components of the two-dimensional image data, and perform multi-scale feature extraction from the two-dimensional image data; the channel attention mechanism is used to weight different dimensions of the feature map; the spatial attention mechanism is used to weight different spatial positions of the feature map.
[0007] Further preferably, the training method of the DWTSC-UNet denoising network model includes the following steps: Select noise-containing controlled-source electromagnetic data samples from the measured data, perform denoising using the dictionary learning method, and separate the measured noise signals; The measured noise signal and the simulated noise signal are added to the noise-free controlled-source electromagnetic data to form the noise-containing controlled-source electromagnetic data, which is paired with the noise-free controlled-source electromagnetic data samples to construct a one-dimensional denoising sample library; The one-dimensional denoising sample library is segmented, and each sample is dimensionally transformed using a dimension conversion function to obtain a two-dimensional image sample library; The two-dimensional image sample library is input into the DWTSC-UNet denoising network model for training.
[0008] Further preferably, the DWTSC-UNet denoising network model includes an input layer, a hidden layer, and an output layer; the hidden layer includes: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolutional block, a first spatial attention mechanism module, a second convolutional block, a second spatial attention mechanism module, a third convolutional block, a first upsampling block, a second shape reconstruction layer, a first skip connection layer, a first channel attention mechanism layer, a second upsampling block, a second skip connection layer, a second channel attention mechanism module, and a third upsampling block.
[0009] Further preferably, the discrete wavelet transform layer is used to decompose the two-dimensional image data into a low-frequency approximation part, a horizontal high-frequency part, a vertical high-frequency part, and a diagonal high-frequency part; the low-frequency approximation part contains the basic contour of the two-dimensional image data; the horizontal high-frequency part contains the horizontal edge information of the two-dimensional image data; the vertical high-frequency part contains the vertical edge information of the two-dimensional image data; the diagonal high-frequency part contains the diagonal edge information of the two-dimensional image data.
[0010] Further preferably, the discrete wavelet transform layer uses a wavelet basis type of db5 wavelet basis and a boundary processing mode of periodic boundary conditions.
[0011] Further preferably, the controlled-source electromagnetic data classification model is an IncepTCN classification network model.
[0012] In a second aspect, the present application provides a strong interference suppression system for controlled-source electromagnetic data, including: A data classification module, configured to input the to-be-processed controlled-source electromagnetic data into the controlled-source electromagnetic data classification model to obtain the first noise-free controlled-source electromagnetic data and the noise-containing controlled-source electromagnetic data; A data denoising module, configured to convert the noise-containing controlled-source electromagnetic data into two-dimensional image data through a dimension conversion function and input it into the DWTSC-UNet denoising network model to obtain a denoised data result; A dimension conversion module, configured to perform an inverse dimension conversion on the denoised data result using a dimension conversion function to obtain the second noise-free controlled-source electromagnetic data; A data combination module, configured to combine the first noise-free controlled-source electromagnetic data and the second noise-free controlled-source electromagnetic data to obtain complete noise-free controlled-source electromagnetic data; Among them, the DWTSC-UNet denoising network model is a U-shaped structure network that combines discrete wavelet transform, spatial attention mechanism, and channel attention mechanism; The discrete wavelet transform is used to provide high-frequency signals and low-frequency signals, perform weighted learning on different frequency components of two-dimensional image data, and extract multi-scale features from the two-dimensional image data; the channel attention mechanism is used to weight different dimensions of the feature map; the spatial attention mechanism is used to weight different spatial positions of the feature map.
[0013] Further preferably, the controlled-source electromagnetic data strong interference suppression system further includes a denoising model training module, which includes: An actual measured noise signal acquisition unit, configured to select a noise-containing controlled-source electromagnetic data sample from the actual measured data, perform denoising using the dictionary learning method, and separate the actual measured noise signal; A one-dimensional denoising sample library construction unit, configured to add the actual measured noise signal and the simulated noise signal to the noise-free controlled-source electromagnetic data to form noise-containing controlled-source electromagnetic data, form a sample pair with the noise-free controlled-source electromagnetic data sample, and construct a one-dimensional denoising sample library; A dimension conversion unit, which segments the one-dimensional denoising sample library and uses a dimension conversion function to perform dimension conversion on each sample to obtain a two-dimensional image sample library; A model training unit, configured to input the two-dimensional image sample library into the DWTSC-UNet denoising network model for training.
[0014] Further preferably, the DWTSC-UNet denoising network model in the data denoising module includes an input layer, a hidden layer, and an output layer; the hidden layer includes: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolutional block, a first spatial attention mechanism module, a second convolutional block, a second spatial attention mechanism module, a third convolutional block, a first upsampling block, a second shape reconstruction layer, a first skip connection layer, a first channel attention mechanism layer, a second upsampling block, a second skip connection layer, a second channel attention mechanism module, and a third upsampling block; Among them, the discrete wavelet transform layer is used to decompose the two-dimensional image data into a low-frequency approximation part, a horizontal high-frequency part, a vertical high-frequency part, and a diagonal high-frequency part; the low-frequency approximation part contains the basic contour of the two-dimensional image data; the horizontal high-frequency part contains the horizontal edge information of the two-dimensional image data; the vertical high-frequency part contains the vertical edge information of the two-dimensional image data; the diagonal high-frequency part contains the diagonal edge information of the two-dimensional image data.
[0015] Further preferably, the discrete wavelet transform layer uses a wavelet basis type of db5 wavelet basis, and the boundary processing mode adopted is a periodic boundary condition.
[0016] Further preferably, the controlled-source electromagnetic data classification model in the data classification module is an IncepTCN classification network model.
[0017] In a third aspect, the present application provides an electronic device, including: at least one memory for storing a program; at least one processor for executing the program stored in the memory, and when the program stored in the memory is executed, the processor is used to execute the method described in the first aspect or any possible implementation manner of the first aspect.
[0018] In a fourth aspect, the present application provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program. When the computer program runs on a processor, the processor is caused to execute the method described in the first aspect or any possible implementation manner of the first aspect.
[0019] In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor is caused to execute the method described in the first aspect or any possible implementation manner of the first aspect.
[0020] It can be understood that the beneficial effects of the above second aspect to the fifth aspect can refer to the relevant descriptions in the above first aspect and will not be elaborated here.
[0021] Generally speaking, compared with the prior art by the above technical solutions conceived by the present application, the following beneficial effects are obtained: The controlled-source electromagnetic data strong interference suppression method provided by the present application introduces a dimension conversion method, converts the controlled-source electromagnetic signal denoising problem into an image denoising problem, and uses the proposed signal-to-image transformation method to convert the one-dimensional controlled-source electromagnetic time series into two-dimensional data to retain the structural characteristics of the original controlled-source electromagnetic signal.
[0022] The strong interference suppression method for controlled-source electromagnetic data provided by this application introduces a method that combines discrete wavelet transform and UNet network, making full use of the advantages of discrete wavelet transform and UNet architecture. First, discrete wavelet transform performs multi-scale feature extraction on controlled-source electromagnetic data, extracting different frequency information, which helps the network better understand the content of controlled-source electromagnetic data. Then, combining discrete wavelet transform and UNet architecture can perform more effective feature fusion between the encoder and decoder of the model, improving the performance of the network. In addition, UNet itself has good local feature capture ability. Using skip connections, the features extracted by the encoder part are directly passed to the decoder part, and discrete wavelet transform can further strengthen this ability, especially at the detail level of the image, helping the model better capture the local structure information of the image. Moreover, discrete wavelet transform can compress the high-dimensional representation of the image into a low-dimensional multi-scale representation, reducing the computational complexity and improving the processing efficiency of the network.
[0023] This application provides a strong interference suppression method for controlled-source electromagnetic data, which makes full use of the ability of the attention mechanism to improve the model's feature extraction ability, the multi-scale feature extraction ability of discrete wavelet transform, and the unique encoding-decoding structure, skip connections, and effective integration ability of local and global information of the UNet network, and proposes a new denoising network, namely the DWTSC-UNet denoising network; without inspecting the effective signal, it realizes the strong noise suppression of controlled-source electromagnetic data, and the calculated apparent resistivity curve of the denoised data is significantly improved, and the curve becomes smoother and more continuous.
[0024] This application provides a strong interference suppression method for controlled-source electromagnetic data. After the model training is completed, the processes of data processing such as recognition and denoising are all fully automated by the computer, without any manual intervention, and there is no experience requirement for data processing operators. It not only eliminates the problem of subjective deviation caused by manually setting thresholds in traditional methods, but also improves the adaptability to different types of noise. Brief Description of the Drawings
[0025] Figure 1 is one of the flow schematic diagrams of the strong interference suppression method for controlled-source electromagnetic data provided by the embodiment of this application; Figure 2 is the one-dimensional denoising sample library diagram provided by the embodiment of this application; Figure 3 is the schematic diagram of dimension conversion by the dimension conversion function provided by the embodiment of this application; Figure 4 is the architecture diagram of the WDTSC-UNet denoising network model provided by the embodiment of this application; Figure 5 is the schematic diagram of discrete wavelet transform data decomposition provided by the embodiment of this application; Figure 6 It is a graph showing the change of the loss curve during the training process of the WDTSC-UNet denoising network model provided by the embodiment of the present application; Figure 7 It is a graph of the classification sample library provided by the embodiment of the present application; Figure 8 It is an architecture diagram of the IncepTCN classification network model provided by the embodiment of the present application; Figure 9 It is a graph showing the change of accuracy and loss curves during the training process of the IncepTCN classification network model provided by the embodiment of the present application; Figure 10 It is a confusion matrix diagram of the IncepTCN classification network model provided by the embodiment of the present application; Figure 11 It is a classification effect diagram of the IncepTCN classification network model provided by the embodiment of the present application; Figure 12 It is a denoising effect diagram of the DWTSC-UNet model provided by the embodiment of the present application; Figure 13 It is a graph of U / I curve and apparent resistivity calculated from noisy data and denoised data provided by the embodiment of the present application. Detailed implementation manners
[0026] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0027] The term "and / or" in this document is an association relationship describing associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The symbol " / " in this document represents an "or" relationship between associated objects. For example, A / B represents A or B.
[0028] The terms "first", "second", etc. in the description and claims of this document are used to distinguish different objects, rather than to describe a specific order of objects.
[0029] In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Exactly, using words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.
[0030] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" refers to two or more.
[0031] The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.
[0032] As Figure 1 shown, the embodiments of the present application provide a method for suppressing strong interference of controlled-source electromagnetic data based on an SC-UNet network optimized by dimensionality conversion and discrete wavelet transform, which specifically includes the following steps: Step 1: Select controlled-source electromagnetic data with high discrimination and typical noise from a large number of measured data; Step 2: Make a denoising sample library, denoise the measured noisy samples by using the dictionary learning method, add the separated noise to the high-quality controlled-source electromagnetic data to make part of the noisy data samples; the other part of the noise samples are made by adding artificially synthesized simulated noise to the high-quality data; form sample pairs from the noisy controlled-source electromagnetic data samples and the corresponding high-quality controlled-source electromagnetic data samples, and construct a one-dimensional denoising sample library; Step 3: Segment the denoising sample library constructed in Step 2, and use the dimensionality conversion function to perform dimensionality conversion on each sample respectively, converting the one-dimensional data into a two-dimensional matrix, that is, obtaining a two-dimensional sample library; Step 4: Construct a DWTSC-UNet denoising network model, input the two-dimensional sample library obtained in Step 3 into the DWTSC-UNet denoising network model for training to obtain a controlled-source electromagnetic data denoising model; Step 5: Take each data segment in Step 1 as a sample and mark the class label of the sample; the class label indicates whether the sample is a noisy data segment or a high-quality data segment; Step 6: Construct an IncepTCN classification network, input the classification sample library into the IncepTCN classification network for training to obtain a controlled-source electromagnetic data classification model; Step 7: Input the controlled-source electromagnetic data to be processed, segment it first, and then input it into the controlled-source electromagnetic data classification model to obtain the classification result of each data segment, and retain the data segments identified as high-quality by the model; Step 8: Input the controlled-source electromagnetic data segments identified as noisy by the classification model in Step 7 into the controlled-source electromagnetic data denoising model to obtain the data denoising result of each data segment; Step 9: Use the dimensionality conversion function in Step 3 to perform inverse dimensionality conversion on the denoising result obtained in Step 8, converting the two-dimensional image data into a one-dimensional time series; Step 10: Combine the high-quality data retained in Step 7 and the data after dimensionality conversion of the denoised data in Step 9 to obtain a complete controlled-source electromagnetic denoising sequence.
[0033] Further preferably, the dimension transformation function is a data dimension transformation method. Since the length of the input one-dimensional data is 1600, it can be denoted as , and the target is to transform it into a 40×40 two-dimensional matrix A and fill the data in the way of "S" shape; the elements of the matrix can be expressed as ; For odd rows i (such as the first row, the third row, etc.), the data is filled in sequence; the i -th element of the j -th row is: (1) Wherein, ; For even rows i (such as the second row, the fourth row, etc.), the data is filled in reverse order; the i -th element of the j -th row is: (2) Wherein, ; Further preferably, wavelet transform (WT) is a mathematical tool for signal analysis and processing, which can decompose a signal into different frequency components; specifically, the present application adopts two-dimensional discrete wavelet transform, which decomposes the signal through a set of wavelet basis functions, so that the local information of the signal can be extracted; for a two-dimensional matrix, the two-dimensional discrete wavelet transform decomposes it into 4 components, including LL (low-frequency approximation part): containing the low-frequency information of the matrix, that is, the general contour of the matrix; LH (horizontal high-frequency part): containing the horizontal edge information of the matrix; HL (vertical high-frequency part): containing the vertical edge information of the matrix; HH (diagonal high-frequency part): containing the diagonal edge information of the matrix; one-dimensional discrete wavelet transform (1D-DWT) is to convolve a one-dimensional signal through the wavelet function with a one-dimensional signal, that is: (3) Wherein, is the scaled and translated form of the wavelet basis function, that is: (4) Wherein, is the scale parameter (controlling the stretching of the wavelet basis function), is the translation parameter (controlling the position of the wavelet basis function), is the mother wavelet function; The two-dimensional discrete wavelet transform is an extension of the one-dimensional transform; in the two-dimensional case, the one-dimensional discrete wavelet transform is first applied to each row of the matrix, and then the 1D-DWT is applied to each column; since the one-dimensional data is converted into a two-dimensional matrix using the dimension conversion function, denoted as ; where x and y represent the spatial coordinates in the horizontal and vertical directions respectively; for a wavelet transform is performed, that is: (5) where is the two-dimensional wavelet basis function, obtained by scaling and translating in the horizontal and vertical directions through one-dimensional wavelet transform, that is: (6) where is the scale parameter, controlling the scaling degree of the wavelet basis function; and are the translation parameters respectively, controlling the position of the wavelet basis function in the horizontal and vertical directions, is the mother wavelet function; Further preferably, the DWTSC-UNet denoising network includes an input layer, a hidden layer, and an output layer; among them, the hidden layer is composed of a discrete wavelet transform layer, two spatial attention mechanism layers, three convolutional blocks, two channel attention mechanism layers, three upsampling convolutional blocks, and two connection layers; Further preferably, the two-dimensional convolutional layers in the three convolutional blocks use convolutional kernels with different numbers of channels and the same size; 4-channel 3 3 convolutional path: Use 4 channels, with a size of 3 3 to extract the low-level features of the image; 32-channel 3 3 convolutional path: Use 32 channels, with a size of 3 3 to further abstract and extract higher-level features; 64-channel 3 3 convolutional path: Use 64 channels, with a size of 3 3 to extract more complex high-level features; 2 2 max pooling path: Use 2 2 pooling windows, with a stride of 2 for max pooling for downsampling to reduce the spatial dimensions (width and height); Further preferably, in the three upsampling blocks, convolutional kernels with different numbers of channels and the same size are used, 128-channel 2 2 convolutional path: Use 128 channels, with a stride of 2 and a size of 2 2 for upsampling to restore the spatial resolution of the image; 128-channel 2 2 Convolution Path: Use 128 channels, stride of 2, size of 2 Perform upsampling using a convolution of 2 to further restore the spatial resolution of the image; 96 channels of 2 2 Convolution Path: Use 96 channels, stride of 2, size of 2 Perform upsampling using a transposed convolution of 2 to improve the spatial resolution of the image and restore the image size; Further preferably, in the two spatial attention mechanism block layers, use the same-sized convolutional kernels, 7 7 Convolution Path: Use 7 Perform convolution of 7 to capture spatial information; Further preferably, in the two channel attention mechanism block layers, use two convolutions of 1 The first convolution of 1 Reduce the number of input channels with the first convolution of 1, and the second convolution of 1 Restore the number of channels with the second convolution of 1; The architecture of the denoising network is the improved UNet network, namely the DWT-CSUNet denoising network. The improvement compared with the traditional UNet network lies in that the DWT-CSUNet denoising network combines the advantages of discrete wavelet transform, spatial attention mechanism, channel attention mechanism and traditional U-shaped structure network. In this application, discrete wavelet transform is introduced. First of all, through multi-scale feature extraction, discrete wavelet transform can provide both high-frequency and low-frequency information of the signal, which helps the network extract more abundant hierarchical information from the data. Secondly, it can perform weighted learning on different frequency components of the image, improve the sensitivity to details and edges, and enhance the network's ability to express complex signals. Then, as a feature preprocessing method, discrete wavelet transform optimizes the data before network training, reduces the computational complexity of the network during training, and accelerates network training. Finally, in complex tasks, discrete wavelet transform helps the neural network capture a wider range of patterns by extracting multi-scale features of the signal, enhancing the generalization ability of the model. In addition, this application introduces a channel attention mechanism module and a spatial attention mechanism module. The internal structure of the module is simple, including a small number of convolution, pooling and feature fusion operations, with low computational complexity and saving computational resources. The channel attention mechanism is used to weight different channels (i.e., different dimensions of the feature map), assign a larger weight to important channels to highlight important features and enhance the network's attention to key features; assign a smaller weight to unimportant channels to suppress unimportant features and thus reduce redundant information. The spatial attention mechanism weights different spatial positions of the feature map, which helps the network focus on important regions or targets in the image and ignore the background or irrelevant parts. Secondly, by assigning higher weights to specific spatial regions, more detailed spatial information can be captured, further enhancing the denoising accuracy of the network. In controlled-source electromagnetic data denoising, this means that DWTSC-UNet can observe and understand the characteristics of controlled-source electromagnetic signals in more detail, which is very beneficial for accurately removing noise from controlled-source electromagnetic data because the noise may exist at different scales. The UNet network plays a crucial role in the DWTSC-UNet network. The overall DWTSC-UNet network adopts an "encoder-decoder" model. The encoder (downsampling part) gradually reduces the image resolution through convolution and pooling operations, extracting increasingly abstract features. The decoder (upsampling part) gradually restores the spatial resolution and image size of the image. At the same time, the UNet network introduces skip connections, directly transmitting the feature maps in the encoder stage to the corresponding layers in the decoder stage. By directly transmitting high-resolution feature maps, it avoids the loss of spatial information caused by pooling operations, thus helping the model better process information such as edges, details, and textures in the image. Skip connections enable gradients to be more easily propagated to the early layers of the network during backpropagation, thereby accelerating the training process and avoiding the problem of gradient vanishing. In addition, the advantage of the DWTSC-UNet network lies in its ability to make full use of the advantages of the UNet backbone network, discrete wavelet transform, and attention mechanism module. By combining the UNet backbone network, discrete wavelet transform, and attention mechanism module, the DWTSC-UNet network can simultaneously capture important information, extract local information, and multi-scale features, thus more comprehensively understanding controlled-source electromagnetic data. This method of comprehensively utilizing different modules makes the DWTSC-Unet network more powerful and effective in extracting important features, retaining detail features, adapting to, and expressing complex signals. Therefore, the DWTSC-UNet network in this application constructs a network structure that is more conducive to extracting the features of controlled-source electromagnetic data and suppressing the noise of controlled-source electromagnetic data by combining the attention mechanism module and discrete wavelet transform according to the structure of the UNet backbone network.
[0034] Based on the multi-scale feature extraction ability of the discrete wavelet transform, the feature focusing characteristics of the attention mechanism, and the unique advantages of the UNet network in processing two-dimensional data, this application combines the discrete wavelet transform, attention mechanism, and UNet network to optimize the UNet network structure, improve the performance of the network, and introduce the improved UNet network to solve the problem of strong noise suppression in controlled-source electromagnetic data, thereby improving the noise suppression accuracy. Further preferably, the discrete wavelet transform layer in the DWTSC-Unet denoising network uses the "db5" wavelet basis type, that is, the Daubechies wavelet basis, and the boundary processing mode used is the 'periodic' boundary processing, that is, the periodic boundary condition.
[0035] Embodiment 1 This application provides a method and system for suppressing strong interference in controlled-source electromagnetic data based on an SC-UNet (DWTSC-UNet) network optimized by dimension conversion and discrete wavelet transform. It introduces a deep learning method optimized by dimension conversion and discrete wavelet transform to solve the problem of suppressing strong interference in controlled-source electromagnetic data, specifically including the following steps: Step 1: Obtain controlled-source electromagnetic data and segment it using a time window, taking each data segment as a sample; Step 2: For typical actual noisy data segments, use the dictionary learning (SISC) algorithm for data denoising to obtain a reliable denoising effect, and obtain a reliable noise-free state of the noisy data segments to create a high-quality one-dimensional sample library for the denoising model; As Figure 2 shown, the embodiment of the present application provides a one-dimensional denoising sample library, which shows 4 typical samples. The one-dimensional sample library contains noise samples of different types and amplitudes; the noise samples include Gaussian noise signals, impulse noise signals, square wave noise signals, and mixed noise signals; in order to enable the present application to effectively distinguish useful signals from noise and ensure that the network has good generalization ability, it is necessary to provide as many useful signal and noise samples as possible during the training process, so that the network can learn more features; the number of sample pairs contained in the sample library of the present application is 48,000 pairs, among which, the number of sample pairs in the training set and the validation set are 42,000 pairs and 6,000 pairs respectively, and the ratio of the training set to the validation set is 7:1; In the embodiment of the present application, before model training, the sample data is normalized to reduce the error introduced by the difference in sample amplitudes:
[0036] wherein, is the i th normalized sample; in other feasible embodiments, no specific limitation is made thereto; Step 3: Segment the one-dimensional sample library obtained in Step 2, and use the dimension conversion function to perform dimension conversion on each sample respectively, converting the one-dimensional data into a two-dimensional matrix, that is, obtaining a two-dimensional sample library; As Figure 3 shown is a schematic diagram of dimension conversion by the dimension conversion function. The length of the sampling point sequence of each sample is 1,600, and the dimension conversion function is used to convert the sequence into a matrix shape of 40×40; In the embodiment of the present application, the dimension conversion function performs dimension conversion in an "S" shape, that is, for odd rows (such as the first row, the third row, etc.), the data is filled in sequence; for even rows (such as the second row, the fourth row, etc.), the data is filled in reverse order; Step 4: Construct a DWTSC-UNet denoising network, and input the constructed two-dimensional sample library into the DWTSC-UNet denoising network for training to obtain a controlled-source electromagnetic data denoising model; As Figure 4 shown is the DWTSC-UNet denoising network, which is composed of an input layer, a hidden layer, and an output layer; In the input layer of the embodiment of the present application, a dimension transformation function is used for dimension transformation, converting the size of 1×1600 to 1×40×40, and adding the batch size of 256 at the same time. The shape of the input layer is (256, 1, 40, 40); In the embodiment of the present application, the hidden layer is composed of a total of fifteen parts: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolutional block, a first spatial attention mechanism module, a second convolutional block, a second spatial attention mechanism module, a third convolutional block, a first upsampling block, a second shape reconstruction layer, a first skip connection layer, a first channel attention mechanism layer, a second upsampling block, a second skip connection layer, a second channel attention mechanism module, and a third upsampling block. The calculation processes of the discrete wavelet transform layer, convolutional block, spatial attention mechanism module, channel attention mechanism module, upsampling block, skip connection layer, and shape reconstruction layer in the embodiment of the present application are as follows: The steps of the discrete wavelet transform layer are as follows: First, the input shape is (256, 1, 40, 40). Using the discrete wavelet transform, each image is decomposed into a low-frequency part (LL) and three high-frequency parts (LH, HL, HH), that is, decomposed into 4 channels. Then, through the 'db5' wavelet basis and the 'periodic' boundary processing mode, the image shape is converted to (256, 4, 24, 24), and the result of the discrete wavelet transform layer is output; The steps of the first shape reconstruction layer are as follows: First, input the result of the discrete wavelet transform layer. Use the bilinear interpolation method to adjust the output size of the discrete wavelet transform layer to the same size as the input layer, that is, (256, 4, 40, 40), and output the result of the shape reconstruction layer; The steps of the first convolutional block are as follows: First, input the result of the first shape reconstruction layer, and use 32 convolutional kernels with a size of 3 3, a stride of 1, and a padding of 1 to perform two-dimensional convolution on the result of the first shape reconstruction layer, and use the 'ReLU' activation function for activation; Second, use the Batch Normalization layer to standardize the data of each channel; Third, use a pooling kernel with a size of 2 2 and a stride of 2 to perform two-dimensional max pooling on the standardized result, reducing the spatial size by half, that is, (256, 32, 20, 20), and output the result of the first convolutional block; The steps of the first spatial attention mechanism module are as follows: First, input the result of the first convolutional block, and use average pooling to calculate the channel average value of each position in the result of the first convolutional block, with the result shape being (256, 1, 20, 20); Second, use max pooling to calculate the channel maximum value of each position in the result of the first convolutional block, with the result shape being (256, 1, 20, 20); Third, concatenate the results of average pooling and max pooling along the channel dimension, with the result shape being (256, 2, 20, 20); Fourth, use 2 convolutional kernels with a size of 7 7, a stride of 1, and a padding of 3 to perform two-dimensional convolution on the concatenated result, with the result shape being (256, 1, 20, 20), and use the "Sigmoid" activation function for activation; Finally, perform element-wise multiplication on the result of the first convolutional block and the result after "Sigmoid" activation, with the result shape being (256, 32, 20, 20), and output the result of the first spatial attention mechanism module; The steps of the second convolutional block are as follows: First, input the result of the first spatial attention mechanism module, and use 64 convolutional kernels with a size of 3 3, a stride of 1, and a padding of 1 to perform two-dimensional convolution on the result of the first spatial attention mechanism module, and use the "ReLU" activation function for activation; Second, use the batch normalization layer (BatchNormalization) to standardize the data of each channel; Third, use a pooling kernel with a window size of 2 2 and a stride of 2 to perform two-dimensional max pooling on the standardized result, reducing the spatial size to half, i.e., (256, 64, 10, 10), and output the result of the second convolutional block; The steps of the second spatial attention mechanism module are as follows: First, input the result of the second convolutional block, and use average pooling to calculate the channel average value of each position in the result of the second convolutional block, with the result shape being (256, 1, 10, 10); Second, use max pooling to calculate the channel maximum value of each position in the result of the second convolutional block, with the result shape being (256, 1, 10, 10); Third, concatenate the results of average pooling and max pooling along the channel dimension, with the result shape being (256, 2, 10, 10); Fourth, use 2 convolutional kernels with a size of 7 7, a stride of 1, and a padding of 3 to perform two-dimensional convolution on the concatenated result, with the result shape being (256, 1, 10, 10), and use the "Sigmoid" activation function for activation; Finally, perform element-wise multiplication on the result of the second convolutional block and the result after "Sigmoid" activation, with the result shape being (256, 64, 10, 10), and output the result of the second spatial attention mechanism module; The steps of the third convolutional block are as follows: First, input the result of the second spatial attention mechanism module, and use 128 convolutional kernels with a size of 3 3. A convolutional kernel with a stride of 1 and a padding of 1 performs a two-dimensional convolution on the result of the second spatial attention mechanism module, and is activated using the "ReLU" activation function; second, a batch normalization layer (BatchNormalization) is used to standardize the data of each channel; third, a pooling window size of 2 2. A pooling kernel with a stride of 2 performs two-dimensional max pooling on the standardized result, reducing the spatial dimensions to half, i.e., (256, 128, 5, 5), and outputs the result of the third convolutional block; The steps of the first upsampling block are as follows: First, the result of the third convolutional block is input, and 64 filters of size 3 3. A convolutional kernel with a stride of 2 performs two-dimensional transposed convolution on the result of the third convolutional block, doubling the spatial dimensions, i.e., (256, 64, 10, 10), and outputs the result of the upsampling block; The steps of the second shape reconstruction layer are as follows: First, the result of the first upsampling block is input, and the output size of the upsampling block is adjusted to the same size as the input layer using bilinear interpolation, i.e., (256, 64, 10, 10), and outputs the result of the second shape reconstruction layer; The steps of the first skip connection layer are as follows: First, the results of the first shape reconstruction layer and the first upsampling block are input, and the results of the second shape reconstruction layer and the first upsampling block are concatenated, with the resulting shape being (256, 128, 10, 10), and outputs the result of the first skip connection layer; The steps of the first channel attention mechanism layer are as follows: First, the result of the first skip connection layer is input, and average pooling is used to perform spatial average pooling on the result of the first skip connection layer, i.e., pooling over the height and width dimensions, with the resulting shape being (256, 128, 1, 1); second, max pooling is used to perform max pooling on the result of the first skip connection layer over the height dimension, with the resulting shape being (256, 128, 1, 10), and then max pooling is performed on the max pooling result over the height dimension over the width dimension, with the resulting shape being (256, 128, 1, 1); third, the average pooling and max pooling results are concatenated over the channel dimension, with the resulting shape being (256, 256, 1, 1); fourth, 256 filters of size 1 1. A convolutional kernel with a stride of 1 performs a two-dimensional convolution on the concatenated result, with the resulting shape being (256, 8, 1, 1), and is activated using the "ReLU" activation function; fifth, 128 filters of size 1 1. A convolutional kernel with a stride of 1 performs a 2D convolution on the result after "ReLU" activation. The result shape is (256, 128, 1, 1), and it is activated using the "Sigmoid" activation function. Finally, the result of the first skip connection layer is multiplied by the result after "Sigmoid" activation. The result shape is (256, 128, 10, 10), and the result of the first channel attention mechanism layer is output; The steps of the second upsampling block are as follows: Input the result of the first channel attention mechanism layer, and use 64 with a size of 3 3. A transposed convolutional kernel with a stride of 2 performs a 2D transposed convolution on the result of the first channel attention mechanism layer, expanding the spatial dimension by two times, that is, (256, 64, 20, 20), and the result of the second upsampling block is output; The steps of the second skip connection layer are as follows: First, input the results of the first convolutional block and the second upsampling block, and concatenate the results of the first convolutional block and the second upsampling block. The result shape is (256, 96, 20, 20), and the result of the second skip connection layer is output; The steps of the second channel attention mechanism module are as follows: First, input the result of the second skip connection layer, and use average pooling to perform spatial average pooling on the result of the first skip layer, that is, pooling on the height and width dimensions. The result shape is (256, 96, 1, 1); Second, use max pooling to perform max pooling on the height dimension of the result of the second skip connection layer. The result shape is (256, 96, 1, 20), and then perform max pooling on the width dimension of the max pooling result on the height dimension. The result shape is (256, 96, 1, 1); Third, concatenate the average pooling and max pooling results on the channel dimension. The result shape is (256, 192, 1, 1); Fourth, use 256 with a size of 1 1. A convolutional kernel with a stride of 1 performs a 2D convolution on the concatenated result. The result shape is (256, 6, 1, 1), and it is activated using the "ReLU" activation function; Fifth, use 128 with a size of 1 1. A convolutional kernel with a stride of 1 performs a 2D convolution on the result after "ReLU" activation. The result shape is (256, 96, 1, 1), and it is activated using the "Sigmoid" activation function. Finally, the result of the first skip connection layer is multiplied by the result after "Sigmoid" activation. The result shape is (256, 96, 20, 20), and the result of the second channel attention mechanism layer is output; The steps of the third upsampling block are as follows: Input the result of the second channel attention mechanism layer, and use 64 with a size of 3 3. The convolution kernel with a step size of 2 performs two-dimensional transposed convolution on the result of the second-channel attention mechanism layer, expanding the spatial dimension to twice the original, i.e., (256, 1, 40, 40), and outputs the result of the third upsampling block; It should be noted that the number of the above upsampling blocks, the number of spatial attention mechanism modules, the number of channel attention mechanism modules, the number of skip connection layers, the number of convolution kernels, and their sizes are set based on the training effect of the model. Therefore, the above embodiments are only for illustrative purposes. Without departing from the concept of the present application, the number of sampling blocks, the number of spatial attention mechanism modules, the number of channel attention mechanism modules, the number of skip connection layers, the size and number of convolution kernels can be adjusted; Further preferably, the Adam optimizer is selected during the training process of the denoising model. Among them, the training and validation batch sizes are both 256, and the initial learning rate is 1×10 -5 , and the learning rate decay method is used. The learning rate decays by 0.1 every 10 training epochs, and a total of 500 times of training are performed; in other feasible embodiments, no specific limitation is made on this, and other optimizers can be selected; Such as Figure 5 is a schematic diagram of multi-scale feature decomposition by discrete wavelet transform. The two-dimensional matrix is decomposed into four frequency components through discrete wavelet transform, including a low-frequency part (LL) and three high-frequency parts (LH, HL, HH); Figure 6 is the loss change during the training process of the DWTSC-UNet denoising network model. Among them, the solid line represents the change in loss of the validation set during the model training process, and the dashed line represents the change in loss of the training set after the model is trained with the training set; from the curve shape, as the number of training times increases, the loss value of the model gradually decreases and finally tends to be stable, which indicates that the data features learned by the model tend to grow and converge, the adaptability of the model to data is increasing, and the error of the model is decreasing; Step 5: Use each data segment in Step 1 as a sample and mark the class label of the sample to construct a classification sample library; the class label indicates whether the sample is a noise data segment or a high-quality data segment; Such as Figure 7 is the classification sample library provided by the present application, showing 16 typical samples in the sample library; the first column is the measured relatively high-quality samples; the second column is the measured noisy samples; the third column is the simulated noise-free samples; the fourth column is the simulated noisy samples; it can be seen that the noise of the controlled-source signal has many types such as Gaussian noise, harmonic noise, square wave noise, impulse-like noise, and baseline drift noise; Step 6: Construct an IncepTCN classification network, and input the classification sample library into the IncepTCN classification network for training to obtain a controlled-source electromagnetic data classification model; Figure 8 Schematic diagram of the IncepTCN data classification model structure constructed for this application. The IncepTCN data classification model consists of three parts: an input layer, a hidden layer, and an output layer; the shape of the input layer is: the number of channels multiplied by the sample length, that is, 1 1600; In the embodiment of this application, the hidden layer consists of a convolutional layer, a first multi-scale convolutional module, a first time-domain convolutional block, a first max-pooling layer, a second multi-scale convolutional module, a second time-domain convolutional block, a second max-pooling layer, a third multi-scale convolutional module, a third time-domain convolutional block, a third max-pooling layer, a fourth multi-scale convolutional module, a fourth time-domain convolutional block, and a fourth max-pooling layer, a total of thirteen parts; the calculation processes of the convolutional layer, multi-scale convolutional module, time-domain convolutional block, and max-pooling layer in the embodiment of this application are as follows: The steps of the convolutional layer are: use 16 convolutional kernels of size 16 1 to perform one-dimensional convolution on the training samples and use "ReLU" activation to output the result of the convolutional layer; The steps of the first multi-scale convolutional module are: First, input the result of the convolutional layer. The four paths of the first multi-scale convolutional module are as follows, 1 3 convolutional path: use 1 3 convolutions to extract local spatio-temporal features; 1 5 convolutional path: use 1 5 convolutions to extract medium-range spatio-temporal features; 1 7 convolutional path: use 1 7 convolutions to extract wider-range spatio-temporal features; 1 3 max-pooling path: use 1 3 max-pooling to fuse local-range features; finally, connect the outputs of the four paths as the final output of the first multi-scale convolutional module to achieve multi-scale feature extraction and use it as the result of the first multi-scale convolutional module; The steps of the first time-domain convolutional block are: First, use 64 convolutional kernels of size 3 1 to perform one-dimensional causal dilated convolution and one-dimensional convolution on the result of the first multi-scale convolutional module respectively. The causal dilated convolution uses "ReLU" activation, and the one-dimensional convolution is not activated; Second, use 64 convolutional kernels of size 3 again 1 to perform one-dimensional causal dilated convolution on the activation value of the first causal dilated convolution of the residual block; Third, sum the one-dimensional convolution of the residual block and the second unactivated one-dimensional causal dilated convolution of the residual block and use "ReLU" activation to output the result of the first time-domain convolutional block; The steps of the first max-pooling layer are: First, input the result of the first time-domain convolutional block, and use a max-pooling operation with a size of 2 and a stride of 2 for screening to output the result of the first max-pooling layer; The steps of the second multi-scale convolution module are as follows: First, input the result of the first max pooling layer. The four paths of the second multi-scale convolution module are as follows: 1 3-convolution path: Use 1 3-convolution to extract local spatio-temporal features; 1 5-convolution path: Use 1 5-convolution to extract medium-range spatio-temporal features; 1 7-convolution path: Use 1 7-convolution to extract wider-range spatio-temporal features; 1 3-max pooling path: Use 1 3-max pooling to fuse local-range features; Finally, connect the outputs of the four paths as the final output of the second multi-scale convolution module to achieve multi-scale feature extraction and serve as the result of the second multi-scale convolution module; The steps of the second temporal convolution block are as follows: First, use 64 convolution kernels of size 3 ×1 to perform one-dimensional causal dilated convolution and one-dimensional convolution on the result of the second multi-scale convolution module respectively. The causal dilated convolution uses the "ReLU" activation, and the one-dimensional convolution is not activated; Second, use 64 convolution kernels of size 3 ×1 again to perform one-dimensional causal dilated convolution on the activation value of the first causal dilated convolution of the residual block; Third, sum the one-dimensional convolution of the residual block and the second unactivated one-dimensional causal dilated convolution of the residual block, and use "ReLU" activation to output the result of the second temporal convolution block; The steps of the second max pooling layer are as follows: First, input the result of the second temporal convolution block, and use max pooling operation with a size of 2 and a stride of 2 for screening to output the result of the max pooling layer; The steps of the third multi-scale convolution module are as follows: First, input the result of the second max pooling layer. The four paths of the third multi-scale convolution module are as follows: 1 3-convolution path: Use 1 3-convolution to extract local spatio-temporal features; 1 5-convolution path: Use 1 5-convolution to extract medium-range spatio-temporal features; 1 7-convolution path: Use 1 7-convolution to extract wider-range spatio-temporal features; 1 3-max pooling path: Use 1 3-max pooling to fuse local-range features; Finally, connect the outputs of the four paths as the final output of the third multi-scale convolution module to achieve multi-scale feature extraction and serve as the result of the third multi-scale convolution module; The steps of the third temporal convolution block are as follows: First, use 64 convolution kernels of size 3 The 1D causal dilated convolution and 1D convolution are respectively performed on the results of the third multi-scale convolution module using a 1D convolutional kernel of size 1. The causal dilated convolution uses the "ReLU" activation, while the 1D convolution is not activated. Second, 64 convolutional kernels of size 3 1 are used to perform 1D causal dilated convolution on the activation values of the first causal dilated convolution of the residual block. Third, the 1D convolution of the residual block and the second non-activated 1D causal dilated convolution of the residual block are summed and activated using "ReLU" to output the results of the third time-domain convolution block. The steps of the third max pooling layer are as follows: First, the results of the third time-domain convolution block are input, and a max pooling operation with a size of 2 and a stride of 2 is used for screening to output the results of the third max pooling layer.
[0037] The steps of the fourth multi-scale convolution module are as follows: First, the results of the third max pooling layer are input. The four paths of the fourth multi-scale convolution module are as follows: 1 3 convolution path: Use 1 3 convolutions to extract local spatio-temporal features; 1 5 convolution path: Use 1 5 convolutions to extract medium-range spatio-temporal features; 1 7 convolution path: Use 1 7 convolutions to extract wider-range spatio-temporal features; 1 3 max pooling path: Use 1 3 max pooling to fuse features in the local range; Finally, the outputs of the four paths are concatenated as the final output of the fourth multi-scale convolution module to achieve multi-scale feature extraction and serve as the results of the fourth multi-scale convolution module. The steps of the fourth time-domain convolution block are as follows: First, 64 convolutional kernels of size 3 1 are used to perform 1D causal dilated convolution and 1D convolution on the results of the third multi-scale convolution module respectively. The causal dilated convolution uses the "ReLU" activation, while the 1D convolution is not activated. Second, 64 convolutional kernels of size 3 1 are used to perform 1D causal dilated convolution on the activation values of the first causal dilated convolution of the residual block. Third, the 1D convolution of the residual block and the second non-activated 1D causal dilated convolution of the residual block are summed and activated using "ReLU" to output the results of the fourth time-domain convolution block. The steps of the fourth max pooling layer are as follows: First, the results of residual module 12 are input, and a max pooling operation with a size of 2 and a stride of 2 is used for screening to output the results of max pooling layer 13.
[0038] It should be noted that the number of the above-mentioned multi-scale convolution modules, the number of residual modules, the number of convolution kernels, and the size are set based on the training effect of the model. Therefore, the above embodiments are only for illustrative purposes. Without departing from the concept of the present application, the number of multi-scale convolution modules, the number of residual modules, the number of convolution kernels, and the size can be adjusted; Finally, the output layer of IncepTCN consists of 1 Flatten layer and 1 fully connected layer; the Flatten layer flattens the result of the max pooling layer into a 1 dimensional sequence of 96,000; the fully connected layer contains 2 neurons and is activated by the "Softmax" function; the output of the output layer is the probability of the category, so as to obtain the classification result of the sample, that is, noise or high quality; During the training process of the classification model in the embodiment of the present application, the Adam optimizer is selected. Among them, the training and validation Batchsize are both 256, and the initial learning rate is 1×10 -5 , and a total of 30 epochs are trained; in other feasible embodiments, specific limitations are not imposed on this, and other optimizers can be selected; Figure 9 The figure shows the accuracy and loss changes during the training process of the IncepTCN classification network model. Among them, the solid line represents the changes in accuracy and loss of the validation set during the model training process, and the dotted line represents the changes in accuracy and loss of the training set after the model is trained on the training set; from the curve shape, as the number of training times increases, the accuracy of the model is gradually increasing, and the loss value of the model is also gradually decreasing, and finally it also tends to be stable, which indicates that the data features learned by the model tend to grow to convergence, the adaptability of the model to the data is increasing, and the error of the model is decreasing; Step 7: Input the controllable-source electromagnetic data to be processed, segment it first, and then input it into the controllable-source electromagnetic data classification model to obtain the classification result of each data segment, and retain the data segments identified as high quality by the model; Step 8: Input the controllable-source electromagnetic data segments identified as noisy by the classification model in Step 7 into the controllable-source electromagnetic data denoising model to obtain the data denoising results of each data segment; Step 9: Use the dimension conversion function in Step 3 to perform an inverse dimension transformation on the denoising result obtained in Step 8, and convert the two-dimensional data into a one-dimensional time series; Step 10: Combine the high-quality data retained in Step 7 and the data after dimension conversion of the denoised data in Step 9 to obtain a complete controllable-source electromagnetic denoising sequence.
[0039] Figure 10It is the confusion matrix of the IncepTCN classification model. Here, the abscissa is the result predicted by the IncepTCN classification model, and the ordinate is the manually marked result; the label equal to 0 indicates high quality, and the label equal to 1 indicates noise. The upper left, upper right, lower left, and lower right parts of each subgraph represent the numbers of PT samples, NF samples, PF samples, and NT samples respectively; the darker the color, the larger the value; from left to right are the cases of signal-dominated, signal-noise balanced, and noise-dominated; in the case where high-quality samples are dominant, the IncepTCN classification model has achieved excellent results, with an F1 score exceeding 0.99; when the numbers of high-quality samples and noise samples are balanced, the accuracy of the IncepTCN classification model exceeds 0.99; when noise samples are dominant, the IncepTCN classification model also shows good performance, with an F1 score exceeding 0.95; Figure 11 It is the classification effect diagram of the IncepTCN classification model. Here, from top to bottom are the cases of signal-dominated, signal-noise balanced, and noise-dominated, and it can be seen from Figure 11 that the recognition effect of the IncepTCN classification model is accurate, and the noisy segments are all recognized.
[0040] Figure 12 It is the denoising effect diagram of the DWTSC-UNet model; here, the dashed line represents the synthesized noise sample, and the solid line represents the result after denoising by the DWTSC-UNet model. It can be seen from Figure 12 that the noise is effectively removed by the DWTSC-UNet model, and the overall curve becomes smooth, and no obvious noise can be seen; Figure 13 They are the apparent resistivity curve and U / I curve before and after corresponding data processing; here, the dashed line represents the apparent resistivity and U / I curves calculated from the time series of the synthesized noise signal, and the solid line represents the apparent resistivity and U / I curves calculated from the time series after being processed by the method of the present application. From left to right are the noise-containing signals with signal-to-noise ratios of 5 dB, -5 dB, -10 dB, and -15 dB respectively; it can be seen from Figure 13 that when the signal-to-noise ratio is 5 dB, the original noise curve presents a relatively smooth curve with a slight distortion at 3 Hz. When the signal-to-noise ratios are -55 dB, -10 dB, and -15 dB, the original noise curve shows significant distortion in the frequency range below 10 Hz. After being processed by the method of the present application, the distorted curves become smooth and continuous.
[0041] Embodiment 2 The present application provides a controllable-source electromagnetic data strong interference suppression system, including: A data classification module, which is used to input the controllable-source electromagnetic data to be processed into a controllable-source electromagnetic data classification model to obtain first noise-free controllable-source electromagnetic data and noise-containing controllable-source electromagnetic data; A data denoising module, which is used to convert the noise-containing controllable-source electromagnetic data into two-dimensional image data through a dimension conversion function and input it into a DWTSC-UNet denoising network model to obtain a denoising data result; A dimension conversion module, which is used to perform inverse dimension conversion on the denoising data result by using a dimension conversion function to obtain second noise-free controllable-source electromagnetic data; A data combination module, which is used to combine the first noise-free controllable-source electromagnetic data and the second noise-free controllable-source electromagnetic data to obtain complete noise-free controllable-source electromagnetic data; Wherein, the DWTSC-UNet denoising network model is a U-shaped structure network combining discrete wavelet transform, spatial attention mechanism and channel attention mechanism; The discrete wavelet transform is used to provide high-frequency signals and low-frequency signals, perform weighted learning on different frequency components of the two-dimensional image data, and perform multi-scale feature extraction from the two-dimensional image data; the channel attention mechanism is used to weight different dimensions of the feature map; the spatial attention mechanism is used to weight different spatial positions of the feature map. Further preferably, the controllable-source electromagnetic data strong interference suppression system further includes a denoising model training module, which includes: An actual measured noise signal acquisition unit, which is used to select noise-containing controllable-source electromagnetic data samples from the actual measured data, perform denoising by using a dictionary learning method, and separate the actual measured noise signal; A one-dimensional denoising sample library construction unit, which is used to add the actual measured noise signal and the simulated noise signal to the noise-free controllable-source electromagnetic data to form noise-containing controllable-source electromagnetic data, form sample pairs with the noise-free controllable-source electromagnetic data samples, and construct a one-dimensional denoising sample library; A dimension conversion unit, which segments the one-dimensional denoising sample library and uses a dimension conversion function to perform dimension conversion on each sample to obtain a two-dimensional image sample library; A model training unit, which is used to input the two-dimensional image sample library into the DWTSC-UNet denoising network model for training.
[0042] Further preferably, the DWTSC-UNet denoising network model in the data denoising module includes an input layer, a hidden layer and an output layer; the hidden layer includes: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolutional block, a first spatial attention mechanism module, a second convolutional block, a second spatial attention mechanism module, a third convolutional block, a first upsampling block, a second shape reconstruction layer, a first skip connection layer, a first channel attention mechanism layer, a second upsampling block, a second skip connection layer, a second channel attention mechanism module and a third upsampling block; Among them, the discrete wavelet transform layer is used to decompose the two-dimensional image data into a low-frequency approximation part, a horizontal high-frequency part, a vertical high-frequency part, and a diagonal high-frequency part; the low-frequency approximation part contains the basic contour of the two-dimensional image data; the horizontal high-frequency part contains the horizontal edge information of the two-dimensional image data; the vertical high-frequency part contains the vertical edge information of the two-dimensional image data; the diagonal high-frequency part contains the diagonal edge information of the two-dimensional image data.
[0043] Further preferably, the discrete wavelet transform layer uses the db5 wavelet basis as the wavelet basis type, and the boundary processing mode adopted is the periodic boundary condition.
[0044] Further preferably, the controlled-source electromagnetic data classification model in the data classification module is the IncepTCN classification network model.
[0045] In summary, compared with the prior art, the present application has the following advantages: The present application introduces a dimension conversion method to convert the problem of controlled-source electromagnetic signal denoising into an image denoising problem. By using the proposed signal-to-image transformation method, the one-dimensional controlled-source electromagnetic time series is converted into two-dimensional data to retain the structural characteristics of the original controlled-source electromagnetic signal.
[0046] The present application introduces a method that combines discrete wavelet transform and UNet network, making full use of the advantages of discrete wavelet transform and UNet architecture. First, the discrete wavelet transform performs multi-scale feature extraction on the controlled-source electromagnetic data, extracting different frequency information, which helps the network better understand the content of the controlled-source electromagnetic data. Then, combining the discrete wavelet transform and UNet architecture can perform more effective feature fusion between the encoder and decoder of the model, improving the performance of the network. In addition, UNet itself has good local feature capture ability. By using skip connections, the features extracted by the encoder part are directly passed to the decoder part, and the discrete wavelet transform can further strengthen this ability, especially at the detail level of the image, helping the model better capture the local structural information of the image. In addition, the discrete wavelet transform can compress the high-dimensional representation of the image into a low-dimensional multi-scale representation, reducing the computational complexity and improving the processing efficiency of the network.
[0047] The present application makes full use of the ability of the attention mechanism to improve the model's feature extraction ability, the multi-scale feature extraction ability of the discrete wavelet transform, and the unique encoding-decoding structure, skip connections, and effective integration ability of local and global information of the UNet network, and proposes a new denoising network, namely the DWTSC-UNet denoising network; without inspecting the effective signal, strong noise suppression of the controlled-source electromagnetic data is achieved, and the apparent resistivity curve calculated from the denoised data is significantly improved, becoming smoother and more continuous.
[0048] After the model training of this application is completed, processes such as data processing recognition and denoising are all fully automated by a computer, without any manual intervention, and there is no experience requirement for data processing operators. This not only eliminates the problem of subjective deviation caused by manually setting thresholds in traditional methods, but also improves the adaptability to different types of noise.
[0049] It can be understood that for the detailed function implementation of each of the above units / modules, reference can be made to the introduction in the foregoing method embodiments, and details are not described herein.
[0050] It should be understood that the above system is used to execute the method in the above embodiment. For the corresponding program modules in the system, their implementation principles and technical effects are similar to those described in the above method. The working process of this system can refer to the corresponding process in the above method, and details are not described herein.
[0051] Based on the method in the above embodiment, an embodiment of this application provides an electronic device, which may include: a processor, a communications interface, a memory, and a communication bus. Among them, the processor, the communications interface, and the memory complete mutual communication through the communication bus. The processor can call the logical instructions in the memory to execute the method in the above embodiment.
[0052] Those skilled in the art can easily understand that the above are only the preferred embodiments of this application, and are not intended to limit this application. Any modifications, equivalent replacements, and improvements made within the spirit and principles of this application shall be included within the protection scope of this application.
Claims
1. A controllable source electromagnetic data strong interference suppression method, characterized in that: The following steps are involved: Inputting the controlled source electromagnetic data to be processed into a controlled source electromagnetic data classification model to obtain first noise-free controlled source electromagnetic data and noisy controlled source electromagnetic data; The noisy controllable source electromagnetic data is converted into two-dimensional image data through a dimensional conversion function and input into the DWTSC-UNet denoising network model to obtain the denoised data results; A dimensionality conversion function is used to perform a dimensionality inverse conversion on the denoised data result to obtain the second noise-free controllable source electromagnetic data; combining the first noise-free controllable source electromagnetic data with the second noise-free controllable source electromagnetic data to obtain complete noise-free controllable source electromagnetic data; Among them, the DWTSC-UNet denoising network model is a U-shaped structure network that combines discrete wavelet transform, spatial attention mechanism and channel attention mechanism; Discrete wavelet transform is used to provide high-frequency and low-frequency signals, perform weighted learning on different frequency components of two-dimensional image data, and perform multi-scale feature extraction from two-dimensional image data; the channel attention mechanism is used to weight different dimensions of feature maps; the spatial attention mechanism is used to weight different spatial positions of feature maps.
2. The controllable source electromagnetic data strong interference suppression method according to claim 1 is characterized in that: The training method of the DWTSC-UNet denoising network model includes the following steps: Selecting noisy controllable source electromagnetic data samples from measured data, using dictionary learning method to denoise, and separating measured noise signals; Adding the measured noise signal and the simulated noise signal to the noise-free controllable source electromagnetic data to form the noisy controllable source electromagnetic data, forming a sample pair with the noise-free controllable source electromagnetic data sample to construct a one-dimensional denoising sample library; The one-dimensional denoising sample library is segmented, and the dimension conversion function is used to convert the dimension of each sample to obtain a two-dimensional image sample library; The two-dimensional image sample library is input into the DWTSC-UNet denoising network model for training.
3. The controllable source electromagnetic data strong interference suppression method according to claim 1 or 2, characterized in that: The DWTSC-UNet denoising network model includes an input layer, a hidden layer, and an output layer; The hidden layers include: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolution block, a first spatial attention mechanism module, a second convolution block, a second spatial attention mechanism module, a third convolution block, a first upsampling block, a second shape reconstruction layer, a first jump connection layer, a first channel attention mechanism layer, a second upsampling block, a second jump connection layer, a second channel attention mechanism module and a third upsampling block.
4. The controllable source electromagnetic data strong interference suppression method according to claim 3 is characterized in that: The discrete wavelet transform layer is used to decompose the two-dimensional image data into a low-frequency approximate part, a horizontal high-frequency part, a vertical high-frequency part and a diagonal high-frequency part; the low-frequency approximate part contains the basic outline of the two-dimensional image data; the horizontal high-frequency part contains the horizontal edge information of the two-dimensional image data; the vertical high-frequency part contains the vertical edge information of the two-dimensional image data; and the diagonal high-frequency part contains the diagonal edge information of the two-dimensional image data.
5. The controllable source electromagnetic data strong interference suppression method according to claim 4 is characterized in that: The discrete wavelet transform layer uses the db5 wavelet as the wavelet basis type and the periodic boundary condition as the boundary processing mode.
6. The controllable source electromagnetic data strong interference suppression method according to claim 1 is characterized in that: The controlled source electromagnetic data classification model is the IncepTCN classification network model.
7. A controllable source electromagnetic data strong interference suppression system, characterized in that: include: A data classification module, used for inputting the controllable source electromagnetic data to be processed into a controllable source electromagnetic data classification model to obtain first noise-free controlled source electromagnetic data and noisy controlled source electromagnetic data; A data denoising module is used to convert the noisy controllable source electromagnetic data into two-dimensional image data through a dimensional conversion function and input it into the DWTSC-UNet denoising network model to obtain denoised data results; A dimension conversion module, used for performing a dimension inverse conversion on the denoised data result by using a dimension conversion function to obtain second noise-free controllable source electromagnetic data; A data combination module, used for combining the first noise-free controllable source electromagnetic data and the second noise-free controllable source electromagnetic data to obtain complete noise-free controllable source electromagnetic data; Among them, the DWTSC-UNet denoising network model is a U-shaped structure network that combines discrete wavelet transform, spatial attention mechanism and channel attention mechanism; Discrete wavelet transform is used to provide high-frequency and low-frequency signals, perform weighted learning on different frequency components of two-dimensional image data, and perform multi-scale feature extraction from two-dimensional image data; the channel attention mechanism is used to weight different dimensions of feature maps; the spatial attention mechanism is used to weight different spatial positions of feature maps.
8. The controllable source electromagnetic data strong interference suppression system according to claim 7 is characterized in that: Also included is a denoising model training module, which includes: A measured noise signal acquisition unit is used to select a noisy controllable source electromagnetic data sample from the measured data, perform denoising using a dictionary learning method, and separate the measured noise signal; A one-dimensional denoising sample library construction unit is used to add the measured noise signal and the simulated noise signal to the noise-free controllable source electromagnetic data to form noisy controllable source electromagnetic data, and form a sample pair with the noise-free controllable source electromagnetic data sample to construct a one-dimensional denoising sample library; A dimension conversion unit divides the one-dimensional denoising sample library into segments, and performs dimension conversion on each sample using a dimension conversion function to obtain a two-dimensional image sample library; The model training unit is used to input the two-dimensional image sample library into the DWTSC-UNet denoising network model for training.
9. The controllable source electromagnetic data strong interference suppression system according to claim 7 or 8, characterized in that: The DWTSC-UNet denoising network model in the data denoising module includes an input layer, a hidden layer and an output layer; the hidden layer includes: a discrete wavelet transform layer, a first shape reconstruction layer, a first convolution block, a first spatial attention mechanism module, a second convolution block, a second spatial attention mechanism module, a third convolution block, a first upsampling block, a second shape reconstruction layer, a first jump connection layer, a first channel attention mechanism layer, a second upsampling block, a second jump connection layer, a second channel attention mechanism module and a third upsampling block; Among them, the discrete wavelet transform layer is used to decompose the two-dimensional image data into a low-frequency approximate part, a horizontal high-frequency part, a vertical high-frequency part and a diagonal high-frequency part; the low-frequency approximate part contains the basic outline of the two-dimensional image data; the horizontal high-frequency part contains the horizontal edge information of the two-dimensional image data; the vertical high-frequency part contains the vertical edge information of the two-dimensional image data; the diagonal high-frequency part contains the diagonal edge information of the two-dimensional image data.
10. The controllable source electromagnetic data strong interference suppression system according to claim 9, characterized in that: The discrete wavelet transform layer uses the db5 wavelet as the wavelet basis type and the periodic boundary condition as the boundary processing mode.
Citation Information
Patent Citations
Magnetotelluric signal identification and reconstruction method and system based on deep residual network
CN114429151A
Geomagnetic data denoising method and system based on reference trace data constraint and deep learning
CN117272138A
Signal denoising method and system based on denoising generative adversarial network and diffusion model
CN117743768A
Deep neural network based method for electromagnetic source image reconstruction
EP4312183A1
AU2020101013A4
Cited By
Controllable source electromagnetic apparent resistivity curve correction method and system based on deep learning
CN120372168A
Controllable source electromagnetic apparent resistivity curve correction method and system based on deep learning
CN120372168B
Magnetotelluric signal denoising method and system based on multi-path fusion network
CN120972273A
Geomagnetic interference suppression method and system based on multi-dimensional mapping deep learning
CN122194322A
A Geomagnetic Interference Suppression Method and System Based on Multi-Dimensional Mapping Deep Learning
CN122194322B
