Super-resolution remote sensing image reconstruction method, system and equipment based on frequency domain enhancement

The frequency domain-enhanced super-resolution remote sensing image reconstruction method solves the blurring effect and artifact problems in the processing of complex ground structures, achieves efficient restoration of image details and edge contours, and improves the visual quality and structural consistency of remote sensing images.

CN121481853AActive Publication Date: 2026-02-06YANTAI UNIV

Patent Information

Application Number
CN202610030177.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-01-12
Publication Date
2026-02-06
Estimated Expiration
2046-01-12

AI Technical Summary

Technical Problem

Existing remote sensing image reconstruction methods are prone to introducing blurring effects or producing unnatural artifacts when processing complex ground structures, making it difficult to meet the needs of refined ground feature identification and quantitative analysis. In particular, they are not effective in complex scenes such as building outlines, the fine textures of dense vegetation, and the reflective features of water surfaces.

Method used

A frequency-domain-enhanced super-resolution remote sensing image reconstruction method is adopted. By combining frequency interaction processing and depth-separable convolution with radial frequency weighting strategy and selective scanning processing, multi-dimensional interaction and selective fusion of features are achieved, thereby improving the structural consistency and texture detail recovery capability of the image.

Benefits of technology

It significantly reduces texture blurring and edge distortion, improves the visual quality and structural fidelity of reconstructed images, maintains the ability to recover detailed features in complex scenes, and has low computational complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121481853A_ABST
    Figure CN121481853A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of image data processing, and particularly relates to a super-resolution remote sensing image reconstruction method, system and device based on frequency domain enhancement, and the method comprises the steps: S1, extracting the shallow features of a low-resolution remote sensing image; s2, inputting the shallow features into a plurality of cascaded frequencies for interactive processing, performing double-branch processing on the input features, performing inverse transformation after radial weighting on different frequency components in a frequency domain to obtain first features, and obtaining second features through depth separable convolution, an activation function, a selection scanning module and layer normalization; fusing the two branch features according to the weight, performing jump connection with the original features, performing enhancement through a feedforward network, performing repeated execution for a set number of times, and performing convolution and residual connection to obtain deep features; and S3, fusing the deep features and the shallow features, and outputting a super-resolution image through convolution and pixel rearrangement up-sampling. According to the method, texture details and edge contours of the remote sensing image can be more accurately reconstructed while the structural consistency is kept.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of image data processing, and particularly relates to a super-resolution remote sensing image reconstruction method, system and device based on frequency domain enhancement. BACKGROUND

[0002] Remote sensing technology plays an important role in the fields of geological exploration, ecological environment monitoring and disaster warning. However, due to the limitations of physical performance of sensors, imaging conditions, and factors such as transmission and storage, the actual collected remote sensing images often have the problem of low spatial resolution, which is difficult to meet the needs of fine ground object identification and quantitative analysis.

[0003] Although the traditional super-resolution reconstruction method based on interpolation or frequency domain signal processing is simple to implement and has high computational efficiency, it performs poorly in texture reconstruction and edge preservation when facing complex ground object structures, and is prone to introduce blurring effects or produce unnatural artifacts.

[0004] Due to the wide coverage of remote sensing images, the high complexity of ground objects, the significant scale difference, and the strong diversity of texture structures, existing deep learning-based methods still face severe challenges when processing highly heterogeneous ground areas. For example, in complex scenes such as building contour edges, fine textures of dense vegetation, and water surface reflection characteristics, existing models are prone to produce texture blurring, edge distortion, or structural inconsistency, resulting in defects in the naturalness and structural authenticity of the generated images. SUMMARY

[0005] The purpose of the present application is to provide a super-resolution remote sensing image reconstruction method, system and device based on frequency domain enhancement.

[0006] The super-resolution remote sensing image reconstruction method based on frequency domain enhancement comprises: S1, obtaining a low-resolution remote sensing image for shallow feature extraction to obtain shallow features; S2, after the shallow features are sequentially connected and processed by multiple frequency interaction processes, deep features are obtained, and each frequency interaction process is as follows: S2.1, the shallow features are simultaneously processed by the following branch processes: Branch one, the shallow features are processed by channel expansion, and then frequency domain transformation is performed to obtain a frequency domain graph. In the frequency domain graph, weights are applied to different frequency domain components according to the center position of the frequency domain graph to obtain a weighted frequency domain graph. The first branch feature is obtained by inverse Fourier transform, and the first channel weight is obtained by processing through the channel selection interaction mechanism; Branch two, the shallow features sequentially pass through depth separable convolution processing, activation processing, selection scanning processing, and layer normalization processing to obtain the second branch feature, and the second channel weight is obtained by processing through the channel selection interaction mechanism; S2.2, the first branch feature and the second branch feature are fused by Hadamard product weighting according to the first channel weight and the second channel weight to obtain a fused feature, the fused feature is connected with the shallow feature to obtain a first feature, the first feature is enhanced to obtain a second feature, and the first feature and the second feature are connected to obtain a third feature; S2.3, the third feature is taken as a new shallow feature to execute S2.1, the new third feature obtained is taken as a new shallow feature to execute S2.1 again, and S2.1 is executed for a plurality of times in a loop, and convolution processing and residual connection are performed on all results to obtain a fourth feature, the fourth feature is connected with the shallow feature to obtain a deep feature; S3, the deep feature and the shallow feature are connected, convolution processing and pixel rearrangement processing are performed, and up-sampling is performed to obtain a super-resolution image.

[0007] The selection scanning processing of branch two in S2.1 is specifically: the feature map after the activation processing is linearly mapped into four channel groups, each channel group flattens the two-dimensional image feature into a one-dimensional sequence according to different scanning strategies, obtains a spatial model representation of continuous time state through structured state space sequence processing, converts the spatial model representation into a discrete model, and performs convolution processing in a recursive form to obtain the input of layer normalization processing.

[0008] The scanning strategy is a row-first and column-first scanning mode, and the four scanning modes are row-first forward scanning, row-first reverse scanning, column-first forward scanning and column-first reverse scanning.

[0009] The convolution processing in a recursive form is specifically: , , wherein, is a structured convolution kernel, the matrix , , and are a discrete-time state transition matrix, a discrete-time state input matrix, an output matrix and a direct transfer matrix respectively, is the length of the input sequence, is the input sequence, is the output sequence, that is, the input of the layer normalization processing in branch two.

[0010] The feature enhancement of the first feature in S2.2 is specifically: the first feature is normalized, the channel dimension is expanded after normalization through linear projection, and then spatial modeling and local information extraction processing are performed through deep separable convolution, and the second feature is obtained after activation.

[0011] The second feature is obtained after processing and activation, including Gaussian error linear unit activation and Sigmoid weighted linear activation.

[0012] In branch one of S2.1, weights are applied to different frequency domain components according to the center position of the frequency domain graph, specifically: , wherein, is the weight applied to different frequency domain components, H and W represent the height and width of the frequency domain graph respectively, represents the position coordinates in the frequency domain graph, represents the center position coordinates of the frequency domain graph.

[0013] After the first branch feature channel selection interaction mechanism processing of branch one in S2.1, global average pooling is performed to obtain the first channel weight.

[0014] The super-resolution remote sensing image reconstruction system based on frequency domain enhancement is used to implement the super-resolution remote sensing image reconstruction method based on frequency domain enhancement, and comprises: A shallow feature acquisition module acquires a low-resolution remote sensing image to extract shallow features, thereby obtaining shallow features. A deep feature acquisition module, after the shallow features are sequentially connected and processed by multiple frequency interactions, obtains deep features, and each frequency interaction is as follows: The shallow features are simultaneously processed by the following branches: Branch one, the shallow features are processed by channel expansion, and then frequency domain transformation is performed to obtain a frequency domain graph. In the frequency domain graph, weights are applied to different frequency domain components according to the center position of the frequency domain graph to obtain a weighted frequency domain graph. The first branch feature is obtained through inverse Fourier transformation, and the first channel weight is obtained through channel selection interaction mechanism processing. Branch two, the shallow features are sequentially processed by depth separable convolution, activation, selection scanning, and layer normalization to obtain the second branch feature, and the second channel weight is obtained through the channel selection interaction mechanism processing. The first branch feature and the second branch feature are fused by Hadamard product weighting according to the first channel weight and the second channel weight to obtain the fusion feature. The fusion feature and the shallow feature are connected by jumping to obtain the first feature. The first feature is processed by feature enhancement to obtain the second feature. The first feature and the second feature are connected by jumping to obtain the third feature. The third feature is taken as new shallow features to perform branch processing. The new third feature obtained is taken as new shallow features to perform branch processing again. The branch processing is executed in a loop for a set number of times. The results of all executions are processed by convolution and residual connection to obtain the fourth feature. The fourth feature and the shallow feature are connected by jumping to obtain the deep feature. The super-resolution image output module is connected with the deep features and the shallow features, performs convolution processing and pixel rearrangement processing, and performs upsampling to obtain a super-resolution image.

[0015] The super-resolution remote sensing image reconstruction device based on frequency domain enhancement comprises a processor and a memory.

[0016] The super-resolution remote sensing image reconstruction method based on frequency domain enhancement has the following beneficial effects: The branch one of the present application introduces frequency domain enhancement processing, adopts a radial frequency weighting strategy in the frequency domain, effectively strengthens high-frequency components related to texture and edges, and suppresses low-frequency redundant information.

[0017] In view of the problems of complex ground object types, large scale differences and strong structural diversity of remote sensing images, the present application designs a branch processing to realize a multi-dimensional feature interaction mechanism, and realizes selective fusion of features in the channel and sequence dimensions.

[0018] The lightweight depth separable convolution processing and the efficient selection scanning processing can control the computational complexity while ensuring strong feature extraction and reconstruction capability.

[0019] Meanwhile, the present application uses a smooth nonlinear activation function to further enhance the expression ability of the features. BRIEF DESCRIPTION OF DRAWINGS

[0020] Figure 1 is a low-resolution remote sensing image; Figure 2 The super-resolution remote sensing image obtained by the method of the present application. DETAILED DESCRIPTION

[0021] Embodiment In order to further understand the content of the present application, the present application will be described in detail in conjunction with the embodiments.

[0022] This invention relates to a method, system, and device for super-resolution remote sensing image reconstruction based on frequency domain enhancement, comprising the following steps: Super-resolution remote sensing image reconstruction methods based on frequency domain enhancement include: S1. Obtain low-resolution remote sensing images and perform shallow feature extraction to obtain shallow features.

[0023] For an input low-resolution image Shallow features are obtained by passing through a 3×3 convolutional layer. This process can be represented as: , in, It is a shallow feature obtained after a 3×3 convolution layer. H, W, and C represent the height, width, and number of channels of the feature map, respectively. The number of channels is determined by the number of convolution kernels. This indicates a convolutional layer with a kernel size of 3x3. This represents a low-resolution image with a height of H, a width of W, and 3 channels.

[0024] The shallow feature extraction part captures the basic edge, texture and brightness information of the remote sensing image, providing the original foundation for subsequent deep feature extraction.

[0025] S2. Shallow features are processed by a series of sequentially connected frequencies to obtain deep features. Each frequency interaction is processed as follows: S2.1. Perform the following branching processing on shallow features simultaneously: Branch 1: The shallow features are subjected to channel dilation and then frequency domain transformation to obtain a frequency domain map. In the frequency domain map, weights are applied to different frequency domain components according to the center position of the frequency domain map to obtain a weighted frequency domain map. The first branch features are obtained by inverse Fourier transform and the first channel weights are obtained by processing through the channel selection interaction mechanism. Branch 2 involves sequentially processing the shallow features through depthwise separable convolution, activation, selective scanning, and layer normalization to obtain the second branch features. The second channel weights are then obtained through a channel selection interaction mechanism.

[0026] Specifically, one-third of the input features are dilated into channels by linear projection. C, This is a predefined channel expansion factor, which is set to 1 here.

[0027] During frequency domain enhancement, the input features are transformed in the frequency domain, projecting the spatial domain features onto a two-dimensional frequency domain map. : , in, Represents the Fast Fourier Transform. This represents a linear projection operation, where U is the input feature of branch one, which is a shallow feature here.

[0028] In the frequency domain image, weights are applied to different frequency components based on their center position to obtain a weighted frequency domain image. This highlights high-frequency information related to texture and edges while suppressing low-frequency redundant components. (Weighted frequency domain image) for: , , in, To assign weights to different frequency domain components, H and W represent the height and width of the frequency domain plot, respectively. This represents the position coordinates in the frequency domain plot. This represents the coordinates of the center position of the frequency domain plot. This represents the weighting factor.

[0029] Weighted frequency domain graph via inverse Fourier transform Returning to the spatial domain, we obtain the features of the first branch: , The weight of the first channel is obtained through a channel selection interaction mechanism. Specifically, after the first branch feature channel selection interaction mechanism is processed, global average pooling is then performed to obtain the weight of the first channel.

[0030] , GAP(⋅) represents the Global Average Pooling operation, used to aggregate global information in the spatial dimension; GELU(⋅) is the Gaussian Error Linear Unit activation function, used to enhance the nonlinear expressive power of the model; This indicates a convolution operation with a kernel size of 1×3; Sigmoid(⋅) represents the Sigmoid activation function, used to normalize the input features. Branch two also requires processing the input features. Expand the channel using linear projection. C, here the input features still refer to shallow features.

[0031] The second branch features are obtained by sequentially performing depthwise separable convolution, activation processing, selective scanning processing, and layer normalization. The process can be described as follows: , Among them, select scan processing Specifically, the activated feature map is linearly mapped into four channel groups. Each channel group flattens the two-dimensional image features into a one-dimensional sequence according to a different scanning strategy. After structured state space sequence processing, a spatial model representation of the continuous time state is obtained, which can effectively capture long-distance dependencies in the sequence. Through recursive updating of the hidden state vector, efficient modeling and information transmission of the sequence are achieved, thereby improving the ability to express and predict complex time series data. The spatial model representation is converted into a discrete model and recursively convolved to obtain the input for layer normalization processing.

[0032] The scanning strategy is a row-first and column-first scanning method. The four scanning methods are row-first forward scanning, row-first reverse scanning, column-first forward scanning, and column-first reverse scanning.

[0033] The spatial model of continuous-time state is represented as: , in, It is the derivative of the hidden state vector with respect to time t; It is a hidden state vector, representing the internal state of the system at time t, and a matrix. It is a continuous-time state transition matrix that determines the dynamic changes of the hidden state vector; the matrix It is a continuous-time state input matrix, representing how the input signal affects the change of the hidden state vector; It is the input signal. It is the output signal; matrix It is the output matrix, representing how the hidden state vectors affect the output; scalar It is a direct transfer matrix, representing the direct effect of the input on the output.

[0034] Convert a continuous model to a discrete model: , , in, It is the time step, representing the sampling interval. It is a discrete-time state transition matrix. For matrix exponents, It is a discrete-time state input matrix. It is the identity matrix, a matrix It is a continuous-time state transition matrix. It is a continuous-time state input matrix; After discretizing the spatial model, the recurrence equation is obtained: ; in, It is the first The hidden state vector at each time step It is the first Input at each time step, It is the first The output of each time step It is the length of the input sequence, the matrix , , and These are the discrete-time state transition matrix, discrete-time state input matrix, output matrix, and direct transfer matrix, which control state updates and output generation, respectively. Convolution is performed recursively to facilitate parallel computation, specifically as follows: , , in, It is a structured convolution kernel, a matrix , , and These are the discrete-time state transition matrix, the discrete-time state input matrix, the output matrix, and the direct transfer matrix, respectively. It is the length of the input sequence. Given the input sequence, The output sequence serves as the input for the normalization process in the second branch. Finally, all sequences are merged and reshaped to restore the 2D structure.

[0035] Second branch features Sequence weights are obtained through a sequence selection interaction mechanism. : .

[0036] S2.2. The first branch features and the second branch features are weighted and fused by Hadamard product according to the first channel weight and the second channel weight to obtain the fused features. The fused features are then connected with the shallow features to obtain the first features. The first features are then enhanced to obtain the second features. The first features and the second features are then connected to obtain the third features.

[0037] Specifically, using Hadamah (a type of product) The weights obtained from the two branches , and characteristics , The features are then fused, and the fused features are concatenated. Finally, a linear projection is used to project the concatenated feature channels onto the input channel number. C , obtain fusion features To ensure that its shape matches the input shape: , in This indicates a feature splicing operation.

[0038] The first feature is obtained by skipping connections between the fused feature and the shallow feature. The first feature is normalized, and the channel dimension is expanded by linear projection after normalization. Then, spatial modeling and local information extraction are performed by depthwise separable convolution. After processing, activation is performed to obtain the second feature.

[0039] Specifically, the first feature after normalization Z First, the channel dimension is expanded to [a certain value] using linear projection. C Subsequently, depthwise separable convolution is used to perform spatial modeling and local information extraction on the features, resulting in the feature... Y : , After processing, activation is performed to obtain the second feature, which includes Gaussian error linear unit activation and Sigmoid weighted linear activation. Y To enhance feature representation, Gaussian error linear units (GELU) and sigmoid weighted linear units (SiLU) are activated respectively. The activated features are then fused, and the channel number is linearly projected back. C The second feature is obtained, and this process is represented as follows: .

[0040] By skipping the first and second features, we obtain the third feature.

[0041] S2.3. Using the third feature as a new shallow feature, execute S2.1 again. Repeat this process, executing S2.1 a set number of times. Perform convolution and residual connections on all the results to obtain the fourth feature. Then, perform a skip connection between the fourth feature and the shallow features to obtain the deep feature. .

[0042] The ability to model high-order semantics and high-frequency textures is improved by using residual connections and convolution processing in the deep feature extraction part.

[0043] S3, Deep Features shallow features Skip connections, perform convolution and pixel rearrangement processing, and upsampling to obtain a super-resolution image.

[0044] This step includes two parts. The algorithm employs a convolutional layer and a pixel rearrangement process (PS). The PS layer rearranges the channel dimensions of the feature map, mapping the channel dimension information to the spatial dimension, achieving efficient upsampling without interpolation loss to recover high-resolution images. : , in, Indicates magnification factor. , These represent the height and width of the reconstructed high-resolution image, respectively; both are the same size as the input low-resolution image. times.

[0045] A frequency-domain-enhanced super-resolution remote sensing image reconstruction system, used to implement the aforementioned frequency-domain-enhanced super-resolution remote sensing image reconstruction method, includes: The shallow feature acquisition module acquires low-resolution remote sensing images and extracts shallow features to obtain shallow features. The deep feature acquisition module obtains deep features by processing shallow features through a series of sequentially connected frequency interactions. Each frequency interaction is processed as follows: The following branching processes are performed simultaneously on the shallow features: Branch 1: The shallow features are subjected to channel dilation and then frequency domain transformation to obtain a frequency domain map. In the frequency domain map, weights are applied to different frequency domain components according to the center position of the frequency domain map to obtain a weighted frequency domain map. The first branch features are obtained by inverse Fourier transform and the first channel weights are obtained by processing through the channel selection interaction mechanism. Branch 2: The shallow features are processed sequentially through depth-separable convolution, activation, selective scanning, and layer normalization to obtain the second branch features. The second channel weights are obtained through a channel selection interaction mechanism. The first branch features and the second branch features are weighted and fused together by Hadamard product according to the first channel weight and the second channel weight to obtain the fused feature. The fused feature is then connected with the shallow features to obtain the first feature. The first feature is then enhanced to obtain the second feature. The first feature and the second feature are then connected to obtain the third feature. The third feature is used as a new shallow feature to perform branch processing. The resulting new third feature is used as a new shallow feature to perform branch processing again. This process is repeated a set number of times. All the results are then convolved and residual connected to obtain the fourth feature. The fourth feature is then skipped and connected with the shallow features to obtain the deep feature. The super-resolution image output module performs skip connections between deep and shallow features, convolution and pixel rearrangement, and upsampling to obtain a super-resolution image.

[0046] A frequency-domain-enhanced super-resolution remote sensing image reconstruction device includes a processor and a memory, wherein the processor executes a computer program stored in the memory to implement the frequency-domain-enhanced super-resolution remote sensing image reconstruction method.

Claims

1. A super-resolution remote sensing image reconstruction method based on frequency domain enhancement, characterized in that, include: S1. Obtain low-resolution remote sensing images and perform shallow feature extraction to obtain shallow features; S2. Shallow features are processed by a series of sequentially connected frequencies to obtain deep features. Each frequency interaction is processed as follows: S2.

1. Perform the following branching processing on shallow features simultaneously: Branch 1: The shallow features are subjected to channel dilation and then frequency domain transformation to obtain a frequency domain map. In the frequency domain map, weights are applied to different frequency domain components according to the center position of the frequency domain map to obtain a weighted frequency domain map. The first branch features are obtained by inverse Fourier transform and the first channel weights are obtained by processing through the channel selection interaction mechanism. Branch 2: The shallow features are processed sequentially through depth-separable convolution, activation, selective scanning, and layer normalization to obtain the second branch features. The second channel weights are obtained through a channel selection interaction mechanism. S2.

2. The first branch features and the second branch features are weighted and fused by Hadamard product according to the first channel weight and the second channel weight to obtain the fused features. The fused features are then connected with the shallow features to obtain the first features. The first features are then enhanced to obtain the second features. The first features and the second features are then connected to obtain the third features. S2.

3. Use the third feature as a new shallow feature and execute S2.

1. Then use the new third feature as a new shallow feature and execute S2.1 again. Repeat this process for a set number of times. Perform convolution and residual connection on all the results to obtain the fourth feature. Then perform a skip connection between the fourth feature and the shallow feature to obtain the deep feature. S3. Deep features and shallow features are skipped and connected, then convolutional and pixel rearrangement are performed, followed by upsampling to obtain a super-resolution image.

2. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 1, characterized in that, The specific steps of the selection scanning process in branch two of S2.1 are as follows: the feature map after activation is linearly mapped into four channel groups. Each channel group flattens the two-dimensional image features into a one-dimensional sequence according to a different scanning strategy. After structured state space sequence processing, a spatial model representation of the continuous time state is obtained. The spatial model representation is converted into a discrete model and convolved in a recursive form to obtain the input for layer normalization processing.

3. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 2, characterized in that, The scanning strategy is a row-first and column-first scanning method. The four scanning methods are row-first forward scanning, row-first reverse scanning, column-first forward scanning, and column-first reverse scanning.

4. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 2, characterized in that, Convolution is performed recursively, specifically as follows: , , in, It is a structured convolution kernel, a matrix , , and These are the discrete-time state transition matrix, the discrete-time state input matrix, the output matrix, and the direct transfer matrix, respectively. It is the length of the input sequence. Given the input sequence, This is the output sequence, which is the input for the normalization process in the middle layer of branch two.

5. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 1, characterized in that, In S2.2, the feature enhancement of the first feature is as follows: the first feature is normalized, and after normalization, the channel dimension is expanded by linear projection. Then, spatial modeling and local information extraction are performed by depthwise separable convolution. After processing, activation is performed to obtain the second feature.

6. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 5, characterized in that, The second feature is obtained after the processing and activation, including Gaussian error linear unit activation and Sigmoid weighted linear activation.

7. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 1, characterized in that, In S2.1, branch one applies weights to different frequency components based on the center position of the frequency domain graph, specifically as follows: , in, To assign weights to different frequency domain components, H and W represent the height and width of the frequency domain plot, respectively. This represents the position coordinates in the frequency domain plot. This represents the coordinates of the center position of the frequency domain plot.

8. The super-resolution remote sensing image reconstruction method based on frequency domain enhancement according to claim 1, characterized in that, In S2.1, the first channel weight is obtained through the channel selection interaction mechanism. Specifically, after the first branch feature channel selection interaction mechanism is processed, global average pooling is performed to obtain the first channel weight.

9. A super-resolution remote sensing image reconstruction system based on frequency domain enhancement, used to implement the super-resolution remote sensing image reconstruction method based on frequency domain enhancement as described in any one of claims 1-8, characterized in that, include: The shallow feature acquisition module acquires low-resolution remote sensing images and extracts shallow features to obtain shallow features. The deep feature acquisition module obtains deep features by processing shallow features through a series of sequentially connected frequency interactions. Each frequency interaction is processed as follows: The following branching processes are performed simultaneously on the shallow features: Branch 1: The shallow features are subjected to channel dilation and then frequency domain transformation to obtain a frequency domain map. In the frequency domain map, weights are applied to different frequency domain components according to the center position of the frequency domain map to obtain a weighted frequency domain map. The first branch features are obtained by inverse Fourier transform and the first channel weights are obtained by processing through the channel selection interaction mechanism. Branch 2: The shallow features are processed sequentially through depth-separable convolution, activation, selective scanning, and layer normalization to obtain the second branch features. The second channel weights are obtained through a channel selection interaction mechanism. The first branch features and the second branch features are weighted and fused together by Hadamard product according to the first channel weight and the second channel weight to obtain the fused feature. The fused feature is then connected with the shallow features to obtain the first feature. The first feature is then enhanced to obtain the second feature. The first feature and the second feature are then connected to obtain the third feature. The third feature is used as a new shallow feature to perform branch processing. The resulting new third feature is used as a new shallow feature to perform branch processing again. This process is repeated a set number of times. All the results are then convolved and residual connected to obtain the fourth feature. The fourth feature is then skipped and connected with the shallow features to obtain the deep feature. The super-resolution image output module performs skip connections between deep and shallow features, convolution and pixel rearrangement, and upsampling to obtain a super-resolution image.

10. A super-resolution remote sensing image reconstruction device based on frequency domain enhancement, characterized in that, It includes a processor and a memory, wherein the processor executes a computer program stored in the memory to implement the frequency domain enhancement-based super-resolution remote sensing image reconstruction method as described in any one of claims 1-8.

Citation Information

Patent Citations

  • Image super-resolution reconstruction method

    CN116188274A

  • Remote sensing image super-resolution reconstruction method and system based on multi-scale enhancement module

    CN116342389A

  • Remote sensing image super-resolution reconstruction method based on multi-path fusion and attention

    CN117173022A

  • High-resolution reconstruction method for remote sensing image under complex degradation model

    CN117474764A

  • Space and frequency domain combined super-resolution reconstruction method for arbitrary-scale multi-modal remote sensing image

    CN118799183A

Cited By

  • Remote sensing image super-resolution reconstruction method, device and equipment based on feature modulation

    CN122048671A

  • Image super-resolution reconstruction method and system based on frequency domain adaptive enhancement

    CN122199264A