Self-supervised remote sensing image space-spectrum fusion method and device based on prior image constraint

By using a priori images as constraints in the null spectral fusion of remote sensing images and using a self-supervised training method, the problem of insufficient consideration of the relationship between full-color images and multi-spectral images in the prior art is solved, and the stability and accuracy of the fusion results are improved.

CN119851073AActive Publication Date: 2025-04-18AEROSPACE INFORMATION RES INST CAS
6 Cites 5 Cited by

Patent Information

Application Number
CN202411782510.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-05
Publication Date
2025-04-18
Estimated Expiration
2044-12-05

AI Technical Summary

Technical Problem

The existing deep learning methods lack sufficient consideration of the inherent relationship between full-color and multi-spectral images when fusion of remote sensing images, resulting in distortion of the fusion results in spatial details and spectral information maintenance, especially when processing different sensor data, the generalization ability of the model is poor.

Method used

The self-supervised remote sensing image null spectrum fusion method based on prior image constraints is adopted. By generating a prior image, the image contains the spatial information of the full-color image and the spectral information of the multi-spectral image, and is input into the remote-sensing image null spectrum fusion network as constraints. The self-supervised training method is used to calculate the probability distribution differences between the spatial loss and spectral loss between the fusion image, the sample full-color image and the sample multi-spectral image through the target loss function.

Benefits of technology

The generalization ability of the model when processing different sensor data is improved, a more stable fusion effect is achieved, and the accuracy of fusion results in spatial details and spectral information is enhanced.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a priori image constraint-based self-supervised remote sensing image space-spectrum fusion method and device, and relates to the technical field of remote sensing satellites. The method comprises the following steps: acquiring a panchromatic image and a multispectral image; a prior image is generated based on the spatial information of the panchromatic image and the spectral information of the multispectral image, and the prior image is used for constraining the fusion process of the panchromatic image and the multispectral image by a remote sensing image spatial-spectral fusion network; inputting the panchromatic image, the multispectral image and the prior image into the remote sensing image spatial-spectral fusion network, and obtaining a target fusion image output by the remote sensing image spatial-spectral fusion network; by implementing the technical scheme provided by the invention, the generalization ability of the model in processing different sensor data is enhanced, and a more stable fusion effect is realized.
Need to check novelty before this filing date? Find Prior Art