Method and device for relative registration between wavebands of remote sensing image of geologic No.1 satellite
By using a self-selected region offset calculator and time frame selection resampling technology, the problem of insufficient registration accuracy between bands in the Geological Survey-1 satellite remote sensing images was solved, achieving high-precision registration even with poor image quality and focal plane module placement errors.
Patent Information
- Application Number
- CN202512045361.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-31
- Publication Date
- 2026-01-30
- Estimated Expiration
- 2045-12-31
AI Technical Summary
The registration accuracy between bands of remote sensing images from the Geological Survey-1 satellite is limited. Existing technologies cannot accurately register images with poor quality, and there are imaging distortions caused by errors in the placement of the focal plane module, which affect the registration effect.
Image quality is screened using a self-selected region offset calculator. After calculating the offset, image registration is performed. Relative registration between bands is achieved by using time frame selection and resampling to process band images with inconsistent resolutions.
Even with poor image quality and focal plane module placement errors, it improves the accuracy and precision of inter-band registration, avoiding errors caused by changes in image quality and resolution differences.
Smart Images

Figure CN121437584A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of image data processing technology, and in particular to a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite. Background Technology
[0002] Currently, before processing satellite remote sensing images, it is necessary to complete the registration between remote sensing image bands because the registration accuracy between remote sensing image bands will directly affect the accuracy of subsequent product production.
[0003] The Geological Survey-1 satellite's hyperspectral camera includes a visible light camera and a shortwave infrared camera. The hyperspectral camera operates in pushbroom mode, which results in different ground features being captured at the same imaging time in different bands, and the same ground feature exhibiting lateral and longitudinal shifts between different bands. Furthermore, the visible light camera's imaging component consists of two time-delay integration charge-coupled device (TDICCD) focal plane modules. The placement of these two modules is manual, inevitably introducing errors that cause slight distortions in the imaging between the two modules, thus affecting the accurate registration between bands in the Geological Survey-1 remote sensing images.
[0004] Currently, the most direct solution for registering remote sensing images between bands of the Geological Survey-1 satellite is to find control points and use the found control points to transform the remote sensing images to complete the registration. However, this will basically change the original pixel values of the remote sensing images, which does not meet the registration requirements of the Geological Survey-1 satellite remote sensing images. It is also time-consuming, and if the quality of the remote sensing images is poor, there may be situations where control points cannot be found. Summary of the Invention
[0005] In view of this, the present invention provides a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite, which can accurately perform relative registration between bands of remote sensing images without changing the original pixel values of the remote sensing images when the image quality is poor.
[0006] According to one aspect of the present invention, a method for relative registration between bands of remote sensing images from the Geological Survey-1 satellite is provided, the method comprising: Acquire all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, and acquire all first focal plane module band images of visible light and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Satellite-1. Based on the self-selected region offset calculator, registration is performed between all the shortwave infrared band images to obtain a registered shortwave infrared band image. Based on the self-selected region offset calculator, registration is performed between all the first focal plane module band images, between all the second focal plane module band images, and between the first focal plane module band image and the second focal plane module band image to obtain a registered visible light band image. The registration of the shortwave infrared band image and the registration of the visible light band image is performed based on time frame selection and resampling to complete the relative registration between the bands of the Geological Survey-1 satellite remote sensing image.
[0007] Preferably, the step of acquiring all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Survey-1 satellite, and acquiring all first focal plane module band images of visible light and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Survey-1 satellite, includes: Acquire all initial shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, and acquire all initial first focal plane module band images and all initial second focal plane module band images of the visible light corresponding to the remote sensing image bands of the Geological Satellite-1. By removing a fixed offset from all the initial shortwave infrared band images, all the initial first focal plane module band images, and all the initial second focal plane module band images, the corresponding shortwave infrared band images, first focal plane module band images, and second focal plane module band images are obtained.
[0008] Preferably, the registration of all the shortwave infrared band images based on the self-selected region offset calculator to obtain the registered shortwave infrared band images includes: A reference shortwave infrared band image is extracted from all the shortwave infrared band images and used as a reference. Shortwave infrared band images other than the reference shortwave infrared band image are used as other shortwave infrared band images. A first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images is calculated based on a self-selected region offset calculator. The pixel positions of the other shortwave infrared band images are corrected according to the first offset to obtain the other shortwave infrared band images after each position correction. The reference shortwave infrared band image and all the other shortwave infrared band images after position correction are used as the registered shortwave infrared band images.
[0009] Preferably, the registration of all first focal plane module band images, all second focal plane module band images, and the registration of the first focal plane module band image and the second focal plane module band image based on the self-selected region offset calculator to obtain a registered visible light band image includes: Extract a reference first focal plane module band image from all the first focal plane module band images, and take the first focal plane module band images other than the reference first focal plane module band image from all the first focal plane module band images as other first focal plane module band images. Calculate a second offset between the reference first focal plane module band image and each of the other first focal plane module band images based on a self-selected region offset calculator. Extract a reference second focal plane module band image from all the second focal plane module band images, and take the second focal plane module band images other than the reference second focal plane module band image from all the second focal plane module band images as other second focal plane module band images. Calculate a third offset between the reference second focal plane module band image and each of the other second focal plane module band images based on the self-selected region offset calculator. A reference first focal plane module band image is extracted from the reference first focal plane module band image and the reference second focal plane module band image for use as a reference, or a reference second focal plane module band image is extracted from the reference first focal plane module band image and the reference second focal plane module band image for use as a reference, and a fourth offset between the reference first focal plane module band image and the reference second focal plane module band image is calculated based on the self-selected region offset calculator; If the reference image extracted from the reference first focal plane module band image and the reference second focal plane module band image is the reference first focal plane module band image, then the pixel position of each of the other first focal plane module band images is corrected according to the second offset to obtain each position-corrected other first focal plane module band image. The pixel position of the reference second focal plane module band image is corrected according to the fourth offset to obtain the position-corrected reference second focal plane module band image. The pixel position of each of the other second focal plane module band images is corrected according to the third offset and the fourth offset to obtain each position-corrected other second focal plane module band image. The reference first focal plane module band image, each position-corrected other first focal plane module band image, the position-corrected reference second focal plane module band image, and each position-corrected other second focal plane module band image are used as registered visible light band images. If the reference image extracted from the reference first focal plane module band image and the reference second focal plane module band image is the reference second focal plane module band image, then the pixel position of each of the other first focal plane module band images is corrected according to the second offset and the fourth offset to obtain the other first focal plane module band image after position correction. The pixel position of the reference first focal plane module band image is corrected according to the fourth offset to obtain the reference first focal plane module band image after position correction. The pixel position of the other second focal plane module band image is corrected according to the third offset to obtain the other second focal plane module band image after position correction. The other first focal plane module band image after position correction, the reference first focal plane module band image after position correction, the reference second focal plane module band image, and the other second focal plane module band image after position correction are used as the registered visible light band image.
[0010] Preferably, the step of calculating the first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images based on the self-selected region offset calculator includes: Based on the self-selected region offset calculator, the reference short-wave infrared target image region corresponding to the reference short-wave infrared band image and the other short-wave infrared target image regions corresponding to the other short-wave infrared band images are determined; Fourier transform is performed on the reference shortwave infrared target image region and the other shortwave infrared target image regions to obtain the corresponding reference Fourier transform result and other Fourier transform results. The cross power spectrum is calculated based on the reference Fourier transform result and the other Fourier transform results. Perform an inverse Fourier transform on the cross-power spectrum to obtain the inverse Fourier transform result. Shift the inverse Fourier transform result to zero frequency and center it to obtain an intermediate image. Calculate the maximum value of the impulse response function of the intermediate image to obtain the pulse peak position. Calculate the first offset between the reference shortwave infrared band image and the other shortwave infrared band images based on the pulse peak position.
[0011] Preferably, the step of determining the reference shortwave infrared target image region corresponding to the reference shortwave infrared band image and the other shortwave infrared target image regions corresponding to the other shortwave infrared band images based on the self-selected region offset calculator includes: The threshold of the reference shortwave infrared band image is calculated based on the Otsu thresholding method. The reference shortwave infrared band image is binarized using the threshold to obtain a shortwave infrared binary image. The sum of pixels in each row of the shortwave infrared binary image is calculated to obtain an array. The window mean is calculated based on the array, and the sliding window with the smallest window mean is taken as the target window. The size of the target window is obtained, and the target window size is used to slide and traverse the reference shortwave infrared band image to obtain all reference shortwave infrared windows. The window mean of each reference shortwave infrared window is calculated. Candidate reference shortwave infrared windows are filtered according to the window mean of the reference shortwave infrared windows and the window mean of the target window. The consecutive candidate reference shortwave infrared windows are determined as the reference shortwave infrared target image region. For each other shortwave infrared image, the target window is traversed by sliding across the other shortwave infrared band image to obtain all other shortwave infrared windows. The window mean of each other shortwave infrared window is calculated. Candidate other shortwave infrared windows are filtered based on the window mean of the other shortwave infrared windows and the window mean of the target window. Consecutive candidate other shortwave infrared windows corresponding to the same other shortwave infrared image are determined as one other shortwave infrared target image region to obtain the other shortwave infrared target image region corresponding to each other shortwave infrared image.
[0012] Preferably, the registration between the registered shortwave infrared image and the registered visible light image based on time frame selection and resampling includes: The registered shortwave infrared band image can be used as a reference image and the registered visible light band image can be used as a non-reference image, or the registered visible light band image can be used as the reference image and the registered shortwave infrared band image can be used as the non-reference image. Obtain a preset start time and a preset end time, and extract a first image region in the reference image and a second image region in the non-reference image at the preset start time and the preset end time; The first image region is resampled so that the size of the first image region is the same as the size of the second image region, and the resampled first image region is used as the resampled image region. The fifth offset between the resampled image region and the second image region is calculated based on the self-selected region offset calculator. The pixel position of the non-reference image is corrected according to the fifth offset in order to perform registration between the registered short-wave infrared band image and the registered visible light band image.
[0013] According to another aspect of the present invention, a relative registration device between bands of remote sensing images from the Geological Survey-1 satellite is provided, the device comprising: The acquisition module is used to acquire all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, as well as all first focal plane module band images of visible light and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Satellite-1. The first registration module is used to register all the shortwave infrared band images based on the self-selected region offset calculator to obtain a registered shortwave infrared band image, and to register all the first focal plane module band images, all the second focal plane module band images, and the first focal plane module band image and the second focal plane module band image based on the self-selected region offset calculator to obtain a registered visible light band image. The second registration module is used to register the registered shortwave infrared band image and the registered visible light band image based on time frame selection and resampling, so as to complete the relative registration between the bands of the Geological Survey-1 satellite remote sensing image.
[0014] According to another aspect of the present invention, a storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the above-described method for relative registration between bands of remote sensing images from the Geological Survey-1 satellite.
[0015] According to another aspect of the present invention, a computer device is provided, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor executes the program to implement the above-described relative registration method between bands of remote sensing images from the Geological Survey-1 satellite.
[0016] By employing the above technical solution, this invention provides a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite. Through this invention, registration is performed between all shortwave infrared band images based on a self-selected region offset calculator; registration is also performed between all first focal plane module band images, between all second focal plane module band images, and between first and second focal plane module band images. On one hand, in scenarios with poor image quality, direct registration can lead to errors in offset calculation. Therefore, before registration, the best-quality region needs to be selected from the image using a self-selected region offset calculator, and the offset of this region is calculated as the offset of the overall image. This improves the accuracy of offset calculation, thereby improving the accuracy of registration. On the other hand, to avoid the influence of imaging deviations between the two focal plane modules on registration, registration is also performed between the first and second focal plane module band images. After obtaining the registered visible light band image and the registered short-wave infrared band image, the registration between the visible light band image and the registered short-wave infrared band image is performed. Since the resolutions of the two are different, the resolution is unified by time frame selection and resampling, and then the offset between the two is calculated to improve the accuracy of the registration.
[0017] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and in order to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description
[0018] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this invention, illustrate exemplary embodiments of the invention and are used to explain the invention, but do not constitute an undue limitation of this application. In the drawings: Figure 1 The diagram illustrates a flowchart of a method for relative registration between bands of remote sensing images from the Geological Survey-1 satellite, provided by an embodiment of the present invention. Figure 2 This paper illustrates a flowchart of another method for relative registration between bands of remote sensing images from the Geological Survey-1 satellite, provided by an embodiment of the present invention. Figure 3 This diagram illustrates the structure of a relative registration device between remote sensing image bands from the Geological Survey-1 satellite, as provided in an embodiment of the present invention. Figure 4 This invention provides a schematic diagram of another relative registration device for remote sensing images from the Geological Survey-1 satellite. Detailed Implementation
[0019] The present invention will be described in detail below with reference to the accompanying drawings and embodiments. It should be noted that, unless otherwise specified, the embodiments and features described in the present invention can be combined with each other.
[0020] This embodiment provides a method for relative registration between bands of remote sensing images from the Geological Survey-1 satellite, such as... Figure 1 As shown, the method includes: 101. Obtain all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, and obtain all first focal plane module band images of visible light and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Satellite-1.
[0021] 102. Based on the self-selected region offset calculator, register all the shortwave infrared band images to obtain a registered shortwave infrared band image. Based on the self-selected region offset calculator, register all the first focal plane module band images, register all the second focal plane module band images, and register the first focal plane module band image and the second focal plane module band image to obtain a registered visible light band image.
[0022] In this embodiment, it should be noted that poor image quality manifests as noise interference, blurring and distortion, uneven illumination, and missing data. In scenarios with poor image quality, direct registration will interfere with the frequency domain phase information during offset calculation, causing a shift in the peak points after the inverse Fourier transform, leading to incorrect offset calculation and decreased registration accuracy. Conversely, if the image is denoised first and then the offset is calculated, the denoising process alters the data's authenticity, also resulting in decreased registration accuracy. Therefore, before registration, it is necessary to select the highest-quality region from the image and calculate the offset for that region as the offset for the entire image. The method for selecting the highest-quality region from the image is a user-selectable region offset calculator.
[0023] 103. Based on time frame selection and resampling, the registration of the shortwave infrared band image and the registration of the visible light band image are performed to complete the relative registration between the bands of the Geological Satellite-1 remote sensing image.
[0024] In this embodiment, before registering the shortwave infrared band image and the registered visible light band image, the resolution between the shortwave infrared band image and the registered visible light band image is unified based on time frame selection and resampling. Then, the registration between the shortwave infrared band image and the registered visible light band image is performed based on the self-selected region offset calculator.
[0025] This invention provides a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite. The technical solution of this invention performs registration between all shortwave infrared band images based on a self-selected region offset calculator, and also performs registration between all first focal plane module band images, between all second focal plane module band images, and between first and second focal plane module band images. On one hand, in scenarios with poor image quality, direct registration can lead to errors in offset calculation. Therefore, before registration, it is necessary to select the region with the best quality from the image using a self-selected region offset calculator, calculate the offset of this region, and use it as the offset of the overall image. This improves the accuracy of offset calculation, thereby improving the accuracy of registration. On the other hand, to avoid the influence of imaging deviations between two focal plane modules on registration, registration is also performed between the first and second focal plane module band images. After obtaining the registered visible light band image and the registered short-wave infrared band image, the registration between the visible light band image and the registered short-wave infrared band image is performed. Since the resolutions of the two are different, the resolution is unified by time frame selection and resampling, and then the offset between the two is calculated to improve the accuracy of the registration.
[0026] Furthermore, as a refinement and extension of the specific implementation methods of the above embodiments, and to fully illustrate the specific implementation process in this embodiment, another method for relative registration between bands of Geological Survey-1 remote sensing images is provided, such as... Figure 2 As shown, the method includes: 201. Obtain all initial shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, and obtain all initial first focal plane module band images of visible light and all initial second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Satellite-1.
[0027] 202. Remove the fixed offset from all the initial shortwave infrared band images, all the initial first focal plane module band images, and all the initial second focal plane module band images respectively to obtain all shortwave infrared band images, all first focal plane module band images, and all second focal plane module band images.
[0028] For steps 201 and 202 of the embodiment, the Geological Survey-1 satellite remote sensing image includes a shortwave infrared camera and a visible light camera. The shortwave infrared camera captures shortwave infrared images, and the visible light camera captures visible light images. The visible light camera consists of two time-delay integration charge-coupled device (TDICCD) focal plane modules, referred to as the first focal plane module and the second focal plane module. The Geological Survey-1 satellite remote sensing image bands include: ten initial shortwave infrared bands corresponding to the shortwave infrared image, nine initial first focal plane module bands (including one panchromatic band and eight multispectral bands) corresponding to the first focal plane module of the visible light image, and nine initial second focal plane module bands (including one panchromatic band and eight multispectral bands) corresponding to the second focal plane module of the visible light image. Therefore, there are a total of 28 Geological Survey-1 satellite remote sensing image bands.
[0029] Since each band corresponds one-to-one with an image, ten initial shortwave infrared band images, nine initial first focal plane module band images, and nine initial second focal plane module band images of the visible light were acquired, corresponding to the bands of the Geological Survey-1 satellite remote sensing image. The goal is to align the pixel positions of the same ground feature across all 28 images (all initial shortwave infrared band images, all initial first focal plane module band images, and all initial second focal plane module band images) at the same imaging time.
[0030] The installation error of the lens equipment of the hyperspectral camera of the Geological Survey-1 satellite caused a systematic error, which affected all the bands of the Geological Survey-1 satellite remote sensing images. Therefore, before registering the bands of the Geological Survey-1 satellite remote sensing images, it is necessary to remove this systematic error. Since the lens equipment of the hyperspectral camera of the Geological Survey-1 satellite will not fluctuate much once it is installed, this systematic error is a fixed offset.
[0031] The fixed offset includes row-direction fixed offset and column-direction fixed offset. Taking the removal of fixed offset from an initial shortwave infrared band image as an example, the method for removing fixed offset from 28 Geological Satellite-1 remote sensing image bands is the same and will not be repeated here. All pixel positions of the initial shortwave infrared band image are corrected according to the fixed offset. For the column direction, if the column-direction fixed offset is greater than or equal to 0, then each pixel position in the column direction is shifted to the left by the column-direction fixed offset. If the column-direction fixed offset is less than 0, then each pixel position in the column direction is shifted to the right by the absolute value of the column-direction fixed offset. The same applies to the row direction, and will not be repeated here.
[0032] 203. Based on the self-selected region offset calculator, register all the shortwave infrared band images to obtain registered shortwave infrared band images.
[0033] In this embodiment, the registration of all the shortwave infrared band images based on the self-selected region offset calculator to obtain the registered shortwave infrared band image includes: extracting a reference shortwave infrared band image from all the shortwave infrared band images; taking the shortwave infrared band images other than the reference shortwave infrared band image from all the shortwave infrared band images as other shortwave infrared band images; calculating a first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images based on the self-selected region offset calculator; correcting the pixel position of the corresponding other shortwave infrared band images according to the first offset to obtain other shortwave infrared band images after position correction; and taking the reference shortwave infrared band image and all other shortwave infrared band images after position correction as the registered shortwave infrared band image.
[0034] In this embodiment, the ten shortwave infrared band images are registered together. One of the shortwave infrared band images is selected as a reference and named the reference shortwave infrared band image. The other nine shortwave infrared band images are other shortwave infrared band images. When calculating the first offset, the first offset between the reference shortwave infrared band image and each other shortwave infrared band image is calculated, for a total of nine first offsets.
[0035] The step of calculating the first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images based on a self-selected region offset calculator includes: determining, based on the self-selected region offset calculator, the reference shortwave infrared target image region corresponding to the reference shortwave infrared band image and the other shortwave infrared target image regions corresponding to the other shortwave infrared band images; performing Fourier transform on the reference shortwave infrared target image region and the other shortwave infrared target image regions to obtain the corresponding reference Fourier transform result and other Fourier transform results; calculating the cross power spectrum based on the reference Fourier transform result and the other Fourier transform results; performing an inverse Fourier transform on the cross power spectrum to obtain the inverse Fourier transform result; performing a zero-frequency shift operation on the inverse Fourier transform result to the image center to obtain an intermediate image; calculating the maximum value of the impulse response function of the intermediate image to obtain the impulse peak position; and calculating the first offset between the reference shortwave infrared band image and the other shortwave infrared band images based on the impulse peak position.
[0036] The step of determining the reference shortwave infrared target image region corresponding to the reference shortwave infrared band image and the other shortwave infrared target image regions corresponding to the other shortwave infrared band images based on the self-selected region offset calculator includes: calculating a threshold for the reference shortwave infrared band image based on the Otsu thresholding method; binarizing the reference shortwave infrared band image using the threshold to obtain a shortwave infrared binary image; calculating the pixel sum of each row of the shortwave infrared binary image to obtain an array; calculating the window mean based on the array; selecting the sliding window with the smallest window mean as the target window; obtaining the size of the target window; using the size of the target window to slide and traverse the reference shortwave infrared band image to obtain all reference shortwave infrared windows; and calculating the window mean of each reference shortwave infrared window. Candidate shortwave infrared windows are selected based on the window mean of the reference shortwave infrared window and the window mean of the target window. Consecutive candidate shortwave infrared windows are identified as reference shortwave infrared target image regions. For each other shortwave infrared image, the size of the target window is used to slide and traverse the other shortwave infrared band images to obtain all other shortwave infrared windows. The window mean of each other shortwave infrared window is calculated. Candidate other shortwave infrared windows are selected based on the window mean of the other shortwave infrared windows and the window mean of the target window. Consecutive candidate other shortwave infrared windows corresponding to the same other shortwave infrared image are identified as another shortwave infrared target image region, thus obtaining the other shortwave infrared target image region corresponding to each other shortwave infrared image.
[0037] Specifically, the following example illustrates how the first offset between a reference shortwave infrared band image and another shortwave infrared band image is calculated using a self-selected region offset calculator: Suppose that the reference in the two band images whose offsets are to be calculated is The two band images whose offsets are to be calculated are not used as references. At this time, the reference shortwave infrared band image is The other shortwave infrared band image is The number of rows in the reference shortwave infrared band image and the other shortwave infrared band image are both L, and the number of columns in the reference shortwave infrared band image and the other shortwave infrared band image are both W.
[0038] Calculate the reference shortwave infrared band image based on Otsu's thresholding method. The threshold is calculated using the following formula:
[0039] in, For the threshold, For reference, a shortwave infrared band image.
[0040] Using thresholding for reference shortwave infrared band images Binarization is performed to obtain a shortwave infrared binary image; binarization is then performed using a reference shortwave infrared band image. Pixels larger than the threshold are set to 1, and pixels smaller than or equal to the threshold are set to 0.
[0041]
[0042] in, , , This is a shortwave infrared binary image.
[0043] Calculate the pixel sum of each row in the shortwave infrared binary image to obtain an array, where the elements of the array are... :
[0044] The array is [ , ... 】
[0045] Apply a sliding window to the array and calculate the window mean for each sliding window (the window mean is equal to the sum of the elements in the sliding window divided by the size of the sliding window).
[0046] The window mean of the i-th sliding window is
[0047] Select the sliding window with the smallest window mean as the chosen window, i.e., the target window:
[0048] The size of the sliding window (the size of the sliding window represents the contents of the sliding window). (a series of elements) Let be the target window, and s be the index variable used to iterate through all elements within each sliding window. s is greater than or equal to i and less than or equal to i + 1. -1.
[0049] Based on the sliding window traversal method, the reference shortwave infrared band image is located according to the target window. The region with the best image quality is the reference shortwave infrared target image region. and other shortwave infrared band images The area with the best image quality is the area of other shortwave infrared target images. And refer to the shortwave infrared target image area. Other shortwave infrared target image regions The number of rows in the image is Reference shortwave infrared target image area Other shortwave infrared target image regions The number of image columns is .
[0050] Specifically, for the sliding window traversal method: the size of the target window is obtained; the target window size is used to slide and traverse the reference shortwave infrared band image to obtain all reference shortwave infrared windows; the window mean of each reference shortwave infrared window is calculated; candidate reference shortwave infrared windows are selected based on the window mean of the reference shortwave infrared windows and the window mean of the target window; consecutive candidate reference shortwave infrared windows are determined as reference shortwave infrared target image regions. For each other shortwave infrared image, the target window size is used to slide and traverse the other shortwave infrared band image to obtain all other shortwave infrared windows; the window mean of each other shortwave infrared window is calculated; candidate other shortwave infrared windows are selected based on the window mean of the other shortwave infrared windows and the window mean of the target window; consecutive candidate other shortwave infrared windows corresponding to the same other shortwave infrared image are determined as another other shortwave infrared target image region, thus obtaining the other shortwave infrared target image region corresponding to each other shortwave infrared image.
[0051] Specifically, the process of selecting candidate reference shortwave infrared windows based on the window mean of the reference shortwave infrared window and the window mean of the target window involves: obtaining a preset threshold; calculating the sum of 1 and the preset threshold to obtain a preset coefficient; calculating the product of the preset coefficient and the window mean of the target window; and identifying reference shortwave infrared windows whose window mean is less than or equal to this product as candidate reference shortwave infrared windows, where the preset threshold is greater than 0 and less than 1. The method for determining other candidate shortwave infrared windows is the same and will not be elaborated further here.
[0052] Reference shortwave infrared target image region Other shortwave infrared target image regions Perform a Fourier transform to obtain the reference Fourier transform result and other Fourier transform results.
[0053] Calculate the cross-power spectrum between the reference Fourier transform result and other Fourier transform results:
[0054] Where CPS represents cross-power spectrum. This represents the amplitude spectrum corresponding to the reference Fourier transform result. This represents the amplitude spectrum corresponding to other Fourier transform results. The result is obtained by multiplying the reference Fourier transform result by the conjugate complex number of the other Fourier transform results.
[0055] Perform an inverse Fourier transform on the cross-power spectrum to obtain the inverse Fourier transform result. Then, shift the zero frequency of the inverse Fourier transform result to the center of the image to obtain the intermediate image.
[0056] in, It is the result of the inverse Fourier transform. It is an operation that moves the zero frequency to the center of the image. It is an intermediate image.
[0057] Calculate the maximum value of the impulse response function of the intermediate image to obtain the pulse peak position:
[0058] in, It is the impulse response function of the intermediate image. =( , ), It is the position of the pulse peak.
[0059] Calculate the reference shortwave infrared target image region based on the pulse peak position. Other shortwave infrared target image regions The first offset between the reference shortwave infrared band image and other shortwave infrared band images is calculated. The first offset includes row offset and column offset.
[0060] Line offset:
[0061] Column offset:
[0062] in, For row index, For column indexes, and These represent the row offset and column offset, respectively, referring to the shortwave infrared target image area. Other shortwave infrared target image regions The number of rows in the image is Reference shortwave infrared target image area Other shortwave infrared target image regions The number of image columns is .
[0063] The aforementioned row offset and column offset are the first offsets of the other shortwave infrared band image relative to the reference shortwave infrared band. Therefore, for each other shortwave infrared band image, the pixel position is corrected according to the first offset to obtain a position-corrected other shortwave infrared band image. The reference shortwave infrared band image and all position-corrected other shortwave infrared band images are used as the registration shortwave infrared band images. Specifically: in the row direction, if the row offset is greater than or equal to 0, all pixel positions in the row direction of the other shortwave infrared band image are shifted to the left by the row offset; if the row offset is less than 0, all pixel positions in the row direction of the other shortwave infrared band image are shifted to the left by the absolute value of the row offset. The same applies to the column direction, which will not be elaborated here. The pixel positions of the reference shortwave infrared band image remain unchanged, thereby completing the registration between the reference shortwave infrared band image and the other shortwave infrared band image. Similarly, the registration between the reference shortwave infrared band image and each other shortwave infrared band image is completed.
[0064] 204. Based on the self-selected region offset calculator, perform registration between all first focal plane module band images, registration between all second focal plane module band images, and registration between the first focal plane module band image and the second focal plane module band image to obtain a registered visible light band image.
[0065] In this embodiment, on the one hand, the nine first focal plane module band images are registered with each other, and the nine second focal plane module band images are registered with each other. On the other hand, since the placement of the two focal plane modules is done manually, there are unavoidable errors, resulting in slight distortion in the imaging between the two focal plane modules. Therefore, the first focal plane module band images and the second focal plane module band images also need to be registered with each other.
[0066] The registration of all first focal plane module band images, all second focal plane module band images, and the registration of the first focal plane module band image and the second focal plane module band image based on the self-selected region offset calculator to obtain a registered visible light band image includes: extracting a reference first focal plane module band image for reference from all first focal plane module band images; taking all first focal plane module band images other than the reference first focal plane module band image as other first focal plane module band images; calculating a second offset between the reference first focal plane module band image and each of the other first focal plane module band images based on the self-selected region offset calculator; and extracting a reference second focal plane module band image for reference from all second focal plane module band images. The focal plane module band image is used as follows: Second focal plane module band images other than the reference second focal plane module band image are used as other second focal plane module band images. A third offset between the reference second focal plane module band image and each of the other second focal plane module band images is calculated based on the self-selected region offset calculator. Alternatively, a reference first focal plane module band image is extracted from the reference first focal plane module band image and the reference second focal plane module band image, or a reference second focal plane module band image is extracted from the reference first focal plane module band image and the reference second focal plane module band image. A fourth offset between the reference first focal plane module band image and the reference second focal plane module band image is calculated based on the self-selected region offset calculator. Specifically, any one of the nine first focal plane module band images is used as a reference and named the reference first focal plane module band image. The other eight are other first focal plane module band images. The second offset is calculated by determining the second offset between the reference first focal plane module band image and each of the other first focal plane module band images, for a total of eight second offsets. The same applies to the second focal plane module band images, and will not be elaborated further here. A fourth offset is calculated between a reference first focal plane module band image and a reference second focal plane module band image.
[0067] The methods for calculating the second, third, and fourth offsets are the same as those for calculating the first offset; all use a custom region offset calculator. If calculating the second offset between a reference first focal plane module band image and another first focal plane module band image, then the reference first focal plane module band image is... The other first focal plane module band image is If a third offset is calculated between a reference second focal plane module band image and another second focal plane module band image, then the reference second focal plane module band image is... The other second focal plane module band image is If the fourth offset is calculated, then if the reference image used in the reference first focal plane module band image and the reference second focal plane module band image is the reference first focal plane module band image, then the reference first focal plane module band image is... If the reference image used is the second focal plane module image, then the reference second focal plane module image is... .
[0068] In one implementation, if the reference image extracted from the reference first focal plane module band image and the reference second focal plane module band image is the reference first focal plane module band image, then the pixel position of each of the other first focal plane module band images is corrected according to the second offset to obtain other first focal plane module band images with corrected positions. The pixel position of the reference second focal plane module band image is corrected according to the fourth offset to obtain reference second focal plane module band images with corrected positions. The pixel position of each of the other second focal plane module band images is corrected according to the third offset and the fourth offset to obtain other second focal plane module band images with corrected positions. The reference first focal plane module band image, each other first focal plane module band image with corrected positions, the reference second focal plane module band image with corrected positions, and each other other second focal plane module band image with corrected positions are used as registration visible images. The image is a light band image. If the reference image extracted from the reference first focal plane module image and the reference second focal plane module image is the reference second focal plane module image, then the pixel position of each of the other first focal plane module images is corrected according to the second offset and the fourth offset to obtain the other first focal plane module image after position correction. The pixel position of the reference first focal plane module image is corrected according to the fourth offset to obtain the reference first focal plane module image after position correction. The pixel position of the other second focal plane module image is corrected according to the third offset to obtain the other second focal plane module image after position correction. The other first focal plane module image after position correction, the reference first focal plane module image after position correction, the reference second focal plane module image, and the other second focal plane module image after position correction are used as the registered visible light band image.
[0069] It should be noted that, taking the first focal plane module band image as an example, since the nine first focal plane module band images include one panchromatic band image and eight multispectral band images, and the resolutions of the panchromatic band and the multispectral bands are different, it is necessary to unify the pixel scale of the panchromatic band image and the multispectral band image through resampling when performing pixel position correction. For example, if the reference first focal plane module band image is a panchromatic band image, then the pixel scale of the eight other first focal plane module band images, which are also the eight multispectral band images, is unified towards the panchromatic band image through resampling, and then the second offset is calculated. If the reference first focal plane module band image is one of the eight multispectral band images, then if one of the other first focal plane module band images is a panchromatic band image, then the pixel scale of the panchromatic band image needs to be unified towards the multispectral band image through resampling, and then the second offset is calculated.
[0070] 205. Based on time frame selection and resampling, perform registration between the registered shortwave infrared band image and the registered visible light band image to complete the relative registration between the bands of the Geological Satellite-1 remote sensing image.
[0071] In this embodiment, the registration between the registered shortwave infrared band image and the registered visible light band image based on time frame selection and resampling includes: using the registered shortwave infrared band image as a reference image and the registered visible light band image as a non-reference image, or using the registered visible light band image as the reference image and the registered shortwave infrared band image as the non-reference image; obtaining a preset start time and a preset end time, and extracting a first image region in the reference image and a second image region in the non-reference image at the preset start time and the preset end time; resampling the first image region so that the size of the first image region is the same as the size of the second image region, and using the resampled first image region as the resampled image region; calculating a fifth offset between the resampled image region and the second image region based on the self-selected region offset calculator, and correcting the pixel position of the non-reference image according to the fifth offset to perform the registration between the registered shortwave infrared band image and the registered visible light band image.
[0072] Wherein, if the registered short-wave infrared band image and the registered visible light band image are used as references, then the registered short-wave infrared band image is the reference image and the registered visible light band image is the non-reference image; if the registered short-wave infrared band image and the registered visible light band image are used as references, then the registered visible light band image is the reference image and the registered short-wave infrared band image is the non-reference image.
[0073] Because satellites continuously move along their orbits during pushbroom operations, the same ground feature will not be captured simultaneously by the visible light camera and the shortwave infrared camera, but rather in a sequential order. Therefore, the imaging time of the same ground feature in the visible light camera is different from that in the shortwave infrared camera. In order to ensure that the same ground feature is captured during re-registration, a time frame selection method is used to frame both the imaging time of the same ground feature in the visible light camera and the imaging time of the shortwave infrared camera.
[0074] To obtain the preset start time and preset end time, the process includes: arbitrarily selecting a ground feature, obtaining the imaging time of the same ground feature in the reference image and the imaging time in the non-reference image, thus obtaining the preset start time and preset end time. Using this time range of the preset start time and preset end time, a first image region is extracted from the entire reference image, and a second image region is extracted from the entire non-reference image.
[0075] Because the registered shortwave infrared image and the registered visible light image have different resolutions, that is, for the same ground object, the image length and width of the first image area and the second image area are different, it is necessary to unify the resolution of the first image area and the second image area after time selection.
[0076] Since the resampled image region corresponds to the reference image in the registered shortwave infrared band image and the registered visible light band image, the resampled image region is used as... Using the second image region as Based on the self-selected region offset calculator, the fifth offset is calculated. The fifth offset is between the second image region and the resampled image region, and also between the non-reference image and the reference image. The pixel position of the non-reference image is corrected according to the fifth offset. The pixel position correction method is the same as step 203 in the embodiment, and will not be repeated here. Thus, the registration between the shortwave infrared band image and the registered visible light band image is completed, which means the relative registration between the bands of the Geological Satellite-1 remote sensing image is completed.
[0077] This invention provides a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite. The technical solution of this invention performs registration between all shortwave infrared band images based on a self-selected region offset calculator, and also performs registration between all first focal plane module band images, between all second focal plane module band images, and between first and second focal plane module band images. On one hand, in scenarios with poor image quality, direct registration can lead to errors in offset calculation. Therefore, before registration, it is necessary to select the region with the best quality from the image using a self-selected region offset calculator, calculate the offset of this region, and use it as the offset of the overall image. This improves the accuracy of offset calculation, thereby improving the accuracy of registration. On the other hand, to avoid the influence of imaging deviations between two focal plane modules on registration, registration is also performed between the first and second focal plane module band images. After obtaining the registered visible light band image and the registered short-wave infrared band image, the registration between the visible light band image and the registered short-wave infrared band image is performed. Since the resolutions of the two are different, the resolution is unified by time frame selection and resampling, and then the offset between the two is calculated to improve the accuracy of the registration.
[0078] Furthermore, as Figure 1 and Figure 2 The specific implementation of the method shown in this invention provides a relative registration device between bands of remote sensing images from the Geological Survey-1 satellite, such as... Figure 3 As shown, the device includes: an acquisition module 31, a first registration module 32, and a second registration module 33; The acquisition module 31 is used to acquire all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Satellite-1, as well as all first focal plane module band images of visible light and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Satellite-1. The first registration module 32 is used to register all the shortwave infrared band images based on the self-selected region offset calculator to obtain a registered shortwave infrared band image, and to register all the first focal plane module band images, all the second focal plane module band images, and the first focal plane module band image and the second focal plane module band image based on the self-selected region offset calculator to obtain a registered visible light band image. The second registration module 33 is used to register the registered shortwave infrared band image and the registered visible light band image based on time frame selection and resampling, so as to complete the relative registration between the bands of the Geological Satellite-1 remote sensing image.
[0079] Accordingly, in order to acquire all shortwave infrared band images corresponding to the remote sensing image bands of the Geological Survey-1 satellite, and to acquire all first focal plane module band images and all second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Survey-1 satellite, the acquisition module 31 is specifically used to acquire all initial shortwave infrared band images corresponding to the remote sensing image bands of the Geological Survey-1 satellite, and to acquire all initial first focal plane module band images and all initial second focal plane module band images of visible light corresponding to the remote sensing image bands of the Geological Survey-1 satellite; and to remove a fixed offset from all the initial shortwave infrared band images, all the initial first focal plane module band images, and all the initial second focal plane module band images to obtain all shortwave infrared band images, all first focal plane module band images, and all second focal plane module band images.
[0080] Accordingly, in order to register all the shortwave infrared band images based on the self-selected region offset calculator to obtain a registered shortwave infrared band image, the first registration module 32 is specifically used to extract a reference shortwave infrared band image for reference from all the shortwave infrared band images, take the shortwave infrared band images other than the reference shortwave infrared band image as other shortwave infrared band images, calculate the first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images based on the self-selected region offset calculator, correct the pixel position of the corresponding other shortwave infrared band images according to the first offset, obtain other shortwave infrared band images after position correction, and take the reference shortwave infrared band image and all other shortwave infrared band images after position correction as the registered shortwave infrared band image.
[0081] Accordingly, in order to perform registration between all first focal plane module band images, registration between all second focal plane module band images, and registration between first focal plane module band images and second focal plane module band images based on the self-selected region offset calculator, and obtain a registered visible light band image, the first registration module 32 is specifically used to extract a reference first focal plane module band image for reference from all first focal plane module band images, and to use all first focal plane module band images other than the reference first focal plane module band image as other first focal plane module band images, based on the self-selected region offset calculator. The calculator calculates a second offset between the reference first focal plane module band image and each of the other first focal plane module band images; extracts a reference second focal plane module band image for reference from all the second focal plane module band images; takes all second focal plane module band images except the reference second focal plane module band image as other second focal plane module band images; calculates a third offset between the reference second focal plane module band image and each of the other second focal plane module band images based on the self-selected region offset calculator; and extracts a reference second focal plane module band image from the reference first focal plane module band image and the reference second focal plane module band image. A reference first focal plane module band image is taken as a reference, or a reference second focal plane module band image is extracted from the reference first focal plane module band image and the reference second focal plane module band image. A fourth offset between the reference first focal plane module band image and the reference second focal plane module band image is calculated based on the self-selected region offset calculator. If the reference image extracted from the reference first focal plane module band image and the reference second focal plane module band image is the reference first focal plane module band image, then the pixel position of each of the other first focal plane module band images is corrected according to the second offset to obtain each position correction. The other first focal plane module band images after correction are obtained by correcting the pixel positions of the reference second focal plane module band image according to the fourth offset, resulting in a position-corrected reference second focal plane module band image. The pixel positions of each of the other second focal plane module band images are then corrected according to the third offset and the fourth offset, resulting in a position-corrected other second focal plane module band image. The reference first focal plane module band image, each position-corrected other first focal plane module band image, the position-corrected reference second focal plane module band image, and each position-corrected other second focal plane module band image are used as registered visible light band images.If the reference image extracted from the reference first focal plane module band image and the reference second focal plane module band image is the reference second focal plane module band image, then the pixel position of each of the other first focal plane module band images is corrected according to the second offset and the fourth offset to obtain a position-corrected other first focal plane module band image. The pixel position of the reference first focal plane module band image is corrected according to the fourth offset to obtain a position-corrected reference first focal plane module band image. The pixel position of the other second focal plane module band image is corrected according to the third offset to obtain a position-corrected other second focal plane module band image. Each position-corrected other first focal plane module band image, the position-corrected reference first focal plane module band image, the reference second focal plane module band image, and each position-corrected other second focal plane module band image are used as the registered visible light band image.
[0082] Accordingly, in order to calculate the first offset between the reference shortwave infrared band image and each of the other shortwave infrared band images based on the self-selected region offset calculator, the first registration module 32 is specifically used to determine the reference shortwave infrared target image region corresponding to the reference shortwave infrared band image and the other shortwave infrared target image regions corresponding to the other shortwave infrared band images based on the self-selected region offset calculator; perform Fourier transform on the reference shortwave infrared target image region and the other shortwave infrared target image regions to obtain the corresponding reference Fourier transform result and other Fourier transform results; calculate the cross power spectrum based on the reference Fourier transform result and the other Fourier transform results; perform inverse Fourier transform on the cross power spectrum to obtain the inverse Fourier transform result; perform a zero-frequency shift operation on the inverse Fourier transform result to the image center to obtain an intermediate image; calculate the maximum value of the impulse response function of the intermediate image to obtain the impulse peak position; and calculate the first offset between the reference shortwave infrared band image and the other shortwave infrared band images based on the impulse peak position.
[0083] Accordingly, in order to determine the reference shortwave infrared target image region corresponding to the reference shortwave infrared band image and the other shortwave infrared target image regions corresponding to the other shortwave infrared band images based on the self-selected region offset calculator, the first registration module 32 is specifically used to calculate the threshold of the reference shortwave infrared band image based on the Otsu thresholding method; to binarize the reference shortwave infrared band image using the threshold to obtain a shortwave infrared binary image; to calculate the pixel sum of each row of the shortwave infrared binary image to obtain an array; to calculate the window mean based on the array; to select the sliding window with the smallest window mean as the target window; to obtain the size of the target window; to slide and traverse the reference shortwave infrared band image using the size of the target window to obtain all reference shortwave infrared windows; and to calculate the value of each reference shortwave infrared target image. The window mean of the window is used to filter candidate reference short-wave infrared windows based on the window mean of the reference short-wave infrared window and the window mean of the target window. Consecutive candidate reference short-wave infrared windows are identified as reference short-wave infrared target image regions. For each other short-wave infrared image, the size of the target window is used to slide and traverse the other short-wave infrared band images to obtain all other short-wave infrared windows. The window mean of each other short-wave infrared window is calculated. Candidate other short-wave infrared windows are filtered based on the window mean of the other short-wave infrared windows and the window mean of the target window. Consecutive candidate other short-wave infrared windows corresponding to the same other short-wave infrared image are identified as one other short-wave infrared target image region, thus obtaining the other short-wave infrared target image region corresponding to each other short-wave infrared image.
[0084] Accordingly, in order to register the registered shortwave infrared band image and the registered visible light band image based on time frame selection and resampling, the second registration module 33 includes: a resampling unit 331 and a registration unit 332. The resampling unit 331 is specifically used to: use the registered shortwave infrared band image as a reference image and the registered visible light band image as a non-reference image, or use the registered visible light band image as the reference image and the registered shortwave infrared band image as the non-reference image; acquire a preset start time and a preset end time; extract a first image region in the reference image and a second image region in the non-reference image at the preset start time and the preset end time; perform resampling processing on the first image region so that the size of the first image region is the same as the size of the second image region; and use the resampled first image region as the resampled image region. The registration unit 332 is specifically used to calculate the fifth offset between the resampled image region and the second image region based on the self-selected region offset calculator, and to correct the pixel position of the non-reference image according to the fifth offset, so as to perform registration between the registered short-wave infrared band image and the registered visible light band image.
[0085] It should be noted that other corresponding descriptions of the functional units involved in the relative registration device between remote sensing image bands of the Geological Survey-1 satellite provided in this embodiment can be found in [reference needed]. Figures 1 to 2 The corresponding description will not be repeated here.
[0086] Based on the above, Figures 1 to 2 Accordingly, this embodiment also provides a storage medium, which may be volatile or non-volatile, storing a computer program that, when executed by a processor, implements the above-described method. Figures 1 to 2 The method for relative registration between bands in the Geological Survey-1 satellite remote sensing image is shown.
[0087] Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, portable hard drive, etc.) and includes several instructions to cause a computer device (such as a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present invention.
[0088] Based on the above, Figures 1 to 2 The method shown and Figure 3 , Figure 4 To achieve the above objectives, the present application also provides a computer device, specifically a personal computer, server, network device, etc., as shown in the illustrated embodiment. This computer device includes a storage medium and a processor; the storage medium stores a computer program; the processor executes the computer program to achieve the above-described objectives. Figure 1 and Figure 2 The method for relative registration between bands in the Geological Survey-1 satellite remote sensing image is shown.
[0089] Optionally, the computer device may also include a user interface, a network interface, a camera, radio frequency (RF) circuitry, sensors, audio circuitry, a Wi-Fi module, etc. The user interface may include a display screen, input units such as a keyboard, etc., and optional user interfaces may also include USB interfaces, card reader interfaces, etc. The network interface may optionally include standard wired interfaces, wireless interfaces (such as Wi-Fi interfaces), etc.
[0090] Those skilled in the art will understand that the computer device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or combine certain components, or have different component arrangements.
[0091] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the aforementioned computer device, supporting the operation of information processing programs and other software and / or programs. The network communication module is used to enable communication between the various components within the non-volatile storage medium, as well as communication with other hardware and software in the information processing entity device.
[0092] Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus necessary general-purpose hardware platform, or it can be implemented by hardware.
[0093] This invention provides a method and apparatus for relative registration between bands of remote sensing images from the Geological Survey-1 satellite. The technical solution of this invention performs registration between all shortwave infrared band images based on a self-selected region offset calculator, and also performs registration between all first focal plane module band images, between all second focal plane module band images, and between first and second focal plane module band images. On one hand, in scenarios with poor image quality, direct registration can lead to errors in offset calculation. Therefore, before registration, it is necessary to select the region with the best quality from the image using a self-selected region offset calculator, calculate the offset of this region, and use it as the offset of the overall image. This improves the accuracy of offset calculation, thereby improving the accuracy of registration. On the other hand, to avoid the influence of imaging deviations between two focal plane modules on registration, registration is also performed between the first and second focal plane module band images. After obtaining the registered visible light band image and the registered short-wave infrared band image, the registration between the visible light band image and the registered short-wave infrared band image is performed. Since the resolutions of the two are different, the resolution is unified by time frame selection and resampling, and then the offset between the two is calculated to improve the accuracy of the registration.
[0094] Those skilled in the art will understand that the accompanying drawings are merely schematic diagrams of a preferred embodiment, and the modules or processes shown in the drawings are not necessarily essential for implementing the present invention. Those skilled in the art will understand that the modules in the apparatus of the embodiment can be distributed within the apparatus of the embodiment as described, or they can be located in one or more apparatuses different from this embodiment, with corresponding changes. The modules of the above-described embodiment can be combined into one module, or further divided into multiple sub-modules.
[0095] The serial numbers used above are for descriptive purposes only and do not represent the superiority or inferiority of the implementation scenarios. The above disclosures are merely a few specific implementation scenarios of the present invention; however, the present invention is not limited thereto, and any variations conceived by those skilled in the art should fall within the protection scope of the present invention.
Claims
1. A method for inter-band relative registration of Landsat-1 remote sensing images, characterized in that, The method comprises: acquiring all short-wave infrared band images corresponding to the wave bands of the remote sensing image of the first geology satellite, and acquiring all first focal plane module band images and all second focal plane module band images of visible light corresponding to the wave bands of the remote sensing image of the first geology satellite; performing registration among all the short-wave infrared band images based on a self-selected area offset calculator to obtain registered short-wave infrared band images, performing registration among all the first focal plane module band images, registration among all the second focal plane module band images, and registration between the first focal plane module band images and the second focal plane module band images based on the self-selected area offset calculator to obtain registered visible light band images; performing registration between the registered short-wave infrared band images and the registered visible light band images based on time frame selection and resampling to complete the relative registration among the wave bands of the remote sensing image of the first geology satellite.
2. The method for inter-band relative registration of Landsat-1 remote sensing images according to claim 1, characterized in that, The acquiring all short-wave infrared band images corresponding to the wave bands of the remote sensing image of the first geology satellite, and acquiring all first focal plane module band images and all second focal plane module band images of visible light corresponding to the wave bands of the remote sensing image of the first geology satellite comprises: acquiring all initial short-wave infrared band images corresponding to the wave bands of the remote sensing image of the first geology satellite, and acquiring all initial first focal plane module band images and all initial second focal plane module band images of visible light corresponding to the wave bands of the remote sensing image of the first geology satellite; removing a fixed offset from all the initial short-wave infrared band images, all the initial first focal plane module band images, and all the initial second focal plane module band images respectively to obtain all short-wave infrared band images, all first focal plane module band images, and all second focal plane module band images.
3. The method for inter-band relative registration of Landsat-1 remote sensing images according to claim 1, characterized in that, The performing registration among all the short-wave infrared band images based on the self-selected area offset calculator to obtain registered short-wave infrared band images comprises: extracting a reference short-wave infrared band image serving as a reference from all the short-wave infrared band images, taking the short-wave infrared band images other than the reference short-wave infrared band image as other short-wave infrared band images, and calculating a first offset between the reference short-wave infrared band image and each of the other short-wave infrared band images based on a self-selected area offset calculator; correcting the pixel positions of the corresponding other short-wave infrared band images according to the first offset to obtain each position-corrected other short-wave infrared band image, and taking the reference short-wave infrared band image and all the position-corrected other short-wave infrared band images as registered short-wave infrared band images.
4. The method for inter-band relative registration of Landsat-1 remote sensing images according to claim 1, characterized in that, The performing registration among all the first focal plane module band images, registration among all the second focal plane module band images, and registration between the first focal plane module band images and the second focal plane module band images based on the self-selected area offset calculator to obtain registered visible light band images comprises: extracting a reference first focal plane module band image as a reference from all the first focal plane module band images, taking the first focal plane module band images other than the reference first focal plane module band image as other first focal plane module band images, calculating a second offset between the reference first focal plane module band image and each of the other first focal plane module band images based on a self-selected region offset calculator; extracting a reference second focal plane module band image as a reference from all the second focal plane module band images, taking the second focal plane module band images other than the reference second focal plane module band image as other second focal plane module band images, calculating a third offset between the reference second focal plane module band image and each of the other second focal plane module band images based on the self-selected region offset calculator; extracting a reference first focal plane module band image as a reference from the reference first focal plane module band image and the reference second focal plane module band image, or extracting a reference second focal plane module band image as a reference from the reference first focal plane module band image and the reference second focal plane module band image, calculating a fourth offset between the reference first focal plane module band image and the reference second focal plane module band image based on the self-selected region offset calculator; if the reference first focal plane module band image is extracted as a reference from the reference first focal plane module band image and the reference second focal plane module band image, correcting the pixel position of each of the other first focal plane module band images according to the second offset to obtain each position-corrected other first focal plane module band image, correcting the pixel position of the reference second focal plane module band image according to the fourth offset to obtain a position-corrected reference second focal plane module band image, correcting the pixel position of each of the other second focal plane module band images according to the third offset and the fourth offset to obtain each position-corrected other second focal plane module band image, and taking the reference first focal plane module band image, each position-corrected other first focal plane module band image, the position-corrected reference second focal plane module band image, and each position-corrected other second focal plane module band image as registered visible light band images; If the reference first focal plane module band image and the reference second focal plane module band image are extracted for reference, and the reference second focal plane module band image is used for reference, then the pixel position of each corresponding other first focal plane module band image is corrected according to the second offset and the fourth offset, to obtain each position-corrected other first focal plane module band image, the pixel position of the reference first focal plane module band image is corrected according to the fourth offset, to obtain a position-corrected reference first focal plane module band image, the pixel position of each corresponding other second focal plane module band image is corrected according to the third offset, to obtain each position-corrected other second focal plane module band image, and each position-corrected other first focal plane module band image, the position-corrected reference first focal plane module band image, the reference second focal plane module band image and each position-corrected other second focal plane module band image are used as the registered visible band image.
5. The method for band-to-band relative registration of Landsat-1 remote sensing images according to claim 3, characterized in that, The self-selected region-based offset calculator calculates the first offset between the reference short-wave infrared band image and each other short-wave infrared band image, including: The self-selected region-based offset calculator determines a reference short-wave infrared target image region corresponding to the reference short-wave infrared band image and other short-wave infrared target image regions corresponding to the other short-wave infrared band images. The reference short-wave infrared target image region and the other short-wave infrared target image regions are subjected to Fourier transform, to obtain corresponding reference Fourier transform results and other Fourier transform results, and the first offset between the reference short-wave infrared band image and the other short-wave infrared band images is calculated according to the reference Fourier transform results and the other Fourier transform results. The inverse Fourier transform result is subjected to an operation of moving zero frequency to the center of the image, to obtain an intermediate image, the maximum value of the impulse response function of the intermediate image is calculated, to obtain an impulse peak position, and the first offset between the reference short-wave infrared band image and the other short-wave infrared band images is calculated according to the impulse peak position.
6. The method for inter-band relative registration of Landsat-1 remote sensing images according to claim 5, characterized in that, The self-selected region-based offset calculator determines a reference short-wave infrared target image region corresponding to the reference short-wave infrared band image and other short-wave infrared target image regions corresponding to the other short-wave infrared band images, including: The threshold value of the reference short-wave infrared band image is calculated based on the Otsu threshold method; The reference short-wave infrared band image is binarized by using the threshold value, to obtain a short-wave infrared binary image, the sum of pixels of each row of the short-wave infrared binary image is calculated, to obtain an array, the window mean value is calculated according to the array, and the sliding window with the minimum window mean value is used as a target window; Obtaining the size of the target window, using the size of the target window to slide on the reference short-wave infrared band image to obtain all reference short-wave infrared windows, calculating the window mean of each reference short-wave infrared window, screening candidate reference short-wave infrared windows according to the window mean of the reference short-wave infrared window and the window mean of the target window, and determining continuous candidate reference short-wave infrared windows as a reference short-wave infrared target image region. For each other short-wave infrared image, using the size of the target window to slide on the other short-wave infrared band image to obtain all other short-wave infrared windows, calculating the window mean of each other short-wave infrared window, screening candidate other short-wave infrared windows according to the window mean of the other short-wave infrared window and the window mean of the target window, and determining continuous candidate other short-wave infrared windows corresponding to the same other short-wave infrared image as an other short-wave infrared target image region, to obtain an other short-wave infrared target image region corresponding to each other short-wave infrared image.
7. The method for inter-band relative registration of Landsat-1 remote sensing images according to claim 1, characterized in that, The registration between the registered short-wave infrared band image and the registered visible light band image based on the time frame selection and resampling comprises: taking the registered short-wave infrared band image as a reference image and the registered visible light band image as a non-reference image, or taking the registered visible light band image as the reference image and the registered short-wave infrared band image as the non-reference image; obtaining a preset starting time and a preset ending time, and intercepting a first image region in the reference image and a second image region in the non-reference image at the preset starting time and the preset ending time; performing resampling processing on the first image region to make the size of the first image region the same as the size of the second image region, and taking the first image region after the resampling processing as a resampled image region; calculating a fifth offset between the resampled image region and the second image region based on the self-selected region offset calculator, and correcting the pixel position of the non-reference image according to the fifth offset to perform the registration between the registered short-wave infrared band image and the registered visible light band image.
8. A device for inter-band relative registration of Landsat-1 remote sensing images, characterized by The device comprises: an obtaining module, configured to obtain all short-wave infrared band images corresponding to a satellite remote sensing image band of a geological satellite No. 1, and obtain all first focus module band images and all second focus module band images of visible light corresponding to the satellite remote sensing image band of the geological satellite No. 1; a first registration module, configured to perform registration between all the short-wave infrared band images based on a self-selected region offset calculator to obtain a registered short-wave infrared band image, and perform registration between all the first focus module band images, registration between all the second focus module band images, and registration between the first focus module band image and the second focus module band image based on the self-selected region offset calculator to obtain a registered visible light band image; and a second registration module, configured to perform registration between the registered short-wave infrared band image and the registered visible light band image based on time frame selection and resampling. A second registration module is configured to perform registration between the registered short-wave infrared band image and the registered visible light band image based on time frame selection and resampling, so as to complete the relative band-to-band registration of the GF-1 satellite remote sensing image.
9. A storage medium having stored thereon a computer program, characterized in that The program, when executed by a processor, implements the method for relative band-to-band registration of the GF-1 satellite remote sensing image according to any one of claims 1 to 7.
10. A computer device comprising a memory, a processor, and a computer program stored on a storage medium and executable on the processor, characterized in that, The processor, when executing the program, implements the method for relative band-to-band registration of the GF-1 satellite remote sensing image according to any one of claims 1 to 7.
Citation Information
Patent Citations
Short-wave infrared and visible light image registration fusion device and method
CN115018889A
Short-wave infrared remote sensing image double-window simulation reconstruction method and device
CN115830185A
Remote sensing data intelligent noise reduction and enhancement system and method based on deep learning
CN119130847A
Method and device for generating satellite remote-sensing image with high spatial, temporal and spectral resolutions
US12315104B1
Cited By
Physical data dual-drive short wave infrared image colorization wave band optimization method and device
CN121883626A