A remote sensing image band registration method, device, equipment and medium
By establishing a band registration model in the form of polynomial and using imaging parameters to perform simple polynomial calculations, the complex problem of satellite remote sensing image band registration operations is solved, and efficient and simple registration process and high-precision band registration are achieved.
Patent Information
- Application Number
- CN202311560229.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-21
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2043-11-21
AI Technical Summary
In the prior art, the band registration operation of satellite remote sensing images is complex, especially for agile satellite remote sensing images collected by linear array sensors. Both image and object square methods have complex image matching and geometric imaging models, which are subject to satellite orbits. The status has a great impact.
The band registration model in the form of polynomials is adopted. By obtaining the imaging parameters and detector offsets of multiple sample images, the target band registration model is established, and the imaging parameters are used to perform simple polynomial calculations for registration, avoiding image matching and strictness. Use of geometric imaging models.
It realizes an efficient and simple band registration process, improves registration accuracy, adapts to the band registration offset changes of high-resolution and high-agile platforms, and reduces the dependence on posture measurement accuracy and geometric positioning accuracy.
Smart Images

Figure CN117576170B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of image preprocessing, and in particular to a remote sensing image band registration method, device, equipment and medium. Background Art
[0002] Band registration is the registration process performed on multi-band images in the preprocessing of satellite remote sensing images. Usually, one of the multi-bands is used as the reference band, and the other bands are used as the bands to be matched. A conversion relationship is established between the coordinates of the same-name pixels in the image of the band to be matched and the reference band image. The image of the band to be matched is resampled according to the conversion relationship, thereby achieving registration of images of different bands, which can improve the quality of satellite remote sensing images and the accuracy of information extraction.
[0003] In the related art, there are two main methods for band registration for remote sensing images acquired by linear array sensors: one is the image correlation registration method based on the image space, and the other is the strict geometric model registration method based on the object space. The image-based method generally uses the grayscale and texture features of the image itself to match the images between bands, and then establishes a coordinate transformation relationship based on the matching points to complete the band registration. Commonly used matching algorithms include grayscale correlation, mutual information, SIFT, Harris corner detection, etc. The object-based method generally obtains the mapping relationship between image points and ground points based on a strict geometric imaging model and internal orientation parameters, thereby determining the same-name image points between different bands, and establishing a coordinate transformation relationship based on the image coordinates of the same-name image points to complete the band registration.
[0004] However, the image-based registration method needs to obtain the grayscale and texture features of the image to be registered each time it performs image registration. For images with heavy clouds, single textures, or large spectral differences, multiple image acquisitions and feature extractions are often required. The object-based method requires complex geometric imaging models and high-precision geometric calibration to meet the requirements of sub-pixel registration, and is often affected by the satellite's on-orbit status, and often requires repeated geometric calibration to meet the registration requirements. For the registration of agile satellite remote sensing images collected by linear array sensors, the band matching operations of the above two methods are relatively complex. Summary of the invention
[0005] In order to solve the problem of complex band registration operation for satellite remote sensing images in the prior art, the present application provides a remote sensing image band registration method, device, equipment and medium.
[0006] In the first aspect, the present application provides a remote sensing image band registration method, which adopts the following technical solution:
[0007] A remote sensing image band registration method, comprising:
[0008] Acquire images corresponding to each of the plurality of sample images, wherein the images include a reference band image corresponding to the reference band and a to-be-registered band image corresponding to the to-be-registered band;
[0009] Matching a reference band image of a target sample image with the band image to be registered to obtain multiple pairs of matching points of the target sample image, where the target sample image is any one of the multiple sample images;
[0010] Determine, according to the multiple pairs of matching points of the target sample image, the offsets corresponding to the target number of detectors in the target sample image, where the target number is the number of detectors in the target sample image;
[0011] Acquire imaging parameters corresponding to each of the multiple sample images, and establish a target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images, wherein the target band registration model includes a registration model in polynomial form corresponding to each of the target number of detectors, and the target band registration model is used to register the image of the band to be registered.
[0012] By adopting the above technical solution, multiple sample images are obtained, and the reference band image of the target sample image and the band image to be registered are matched to obtain multiple pairs of matching points of the target sample image; according to the multiple pairs of matching points of the target sample image, the offsets corresponding to the target number of detectors in the target sample image are determined, and the calculated offsets change with the imaging state, which can adapt to the situation where the offset of the band registration of the high-resolution and high-agility platform is constantly changing; the imaging parameters corresponding to each of the multiple sample images are obtained, and a target band registration model is established according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each sample image of the multiple sample images. The target band registration model is used to register the image of the band to be registered, and is composed of polynomials related to the imaging parameters. When the band registration is actually performed, it is less affected by the attitude and orbit measurement accuracy and the geometric positioning accuracy, and there is no need to perform image matching. Only the imaging parameters need to be input for simple polynomial calculation, which is independent of the ground object features of the image. The band registration process is simple, efficient and has high registration accuracy.
[0013] In a preferred example, the present application can be further configured as follows: the imaging parameters include: posture parameters, imaging position, imaging time and elevation; according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, a target band registration model is established, including:
[0014] According to the attitude parameters, imaging positions, imaging times and elevations corresponding to each of the multiple sample images and the offset corresponding to the target detector in each of the multiple sample images, a polynomial registration model corresponding to the target detector is established. The target detector is a detector at the same position in the multiple sample images, and the polynomial registration model corresponding to the target detector is composed of coefficients and a polynomial consisting of the attitude parameters, imaging positions, imaging time and elevation; according to the polynomial registration models corresponding to the target number of detectors, the target band registration model is obtained.
[0015] By adopting the above technical scheme, a polynomial registration model corresponding to the target detector can be established according to the attitude parameters, orbital parameters, imaging position, imaging time, elevation and offset corresponding to the target sample image. A band registration model corresponding to the target sample image can be obtained according to the polynomial registration models corresponding to multiple detectors. When the elevation variable is taken into account, the influence of terrain changes on the detector offset during the band registration process can be eliminated.
[0016] In a preferred example, the present application can be further configured as follows: the attitude parameters include the roll angle, pitch angle, yaw angle and angular velocity, the imaging position includes longitude and latitude,
[0017] The polynomial registration model corresponding to the target detector is:
[0018] Δx i =a1 i ·roll 3 +a2 i ·roll 2 +a3 i ·roll+a4 i Pitch 3 +a5 i Pitch 2 +a6 i pitch+a7 i ·yaw+a8 i ·roll v +a9 i Pitch v +a10 i ·yaw v +a11 i ·period+a12 i lat 2 +a13 i lat+a14 i lon+a15 i ·h+a16 i
[0019] Δy i =b1 i ·roll 3 +b2 i ·roll 2 +b3 i ·roll+b4 i Pitch 3 +b5 i Pitch 2 +b6 i pitch+b7 i ·yaw+b8 i ·roll v +b9 i Pitch v +b1o i ·yaw v +b11 i ·period+b12 i lat 2 +b13 i lat+b14 i lon+b15 i ·h+b16 i
[0020] Where i represents the serial number of the target detector, Δx i is the offset of the target detector in the linear array direction, Δy i is the offset of the target probe in the along-track direction, a1 i ...a16 i is the coefficient of the registration model linear array direction corresponding to the target detector, b1 i ...b16 i is the coefficient of the registration model along the track direction corresponding to the target detector, roll is the roll angle, pitch is the pitch angle, yaw is the yaw angle, roll v is the angular velocity of the roll, pitch v is the pitch angular velocity, yaw v is the yaw angular velocity, period is the travel time, which means the imaging time, lon is the longitude, lat is the latitude, and h is the altitude.
[0021] By adopting the above technical solution, the registration model corresponding to each detector is pre-established. When actually performing band registration, there is no need for image matching, strict geometric imaging model and internal orientation parameters. Instead, it is represented by a polynomial related to the imaging parameters. Only the imaging parameters need to be input for simple polynomial calculations. The model is simple, easy to implement and has a fast processing speed.
[0022] In a preferred example, the present application can be further configured as follows: the imaging parameters also include orbital parameters, and a target band registration model is established according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, including:
[0023] A target band registration model is established based on the attitude parameters, orbital parameters, imaging positions, imaging times and elevations corresponding to each of the multiple sample images, and the offsets corresponding to the detectors of the target number in each of the multiple sample images, wherein the orbital parameters include satellite speed and satellite position.
[0024] By adopting the above technical solution, a target band registration model is established according to the attitude parameters, orbital parameters, imaging positions, imaging times and elevations corresponding to each of the multiple sample images, and the offsets corresponding to the detectors of the target number in each of the multiple sample images. The orbital parameters are applied to the construction of the target band registration model, which can improve the accuracy of the target band registration model.
[0025] In a preferred example, the present application can be further configured as follows: according to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the detectors of the target number in each of the plurality of sample images, a target band registration model is established, including:
[0026] According to the imaging parameters corresponding to the plurality of sample images and the offsets corresponding to the target number of detectors in each sample image of the plurality of sample images, an initial target band registration model is established, wherein the initial target band registration model includes an initial registration model in a polynomial form corresponding to the target number of detectors;
[0027] Determining the value of each term in the polynomial of the initial registration model of the first detector, and judging whether the value of each term exceeds a preset threshold, wherein the first detector is any one of the target number of detectors;
[0028] generating a target registration model of the first detector according to the terms whose values in the polynomial of the initial registration model of the first detector exceed the preset threshold;
[0029] The target band registration model is obtained according to the target registration models corresponding to the detectors of the target number.
[0030] By adopting the above technical solution, the preset threshold is compared with the value of each term in the polynomial of the initial registration model of the first detector, and the terms in the initial registration model whose values exceed the preset threshold are removed to obtain more representative terms, which can improve the processing speed of the target band registration model and improve the band registration efficiency.
[0031] In a preferred example, the present application may be further configured to: obtain imaging parameters corresponding to the target sample image, including:
[0032] Determining the imaging time of the target sample image;
[0033] The imaging parameters corresponding to the target sample image are acquired according to the imaging time.
[0034] By adopting the above technical solution, the imaging parameters corresponding to the target sample image can be accurately obtained according to the imaging time of the target sample image, thereby improving the accuracy of the imaging parameters.
[0035] In a preferred example, the present application can be further configured as follows: the method further includes:
[0036] Get the image to be processed;
[0037] Determining imaging parameters corresponding to each row of the image to be processed according to the imaging time of the image to be processed, thereby obtaining imaging parameters corresponding to the image to be processed;
[0038] Obtaining the offset of each pixel in the image to be processed according to the target band registration model and the imaging parameters corresponding to the image to be processed;
[0039] According to the offset of each pixel in the image to be processed, the image of the to-be-registered band of the image to be processed is resampled to obtain the registered image of the to-be-registered band corresponding to the image to be processed.
[0040] By adopting the above technical solution, the band registration offset calculation process is independent of the image features, so the registration accuracy is not affected by the image's own texture features, and the calculated offset changes with the imaging state, which can adapt to the situation where the band registration offset of the high-resolution and high-agility platform is constantly changing.
[0041] In a second aspect, the present application provides a remote sensing image band registration device, which adopts the following technical solution:
[0042] A remote sensing image band registration device, comprising:
[0043] An acquisition module, used for acquiring images corresponding to each of the plurality of sample images, wherein the images include a reference band image corresponding to the reference band and a to-be-registered band image corresponding to the to-be-registered band;
[0044] A matching module, used for matching a reference band image of a target sample image with the band image to be registered to obtain a plurality of pairs of matching points of the target sample image, wherein the target sample image is any one of the plurality of sample images;
[0045] A determination module, configured to determine, based on a plurality of pairs of matching points of the target sample image, offsets corresponding to a target number of detectors in the target sample image, wherein the target number is the number of detectors in the target sample image;
[0046] A module is established, which is used to obtain imaging parameters corresponding to each of the multiple sample images, and establish a target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images, wherein the target band registration model includes a registration model in the form of a polynomial corresponding to each of the target number of detectors, and the target band registration model is used to register the image of the band to be registered.
[0047] In a third aspect, the present application provides an electronic device, which adopts the following technical solution:
[0048] one or more processors;
[0049] Memory;
[0050] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the remote sensing image band registration method as described in any one of the first aspects.
[0051] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:
[0052] A computer-readable storage medium stores a computer program, which, when executed in a computer, causes the computer to execute the remote sensing image band registration method as described in any one of the first aspects.
[0053] In summary, this application includes the following beneficial technical effects:
[0054] The present application obtains multiple sample images, matches the reference band image of the target sample image with the band image to be registered, and obtains multiple pairs of matching points of the target sample image; according to the multiple pairs of matching points of the target sample image, determines the offsets corresponding to the target number of detectors in the target sample image, and the calculated offsets change with the imaging state, which can adapt to the situation where the offset of the band registration of the high-resolution and high-agility platform is constantly changing; obtains the imaging parameters corresponding to each of the multiple sample images, and establishes a target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images. The target band registration model is used to register the image of the band to be registered, and is composed of polynomials related to the imaging parameters. When the band registration is actually performed, it is less affected by the attitude and orbit measurement accuracy and the geometric positioning accuracy, and there is no need to perform image matching. Only the imaging parameters need to be input for simple polynomial calculation, which is independent of the ground object features of the image. The band registration process is simple, efficient and has high registration accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] Figure 1 It is a flowchart of a remote sensing image band registration method provided in an embodiment of the present application;
[0056] Figure 2 is a schematic diagram of the relationship between the offset along the linear array direction and the pitch angle provided in an embodiment of the present application;
[0057] Figure 3 is a schematic diagram of the mean error of the registered images provided in the embodiment of the present application;
[0058] Figure 4 It is a structural schematic diagram of a remote sensing image band registration device provided in an embodiment of the present application;
[0059] Figure 5 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0060] The following is combined with Figure 1 -Attached Figure 5 This application is described in further detail.
[0061] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, those skilled in the art may make modifications to the present embodiment without any creative contribution as needed, but such modifications are protected by the patent law as long as they are within the scope of the claims of the present application.
[0062] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0063] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.
[0064] The present application embodiment provides a remote sensing image band registration method, such as Figure 1 As shown, the method provided in the embodiment of the present application can be executed by an electronic device, and the electronic device can be a server or a terminal device, wherein the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., but is not limited thereto. The terminal device and the server can be directly or indirectly connected via wired or wireless communication. The embodiment of the present application does not limit this. The method includes steps S101-S105, wherein: S101, obtaining images corresponding to each of the multiple sample images, the images including reference band images corresponding to the reference band and to-be-registered band images corresponding to the to-be-registered bands.
[0065] In this embodiment, multiple sample images can be selected from historical images taken by the linear array sensor. For the accuracy of band registration, the sample images are mainly farmland, city, grassland and bare land, and avoid large areas of water, dense vegetation, clouds and snow-capped mountains where it is difficult to find image matching points. In one possible scenario, sample images can be selected by manually viewing the images; in another possible scenario, feature extraction can be performed on multiple historical images, and the extracted features include color, texture, shape, etc. Then, a classifier (such as a neural network) is used to classify the multiple historical images based on the extracted features, so as to obtain sample images that meet the requirements.
[0066] For any sample image, the images corresponding to each band of the sample image can be extracted. The sample image is a remote sensing image, and the corresponding bands may include a red band, a blue band, a green band, and a near-red band. This embodiment does not impose specific restrictions on the bands, and one band can be selected as a reference band and one as a band to be registered. The image corresponding to the reference band is the reference band image, and the image corresponding to the band to be registered is the band image to be registered.
[0067] S102 : Matching the reference band image of the target sample image with the band image to be registered to obtain multiple pairs of matching points of the target sample image, where the target sample image is any one of the multiple sample images.
[0068] In this embodiment, the red band image of the target sample image can be used as a reference band image, and the blue band image of the target sample image can be used as a band image to be registered. The red band image and the blue band image are matched by a matching algorithm to obtain multiple pairs of matching points, which are evenly distributed on the image to accurately reflect the overall situation of the target sample image. The matching algorithm can be one of a grayscale-based matching algorithm (such as a cross-correlation matching algorithm), a feature matching algorithm, a fast Fourier transform, and a deep learning algorithm.
[0069] In order to improve the accuracy of matching points, matching points with larger errors can also be eliminated. Specifically, the distance between each pair of matching points can be calculated to determine whether the distance exceeds a preset distance threshold. If so, the error of the pair of matching points is determined to be large and they are eliminated to obtain valid matching points. It is determined whether the number of valid matching points is less than a preset number threshold. If so, the matching points of the target sample image can be re-determined. The preset number threshold can be set manually according to actual conditions. Optionally, the preset number threshold can be set to 1000.
[0070] S103 . Determine, based on multiple pairs of matching points of the target sample image, the offsets corresponding to the target number of detectors in the target sample image, where the target number is the number of detectors in the target sample image.
[0071] For any pair of matching points, assuming that the position of one matching point in the reference band image is (x1, y1) and the position of the other matching point in the image to be registered is (x2, y2), then the offset of the pair of matching points is (x2-x1, y2-y1), thereby obtaining the offsets corresponding to multiple pairs of matching points.
[0072] The number of detectors in the target sample image can be read from the properties of the linear array sensor. The number of detectors in multiple sample images is equal and their positions correspond to each other. The center of a detector in a target sample image may not correspond to a matching point. Therefore, after determining the offsets corresponding to multiple pairs of matching points in the target sample image, the offset corresponding to the center point of the detector can be determined by an interpolation algorithm as the offset corresponding to the detector, thereby obtaining the offsets corresponding to the target number of detectors.
[0073] Among them, if the offset of the detector in the target sample image is time-varying, the offset corresponding to the time-varying detector at different time points can be obtained. The number of time points can be determined manually according to actual needs. Optionally, the offset corresponding to the detector at 5 time points can be selected, and the offset corresponding to each time point is used as a new detector offset.
[0074] S104, obtaining imaging parameters corresponding to each of the multiple sample images, and establishing a target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images, wherein the target band registration model includes registration models in the form of polynomials corresponding to the target number of detectors, and the target band registration model is used to register images of the bands to be registered.
[0075] In this embodiment, any one of the multiple sample images is used as a target sample image. The target sample image can be acquired by a linear array sensor. The imaging parameters corresponding to the target sample image are the parameters of the linear array sensor at the time of acquisition of the target sample image. The imaging parameters may include attitude parameters, orbital parameters, imaging position, imaging time and elevation of the linear array sensor, wherein the attitude parameters may include a roll angle, a pitch angle, a yaw angle and an angular velocity, the orbital parameters may include the speed and position of the satellite, and the imaging position may include the longitude and latitude, thereby obtaining the imaging parameters corresponding to each of the multiple sample images.
[0076] According to the imaging parameters corresponding to the multiple sample images and the offsets corresponding to the target number of detectors in each sample image, a target band registration model can be established. The target band registration model is used to register the band to be registered, thereby obtaining the registration image corresponding to the band to be registered.
[0077] For multiple bands corresponding to the sample image, one of them is selected as the reference band, and the remaining bands can be used as the bands to be registered. The above process of determining the target band registration model is repeated to obtain the target band registration model corresponding to each band to be registered. For the image to be registered, the image to be registered is band-registered through the target band registration model corresponding to each band to be registered, and the registered images of each band to be registered corresponding to the image to be registered can be obtained. The registered images of each band to be registered are integrated to obtain the registered image after the image to be registered is band-registered.
[0078] In the embodiment of the present application, a plurality of sample images are acquired, and a reference band image of a target sample image and a band image to be registered are matched to obtain a plurality of pairs of matching points of the target sample image; based on the plurality of pairs of matching points of the target sample image, the offsets corresponding to the target number of detectors in the target sample image are determined, and the calculated offsets vary with the imaging state, and can adapt to the situation where the offsets of the band registration of a high-resolution and high-agility platform are constantly changing; the imaging parameters corresponding to the plurality of sample images are acquired, and a target band registration model is established based on the imaging parameters corresponding to the plurality of sample images and the offsets corresponding to the target number of detectors in each sample image of the plurality of sample images. The target band registration model is used to register the image of the band to be registered, and is composed of polynomials related to the imaging parameters. When the band registration is actually performed, it is less affected by the attitude and track measurement accuracy and the geometric positioning accuracy, and there is no need to perform image matching. Only the imaging parameters need to be input for simple polynomial calculation, which is independent of the ground object features of the image. The band registration process is simple, efficient and easy to implement.
[0079] A possible implementation of the embodiment of the present application is to obtain imaging parameters corresponding to the target sample image, including:
[0080] determining an imaging time of a target sample image;
[0081] The imaging parameters corresponding to the target sample image are obtained according to the imaging time.
[0082] In this embodiment, the sensor will simultaneously record the imaging time corresponding to the image when capturing an image. According to the imaging time corresponding to the target sample image, the imaging parameters corresponding to the target sample image at the imaging time can be read from various data of the sensor.
[0083] The embodiment of the present application can accurately obtain imaging parameters corresponding to the target sample image according to the imaging time of the target sample image, thereby improving the accuracy of the imaging parameters.
[0084] In a possible implementation of the embodiment of the present application, the imaging parameters include: posture parameters, imaging position, imaging time and elevation,
[0085] According to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, a target band registration model is established, including:
[0086] According to the attitude parameters, imaging positions, imaging times and elevations corresponding to the multiple sample images, and the offset corresponding to the target detector in each of the multiple sample images, a polynomial registration model corresponding to the target detector is established, wherein the target detector is a detector at the same position in the multiple sample images, and the polynomial registration model corresponding to the target detector is composed of coefficients and a polynomial consisting of the attitude parameters, the imaging position, the imaging time and the elevation;
[0087] According to the polynomial registration models corresponding to the detectors of the target number, the target band registration model is obtained.
[0088] In this embodiment, each detector corresponds to an offset. For the target detector, by analyzing the relationship between the imaging parameters and the offsets corresponding to each of the multiple sample images, a polynomial registration model corresponding to the target detector can be established by the least squares method. The variables in the registration model are imaging parameters, and each variable corresponds to a coefficient, thereby obtaining the registration models corresponding to the target number of detectors. The registration models of the target number are integrated to obtain the target band registration model.
[0089] The embodiment of the present application can establish a polynomial registration model corresponding to the target detector based on the posture parameters, imaging positions, imaging times, elevations corresponding to multiple sample images and the offset corresponding to the target detector. The target band registration model can be obtained based on the polynomial registration models corresponding to the target number of detectors. When the elevation variable is taken into account, the influence of terrain changes on the detector offset during the band registration process can be eliminated, making the band registration result more accurate.
[0090] In a possible implementation of the embodiment of the present application, the attitude parameters include the roll angle, pitch angle, yaw angle and angular velocity, and the imaging position includes longitude and latitude.
[0091] The polynomial registration model corresponding to the target detector is:
[0092] Δx i =a1 i ·roll 3 +a2 i ·roll 2 +a3 i ·roll+a4 i Pitch 3 +a5 i Pitch 2 +a6 ipitch+a7 i ·yaw+a8 i ·roll v +a9 i Pitch v +a10 i ·yaw v +a11 i ·period+a12 i lat 2 +a13 i lat+a14 i lon+a15 i ·h+a16 i
[0093] Δy i =b1 i ·roll 3 +b2 i ·roll 2 +b3 i ·roll+b4 i Pitch 3 +b5 i Pitch 2 +b6 i pitch+b7 i ·yaw+b8 i ·roll v +b9 i Pitch v +b10 i ·yaw v +b11 i ·period+b12 i lat 2 +b13 i lat+b14 i lon+b15 i ·h+b16 i
[0094] Where i represents the serial number of the target detector, Δx i is the offset of the target detector in the linear array direction, Δy i is the offset of the target probe in the along-track direction, a1 i ...a16 i is the coefficient of the registration model linear array direction corresponding to the target detector, b1 i ...b16 i is the coefficient of the registration model along the track direction corresponding to the target detector, roll is the roll angle, pitch is the pitch angle, yaw is the yaw angle, roll vis the angular velocity of the side swing, pitch v is the pitch angular velocity, yaw v is the yaw angular velocity, period is the travel time, which means the imaging time, lon is the longitude, lat is the latitude, and h is the altitude.
[0095] In this embodiment, for the linear array sensor, the coefficients of the registration model corresponding to each detector in each band to be registered are different, so they need to be calculated separately. Figure 2 The figure shows the relationship between the offset along the linear array direction and the pitch angle when roll=0 for a detector.
[0096] In the embodiment of the present application, the registration model corresponding to each detector is pre-established. When actually performing band registration, there is no need for image matching, strict geometric imaging model and internal orientation parameters. Instead, it is represented by a polynomial related to the imaging parameters. Only the imaging parameters need to be input for simple polynomial calculations. The model is simple and easy to implement, and the processing speed is fast.
[0097] In a possible implementation manner of the embodiment of the present application, the imaging parameters also include orbital parameters.
[0098] According to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, a target band registration model is established, including:
[0099] A target band registration model is established based on the attitude parameters, orbital parameters, imaging position, imaging time and elevation corresponding to each of the multiple sample images, and the offsets corresponding to the detectors of the target number in each of the multiple sample images. The orbital parameters include satellite speed and satellite position.
[0100] In this embodiment, the imaging parameters can be flexibly set according to the requirements of the registration accuracy. The imaging parameters can also include orbital parameters. The orbital parameters include satellite speed and satellite position. According to the attitude parameters, orbital parameters, imaging position, imaging time, and elevation corresponding to each of the multiple sample images, and the offsets corresponding to the detectors of the target number in each of the multiple sample images, a target band registration model is established. The obtained target band registration model is composed of a registration model in the form of a polynomial of the target number. The polynomial contains coefficients and variables. The variables of the registration model in this embodiment include the roll angle, pitch angle, yaw angle in the attitude parameters, the satellite speed and satellite position in the orbital parameters, the roll angular velocity, pitch angular velocity, yaw angular velocity, elevation in the imaging position, and the time corresponding to the imaging time, and each variable corresponds to a coefficient.
[0101] The embodiment of the present application establishes a target band registration model based on the attitude parameters, orbital parameters, imaging positions, imaging times and elevations corresponding to multiple sample images, and the offsets corresponding to the detectors of the target number in each sample image in the multiple sample images. The orbital parameters are applied to the construction of the target band registration model, which can improve the accuracy of the target band registration model.
[0102] A possible implementation of the embodiment of the present application is to establish a target band registration model according to imaging parameters corresponding to each of the multiple sample images and offsets corresponding to the detectors of the target number in each of the multiple sample images, including:
[0103] According to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the target number of detectors in each of the plurality of sample images, an initial target band registration model is established, wherein the initial target band registration model includes an initial registration model in a polynomial form corresponding to each of the target number of detectors;
[0104] Determine the value of each term in the polynomial of the initial registration model of the first detector, and judge whether the value of each term exceeds a preset threshold, the first detector being any one of the target number of detectors;
[0105] Generate a target registration model of the first detector according to the terms whose values in the polynomial of the initial registration model of the first detector exceed a preset threshold;
[0106] According to the target registration models corresponding to the detectors of the target number, the target band registration model is obtained.
[0107] In this embodiment, any sample image can be selected from multiple sample images as the first sample image, the first detector can be determined from the detectors of the target number in the first sample image, the offset of the first detector and the imaging parameters corresponding to the first sample image are substituted into the initial registration model of the first detector, and the value of each item in the initial registration model of the first detector can be obtained. The value of each item is compared with the preset threshold, and the items in the polynomial in the initial registration model of the first detector whose values are less than the preset threshold are deleted. The remaining items constitute the target registration model of the first detector, and the target registration model of each detector in the first sample image constitutes the target band registration model corresponding to the band to be registered. Among them, the unit of each item is pixel, and the larger the value of the item, the greater the influence of the item on the detector offset. The preset threshold can be artificially set according to actual experience. Optionally, the preset threshold can be set to 0.05 pixel, indicating that the influence of the item less than the preset threshold on the detector offset can be ignored.
[0108] In one possible case, the target band registration model is obtained as:
[0109] Δxi =a1 i Pitch 3 +a2 i Pitch 2 +a3 i pitch+a4 i ·roll+a5 i lat+a6 i
[0110] Δy i =b1 i Pitch 3 +b2 i Pitch 2 +b3 i pitch+b4 i ·roll+b5 i lat+b6 i
[0111] The embodiment of the present application compares the preset threshold with the value of each term in the polynomial of the initial registration model of the first detector, removes the terms in the initial registration model whose values exceed the preset threshold, and obtains more representative terms, which can improve the processing speed of the target band registration model and improve the band registration efficiency.
[0112] In one possible case, the target band registration model of the i-th detector is obtained as:
[0113] Δx i =0.000042 pitch 3 +0.000011pitch 2 +0.200850pitch-0.013204roll+0.000724lat-2.213100
[0114] Δy i =-0.000011pitch 3 -0.000121pitch 2 -0.074022pitch+0.107880roll-0.002106lat+5.85600
[0115] The target band registration model of the ith detector can show the influence of various imaging parameters as input variables on the accuracy of the results. For example, when the latitude error reaches 10°, it only brings an error of 0.02 pixels. The target band registration model obtained in this embodiment has small error and high accuracy.
[0116] In a possible implementation manner of the embodiment of the present application, the method further includes:
[0117] Get the image to be processed;
[0118] Determine the imaging parameters corresponding to each row of the image to be processed according to the imaging time of the image to be processed, so as to obtain the imaging parameters corresponding to the image to be processed;
[0119] According to the target band registration model and the imaging parameters corresponding to the image to be processed, the offset of each pixel in the image to be processed is obtained;
[0120] According to the offset of each pixel in the image to be processed, the image of the to-be-registered band of the image to be processed is resampled to obtain the registered image of the to-be-registered band corresponding to the image to be processed.
[0121] In this embodiment, the image to be processed is any image that needs to be band-aligned. For the image to be processed, the linear array sensor can collect one line of image each time, and the obtained multiple lines of images are spliced into a complete image to be processed. The imaging time of the image to be processed is the imaging time corresponding to each line in the image to be processed. The imaging time corresponding to each line of the image to be processed can be determined according to the acquisition frequency of the linear array sensor. Any line in the image to be processed is used as a target line. According to the imaging time corresponding to the target line, the imaging parameters corresponding to the target line can be determined through interpolation processing. The target line corresponds to N detectors, so as to obtain the imaging parameters corresponding to each line of the image to be processed.
[0122] The image to be processed corresponds to multiple bands, one of which is a reference band, and the other multiple bands are all bands to be registered, and each band to be registered corresponds to a target band registration model. The first band to be registered is determined from the multiple bands to be registered, and the target band registration model corresponding to the first band to be registered includes the target registration model corresponding to each detector, and the imaging parameters corresponding to the target row are input into the target registration model corresponding to each detector, so as to obtain the offset of each detector corresponding to the target row, and the imaging parameters corresponding to each row in the image to be processed are respectively input into the target band registration model corresponding to the first band to be registered, so as to obtain the offset of each pixel in the image to be processed in the first band to be registered.
[0123] Further, the image to be processed is resampled according to the offset of each pixel to obtain the registered image of the first band to be registered corresponding to the image to be processed. Repeat the above steps of determining the registered image of the first band to be registered, complete the resampling of each band to be registered, and obtain the registered images corresponding to each band of the image to be processed. The registered images corresponding to each band of the image to be processed are integrated to obtain the registered image corresponding to the image to be processed.
[0124] In the embodiment of the present application, the band registration offset calculation process is independent of the image features, so the registration accuracy is not affected by the texture features of the image itself, and the calculated offset changes with the imaging state, which can adapt to the situation where the band registration offset of the high-resolution and high-agility platform is constantly changing.
[0125] Furthermore, after determining the target band registration models corresponding to the respective bands to be registered, the registration accuracy of the target band registration model can be evaluated. For the first band to be registered, multiple registered images are obtained after band registration through the target band registration model corresponding to the first band to be registered. Any registered image is selected from the multiple registered images as the target registered image. Multiple matching points are obtained on the reference band image corresponding to the target registered image and the first band image to be registered. The number of matching points is recorded as n, and the mean square error of the target registered image in the X direction (linear array direction) and the Y direction (along-track direction) is calculated respectively.
[0126] The formula for the mean error of the target registered image in the X direction is:
[0127]
[0128] Wherein, Δ1 is the point error in the X direction, that is, the coordinate difference of the matching point in the X direction in the reference band image and the first band image to be matched, and n is the number of matching points in the target registered image.
[0129] The formula for the mean error of the target registered image in the Y direction is:
[0130]
[0131] Wherein, Δ2 is the point error in the Y direction, that is, the coordinate difference of the matching point in the Y direction in the reference band image and the first band image to be matched, and n is the number of matching points in the target registered image.
[0132] For example, 80 registered images were selected to evaluate the accuracy of the target band registration model with the red band as the reference band and the blue band as the band to be registered, and 80 mean errors were obtained. Figure 3 This is a schematic diagram of the 80 mean errors obtained. It can be seen that Figure 2 The mean error in the X and Y directions is less than 0.2 pixels, and the registration accuracy is high.
[0133] Furthermore, an error threshold may be set based on actual experience, which is not specifically limited in this embodiment. If the proportion of registered images with errors greater than the error threshold in the registration accuracy assessment exceeds a preset ratio threshold, indicating that the accuracy of the target band registration model is insufficient, sample images may be reselected and a target band registration model may be established to obtain a target band registration model whose registration accuracy meets the requirements, wherein the preset ratio threshold may be set manually as needed, and the error threshold may be selected as 0.3 pixels.
[0134] The above embodiment introduces a remote sensing image band registration method from the perspective of method flow, and the following embodiment introduces a remote sensing image band registration device from the perspective of a virtual module or a virtual unit. For details, please refer to the following embodiment.
[0135] The present application embodiment provides a remote sensing image band registration device, such as Figure 4 As shown, the device may include:
[0136] An acquisition module 401 is used to acquire images corresponding to each of the plurality of sample images, wherein the images include a reference band image corresponding to the reference band and a to-be-registered band image corresponding to the to-be-registered band;
[0137] A matching module 402 is used to match the reference band image of the target sample image with the band image to be registered to obtain multiple pairs of matching points of the target sample image, where the target sample image is any one of the multiple sample images;
[0138] A determination module 403 is used to determine the offsets corresponding to the target number of detectors in the target sample image according to the multiple pairs of matching points of the target sample image, where the target number is the number of detectors in the target sample image;
[0139] Establishing module 404, for obtaining imaging parameters corresponding to each of the plurality of sample images, and establishing a target band registration model according to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the target number of detectors in each of the plurality of sample images, wherein the target band registration model includes registration models in the form of polynomials corresponding to the target number of detectors, and the target band registration model is used to align images of the bands to be registered.
[0140] In a preferred example, the present application may be further configured as follows: when the establishment module 404 establishes the target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, it is specifically used to:
[0141] According to the attitude parameters, imaging positions, imaging times and elevations corresponding to the multiple sample images, and the offset corresponding to the target detector in each of the multiple sample images, a polynomial registration model corresponding to the target detector is established, wherein the target detector is a detector at the same position in the multiple sample images, and the polynomial registration model corresponding to the target detector is composed of coefficients and a polynomial consisting of the attitude parameters, the imaging position, the imaging time and the elevation;
[0142] According to the polynomial registration model corresponding to each detector of the target number, the target band registration model is obtained;
[0143] The attitude parameters include roll angle, pitch angle, yaw angle and angular velocity. The imaging position includes longitude and latitude. The polynomial registration model corresponding to the target detector is:
[0144] Δx i =a1 i ·roll 3 +a2 i ·roll 2 +a3 i ·roll+a4 i Pitch 3 +a5 i Pitch 2 +a6 i pitch+a7 i ·yaw+a8 i ·roll v +a9 i Pitch v +a10 i ·yaw v +a11 i ·period+a12 i lat 2 +a13 i lat+a14 i lon+a15 i ·h+a16 i
[0145] Δy i =b1 i ·roll 3 +b2 i ·roll 2 +b3 i ·roll+b4 i Pitch 3 +b5 i Pitch 2 +b6 i pitch+b7i ·yaw+b8 i ·roll v +b9 i Pitch v +b1o i ·yaw v +b11 i ·period+b12 i lat 2 +b13 i lat+b14 i lon+b15 i ·h+b16 i
[0146] Where i represents the serial number of the target detector, Δx i is the offset of the target detector in the linear array direction, Δy i is the offset of the target probe in the along-track direction, a1 i …a16 i is the coefficient of the registration model linear array direction corresponding to the target detector, b1 i …b16 i is the coefficient of the registration model along the track direction corresponding to the target detector, roll is the roll angle, pitch is the pitch angle, yaw is the yaw angle, roll v is the angular velocity of the roll, pitch v is the pitch angular velocity, yaw v is the yaw angular velocity, period is the travel time, which means the imaging time, lon is the longitude, lat is the latitude, and h is the altitude.
[0147] In a preferred example, the present application may be further configured as follows: when the establishment module 404 establishes the target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, it is specifically used to:
[0148] A target band registration model is established based on the attitude parameters, orbital parameters, imaging position, imaging time and elevation corresponding to each of the multiple sample images, and the offsets corresponding to the detectors of the target number in each of the multiple sample images. The orbital parameters include satellite speed and satellite position.
[0149] In a preferred example, the present application may be further configured as follows: when the establishment module 404 establishes the target band registration model according to the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the detectors of the target number in each of the multiple sample images, it is specifically used to:
[0150] According to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the target number of detectors in each of the plurality of sample images, an initial target band registration model is established, wherein the initial target band registration model includes an initial registration model in a polynomial form corresponding to each of the target number of detectors;
[0151] Determine the value of each term in the polynomial of the initial registration model of the first detector, and judge whether the value of each term exceeds a preset threshold, the first detector being any one of the target number of detectors;
[0152] Generate a target registration model of the first detector according to the terms whose values in the polynomial of the initial registration model of the first detector exceed a preset threshold;
[0153] According to the target registration models corresponding to the detectors of the target number, the target band registration model is obtained.
[0154] In a preferred example, the present application may be further configured as follows: when the establishment module 404 executes the acquisition of imaging parameters corresponding to the target sample image, it is specifically used to:
[0155] determining an imaging time of a target sample image;
[0156] The imaging parameters corresponding to the target sample image are obtained according to the imaging time.
[0157] In a preferred example, the present application can be further configured as follows: the device further includes a resampling module, specifically used for:
[0158] Get the image to be processed;
[0159] Determine the imaging parameters corresponding to each row of the image to be processed according to the imaging time of the image to be processed, so as to obtain the imaging parameters corresponding to the image to be processed;
[0160] According to the target band registration model and the imaging parameters corresponding to the image to be processed, the offset of each pixel in the image to be processed is obtained;
[0161] According to the offset of each pixel in the image to be processed, the image of the to-be-registered band of the image to be processed is resampled to obtain the registered image of the to-be-registered band corresponding to the image to be processed.
[0162] A remote sensing image band registration device provided in an embodiment of the present application is applicable to the above method embodiment and will not be described in detail here.
[0163] An electronic device is provided in an embodiment of the present application, such as Figure 5 As shown, Figure 5The electronic device 500 shown includes: a processor 501 and a memory 503. The processor 501 and the memory 503 are connected, such as through a bus 502. Optionally, the electronic device 500 may also include a transceiver 504. It should be noted that in actual applications, the transceiver 504 is not limited to one, and the structure of the electronic device 500 does not constitute a limitation on the embodiments of the present application.
[0164] Processor 501 may be a CPU (Central Processing Unit), a general purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 501 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.
[0165] The bus 502 may include a path to transmit information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one thick line is used in the diagram, but it does not mean that there is only one bus or only one type of bus.
[0166] The memory 503 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.
[0167] The memory 503 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 501. The processor 501 is used to execute the application code stored in the memory 503 to implement the contents shown in the above embodiment of the remote sensing image band registration method.
[0168] Figure 5 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0169] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment.
[0170] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0171] The above are only some implementation methods of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A remote sensing image band registration method, characterized in that: include: Acquire images corresponding to each of the plurality of sample images, wherein the images include a reference band image corresponding to the reference band and a to-be-registered band image corresponding to the to-be-registered band; Matching a reference band image of a target sample image with the band image to be registered to obtain multiple pairs of matching points of the target sample image, where the target sample image is any one of the multiple sample images; Determine, according to the multiple pairs of matching points of the target sample image, the offsets corresponding to the target number of detectors in the target sample image, where the target number is the number of detectors in the target sample image; Acquire imaging parameters corresponding to each of the plurality of sample images, wherein the imaging parameters include: attitude parameters, imaging positions, imaging time, and elevation; establish a target band registration model according to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the target detectors in each of the plurality of sample images, including: establish a polynomial registration model corresponding to the target detectors according to the attitude parameters, imaging positions, imaging time, and elevation corresponding to each of the plurality of sample images, wherein the attitude parameters include a roll angle, a pitch angle, a yaw angle, and an angular velocity, the imaging positions include longitude and latitude, and the offsets corresponding to the target detectors in each of the plurality of sample images; the polynomial registration model corresponding to the target detectors is: <h2 style=";text-align:left;direction:ltr">Δx<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> =a1<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> 3 <h2 style=";text-align:left;direction:ltr"> +a2<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a3<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll+a4<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> 3 <h2 style=";text-align:left;direction:ltr"> +a5<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a6<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch+a7<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> yaw+a8<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a9<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a10<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> yaw<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a11<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> period+a12<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> ·lat<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a13<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> lat+a14<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> lon+a15<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> h+a16i Δy i =b1 i ·roll 3 +b2 i ·roll 2 +b3 i ·roll+b4 i ·pitch 3 +b5 i ·pitch 2 +b6 i ·pitch+b7 i ·yaw+b8 i ·roll v +b9 i ·pitch v +b10 i ·yaw v +b11 i ·period+b12 i ·lat 2 +b13 i ·lat+b14 i ·lon+b15 i ·h+b16i Where i represents the serial number of the target detector, Δx i is the offset of the target detector in the linear array direction, Δy i is the offset of the target probe in the along-track direction, a1 i ...a16 i is the coefficient of the registration model linear array direction corresponding to the target detector, b1 i ...b16 i is the coefficient of the registration model along the track direction corresponding to the target detector, roll is the roll angle, pitch is the pitch angle, yaw is the yaw angle, roll v is the angular velocity of the roll, pitch v is the pitch angular velocity, yaw v is the yaw angular velocity, period is the travel time, indicating the imaging time, lon is the longitude, lat is the latitude, and h is the altitude; The target detector is a detector at the same position in the multiple sample images, and the polynomial registration model corresponding to the target detector is composed of a polynomial consisting of coefficients and the attitude parameters, imaging position, imaging time and elevation; the target band registration model is obtained according to the polynomial registration model corresponding to each of the target number of detectors; The target band registration model includes registration models in the form of polynomials corresponding to the target number of detectors, and the target band registration model is used to register the image of the band to be registered.
2. The remote sensing image band registration method according to claim 1, characterized in that: The imaging parameters also include orbital parameters. A target band registration model is established based on the imaging parameters corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images. The model includes: establishing a target band registration model based on the attitude parameters, orbital parameters, imaging positions, imaging times and elevations corresponding to each of the multiple sample images and the offsets corresponding to the target number of detectors in each of the multiple sample images. The orbital parameters include satellite speed and satellite position.
3. The remote sensing image band registration method according to claim 1, characterized in that: According to the imaging parameters corresponding to the plurality of sample images and the offsets corresponding to the detectors of the target number in each sample image in the plurality of sample images, a target band registration model is established, including: According to the imaging parameters corresponding to the plurality of sample images and the offsets corresponding to the target number of detectors in each sample image of the plurality of sample images, an initial target band registration model is established, wherein the initial target band registration model includes an initial registration model in a polynomial form corresponding to the target number of detectors; Determining the value of each term in the polynomial of the initial registration model of the first detector, and judging whether the value of each term exceeds a preset threshold, wherein the first detector is any one of the target number of detectors; generating a target registration model of the first detector according to the terms whose values in the polynomial of the initial registration model of the first detector exceed the preset threshold; The target band registration model is obtained according to the target registration models corresponding to the detectors of the target number.
4. The remote sensing image band registration method according to claim 1, characterized in that: Acquiring imaging parameters corresponding to the target sample image, including: Determining the imaging time of the target sample image; The imaging parameters corresponding to the target sample image are acquired according to the imaging time.
5. The remote sensing image band registration method according to claim 1, characterized in that: The method further comprises: Get the image to be processed; Determining imaging parameters corresponding to each row of the image to be processed according to the imaging time of the image to be processed, thereby obtaining imaging parameters corresponding to the image to be processed; Obtaining the offset of each pixel in the image to be processed according to the target band registration model and the imaging parameters corresponding to the image to be processed; According to the offset of each pixel in the image to be processed, the image of the to-be-registered band of the image to be processed is resampled to obtain the registered image of the to-be-registered band corresponding to the image to be processed.
6. A remote sensing image band registration device, characterized in that: include: An acquisition module, used for acquiring images corresponding to each of the plurality of sample images, wherein the images include a reference band image corresponding to the reference band and a to-be-registered band image corresponding to the to-be-registered band; A matching module, used for matching a reference band image of a target sample image with the band image to be registered to obtain a plurality of pairs of matching points of the target sample image, wherein the target sample image is any one of the plurality of sample images; A determination module, configured to determine, based on a plurality of pairs of matching points of the target sample image, offsets corresponding to a target number of detectors in the target sample image, wherein the target number is the number of detectors in the target sample image; A module is established, for obtaining imaging parameters corresponding to each of the plurality of sample images, wherein the imaging parameters include: attitude parameters, imaging position, imaging time and elevation; and a target band registration model is established according to the imaging parameters corresponding to each of the plurality of sample images and the offsets corresponding to the target number of detectors in each of the plurality of sample images, including: establishing a polynomial registration model corresponding to the target detector according to the attitude parameters, imaging position, imaging time and elevation corresponding to each of the plurality of sample images, wherein the attitude parameters include roll angle, pitch angle and yaw angle and angular velocity, the imaging position includes longitude and latitude, and the offsets corresponding to the target detectors in each of the plurality of sample images; the polynomial registration model corresponding to the target detector is: <h2 style=";text-align:left;direction:ltr">Δx<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> =a1<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> 3 <h2 style=";text-align:left;direction:ltr"> +a2<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a3<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll+a4<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> 3 <h2 style=";text-align:left;direction:ltr"> +a5<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a6<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch+a7<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> yaw+a8<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> roll<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a9<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> pitch<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a10<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> yaw<h2 style=";text-align:left;direction:ltr"> v <h2 style=";text-align:left;direction:ltr"> +a11<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> period+a12<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> ·lat<h2 style=";text-align:left;direction:ltr"> 2 <h2 style=";text-align:left;direction:ltr"> +a13<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> lat+a14<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> lon+a15<h2 style=";text-align:left;direction:ltr"> i <h2 style=";text-align:left;direction:ltr"> h+a16i Δy i =b1 i ·roll 3 +b2 i ·roll 2 +b3 i ·roll+b4 i ·pitch 3 +b5 i ·pitch 2 +b6 i ·pitch+b7 i ·yaw+b8 i ·roll v +b9 i ·pitch v +b10 i ·yaw v +b11 i ·period+b12 i ·lat 2 +b13 i ·lat+b14 i ·lon+b15 i ·h+b16i Where i represents the serial number of the target detector, Δx i is the offset of the target detector in the linear array direction, Δy i is the offset of the target probe in the along-track direction, a1 i ...a16 i is the coefficient of the registration model linear array direction corresponding to the target detector, b1 i ...b16 i is the coefficient of the registration model along the track direction corresponding to the target detector, roll is the roll angle, pitch is the pitch angle, yaw is the yaw angle, roll v is the angular velocity of the roll, pitch v is the pitch angular velocity, yaw v is the yaw angular velocity, period is the travel time, indicating the imaging time, lon is the longitude, lat is the latitude, and h is the altitude; The target detector is a detector at the same position in the multiple sample images, and the polynomial registration model corresponding to the target detector is composed of a polynomial consisting of coefficients and the attitude parameters, imaging position, imaging time and elevation; the target band registration model is obtained according to the polynomial registration model corresponding to each of the target number of detectors; The target band registration model includes registration models in the form of polynomials corresponding to the target number of detectors, and the target band registration model is used to register the image of the band to be registered.
7. An electronic device, characterized in that: include: at least one processor; Memory; At least one application, wherein the at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the remote sensing image band registration method according to any one of claims 1-5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed in a computer, the computer is caused to execute the remote sensing image band registration method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Optical remote sensing image simulation method based on radiation and geometry integrated design
CN106652016A
Relative geometric calibration method and system for high-resolution No.6 wide-field-of-view camera
CN110006452A
