On-orbit overall calibration method for photogrammetry parameters of aerospace dual-line array cameras

Through the overall calibration method in orbit, the rigorous imaging model is used to consider the common difference in angle between the star-ground cameras and the non-parallelism of the front and rear line of sight arrays, which solves the problem that changes in camera parameters during satellites during orbit flight affect the image positioning accuracy, and improves the uncontrolled direct front Positioning accuracy of the intersection.

CN115164933BActive Publication Date: 2024-11-22CHINESE PEOPLES LIBERATION ARMY UNIT 61540
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210551679.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-20
Publication Date
2024-11-22
Estimated Expiration
2042-05-20

AI Technical Summary

Technical Problem

During the satellite's orbit, due to emission vibration and temperature changes, the camera's photogrammetry parameters will change, affecting the image positioning accuracy. The existing technology still has room for improvement in improving the positioning accuracy of uncontrolled direct forward intersection.

Method used

The in-orbit overall calibration method of photogrammetry parameters of aerospace dual-line array camera is adopted. By obtaining the coordinate information of preset control points, a rigorous imaging model is constructed, and the normal angle difference between the star-ground camera and the non-parallelism of the front and rear line of sight array are revised and Equivalent transformation, calculate the in-orbit calibration quantification of photogrammetry parameters.

Benefits of technology

The accuracy of in-orbit calibration of the photogrammetry parameters of the two-line array camera is improved, and the system errors caused by the frequent difference in angles between the star-ground cameras and the non-parallelism of the front and rear line of sight arrays is eliminated, and the positioning accuracy of the satellite's uncontrolled direct forward intersection is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115164933B_ABST
    Figure CN115164933B_ABST
Patent Text Reader

Abstract

The present disclosure provides an on-orbit overall calibration method for the photogrammetric parameters of a space dual-line array camera, including: obtaining the coordinate information of preset control points used to calibrate the photogrammetric parameters of the dual-line array camera; according to the coordinate information of the preset control points, using a pre-constructed rigorous imaging model, calculating the on-orbit calibration quantity of the photogrammetric parameters of the dual-line array camera. In the present disclosure, the rigorous imaging model is constructed based on the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear line arrays. Therefore, the photogrammetric parameters of the dual-line array camera calibrated by the rigorous imaging model are more comprehensive and accurate, and the system error caused by the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear line arrays can be eliminated, thereby improving the positioning accuracy of the satellite's uncontrolled direct forward rendezvous.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of satellite surveying and mapping technology, and in particular to an on-orbit overall calibration method for photogrammetry parameters of a space dual-line array camera. Background Art

[0002] Before the launch of a mapping satellite, the camera photogrammetry parameters must be strictly calibrated in the laboratory. However, due to the influence of satellite launch vibration and temperature changes during long-term in-orbit flight, the rigid structure between the payloads and the geometric photogrammetry parameters of the space camera will change, thus affecting the positioning accuracy of satellite images. Therefore, mapping satellites need to achieve high-precision positioning through in-orbit geometric calibration based on the calibration of photogrammetry parameters in the laboratory.

[0003] There are two mainstream methods for on-orbit calibration of camera photogrammetry parameters: one is the overall calibration method used in the Tianhui-1 satellite project, which adopts the idea of ​​reorganizing three-line array cameras, and treats the photogrammetry parameters of all cameras as unknown parameters in a unified solution in the bundle adjustment. Through this method, the satellite's uncontrolled direct forward intersection positioning accuracy is improved from about 200 meters to about 9 meters. The other is the internal calibration based on pointing angle and the external calibration method based on rotation matrix used in the Ziyuan-3 satellite project. Through this method, the satellite's uncontrolled direct forward intersection positioning accuracy is improved from more than one thousand meters to within 15 meters. In general, both methods have achieved relatively good results in satellite engineering practice, but it is still necessary to continue to improve the accuracy of on-orbit geometric calibration of camera photogrammetry parameters in order to further improve the satellite's uncontrolled direct forward intersection positioning accuracy. Summary of the invention

[0004] In view of this, the present invention proposes an on-orbit overall calibration method for aerospace dual-line array camera photogrammetry parameters, which can improve the on-orbit calibration accuracy of dual-line array camera photogrammetry parameters, and further improve the satellite uncontrolled direct forward rendezvous positioning accuracy.

[0005] According to a first aspect of the present disclosure, a method for overall on-orbit calibration of photogrammetry parameters of a space dual-line array camera is provided, comprising:

[0006] Obtaining coordinate information of preset control points for calibrating photogrammetry parameters of a dual-line array camera;

[0007] According to the coordinate information of the preset control points, the on-orbit calibration of the photogrammetry parameters of the dual-line array camera is calculated by using a pre-constructed rigorous imaging model.

[0008] In a possible implementation, when constructing the rigorous imaging model based on the constant difference in the satellite-ground camera angle and the non-parallelism of the front and rear line of sight arrays, it includes:

[0009] The strict imaging models of the front and rear cameras of the dual-line array camera are uniformly equivalently transformed into the first strict imaging model of the vertical photography frame camera;

[0010] According to the constant difference in angle between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first rigorous imaging model is revised to obtain the rigorous imaging model.

[0011] In a possible implementation, when the first rigorous imaging model is revised according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays to obtain the rigorous imaging model, it includes the step of revising the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and the step of revising the revised first rigorous imaging model again according to the non-parallelism of the front and rear sight arrays.

[0012] In a possible implementation, when revising the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear line of sight arrays, it is implemented by respectively using a first revision item based on an orthogonal rotation matrix to revise the constant angle difference between the satellite and the ground camera and a second revision item based on a rotation angle between the front and rear line of sight arrays to revise the non-parallelism of the front and rear line of sight arrays.

[0013] In a possible implementation, the strict imaging model after the first strict imaging model is revised by the first revision item for revising the satellite-to-ground camera angle constant error constructed based on the orthogonal rotation matrix is ​​as follows:

[0014]

[0015] Where (x, y) is the image point coordinate, f is the focal length of the camera, m is the scale factor, and R(ψ, ω, κ) is the first revision term. is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (X P ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ',Y c ',Z c ') is the equivalent transformed coordinate in the CGCS2000 coordinate system.

[0016] In a possible implementation manner, the second revision item includes at least one of a revision item of an image point coordinate x, a revision item of an image point coordinate y, and a revision item of a camera focal length;

[0017] When constructing a second revision item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays, it includes:

[0018] Constructing a revised term of the image point coordinate x based on the rotation angle around the Z axis between the front and rear sight arrays;

[0019] Constructing the camera focal length revision item based on the rotation angle between the front and rear sight arrays about the X-axis;

[0020] A preset influencing factor is obtained to construct a revision item of the image point coordinate y.

[0021] In a possible implementation, the second revised item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays is a revised rigorous imaging model as shown in the following formula:

[0022]

[0023] Where (x', y') is the revised image point coordinate, (x, y) is the image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, and f is the focal length of the camera.

[0024] In a possible implementation, the coordinate information of the preset control point includes the calibrated ground coordinates of the control point and the corresponding calibrated image point coordinates;

[0025] According to the coordinate information of the preset control points, the on-track calibration of the photogrammetry parameters of the dual-line array camera is calculated by using a pre-built rigorous imaging model, including:

[0026] Using the rigorous imaging model, calculating the predicted image point coordinates corresponding to the calibrated ground coordinates of each of the control points;

[0027] Based on the calibrated image point coordinates of each control point and the corresponding predicted image point coordinates, constructing a photogrammetric parameter calibration error equation corresponding to each control point;

[0028] The calibration error equation of the photogrammetric parameters corresponding to each of the control points is solved as a whole to obtain the on-track calibration quantity of the photogrammetric parameters.

[0029] According to a second aspect of the present disclosure, there is provided an on-orbit integrated calibration device for photogrammetry parameters of a space dual-line array camera, comprising:

[0030] A control point coordinate information acquisition module is used to acquire coordinate information of preset control points used for calibrating the photogrammetry parameters of the dual-line array camera;

[0031] The on-orbit calibration module is used to calculate the on-orbit calibration quantity of the photogrammetry parameters of the dual-line array camera according to the coordinate information of the preset control points and using a pre-built rigorous imaging model.

[0032] According to a third aspect of the present disclosure, there is provided an on-orbit integrated calibration device for photogrammetry parameters of a space dual-line array camera, comprising: a processor; and a memory for storing processor executable instructions; wherein the processor is configured to execute the method described in the first aspect of the present disclosure.

[0033] In the present disclosure, a rigorous imaging model is constructed by considering the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays. Therefore, the photogrammetry parameters of the dual-line array camera calibrated by the rigorous imaging model are more comprehensive and accurate, and the systematic errors caused by the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays can be eliminated, thereby improving the positioning accuracy of the satellite's uncontrolled direct forward rendezvous.

[0034] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0036] Figure 1 A schematic flow chart showing an on-orbit overall calibration method for photogrammetry parameters of a space dual-line array camera according to an embodiment of the present disclosure;

[0037] Figure 2 A schematic diagram showing the coverage of Gaofen-14 satellite images, distribution of ground control points and ground check points according to an embodiment of the present disclosure;

[0038] Figure 3 A schematic diagram showing the residual distribution of ground checkpoints in the plane and elevation directions after track calibration according to an embodiment of the present disclosure is shown;

[0039] Figure 4 A schematic block diagram of an on-orbit overall calibration device for photogrammetry parameters of a space dual-line array camera according to an embodiment of the present disclosure is shown;

[0040] Figure 5 A schematic block diagram of an on-orbit overall calibration device for photogrammetry parameters of a space dual-line array camera according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0041] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0042] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0043] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the main purpose of the present disclosure.

[0044] <Method Example>

[0045] Figure 1 A schematic flow chart of an on-orbit overall calibration method for aerospace dual-line array camera photogrammetry parameters according to an embodiment of the present disclosure is shown. Figure 1 As shown, the method includes steps S1100-S1200.

[0046] S1100, obtaining coordinate information of preset control points for calibrating photogrammetry parameters of a dual-line array camera.

[0047] The preset control points are evenly distributed ground control points collected in the calibration field. The number of the preset control points can be determined according to the specific application scenario. For example, 87 preset control points can be selected for on-orbit calibration of the photogrammetry parameters of a dual-line array camera, or 100 preset control points can be selected for on-orbit calibration of the photogrammetry parameters of a dual-line array camera. Here, the number of preset control points is specifically limited.

[0048] Each preset control point has corresponding coordinate information, which includes the calibration ground coordinates and the calibration image point coordinates corresponding to the calibration ground coordinates, wherein the calibration image point coordinates are the image point coordinates corresponding to the calibration ground coordinates in the selected calibration image.

[0049] In a possible implementation, the Ningxia digital calibration field is selected to conduct a dual-line array camera photogrammetry parameter calibration test. Specifically, 87 evenly distributed ground control points collected in the Ningxia digital calibration field are used as preset control points for on-orbit geometric calibration calculation, and the image including the calibration field taken by the Gaofen-14 satellite is used as the calibration image. In this way, the photogrammetry parameters of the dual-line array camera can be calibrated according to the coordinate information corresponding to the 87 preset control points.

[0050] S1200, based on the coordinate information of the preset control points, using a pre-built rigorous imaging model, calculate the on-orbit calibration quantity of the photogrammetry parameters of the dual-line array camera.

[0051] The rigorous imaging model is a rigorous imaging model of a space dual-line array camera, and the rigorous imaging model describes the mapping relationship between the satellite image coordinates (x, y) and the ground coordinates (X, Y, Z) of the ground object point.

[0052] Before executing step S1200, the strict imaging model needs to be pre-built. Considering the influence of factors such as satellite launch vibration and temperature changes during long-term in-orbit flight, the angle between the star camera and the ground camera, and the linear array parallelism of the front line of sight array camera and the rear line of sight array camera will change, thereby affecting the positioning accuracy of the satellite. Therefore, in order to avoid the influence of the above changes on the positioning accuracy of satellite images, the constant difference of the angle between the star and ground cameras and the non-parallelism of the front and rear line of sight arrays need to be considered when building the strict imaging model.

[0053] In a possible implementation, when a rigorous imaging model is constructed by taking into account the constant angle difference between satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays, steps S1010-S1020 are included.

[0054] S1010, according to the equivalent frame principle, the strict imaging models of the front-view camera and the rear-view camera of the dual-line array camera are uniformly equivalently transformed into the first strict imaging model of the vertical photography frame camera. The camera coordinate system of the frame camera is consistent with the three-axis direction of the satellite body coordinate system, that is, the Z axis points to the sub-satellite point, the X axis points to the flight direction, the Y axis and the X axis and the Z axis form a right-hand system, and the coordinate origin is the projection center of the frame camera. The first strict imaging model of the equivalent frame camera constructed in this way is shown in formula (1).

[0055]

[0056] In the formula, (X P ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ,Y c ,Z c ) is the coordinate of the satellite center of mass C in the CGCS2000 coordinate system, is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (ΔX1, ΔX1, ΔX1) are the coordinates of the satellite center of mass in the satellite body coordinate system, (ΔX2, ΔX2, ΔX2) are the coordinates of the camera projection center in the satellite body coordinate system, m is the scale factor, (x, y) are the image point coordinates of the camera, and f is the focal length of the camera.

[0057] It should be noted that after determining the target satellite to be calibrated, some parameters in equation (1) can be determined. The target satellite is a satellite equipped with a dual-line array camera, such as the Gaofen-14 satellite. Specifically, after determining the target satellite to be calibrated, (ΔX1, ΔX1, ΔX1) and (ΔX2, ΔX2, ΔX2) of the target satellite can be determined. In addition, (X c ,Y c ,Z c ), which can be determined based on the precise attitude data of the target satellite The x and f in equation (1) can be determined based on the camera focal length and inclination angle of the dual-line array camera on the target satellite. For example, for the forward-looking camera in the dual-line array camera, x = F f sinθ f , f=F f cosθ f , where F f is the focal length of the forward-looking camera, θ f is the inclination angle of the forward-looking camera. Similarly, for the rear-looking camera in the dual-line array camera, x = F b sinθ b , f=F b cosθ b , where F b is the focal length of the rear-view camera, θ b is the inclination angle of the rear view camera.

[0058] S1020, according to the constant difference in angle between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first rigorous imaging model is revised to obtain a rigorous imaging model.

[0059] In a possible implementation, when the first strict imaging model is revised according to the constant difference of the satellite-to-ground camera angle and the non-parallelism of the front and rear sight arrays to obtain the strict imaging model, it includes the steps of revising the first strict imaging model according to the constant difference of the satellite-to-ground camera angle, and revising the revised first strict imaging model according to the non-parallelism of the front and rear sight arrays. Specifically, after obtaining the first strict imaging model, the first strict imaging model is first revised according to the constant difference of the satellite-to-ground camera angle to obtain the second strict imaging model, and then the second strict imaging model is revised according to the non-parallelism of the front and rear sight arrays to obtain the strict imaging model.

[0060] In a possible implementation, when revising the first rigorous imaging model according to the satellite-to-ground camera angle constant error, the first revision item for revising the satellite-to-ground camera angle constant error constructed based on the orthogonal rotation matrix is ​​implemented. Specific implementation steps include S1021-S1023.

[0061] S1021, transform (1) to obtain formula (2).

[0062]

[0063] S1022, substitute equation (2) into equation (1) to obtain equation (3).

[0064]

[0065] S1023, constructing a first revision term for revising the constant error of the satellite-to-ground camera angle based on the orthogonal rotation matrix, and revising equation (3) by using the first revision term to obtain a second rigorous imaging model.

[0066] In a possible implementation, three rotation angles ψ, ω, and κ are introduced, and the three rotation angles are transformed into an orthogonal rotation moment R(ψ, ω, κ) in the order of Y, Z, and X axes. R(ψ, ω, κ) is used as the first revision item to revise equation (3) to obtain the second rigorous imaging model, so as to eliminate the attitude system error caused by the constant difference in the satellite-ground camera angle.

[0067] In this implementable manner, after revising equation (3) by using R(ψ, ω, κ) as the first revision term, the obtained second rigorous imaging model can be shown as equation (4).

[0068]

[0069] Where (x, y) is the image point coordinate, f is the focal length of the camera, m is the scale factor, and R(ψ, ω, κ) is the first revision term. is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (X P ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ',Y c ',Z c ') is the equivalent transformed coordinate in the CGCS2000 coordinate system.

[0070] For the frame camera after equivalent transformation, if the front and rear sight lines are parallel, the rotation error of the line array can be equivalent to the correction of the angle constant difference between the satellite and the ground camera. However, due to the influence of factors such as payload placement and satellite launch vibration, it is difficult to ensure that the front and rear sight arrays of the dual-line array camera are parallel to each other. Therefore, when constructing a rigorous imaging model, the non-parallelism of the front and rear sight arrays also needs to be taken into account.

[0071] In a possible implementation, when revising the first rigorous imaging model according to the non-parallelism of the front and rear sight arrays, a second revision item for revising the non-parallelism of the front and rear sight arrays is constructed based on the rotation angle between the front and rear sight arrays.

[0072] It should be noted that after the parallel relationship between the front and rear sight arrays is broken, a rotation angle will appear between the front and rear sight arrays. When the rotation angle includes a rotation angle around the Z axis, the image point coordinate x will change; when the rotation angle includes a rotation angle around the X axis, the equivalent frame camera focal length will change. At the same time, the appearance of the rotation angle will also bring about a slight change in the image point coordinate y. Therefore, when constructing the second revision item, at least one of the revision items of the image point coordinate x, the revision item of the image point coordinate y, and the camera focal length revision item can be constructed based on the rotation angle between the front and rear sight arrays.

[0073] In this implementable method, when constructing the second revision item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays, it includes: constructing a revision item of the image point coordinate x based on the rotation angle around the Z axis between the front and rear sight arrays; constructing a camera focal length revision item based on the rotation angle around the X axis between the front and rear sight arrays; and constructing a revision item of the image point coordinate y based on a preset influencing factor.

[0074] For example, the rotation angle between the front and rear sight arrays includes a rotation angle α around the Z axis and a rotation angle γ around the X axis. When constructing a revision item of the image point coordinate x based on the rotation angle α between the front and rear sight arrays around the Z axis, the rotation angle α can be directly multiplied with the image point coordinate y (i.e., αy) as the revision item of the image point coordinate x. When constructing a camera focal length revision item based on the rotation angle γ between the front and rear sight arrays around the X axis, the rotation angle γ can be directly multiplied with the image point coordinate y (i.e., γy) as the camera focal length revision item. When constructing a revision item of the image point coordinate y based on a preset influence factor, the preset influence factor β can be directly multiplied with the image point coordinate y (i.e., βy) as the revision item of the image point coordinate y.

[0075] In an embodiment in which the first rigorous imaging model is first revised according to the constant difference in satellite-ground camera angles to obtain a second rigorous imaging model, and then the second rigorous imaging model is revised according to the non-parallelism of the front and rear line of sight arrays to obtain the rigorous imaging model, when the second rigorous imaging model is revised using the second revision item including the revision item of the image point coordinate x, the revision item of the image point coordinate y and the revision item of the camera focal length, steps S1024-S1028 are included.

[0076] S1024, in formula (4), let

[0077]

[0078] S1025, Substituting (5) into (4), we have

[0079]

[0080] S1026, further order

[0081]

[0082] Then there is

[0083]

[0084] S1027, using the second revision item including the revision item of the image point coordinate x, the revision item of the image point coordinate y and the revision item of the camera focal length to revise the equivalent transformation model (8) of the second rigorous imaging model to obtain a third rigorous imaging model as shown in formula (9).

[0085]

[0086] Where (x', y') is the revised image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, f is the focal length of the camera, γy is the camera focal length revision item, αy is the revision item of the image point coordinate x, and βy is the revision item of the image point coordinate y.

[0087] S1028, substitute equation (8) into equation (9) to obtain the final rigorous imaging model as shown in equation (10).

[0088]

[0089] Where (x', y') is the revised image point coordinate, (x, y) is the image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, and f is the focal length of the camera.

[0090] After the rigorous imaging model is constructed, the initial quantities of the photogrammetric parameters involved in the rigorous imaging model need to be determined in a laboratory environment, and the photogrammetric parameters involved in the rigorous imaging model need to be initially set according to the initial quantities of the photogrammetric parameters, so that the photogrammetric parameters can be calibrated on-orbit based on the rigorous imaging model after the initial setting. The photogrammetric parameters are the camera parameters that affect the positioning accuracy of satellite images.

[0091] In a possible implementation, when calculating the on-track calibration of the photogrammetry parameters of the dual-line array camera according to the coordinate information of the preset control points and using a pre-built rigorous imaging model, steps S1210 to S1230 are included.

[0092] S1210, using a rigorous imaging model, calculating the predicted image point coordinates corresponding to the calibrated ground coordinates of each control point, wherein the predicted image point coordinates include the predicted image point coordinates of the front-view camera and the predicted image point coordinates of the rear-view camera.

[0093] For example, for the control point P, its calibrated ground coordinates and the focal length and inclination of the front-view camera are brought into the right side of the strict imaging model (10), and the predicted image point coordinates of the front-view camera corresponding to the control point P can be calculated. Its calibrated ground coordinates and the focal length and inclination of the rear-view camera are brought into the right side of the strict imaging model (10), and the predicted image point coordinates of the rear-view camera corresponding to the control point P can be calculated.

[0094] S1220: constructing a photogrammetric parameter calibration error equation corresponding to each control point based on the calibrated image point coordinates of each control point and the corresponding predicted image point coordinates.

[0095] In the embodiment where the obtained rigorous imaging model is shown in formula (10), the rigorous imaging model shown in formula (10) is first linearized, and the least squares method is used to construct the photogrammetry parameter calibration error equation shown in formula (11).

[0096] CΔ-L=V (11)

[0097]

[0098] Where (x', y') is the coordinate of the calibrated image point corresponding to the control point, (x0', y0') is the predicted image point coordinate calculated by the rigorous imaging model (10), and Δ T is the photogrammetry parameter calibration vector, which includes the calibration values ​​of 15 photogrammetry parameters that need to be solved as a whole, including 3 calibration values ​​of the constant difference of the satellite-to-ground camera angle dω, dκ, two camera focal length calibration quantities df f 、df b , 4 camera principal point calibration quantities dx f 、dx b ,dy f ,dy b , 4 linear array rotation angle markers quantitative dα f , dα b ,dγ f ,dγ b , and the influence factor calibration quantity dβ of the two image point coordinates f , dβ b , V is the residual.

[0099] The calibrated image point coordinates and the corresponding predicted image point coordinates of each control point are substituted into the photogrammetry parameter calibration error equation to complete the construction of the photogrammetry parameter calibration error equation corresponding to each control point.

[0100] For example, for control point P, the calibrated image point coordinates and predicted image point coordinates of the front view camera are substituted into the photogrammetric parameter calibration error equation (11) to complete the construction of the photogrammetric parameter calibration error equation of the front view camera of control point P; the calibrated image point coordinates and predicted image point coordinates of the rear view camera are substituted into the photogrammetric parameter calibration error equation (11) to complete the construction of the photogrammetric parameter calibration error equation of the rear view camera of control point P. The construction of the photogrammetric parameter calibration error equation corresponding to each control point is completed with reference to control point P.

[0101] S1230, performing overall solution to the calibration error equation of the photogrammetric parameters corresponding to each control point to obtain the on-track calibration quantity of the photogrammetric parameters.

[0102] When the on-orbit quantification of the photogrammetric parameters is determined, the photogrammetric parameters can be adjusted according to the on-orbit quantification and initial quantity of the photogrammetric parameters to make the positioning of the satellite image more accurate.

[0103] After completing the on-orbit calibration of the satellite dual-line array camera photogrammetry parameters, you can also select detection points in the calibration image to evaluate the satellite positioning accuracy before and after the photogrammetry parameter calibration. The following uses the Gaofen-14 satellite as an example to explain the evaluation content.

[0104] For example, 40 evenly distributed control points are selected as checkpoints in a certain scene image taken by Gaofen-14 satellite including the Ningxia digital calibration field to evaluate the satellite positioning accuracy before and after the photogrammetry parameter calibration. Figure 2 shown.

[0105] In the on-orbit calibration test, the overall solution of the dual-line array camera photogrammetry parameters was carried out through 87 control points, and the uncontrolled positioning accuracy was tested using 40 checkpoints in the calibration field. The residual statistics of the ground checkpoints before and after the on-orbit calibration are shown in Table 1. The residual distribution of the ground checkpoints in the plane and elevation directions after the on-orbit calibration is shown in Table 1. Figure 3 shown.

[0106] Table 1

[0107]

[0108] From Table 1, we can see that the mean and mean error of the checkpoint residuals before on-orbit calibration are both large, at the order of 100 meters, and the standard deviation is small, within 5 meters. It can be seen that the error affecting the positioning accuracy of the GF-14 dual-line array image is mainly the system error. After on-orbit calibration, the mean of the checkpoint residuals is basically zero, and the mean error and standard deviation are basically the same. Figure 2It can also be seen that the residual distribution of the checkpoints in the plane and elevation directions after on-track calibration is random and has no obvious systematicity, which indicates that the systematic errors that affect the positioning accuracy of the dual-line array images are better eliminated through the overall solution of the photogrammetry parameters of the dual-line array camera.

[0109] At the same time, in order to verify the uncontrolled positioning accuracy of satellite images far away from the calibration field, five GF-14 stereo images of foreign areas taken between March and April 2021 were selected. Using the checkpoints within the image coverage area, combined with precise attitude determination, precise orbit determination and on-orbit calibration, the photogrammetry parameters of the dual-line array camera were measured, and the direct forward intersection method of stereo images under uncontrolled conditions was adopted to calculate and statistically analyze the geometric calibration accuracy test results, and further analyze and verify the validity and reliability of the geometric calibration results.

[0110] The uncontrolled positioning accuracy of the above calibration results was tested using detection field images from five foreign regions, and the statistical results are shown in Table 2.

[0111] Table 2

[0112]

[0113] According to the accuracy statistics, the uncontrolled positioning accuracy of the direct forward intersection of the dual-line array image of the Gaofen-14 satellite after on-orbit geometric calibration reached 2.34 meters (RMS) in the plane and 1.97 meters (RMS) in the elevation. Although the positioning accuracy is slightly lower than the 0.76 meters (RMS) in the plane and 1.22 meters (RMS) in the elevation of the calibration field, considering that the attitude measurement accuracy of the Gaofen-14 satellite is 0.3 arc seconds (1), the maximum random error in the plane caused by the 500-kilometer altitude orbit is about 0.9 meters, and the maximum random error in the elevation is about 1.8 meters. At the same time, considering the slight changes in the satellite's entire satellite state at different imaging times, the accuracy test results can illustrate the reliability, applicability and stability of the on-orbit geometric calibration photogrammetry parameters.

[0114] In the present disclosure, a rigorous imaging model is constructed based on the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays. Therefore, the photogrammetry parameters of the dual-line array camera calibrated by the rigorous imaging model are more comprehensive and accurate, and the systematic errors caused by the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays can be eliminated, thereby improving the positioning accuracy of the satellite's uncontrolled direct forward rendezvous.

[0115] <Device Example>

[0116] Figure 4 FIG. 1 is a schematic block diagram of an on-orbit calibration device for aerospace dual-line array camera photogrammetry parameters according to an embodiment of the present disclosure. Figure 4 As shown, the on-orbit calibration device 100 includes:

[0117] A control point coordinate information acquisition module 110 is used to acquire coordinate information of preset control points used for calibrating the photogrammetry parameters of the dual-line array camera;

[0118] The on-track calibration module 120 is used to calculate the on-track calibration quantity of the photogrammetry parameters of the dual-line array camera according to the coordinate information of the preset control points by using a pre-built rigorous imaging model.

[0119] In a possible implementation, the on-orbit calibration device 100 further includes a rigorous imaging model construction module (not shown in the figure), which is used to construct a rigorous imaging model based on the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays. The rigorous imaging model construction module includes:

[0120] A first strict imaging model building module (not shown in the figure), used to uniformly and equivalently transform the strict imaging models of the front and rear cameras of the dual-line array camera into a first strict imaging model of a vertical photography frame camera;

[0121] The rigorous imaging model construction module (not shown in the figure) is used to revise the first rigorous imaging model according to the constant angle difference between the satellite and ground cameras and the non-parallelism of the front and rear line of sight arrays to obtain a rigorous imaging model.

[0122] In a possible implementation, a rigorous imaging model construction module (not shown in the figure) is specifically used to revise the first rigorous imaging model according to the constant difference in the satellite-ground camera angle, and to revise the revised first rigorous imaging model again according to the non-parallelism of the front and rear line of sight arrays.

[0123] In a possible implementation, when the rigorous imaging model construction module revises the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear line of sight arrays, it is implemented by respectively using a first revision item based on an orthogonal rotation matrix to revise the constant angle difference between the satellite and the ground camera and a second revision item based on a rotation angle between the front and rear line of sight arrays to revise the non-parallelism of the front and rear line of sight arrays.

[0124] In a possible implementation, the strict imaging model after the first strict imaging model is revised by the first revision item for revising the satellite-to-ground camera angle constant error constructed based on the orthogonal rotation matrix is ​​as follows:

[0125]

[0126] Where (x, y) is the image point coordinate, f is the focal length of the camera, m is the scale factor, and R(ψ, ω, κ) is the first revision term. is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (XP ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ',Y c ',Z c ') is the equivalent transformed coordinate in the CGCS2000 coordinate system.

[0127] In a possible implementation manner, the second revision item includes at least one of a revision item of an image point coordinate x, a revision item of an image point coordinate y, and a revision item of a camera focal length;

[0128] When constructing a second revision item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays, it includes:

[0129] Construct the revised term of the image point coordinate x based on the rotation angle around the Z axis between the front and rear line of sight arrays;

[0130] Construct the camera focal length revision term based on the rotation angle around the X axis between the front and rear sight arrays;

[0131] Get the preset influencing factor, the revision item of the image point coordinate y.

[0132] In a possible implementation, the second revised item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays is a revised rigorous imaging model as shown in the following formula:

[0133]

[0134] Where (x', y') is the revised image point coordinate, (x, y) is the image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, and f is the focal length of the camera.

[0135] In a possible implementation, the coordinate information of the preset control point includes the calibrated image point coordinates of the control point and the corresponding calibrated ground coordinates; the on-track calibration module 120 is specifically used for:

[0136] Using a rigorous imaging model, the predicted image point coordinates corresponding to the calibrated ground coordinates of each control point are calculated;

[0137] Based on the calibrated image point coordinates of each control point and the corresponding predicted image point coordinates, the calibration error equation of the photogrammetric parameters corresponding to each control point is constructed;

[0138] The calibration error equation of the photogrammetric parameters corresponding to each control point is solved as a whole to obtain the on-orbit calibration quantity of the photogrammetric parameters.

[0139] <Equipment Embodiment>

[0140] Figure 5 A schematic block diagram of an on-orbit calibration device for aerospace dual-line array camera photogrammetry parameters according to an embodiment of the present disclosure is shown. Figure 5 As shown, the on-orbit calibration device 200 includes a processor 210 and a memory 220 for storing executable instructions of the processor 210. The processor 210 is configured to implement any of the above-mentioned on-orbit overall calibration methods for photogrammetry parameters of aerospace dual-line array cameras when executing the executable instructions.

[0141] Here, it should be noted that the number of processors 210 may be one or more. Meanwhile, in the on-orbit integral calibration device 200 for aerospace dual-line array camera photogrammetry parameters in the embodiment of the present disclosure, an input device 230 and an output device 240 may also be included. The processor 210, the memory 220, the input device 230 and the output device 240 may be connected via a bus or in other ways, which are not specifically limited here.

[0142] The memory 220 is a computer-readable storage medium that can be used to store software programs, computer executable programs, and various modules, such as the program or module corresponding to the on-orbit overall calibration method of the space dual-line array camera photogrammetry parameters in the embodiment of the present disclosure. The processor 210 executes various functional applications and data processing of the on-orbit overall calibration device 200 of the space dual-line array camera photogrammetry parameters by running the software programs or modules stored in the memory 220.

[0143] The input device 230 may be used to receive input numbers or signals. The signals may be key signals related to user settings and function control of the device / terminal / server. The output device 240 may include display devices such as display screens.

[0144] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An on-orbit overall calibration method for photogrammetry parameters of aerospace dual-line array cameras, characterized in that: include: Obtaining coordinate information of preset control points for calibrating photogrammetry parameters of a dual-line array camera; According to the coordinate information of the preset control points, the on-orbit calibration of the photogrammetry parameters of the dual-line array camera is calculated using a pre-built rigorous imaging model; When constructing the rigorous imaging model based on the constant difference in the satellite-ground camera angle and the non-parallelism of the front and rear line of sight arrays, it includes: The strict imaging models of the front and rear cameras of the dual-line array camera are uniformly equivalently transformed into the first strict imaging model of the vertical photography frame camera; According to the constant difference in angle between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first rigorous imaging model is revised to obtain the rigorous imaging model; When revising the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first revision item for revising the constant angle difference between the satellite and the ground camera constructed based on the orthogonal rotation matrix and the second revision item for revising the non-parallelism of the front and rear sight arrays constructed based on the rotation angle between the front and rear sight arrays are respectively implemented; The rigorous imaging model after revising the first rigorous imaging model based on the first revision item for revising the constant error of the satellite-to-ground camera angle constructed on the basis of the orthogonal rotation matrix is ​​as follows: Where (x, y) is the image point coordinate, f is the focal length of the camera, m is the scale factor, and R(ψ, ω, κ) is the first revision term. is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (X P ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ',Y c ',Z c ') is the equivalent transformed coordinate in the CGCS2000 coordinate system; The revised rigorous imaging model based on the rotation angle between the front and rear line of sight arrays for revising the non-parallelism of the front and rear line of sight arrays is shown as follows: Where (x', y') is the revised image point coordinate, (x, y) is the image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, and f is the focal length of the camera.

2. The method according to claim 1, characterized in that When the first rigorous imaging model is revised according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays to obtain the rigorous imaging model, the method includes the steps of revising the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and revising the revised first rigorous imaging model again according to the non-parallelism of the front and rear sight arrays.

3. The method according to claim 1, characterized in that The second revision item includes at least one of a revision item of an image point coordinate x, a revision item of an image point coordinate y, and a revision item of a camera focal length; When constructing a second revision item for revising the non-parallelism of the front and rear sight arrays based on the rotation angle between the front and rear sight arrays, it includes: Constructing a revised term of the image point coordinate x based on the rotation angle around the Z axis between the front and rear sight arrays; Constructing the camera focal length revision item based on the rotation angle between the front and rear sight arrays about the X-axis; A preset influencing factor is obtained to construct a revision item of the image point coordinate y.

4. The method according to any one of claims 1 to 3, characterized in that: The coordinate information of the preset control point includes the calibrated ground coordinates of the control point and the corresponding calibrated image point coordinates; According to the coordinate information of the preset control points, the on-track calibration of the photogrammetry parameters of the dual-line array camera is calculated by using a pre-built rigorous imaging model, including: Using the rigorous imaging model, calculating the predicted image point coordinates corresponding to the calibrated ground coordinates of each of the control points; Based on the calibrated image point coordinates of each control point and the corresponding predicted image point coordinates, constructing a photogrammetric parameter calibration error equation corresponding to each control point; The calibration error equation of the photogrammetric parameters corresponding to each of the control points is solved as a whole to obtain the on-track calibration quantity of the photogrammetric parameters.

5. An on-orbit overall calibration device for photogrammetry parameters of aerospace dual-line array cameras, characterized in that: include: A control point coordinate information acquisition module is used to acquire coordinate information of preset control points used for calibrating the photogrammetry parameters of the dual-line array camera; An on-orbit calibration module, used to calculate the on-orbit calibration quantity of the photogrammetry parameters of the dual-line array camera according to the coordinate information of the preset control points and using a pre-built rigorous imaging model; When constructing the rigorous imaging model based on the constant difference in the satellite-ground camera angle and the non-parallelism of the front and rear line of sight arrays, it includes: The strict imaging models of the front and rear cameras of the dual-line array camera are uniformly equivalently transformed into the first strict imaging model of the vertical photography frame camera; According to the constant difference in angle between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first rigorous imaging model is revised to obtain the rigorous imaging model; When revising the first rigorous imaging model according to the constant angle difference between the satellite and the ground camera and the non-parallelism of the front and rear sight arrays, the first revision item for revising the constant angle difference between the satellite and the ground camera constructed based on the orthogonal rotation matrix and the second revision item for revising the non-parallelism of the front and rear sight arrays constructed based on the rotation angle between the front and rear sight arrays are respectively implemented; The rigorous imaging model after revising the first rigorous imaging model based on the first revision item for revising the constant error of the satellite-to-ground camera angle constructed on the basis of the orthogonal rotation matrix is ​​as follows: Where (x, y) is the image point coordinate, f is the focal length of the camera, m is the scale factor, and R(ψ, ω, κ) is the first revision term. is the rotation matrix from the satellite body coordinate system to the CGCS2000 coordinate system, (X P ,Y P ,Z P ) is the coordinate of the ground point P in the CGCS2000 coordinate system, (X c ',Y c ',Z c ') is the equivalent transformed coordinate in the CGCS2000 coordinate system; The revised rigorous imaging model based on the rotation angle between the front and rear line of sight arrays for revising the non-parallelism of the front and rear line of sight arrays is shown as follows: Where (x', y') is the revised image point coordinate, (x, y) is the image point coordinate, α is the rotation angle between the front and rear sight arrays around the Z axis, β is the preset influence factor, γ is the rotation angle between the front and rear sight arrays around the X axis, and f is the focal length of the camera.

6. An on-orbit integral calibration device for photogrammetric parameters of aerospace dual-line array cameras, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to implement the method described in any one of claims 1 to 4 when executing the executable instructions.