Aircraft visual navigation camera attitude calibration method
Through statistical error distribution and fitting technology, the problem of attitude error calibration of optical cameras under the limitations of aircraft conditions is solved, and the attitude calibration of optical cameras is realized during flight is achieved, which improves the navigation accuracy of the visual navigation system.
Patent Information
- Application Number
- CN202411213445.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-12-06
AI Technical Summary
Under the limitations of the aircraft conditions, it is impossible to perform optical camera attitude calibration in advance, which makes it difficult to calibrate the camera attitude error in the visual navigation system, affecting navigation accuracy.
Through statistical error distribution, the aircraft attitude information and heading information are provided by inertia guides, and the pitch and roll angle errors are obtained through real-time positioning results fitting, and the installation attitude calibration of the optical camera is performed.
The complex optical camera attitude calibration process is avoided, and the accurate calibration of the optical camera attitude through the flight calibration program is achieved during flight, which improves the navigation accuracy of the visual navigation system.
Smart Images

Figure CN119085708A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of aircraft visual navigation, and in particular relates to a method for calibrating an aircraft visual navigation camera attitude. Background Art
[0002] Visual navigation technology uses the imaging principle for navigation, optical sensors, camera imaging principles and computer vision theory, and image matching technology to determine the relevant navigation parameter information of the carrier. At present, a major visual navigation method is to pre-store a reference map, use the optical camera carried by the aircraft to capture images of ground scenery along the flight route, match the captured images with the pre-stored reference map, determine the position of the real-time captured image in the pre-saved image, and thus determine the geographical location of the aircraft at the time of taking the image. Visual navigation based on scene matching is widely used in various precision-guided missiles, drones and other aircraft.
[0003] The optical (infrared) camera is a key device in the visual navigation system, used to capture the surface image in real time. In addition, when performing visual navigation, it is necessary to synchronously obtain the attitude of the aircraft, which is generally measured using inertial navigation. In principle, the image plane of the camera should be parallel to the inertial navigation reference plane, otherwise it will introduce system angle errors, see Figure 1 As shown, where: X d , Y d , Z d is the geographic coordinate system; X, Y, and Z are the coordinate systems of the aircraft itself, X is along the flight direction of the aircraft (axial direction), Y is the wingspan direction, and Z is the right-hand coordinate system direction of X and Y; when the optical axis direction of the optical camera used for visual navigation is inconsistent with the Z axis of the aircraft, there will be errors in the aircraft position calculated using the scene captured by the optical camera. If the aircraft flies horizontally, the XY plane is aligned with the geographic plane X d Y d The planes are parallel, the theoretical position of the projection of the aircraft on the ground is point G, and the intersection of the optical axis of the optical camera and the ground is point P, then the distance PG is the error size.
[0004] Therefore, general optical measurement cameras will use complex calibration mechanisms and procedures to ensure the accuracy of the installation posture. However, when the aircraft conditions are limited and calibration cannot be performed in advance, how to ensure that the posture of the optical camera is consistent with the aircraft is a problem that needs to be considered. Summary of the invention
[0005] 1. Technical issues to be resolved
[0006] The technical problem to be solved by the present invention is to propose a method for calibrating the attitude error of a camera relative to a reference plane (horizontal plane of attitude) of an aircraft.
[0007] (II) Technical solution
[0008] In order to solve the above technical problems, the present invention provides a method for calibrating the attitude of an aircraft visual navigation camera, characterized in that the method calibrates the installation attitude error of an optical camera in a visual navigation system through a calibration flight, wherein the installation attitude error of the optical camera is determined by statistical error distribution and calibrated.
[0009] Preferably, the method is specifically as follows: the inertial navigation system provides the visual navigation system with the aircraft attitude information and flight heading information required for visual positioning in real time, and the visual navigation system performs visual positioning of the aircraft based on the images taken in real time by its optical camera. Assuming that there are n positioning results in total, the i-th positioning result includes the following information:
[0010] a) Flight heading θ(i);
[0011] b) Aircraft altitude above the ground H(i);
[0012] c) Longitude positioning error d lon (i);
[0013] d) Latitude positioning error d lat (i);
[0014] i is 1, 2...n; project the longitude and latitude positioning errors to the flight direction of the aircraft to obtain the flight direction error:
[0015] X(i)=cos(θ(i))×d lon (i)-sin(θ(i))×d lat (i) (1)
[0016] Project the longitude and latitude positioning errors to the wingspan direction of the aircraft to obtain the wingspan error:
[0017] Y(i)=sin(θ(i))×d lon (i)+cos(θ(i))×d lat (i) (2)
[0018] Taking the aircraft height above the ground H(i) as the independent variable and the flight direction error X(i) as the dependent variable, the fitting curve 1 is obtained:
[0019] X(i)=k1H(i)+b1 (3)
[0020] k1 and b1 are the parameters of curve 1;
[0021] Taking the aircraft height above the ground H(i) as the independent variable and the spanwise error Y(i) as the dependent variable, the fitting curve 2 is obtained:
[0022] Y(i)=k2H(i)+b2 (4)
[0023] k2 and b2 are the parameters of curve 2;
[0024] Then, the error between the optical camera of the visual navigation system and the reference plane of the aircraft is obtained, and the projection angle error on the flight axis, that is, the pitch angle error is:
[0025] α=tan -1 (k1) (5)
[0026] The error between the optical camera of the visual navigation system and the reference plane of the aircraft, the projection angle error in the direction of the wingspan, that is, the roll angle error is:
[0027] β=tan -1 (k2) (6)
[0028] The pitch angle error and roll angle error are substituted into the calculation process of matching positioning to complete the optical camera installation attitude calibration of the visual navigation system.
[0029] The present invention also provides a system for implementing the method.
[0030] The present invention also provides an application of the method in the technical field of aircraft visual navigation.
[0031] The present invention also provides an application of the system in the technical field of aircraft visual navigation.
[0032] (III) Beneficial effects
[0033] The present invention determines the optical camera installation attitude error through statistical error distribution and performs calibration. For the aircraft visual navigation system, the present invention avoids the complicated optical camera attitude calibration process before installation. In actual flight, a calibration flight program can be set to calibrate the optical camera attitude through calibration flight. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 Schematic diagram of the influence of optical camera posture error;
[0035] Figure 2 A system composition diagram for implementing the method of the present invention;
[0036] Figure 3 Figure 2 is the relationship between error and heading, a) is longitude, b) is latitude;
[0037] Figure 4 The relationship between positioning error and height, a) is the aircraft axial direction, b) is the aircraft lateral direction;
[0038] Figure 5Figure 2 is the relationship between positioning error and height, where a) is the aircraft axial direction and b) is the aircraft lateral direction. DETAILED DESCRIPTION
[0039] In order to make the purpose, content and advantages of the present invention more clear, the specific implementation methods of the present invention are further described in detail below in conjunction with the drawings and examples.
[0040] The present invention provides an attitude calibration method for an aircraft-mounted visual navigation camera, which is a method for calibrating a visual navigation optical camera by means of calibration flight. In this method, the aircraft randomly flies a certain distance, tries to cover different heading angles, performs several positioning, decomposes the error into the flight direction and wingspan direction of the aircraft, and statistically analyzes the distribution characteristics of the positioning results.
[0041] The method calibrates the attitude error of the visual navigation optical camera by calibration flight. The following is a further description of the aircraft visual navigation camera attitude calibration method of the present invention:
[0042] In this method, the inertial navigation system provides the visual navigation system with the aircraft (aircraft) attitude (pitch angle and roll angle of the aircraft) and flight heading required for visual positioning in real time. The visual navigation system positions the aircraft based on the images taken by its optical camera in real time, and compares the positioning result with the satellite positioning result at the same time to obtain the distance difference in the longitude and latitude directions, which is the visual positioning error, thereby realizing the optical camera attitude calibration of the visual navigation system.
[0043] The details are as follows:
[0044] Assume there are n positioning results in total, and the i-th positioning result includes the following information:
[0045] a) Flight heading θ(i);
[0046] b) Aircraft altitude above the ground H(i);
[0047] c) Longitude positioning error d lon (i);
[0048] d) Latitude positioning error d lat (i);
[0049] In the above parameters, i is 1, 2, ..., n;
[0050] Project the longitude and latitude positioning errors to the flight direction of the aircraft to obtain the flight direction error:
[0051] X(i)=cos(θ(i))×d lon (i)-sin(θ(i))×d lat (i) (1)
[0052] Project the longitude and latitude positioning errors to the wingspan direction of the aircraft to obtain the wingspan error:
[0053] Y(i)=sin(θ(i))×d lon (i)+cos(θ(i))×d lat (i) (2)
[0054] Taking the aircraft height above the ground H(i) as the independent variable and the flight direction error X(i) as the dependent variable, the fitting curve 1 is obtained:
[0055] X(i)=k1H(i)+b1 (3)
[0056] k1 and b1 are the parameters of curve 1;
[0057] Taking the aircraft height above the ground H(i) as the independent variable and the spanwise error Y(i) as the dependent variable, the fitting curve 2 is obtained:
[0058] Y(i)=k2H(i)+b2 (4)
[0059] k2 and b2 are the parameters of curve 2;
[0060] Then, the error between the optical camera of the visual navigation system and the reference plane of the aircraft is obtained, and the projection angle error on the flight axis, that is, the pitch angle error is:
[0061] α=tan -1 (k1) (5)
[0062] The error between the optical camera of the visual navigation system (i.e., the aircraft visual navigation camera) and the aircraft reference plane, the projection angle error in the span direction, i.e., the roll angle error is:
[0063] β=tan -1 (k2) (6)
[0064] Substituting the pitch angle error and the roll angle error into the matching positioning calculation process (i.e., the navigation calculation process) completes the optical camera attitude calibration of the visual navigation system.
[0065] The technical effects of the present invention are illustrated below with examples.
[0066] The test flight was carried out using a drone as the carrier. The heading angle of the aircraft was -180°~180°, with 90° in the east direction, -90° in the west direction, 0° in the north direction, and 180° in the south direction. Real-time visual positioning was performed during the flight, and several positioning results were obtained.
[0067] Calculate the position error in the longitude and latitude directions, and observe the relationship between the position error in the longitude and latitude directions and the heading angle. The longitude error is large near ±90 degrees (east-west direction), negative to the east, and positive to the west; the latitude error is large around 0 and 180 degrees (north-south direction), negative to the north, and positive to the south.
[0068] The longitude and latitude errors are decomposed into the axial direction (fuselage direction) and lateral direction (wingspan direction) of the aircraft. Through data fitting, it can be seen that the axial error increases with increasing altitude.
[0069] According to the error model, the main sources of system errors are installation errors (inherent attitude errors between the camera and inertial navigation) and delay errors. The impact of system errors is stable; the errors caused by reference map, altitude, and attitude measurement errors are irrelevant to the flight direction.
[0070] The error data is decomposed and fitted. The slope of the axial error is the pitch error of the camera and the inertial navigation, and the intercept is caused by the sampling delay of the camera. The lateral error intercept is close to 0, and the slope is the roll angle difference of the installation. The fitting results show that the pitch angle deviation of the optical camera is -0.38° and the roll angle deviation is -0.21°. These two angles are brought into the navigation calculation process. In subsequent experiments, the attitude error of the optical camera is eliminated. Figure 5 .
[0071] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for calibrating an aircraft visual navigation camera attitude, characterized in that: The method calibrates the installation attitude error of an optical camera in a visual navigation system through calibration flight, wherein the installation attitude error of the optical camera is determined through statistical error distribution and calibrated.
2. The method according to claim 1, characterized in that The method is as follows: the inertial navigation system provides the visual navigation system with the aircraft attitude information and flight heading information required for visual positioning in real time. The visual navigation system performs visual positioning of the aircraft based on the images taken in real time by its optical camera. Assuming there are n positioning results in total, the i-th positioning result includes the following information: a) Flight heading θ(i); b) Aircraft altitude above the ground H(i); c) Longitude positioning error d lon (i); d) Latitude positioning error d lat (i); i is 1, 2...n; project the longitude and latitude positioning errors to the flight direction of the aircraft to obtain the flight direction error: X(i)=cos(θ(i))×d lon (i)-sin(θ(i))×d lat (i) (1) Project the longitude and latitude positioning errors to the wingspan direction of the aircraft to obtain the wingspan error: Taking the aircraft height above the ground H(i) as the independent variable and the flight direction error X(i) as the dependent variable, the fitting curve 1 is obtained: X(i)=k1H(i)+b1 (3) k1 and b1 are the parameters of curve 1; Taking the aircraft height above the ground H(i) as the independent variable and the spanwise error Y(i) as the dependent variable, the fitting curve 2 is obtained: Y(i)=k2H(i)+b2 (4) k2 and b2 are the parameters of curve 2; Then, the error between the optical camera of the visual navigation system and the reference plane of the aircraft is obtained, and the projection angle error on the flight axis, that is, the pitch angle error is: α=tan -1 (k1) (5) The error between the optical camera of the visual navigation system and the reference plane of the aircraft, the projection angle error in the direction of the wingspan, that is, the roll angle error is: β=tan -1 (k2) (6) The pitch angle error and roll angle error are substituted into the calculation process of matching positioning to complete the optical camera installation attitude calibration of the visual navigation system.
3. The method according to claim 2, characterized in that The aircraft attitude information includes the pitch angle and roll angle of the aircraft.
4. The method according to claim 2, characterized in that The calculation process of matching and positioning is a navigation calculation process.
5. The method according to claim 2, characterized in that The aircraft reference plane is a horizontal plane of the aircraft attitude.
6. The method according to claim 2, characterized in that The aircraft is an airplane.
7. A system for implementing the method according to any one of claims 1 to 6.
8. The system according to claim 7, characterized in that The system includes inertial navigation, visual navigation system and satellite navigation system.
9. Application of the method according to any one of claims 1 to 6 in the field of aircraft visual navigation technology.
10. Application of the system as claimed in claim 7 or 8 in the field of aircraft visual navigation technology.
Citation Information
Cited By
Online correction method for installation error of downward-looking camera of unmanned aerial vehicle
CN121962267A
