Visual and inertial integrated navigation method for aircraft
Through the combination of optical cameras and inertial navigation, aircraft scene matching positioning and visual inertial combined navigation without matching area planning are achieved, which solves the problem of complex calculations of traditional navigation methods, improves navigation accuracy and response speed, and is suitable for modern warfare conditions. fast response to demand.
Patent Information
- Application Number
- CN202411216531.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-19
AI Technical Summary
Traditional aircraft scene matching navigation methods require matching area planning, resulting in complex calculations and difficulty in achieving rapid response and high maneuverability under modern war conditions.
An optical camera is used to obtain infrared images of ground scenes in real time, combine altimeter and inertial guide to obtain the attitude information of the aircraft, and achieve scene matching positioning without matching area planning through reference map matching, and perform visual inertial combined navigation filtering to correct inertial errors in real time.
High-frequency unconstrained scene matching positioning is achieved, the matching area planning process is reduced, the aircraft's navigation accuracy and response speed are improved, and long-term high-precision navigation is possible under satellite-free conditions.
Smart Images

Figure CN118980373A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of aircraft navigation, and in particular relates to an aircraft visual-inertial combined navigation method. Background Art
[0002] Military aircraft mainly use inertial navigation (INS) and global satellite navigation system (GNSS) for combined navigation. The inertial navigation system has the advantages of anti-interference, good concealment, all-weather autonomous operation, and continuous output of navigation information, but its positioning error accumulates with the increase of working time; satellite navigation has a large coverage range, high positioning accuracy, little impact from meteorological conditions, and relatively low cost. However, navigation satellites may be attacked by anti-satellite weapons and are vulnerable to electromagnetic interference attacks, resulting in security risks and hidden dangers in satellite navigation technology.
[0003] Visual navigation technology uses the imaging principle for navigation, adopts optical sensors, combines camera imaging principles and computer vision theory, and uses image matching technology to determine the relevant navigation parameter information of the carrier, including scene matching and simultaneous localization and mapping (SLAM) technology.
[0004] SLAM technology estimates its own movement while building an environmental model during the movement without any prior information about the environment. Its principle is to establish the spatial position relationship of the same-name points through the previous and next frame images, thereby determining the movement trajectory of the aircraft. It is suitable for platforms that repeatedly move in a small space and is an important means of navigation for mobile robots and rotor-type drones flying in a low-altitude and small space.
[0005] Visual navigation based on scene matching requires pre-storage of reference maps. The ground scenery images along the flight are captured by the optical camera carried by the aircraft. The captured images are matched with the pre-stored reference maps to determine the position of the real-time captured images in the pre-saved images, thereby determining the geographical location of the aircraft at the time of the image capture. It is possible to reduce the position and velocity accumulation errors of the inertial navigation system without the need for the global navigation satellite system, and achieve long-term high-precision navigation without satellites. Visual navigation based on scene matching is widely used in various types of precision-guided missiles and other aircraft, and usually adopts a fixed-point working mode. Taking the Tomahawk cruise missile of the US military as an example, the entire flight route of the missile from launch to the target is divided into several sections. In each section, inertial guidance is used, and then map matching is selected in a suitable area to correct the position error of the inertial navigation system in the previous section. Therefore, before starting the mission, it is necessary to plan the matching area and determine the appropriate scene matching area to determine the flight route. Scene matching only works regularly in several suitable areas. This process requires professionals to perform a lot of calculation and analysis, and the processing time is long and the process is complicated.
[0006] Under modern warfare conditions, wartime aircraft are required to be able to achieve rapid response and high maneuverability, and the traditional scene matching navigation working mode is unable to cope with this requirement. Summary of the invention
[0007] 1. Technical issues to be resolved
[0008] The technical problem to be solved by the present invention is: how to provide an aircraft scene matching positioning and visual inertial integrated navigation method which does not require matching area planning.
[0009] (II) Technical solution
[0010] In order to solve the above technical problems, the present invention provides a visual-inertial integrated navigation method for an aircraft, which is implemented based on an optical camera, an information processing module, an altimeter and an inertial navigation system, and comprises the following steps:
[0011] 1) Preparation and processing of reference images
[0012] The benchmark map is also called the reference map, which includes orthophotos and topographic maps. The benchmark map covers the possible flight area.
[0013] 2) Real-time image acquisition and geometric correction
[0014] The optical camera takes infrared images of the ground scene in real time, i.e., the real-time image. During the flight, the change of the flight attitude of the aircraft causes the projection of the real-time image to change. According to the flight attitude information, the real-time image is corrected to a vertical shooting state so that it has a common reference base with the reference image.
[0015] 3) Scene matching
[0016] The information processing module intercepts the orthophoto map and topographic map of the corresponding area as the reference map according to the current indicated position of the inertial navigation and the possible dispersion range of the aircraft position error, and uses the real-time map, the inertial navigation attitude information and the altitude information at the same time to match the scene with the reference map to obtain the geographical location of the real-time map taken; wherein, the synchronized altitude information is obtained by the altimeter, and the inertial navigation attitude information includes the real-time attitude information of the pitch and roll of the aircraft, which is obtained by the inertial navigation;
[0017] The information processing module continuously outputs the aircraft positioning results according to the frame rate of the captured images;
[0018] 4) Judgment of the correctness of positioning results
[0019] The information processing module determines the correctness of the aircraft positioning result based on the position and speed information output by the inertial navigation system, and obtains the aircraft positioning result with a high degree of confidence, namely the visual navigation data;
[0020] 5) Visual-Inertial Integrated Navigation
[0021] When the inertial navigation receives the visual navigation data, it performs visual-inertial combined navigation filtering to obtain the inertial navigation position error correction, and performs feedback compensation on the inertial navigation to correct the inertial navigation error in real time.
[0022] The present invention also provides a system for implementing the method.
[0023] The invention also provides an application of the method in the field of aircraft navigation technology.
[0024] The present invention also provides an application of the system in the field of aircraft navigation technology.
[0025] (III) Beneficial effects
[0026] In the present invention, an optical camera is used to obtain infrared images of ground scenes in real time during the flight of an aircraft, an altimeter obtains synchronized altitude information, and an inertial navigation system is used to obtain the real-time pitch and roll attitudes of the aircraft. The position of the aircraft is obtained by matching with a reference map, and then the positioning result is analyzed and judged, and the correct positioning information is output. The inertial navigation position error correction amount is output at a high frequency, which can maximize the navigation accuracy of the inertial navigation system and enable the system to have a long-duration continuous high-precision navigation capability.
[0027] Compared with the traditional scene matching method, the method of the present invention does not require matching area planning, performs scene matching positioning at a high frequency throughout the whole process, and can achieve unconstrained flight track and free matching area planning. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 It is a block diagram of the system composition of the present invention;
[0029] Figure 2 The figure is a flow chart of the method of the present invention. DETAILED DESCRIPTION
[0030] In order to make the purpose, content and advantages of the present invention more clear, the specific implementation methods of the present invention are further described in detail below in conjunction with the drawings and examples.
[0031] The invention proposes an aircraft scene matching positioning and visual inertial combined navigation method which does not require adaptation zone planning and has the advantage of free adaptation zone planning.
[0032] The technical solution for realizing the present invention is as follows:
[0033] The present invention provides an aircraft visual inertial integrated navigation system, including an optical (infrared) camera, an information processing module, an altimeter and an inertial navigation system. The technical implementation route includes: adopting a wide-area reference map pre-binding mode, binding all maps of possible working areas in the navigation system before the mission; adopting a full-process continuous working mode, performing scene matching in real time, locating the position of the aircraft, and realizing "matching area planning-free"; judging the feasibility of the positioning result in the matching positioning result through correctness judgment, and outputting information that the positioning result is unavailable when the credibility does not meet the set threshold, and specifically adopting a method of matching confidence and spatiotemporal relationship constraints between multi-frame matching results; the inertial navigation uses the scene matching positioning result to perform combined navigation filtering and correct the inertial navigation error.
[0034] The method obtains the position information of the aircraft through visual positioning and uses it as the inertial navigation error correction source to perform integrated navigation. The aircraft visual inertial integrated navigation method of the present invention is further described below in conjunction with the accompanying drawings:
[0035] The aircraft visual inertial integrated navigation system of the present invention mainly comprises an optical camera, an information processing module, an altimeter, and an inertial navigation system. During the flight of the aircraft, the optical camera is used to capture the ground scene in real time and generate a real-time image (infrared image), the altimeter is used to obtain synchronized altitude information, and the inertial navigation system is used to obtain the pitch and roll real-time attitude (inertial navigation attitude information) of the aircraft; the information processing module stores a reference map of the flight area, uses the real-time map and the inertial navigation attitude information and altitude information at the same time to perform scene matching, obtains the aircraft position (positioning result), and then combines the information output by the inertial navigation system to judge the correctness of the positioning result, and obtains a result with a high degree of confidence; the result is combined with the inertial navigation system for combined navigation filtering, obtains the combined navigation result and the inertial navigation position error correction amount, and corrects the inertial navigation position error at the next moment.
[0036] The system's combined block diagram and workflow diagram are attached. Figure 1 and attached Figure 2 .
[0037] The aircraft visual-inertial integrated navigation method implemented based on this system includes the following steps:
[0038] 1) Preparation and processing of reference images
[0039] The benchmark map is also called the reference map, which includes the orthophoto map (Digital Orthophoto Map, DOM), the topographic map (Digital Surface Model, DSM or Digital Elevation Model, DEM) and the distribution map of the scene matching area. The benchmark map covers the possible flight area. The benchmark map is bound in the information processing module using the wide-area benchmark map pre-binding mode before delivery, and can be updated as needed.
[0040] 2) Real-time image acquisition and geometric correction
[0041] The optical camera takes infrared images of ground scenes in real time, i.e. real-time images, using optical or infrared imaging systems. During the flight of the aircraft, the real-time image changes due to changes in flight attitude. Based on the flight attitude information, the real-time image is corrected to a vertical shooting state so that it has a common reference base with the reference image.
[0042] 3) Scene matching
[0043] The information processing module intercepts the orthophoto map and topographic map of the corresponding area as the reference map according to the current position indicated by the inertial navigation and the possible dispersion range of the aircraft position error, and uses the real-time map, the inertial navigation attitude information and the altitude information at the same time to match the scene with the reference map to obtain the geographical location of the real-time image taken. Among them, the synchronized altitude information is obtained by the altimeter, and the inertial navigation attitude information includes the real-time attitude information of the pitch and roll of the aircraft, which is obtained by the inertial navigation.
[0044] The information processing module outputs the aircraft positioning results quickly and continuously according to the frame rate of the captured images.
[0045] 4) Judgment of the correctness of positioning results
[0046] The information processing module judges the correctness of the aircraft positioning result (image matching result) based on the position and speed information output by the inertial navigation, and obtains the aircraft positioning result with a higher confidence, namely the visual navigation data (judging the feasibility of the positioning result. When the credibility does not meet the set threshold, the information that the positioning result is unavailable is output). Among them, the judgment is made based on the method of single-frame matching confidence and the spatiotemporal constraint relationship of multi-frame matching results, and the mismatching points are eliminated to improve the reliability of positioning.
[0047] 5) Visual-Inertial Integrated Navigation
[0048] When the inertial navigation receives the visual navigation data, it performs visual-inertial combined navigation filtering to obtain the inertial navigation position error correction, and performs feedback compensation on the inertial navigation to correct the inertial navigation error in real time and improve the navigation accuracy of the system.
[0049] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A visual-inertial integrated navigation method for an aircraft, It is characterized in that The method is based on an optical camera, an information processing module, an altimeter and an inertial navigation system, and includes the following steps: 1) Preparation and processing of reference images The benchmark map is also called the reference map, which includes orthophotos and topographic maps. The benchmark map covers the possible flight area. 2) Real-time image acquisition and geometric correction The optical camera takes infrared images of the ground scene in real time, i.e., the real-time image. During the flight, the change of the flight attitude of the aircraft causes the projection of the real-time image to change. According to the flight attitude information, the real-time image is corrected to a vertical shooting state so that it has a common reference base with the reference image. 3) Scene matching The information processing module intercepts the orthophoto map and topographic map of the corresponding area as the reference map according to the current indicated position of the inertial navigation and the possible dispersion range of the aircraft position error, and uses the real-time map, the inertial navigation attitude information and the altitude information at the same time to match the scene with the reference map to obtain the geographical location of the real-time map taken; wherein, the synchronized altitude information is obtained by the altimeter, and the inertial navigation attitude information includes the real-time attitude information of the pitch and roll of the aircraft, which is obtained by the inertial navigation; The information processing module continuously outputs the aircraft positioning results according to the frame rate of the captured images; 4) Judgment of the correctness of positioning results The information processing module determines the correctness of the aircraft positioning result based on the position and speed information output by the inertial navigation system, and obtains the aircraft positioning result with a high degree of confidence, namely the visual navigation data; 5) Visual-Inertial Integrated Navigation When the inertial navigation receives the visual navigation data, it performs visual-inertial combined navigation filtering to obtain the inertial navigation position error correction, and performs feedback compensation on the inertial navigation to correct the inertial navigation error in real time.
2. The method according to claim 1, It is characterized in that The reference map is bound in the information processing module using a wide area reference map pre-binding mode before delivery, and is updated as required.
3. The method according to claim 1, It is characterized in that In step 4), the feasibility of the positioning result is determined, and when the credibility does not meet the set threshold, the information that the positioning result is unavailable is output.
4. The method according to claim 1, It is characterized in that In step 4), judgment is made based on the single-frame matching confidence and the spatiotemporal constraint relationship of the multi-frame matching results, and the mismatched points are eliminated.
5. The method according to claim 1, It is characterized in that Before using the real-time image, the inertial navigation attitude information and the altitude information at the same time to match the scene with the reference image, image rotation transformation and image scale transformation are performed in sequence.
6. The method according to claim 1, It is characterized in that When performing scene matching, a full-process continuous working mode is used to perform scene matching in real time.
7. The method according to claim 1, It is characterized in that The benchmark map also includes the distribution thematic map of scene matching areas.
8. A system for implementing the method according to any one of claims 1 to 7.
9. Application of the method according to any one of claims 1 to 7 in the field of aircraft navigation technology.
10. Application of the system according to claim 8 in the field of aircraft navigation technology.
Citation Information
Cited By
Remote long-endurance integrated navigation method and system combining visual inertia joint optimization and image matching
CN120252746A
