Navigation device for an optical system for aiming and observing a scene, and method for determining the attitude of such an optical system

The integrated navigation device with inertial and vision modules dynamically corrects attitude drift in optical systems, ensuring precise aiming and reducing mass and power consumption for long-duration missions.

FR3149085A1Active Publication Date: 2024-11-29SAFRAN ELECTRONICS & DEFENSE (FR)
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
FR2023004890
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-11-29
Estimated Expiration
2043-05-22

AI Technical Summary

Technical Problem

Existing navigation devices for optical sighting and observation systems suffer from attitude drift over time, particularly when used for long-duration missions, leading to inaccurate aiming and potential mission failure, and existing solutions like frequent recalibration or use of gravity-sensitive accelerometers are inadequate for three-axis systems.

Method used

A navigation device integrated with an optical system includes an inertial module, vision module, database, and calculator to continuously determine and correct attitude drift by comparing current inertial attitudes with reference attitudes and images, dynamically updating the database with new reference data as needed.

Benefits of technology

The solution effectively maintains precise attitude determination without frequent recalibration, reducing mass and power consumption, enabling long-duration accurate observations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A navigation device (3), configured to be rigidly mounted on an optical scene observation and targeting system (SC), the navigation device (3) comprising an inertial module (31), a vision module (32), at least one database (33) storing a plurality of reference attitudes (Ari), each associated with a reference optical signature (Sri), a computer (34) configured to compare a current inertial attitude (Ac) to the reference attitudes (Ari) so as to determine the nearest reference attitude (Arp) and deduce the associated reference optical signature (Srp), compare the current image (IMc) captured by the vision module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (Δ), and determine the navigation attitude (An) from the nearest reference attitude (Arp) and the angular offset (Δ). Abstract figure: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Navigation device for an optical system for aiming and observing a scene and method for determining the attitude of such an optical system. Technical field

[0001] The present invention relates to a navigation device for determining an attitude for an optical aiming and observation system, for example, optronic binoculars or a terrestrial sight. The invention particularly aims to provide a navigation device that delivers an attitude with reduced drift.

[0002] An optical aiming and observation system, hereinafter referred to as the "optical system," allows observation of a scene at a distance to determine, for example, the movements of people or activities. Such an optical system may be portable or fixed. In order to precisely determine the position of the observed scene, the optical system is associated with a navigation device that determines the angular orientation of the optical system. The angular orientation is known to those skilled in the art as the "attitude." Precise knowledge of the attitude of the optical system allows for modeling and the rapid observation of several areas associated with different angular positions. This advantageously enables the automation of image capture or firing, or the geolocation of friendly or enemy targets.

[0003] As is known, a navigation device includes at least three gyroscopes to determine attitude. During initialization, the navigation device is calibrated with a celestial aiming device or similar instrument to accurately determine an initial attitude. In practice, the gyroscopes induce attitude drift that increases over time, potentially distorting the determined attitude. At long range, an inaccurate attitude can distort aiming and, for example, cause a shot to fail. An immediate solution would be to perform frequent calibration operations with the celestial aiming device to reduce drift. This requires frequently interrupting the observation mission, which presents a major drawback. It is therefore impossible to conduct observations lasting several hours.

[0004] In the prior art, it has been proposed to equip a navigation device with several accelerometers sensitive to the gravity field in order to correct attitude drift. However, such a solution is only applicable for an optical system moving along two axes and is not suitable for an optical system capable of moving along three axes, such as a pair of optronic binoculars.

[0005] The invention thus aims to provide a navigation device for an optical system that allows for the precise determination of an attitude without imposing constraints on operators. In addition, it is important that the navigation device maintains a low mass, a small size and is energy efficient in order to be used during military operations. PRESENTATION OF THE INVENTION

[0006] The invention relates to a navigation device, configured to be mounted permanently on an optical system for aiming and observing a scene, the navigation device being configured to determine a navigation attitude, the navigation device comprising: • at least one inertial module, configured to continuously determine a current inertial attitude, • at least one vision module, configured to continuously capture at least one current image of the scene, • at least one database storing a plurality of reference attitudes, each reference attitude being associated with a reference optical signature, • at least one calculator configured for: • Compare the current inertial attitude to reference attitudes in order to determine the closest reference attitude and deduce the associated reference optical signature, • Compare the current image captured by the vision module with the associated reference optical signature to determine an angular shift, • Determine the navigation attitude from the nearest reference attitude and the angular offset.

[0007] Thanks to the invention, any potential drift of the current inertial attitude can be avoided. Recalibration can be performed dynamically when the current inertial attitude is close to a reference attitude in the database. Determining an angular deviation from the current image allows for the visual measurement of any potential drift of the inertial modulus. In other words, measuring the relative motions between the images allows for dynamic compensation of the drift.

[0008] According to one aspect, the computer is configured to determine the associated optical reference signature only when the difference between the current inertial attitude and the nearest reference attitude is less than a predetermined attitude threshold. Thus, when the reference data are too far from the point of the current attitude, any recalibration is avoided. Recalibration is only performed when high-quality reference data is readily available.

[0009] According to one aspect, the computer is configured to determine a new reference attitude associated with a new optical reference signature when the difference between the current inertial attitude and the nearest reference attitude exceeds a predetermined attitude threshold. The database is advantageously expanded when the operator observes attitudes that have not yet been recorded. This allows for subsequent dynamic recalibrations when these attitudes are reached again.

[0010] According to one aspect, the new reference attitude corresponds to the current inertial attitude and the new optical reference signature is determined from the current image.

[0011] According to one aspect, the computer is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude and, on the other hand, a second uncertainty for the navigation attitude, the computer being configured to use the current inertial attitude as the navigation attitude if the first uncertainty is less than the second uncertainty. Drift is thus controlled via uncertainty estimation, avoiding unnecessary corrections.

[0012] According to one aspect, the inertial module and the vision module are physically linked in their movements.

[0013] According to one aspect, the inertial module includes at least three gyroscopes in order to determine a precise inertial attitude.

[0014] The invention also relates to an assembly of an observation system and a navigation device as described above. Preferably, the navigation device is integrated into the observation system.

[0015] According to one aspect, the observation system takes the form of op-tronic binoculars or a terrestrial sight.

[0016] The invention also relates to a method for determining a navigation attitude by a navigation device as described above, the navigation device being mounted securely on an optical system for aiming and observing a scene, the method comprising steps consisting of: • Compare the current inertial attitude to reference attitudes in order to determine the closest reference attitude and deduce the associated reference optical signature, • Compare the current image captured by the vision module with the associated reference optical signature to determine an angular shift, and • Determine the navigation attitude from the nearest reference attitude and the angular offset.

[0017] According to one aspect, the process includes a step of initializing the attitude This is done using an astral sighting device. This allows for obtaining an ideal reference before making an observation. High-quality reference data can thus be obtained for the database at the start of the observation.

[0018] The invention also relates to a computer program type product, comprising at least one sequence of instructions stored and readable by a processor and which, once read by this processor, causes the execution of the steps of the process as previously presented.

[0019] The invention further relates to a computer-readable medium containing the computer program-type product as described above. PRESENTATION OF FIGURES

[0020] The invention will be better understood upon reading the following description, given by way of example, and referring to the following figures, given by way of non-limiting examples, in which identical references are given to similar objects.

[0021] Fig. 1 is a schematic representation of an operator observing a scene by means of an optical system on which a navigation device is mounted.

[0022] The [Fig.2] is a schematic representation of a navigation device according to one embodiment of the invention.

[0023] Fig. 3 is a schematic representation of a sighting point on a current image.

[0024] Fig. 4 is a schematic representation of a first example of aiming at a scene.

[0025] Fig. 5 is a schematic representation of a second example of aiming at a scene.

[0026] Fig. 6 is a schematic representation of the evolution of an attitude drift according to the prior art and according to the invention for an example of modification of the angular position.

[0027] It should be noted that the figures set out the invention in detail to implement the invention, said figures being of course able to serve to better define the invention where appropriate. DETAILED DESCRIPTION OF THE INVENTION

[0028] With reference to [Fig. 1], an operator 2 is shown observing an external scene SC at a long distance, by means of an optical aiming and observation system 1, hereinafter referred to as "optical system 1". In this example, the optical system 1 is a pair of optronic binoculars, but it is understood that the optical system 1 could be in the form of a sighting system mounted on a rifle or missile.

[0029] Preferably, the optical system 1 comprises an acquisition sensor, for example, a camera. Such an optical system 1 is known per se to those skilled in the art and will not be described in further detail. In order to determine the orientation of the optical system 1, i.e., its attitude, a navigation device 3 is associated with the optical system 1.

[0030] In this example, with reference to [Fig. 1], the navigation device 3 is fixed to the optical system 1 either permanently or removably. The navigation device 3 is thus fixed to the optical system 1 during its movements. Any change in the angular orientation of the optical system 1 induces a change in the angular orientation of the navigation device 3.

[0031] It is understood that the navigation device 3 and the optical system 1 could be integrated into the same equipment. For example, the navigation device 3 could be directly integrated into a housing of the optical system 1.

[0032] A navigation device 3 according to one embodiment of the invention is schematically represented in [Fig. 2]. The navigation device 3 is configured to determine a navigation attitude An corresponding to that of the optical system 1.

[0033] With reference to [Fig.2], the navigation device 3 comprises: • an inertial module 31, configured to continuously determine a current inertial attitude Ac, • a 32-channel vision module, configured to continuously capture at least one current IMc image of the SC scene, • a database 33 storing a plurality of reference attitudes Ari, each reference attitude Ari being associated with a reference optical signature Sri, • a computer 34 configured to determine the navigation attitude An from the current inertial attitude Ac, the current image IMc and the database 33.

[0034] The various elements of the navigation device 3 will now be presented. They are preferably powered by an electric battery not shown.

[0035] In this example, the inertial module 31 comprises three gyroscopes determining a current inertial attitude Ac of the navigation device 3, and therefore of the optical system 1. The current inertial attitude Ac is determined by reference to an initial attitude A0 obtained by calibration from an external navigation system, in particular, a celestial sighting device or a compass. The current inertial attitude Ac is, for example, determined by integrating the angular velocities of the three gyroscopes. As presented in the preamble, the current inertial attitude Ac exhibits increasing drift over time. The current inertial attitude Ac is determined in a way continued by the inertial module 31.

[0036] In this example, the vision module 32 includes an optical sensor, in particular a camera, directed towards the external scene SC. The vision module 32 is configured to continuously capture a current image IMc of the scene SC. It is specified that the current image IMc is independent of the images of the scene SC acquired by the optical system 1. It is nevertheless possible that the current image IMc is identical to that acquired by the optical system 1. Preferably, the vision module 32 and the inertial module 31 are connected to each other to maintain data consistency. It is understood that the vision module 32 could belong to the optical system 1.

[0037] In this example, again with reference to [Fig. 2], the database 33 stores a plurality of reference attitudes Ari associated with a reference optical signature Sri and a reference date Dri. A reference optical signature Sri is determined from at least a portion of a current image IMc captured for said reference attitude Ari by the vision module 32. Preferably, the reference optical signature Sri is determined by an image processing algorithm. By way of example, the reference optical signature Sri corresponds to a dataset (generally a few thousand values) allowing the estimation of a geometric distortion between two images, in particular between the current image IMc and the image used to form the reference optical signature Sri.A reference optical signature Sri has a small file size and allows the image seen by the vision module 32 to be characterized when oriented to the reference attitude Ari. This enables a database 33 with a large number of reference attitudes Ari to be available while maintaining a small file size. Thus, the database 33 can advantageously be fully embedded. The mass and size of the optical aiming and observation system can therefore be reduced. Furthermore, a lightweight reference optical signature Sri reduces computing requirements and therefore power consumption. This is particularly advantageous when the optical system 1 is embedded.

[0038] The reference date Dri corresponds to the current date at the time of determining the reference optical signature Sri. This advantageously allows for the deletion of reference data Sri, Dri, and Ari that have become obsolete due to their age. The reference date Dri is optional.

[0039] By way of example, with reference to [Fig. 3], the current image IMc seen by the optical device 32 when aimed at a reference point Pi corresponding to the reference attitude Ari is schematically represented. In this example, a rectangular reference area Zi is defined in the vicinity of the reference point Pi, and the reference optical signature Sri is determined by calculation from the pixels included in the reference zone Zi. It goes without saying that the reference zone Zi could have a different shape.

[0040] With reference to [Fig.4], three reference points PI, P2, P3 are schematically represented, which correspond respectively to three reference attitudes Arl, Ar2, Ar3 associated with three reference optical signatures Sri, Sr2, Sr3 and three reference dates Drl, Dr2, Dr3.

[0041] The calculator 34 is in the form of a processor, a motherboard, an FPGA or similar and allows calculation operations to be carried out.

[0042] According to one aspect of the invention, as illustrated in [Fig. 2], the computer 34 is configured, according to a first step El, to compare the current inertial attitude Ac to the reference attitudes Ari in the database 3 so as to determine the nearest reference attitude Arp and deduce the associated reference optical signature, hereafter referred to as the "nearest optical signature Srp". The reference date Drp of the nearest optical signature Srp is also obtained in this example.

[0043] With reference to [Fig.2], the computer 34 is further configured, according to a second step E2, to compare the current image IMc captured by the vision module 32 with the nearest optical signature Srp so as to determine an angular shift A.

[0044] According to one aspect of the invention, the optical signature corresponds to the average of the pixels in the rows and columns of the image. By way of example, to determine the angular shift A, the translations in the rows and columns are first determined by correlations between the signature of the current image IMc and the reference optical signatures Sri, Sr2, Sr3 in order to deduce a specific translation. Then, a geometric transformation is applied to convert the determined transformation into an angular shift A.

[0045] According to another aspect, the optical signature corresponds to pixels with a high gradient in the image. To determine the angular shift A, the geometric deformation is calculated to realign the pixels with a high gradient. It goes without saying that other methods could be suitable.

[0046] In practice, the current image IMc is registered to the nearest optical signature Srp in order to estimate the translation and rotation, i.e., a rigid deformation, between the current image IMc and the nearest optical signature Srp. The angular shift A thus corresponds to a measure of geometric deformation.

[0047] The computer 34 is further configured, according to a third step E3, to determine the navigation attitude An from the nearest reference attitude Arp and the angular offset A. This advantageously allows for the correction of any possible drift in the current inertial attitude Ac. Thus, the computer 34 allows for the determination of To determine a navigation attitude An based on past measurements considered accurate. Advantageously, this determination can be routinely performed by operator 2 using optical system 1. Preferably, the navigation attitude An, the nearest reference attitude Arp, and the angular offset A are related by a previously determined mathematical formula.

[0048] According to one aspect, the computer 34 is configured to estimate the quality of the navigation attitude An, which has been determined, for example, based on the following criteria: angular velocity below a fixed threshold, sufficiently high contrast level in the current image, etc. The computer 34 is configured to reject the navigation attitude An if the quality is too low.

[0049] Preferably, a navigation attitude An is determined only if the difference between the current inertial attitude Ac and the nearest reference attitude Arp is less than or equal to a predetermined attitude threshold Sa. Indeed, if the difference is too large, the navigation attitude An that would be determined would lack precision.

[0050] Also, preferably, if the difference between the current inertial attitude Ac and the nearest reference attitude Arp is greater than the predetermined attitude threshold Sa, the computer 34 is configured to store in the database 33 a new reference attitude Ari equal to the current inertial attitude Ac with a new optical reference signature Sri determined from the current image IMc. A reference date Dri is also associated with the new reference attitude Ari. This makes it possible to increase the size of the database 33 with reference attitudes that had not been determined in the past. When using the optical system 1, this will allow for the precise determination of a navigation attitude An since there will be more reference attitudes Ari.Similar to before, calculator 34 is configured to reject the new Ari reference attitude if the quality is too low.

[0051] According to one aspect, the computer 34 is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude Ac and, on the other hand, a second uncertainty for the navigation attitude An. Preferably, the uncertainty estimation is performed by computer learning or by integrating a pre-calibrated error model. Preferably, the database 33 associates each reference attitude Ari with an uncertainty, that is, the uncertainty of the current inertial attitude Ac at the time of recording in the database 33.

[0052] If the first uncertainty is less than the second uncertainty, the computer 34 is configured to use the current inertial attitude Ac as the attitude of na Vigation An. In other words, the navigation attitude An which was determined is not retained due to its high uncertainty.

[0053] In order to maintain a database 33 with high relevance, reference attitudes Ari associated with old reference dates Dri, for example dating back more than 20 minutes, are deleted to allow the storage of more recent reference data.

[0054] An example of an implementation of the invention will henceforth be presented with reference to Figures 4 to 5. In this example, with reference to [Fig. 4], a scene SC is schematically represented in which three reference points PI, P2, P3 are shown, corresponding respectively to three reference attitudes Arl, Ar2, Ar3 associated with three reference optical signatures Sri, Sr2, Sr3 and three reference dates Drl, Dr2, Dr3. For pedagogical purposes, the predetermined attitude threshold Sa is represented as a circle for each reference point PI, P2, P3.

[0055] In practice, at the beginning of a mission, database 33 does not contain any reference attitudes, and these are learned during the mission. In this example, three reference attitudes, Ar1, Ar2, and Ar3, have already been learned.

[0056] Operator 2 wishes to observe the scene with the optical system 1 and with the vision module 32 of the navigation device 3. He first performs a calibration of the inertial module 31 of the navigation device 3 using the celestial aiming device. Thus, the current inertial attitude Ac corresponds to the initial attitude A0.

[0057] Then, as illustrated in [Fig. 4], the operator orients the optical system 1 with the navigation device 3 towards the scene SC according to a aiming attitude which is represented by a aiming point Pv in [Fig. 4]. In this example, the aiming point Pv is at the center of the current image IMc

[0058] The navigation device 3 determines the nearest reference attitude Arp. To this end, the different reference optical signatures Sri, Sr2, Sr3 are compared to a defined area in the vicinity of the aiming point Pv in the current image IMc. This comparison is performed in this example by an image processing algorithm implementing correlation operations.

[0059] In this example, the third optical reference signature Sr3 is the closest. Also, the closest reference attitude Arp is the third reference attitude Ar3 associated with the third reference point P3. Since the difference between the current inertial attitude Ac and the third reference attitude Ar3 is less than the predetermined attitude threshold Sa as illustrated in [Fig. 4], the navigation device 3 can determine a navigation attitude An from this third reference attitude Ar3.

[0060] The calculator 34 first determines an angular offset A between the image The current IMc is captured by the vision module 32 and the third optical reference signature Sr3. It can then determine the navigation attitude An from the nearest reference attitude Arp and the angular offset A. This practically yields a navigation attitude An that corrects any possible drift of the current inertial attitude Ac.

[0061] Preferably, as explained previously, if the current inertial attitude Ac has a low uncertainty, which is for example the case shortly after an astral calibration, the current inertial attitude Ac is used as the navigation attitude An.

[0062] During observation, the operator changes the orientation of the optical system 1 as illustrated in [Fig. 5]. The aiming point Pv is then changed. In this example, the third optical reference signature Sr3 is the closest. Also, the closest reference attitude Arp is again the third reference attitude Ar3 associated with the third reference point P3.In this example, since the difference between the current inertial attitude Ac and the third reference attitude Ar3 is greater than the predetermined attitude threshold Sa, the navigation device 3 does not determine a navigation attitude An but stores new reference data in the database 33 by determining a fourth reference attitude Ar4 (corresponding to the current inertial attitude Ac) associated with a fourth optical reference signature Sr4 (determined in the current image IMc in the vicinity of the aiming point Pv) and a fourth reference date Dr4.

[0063] Advantageously, the database 33 increases in size and allows for increased accuracy and dynamic calibrations during the use of the optical system 1.

[0064] With reference to [Fig. 6], the evolution of an angular position Pang of the optical system 1 over time is shown on a first curve Ca. As illustrated in this figure, the angular position gradually increases to reach a plateau and then gradually decreases again to return to known angular positions. Thus, the angular positions reached at time instants t0, t1, t2, t3 are identical to the angular positions reached respectively at time instants t7, t6, t5, t4 as illustrated in [Fig. 6].

[0065] With reference to [Fig. 6], a second curve Cb shows the evolution of attitude drift according to the prior art Daa and the evolution of attitude drift according to the invention D. It can be seen that in the prior art, the drift increases over time and can become very high, which leads to significant inaccuracies. Conversely, thanks to the invention, it can be seen that the drift is reduced each time the navigation device 3 returns to an angular position already encountered in the past (time instants t7, t6, t5, t4), that is to say, a reference attitude Ari determined in the Database 33. As a result, the attitude drift D is dynamically corrected and can be contained over time. Thanks to the invention, a precise attitude can be provided during the use of the optical system in order to carry out observations for several hours. Advantageously, the navigation device 3 maintains a low mass, a small size, and is energy-efficient, making it suitable for use in military operations.

Claims

Claims

1. Navigation device (3), configured to be mounted securely on an optical system (1) for aiming and observing a scene (SC), the navigation device (3) being configured to determine a navigation attitude (An), the navigation device (3) comprising: • at least one inertial module (31), configured to determine a current inertial attitude (Ac) continuously, • at least one vision module (32), configured to capture at least one current image (IMc) of the scene (SC) continuously, • at least one database (33) storing a plurality of reference attitudes (Ari), each reference attitude (Ari) being associated with a reference optical signature (Sri),• at least one computer (34) configured to: • Compare the current inertial attitude (Ac) with the reference attitudes (Ari) so as to determine the closest reference attitude (Arp) and deduce therefrom the associated reference optical signature (Srp), • Compare the current image (IMc) captured by the vision module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (A), • Determine the navigation attitude (An) from the closest reference attitude (Arp) and the angular offset (A).,

2. Navigation device (3) according to claim 1, wherein the computer (34) is configured to determine the associated reference optical signature (Srp) only when the difference between the current inertial attitude (Ac) and the closest reference attitude (Arp) is less than a predetermined attitude threshold (Sa).

3. Navigation device (3) according to one of claims 1 to 2, in which the calculator (34) is configured to determine a new reference attitude (Ari) associated with a new reference optical signature (Sri) when the difference between the current inertial attitude (Ac) and the nearest reference attitude (Arp) is greater than a predetermined attitude threshold (Sa).

4. Navigation device (3) according to claim 3, in which the new reference attitude (Ari) corresponds to the current inertial attitude (Ac) and the new reference optical signature (Sri) is determined from the current image (IMc).

5. Navigation device (3) according to one of claims 1 to 4, in which the calculator (34) is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude (Ac) and, on the other hand, a second uncertainty for the navigation attitude (An), the calculator (34) being configured to use the current inertial attitude (Ac) as the navigation attitude (An) if the first uncertainty is less than the second uncertainty.

6. Navigation device (3) according to one of claims 1 to 5, in which the inertial module (31) and the vision module (32) are physically integral in their movements.

7. Assembly of an observation system (1) and a navigation device (3) according to claims 1 to 6.

8. An assembly according to claim 7 in which the observation system (1) is in the form of optronic binoculars or a terrestrial sight.

9. Method for determining a navigation attitude (An) by a navigation device (3) according to one of claims 1 to 6, the navigation device (3) being mounted securely on an optical system (1) for aiming and observing a scene (SC), the method comprising steps consisting of: • Comparing the current inertial attitude (Ac) with the reference attitudes (Ari) so as to determine the closest reference attitude (Arp) and deducing therefrom the associated reference optical signature (Srp), • Comparing the current image (IMc) captured by the vision module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (A), and • Determining the navigation attitude (An) from the closest reference attitude (Arp) and the angular offset (A).

10. A determination method according to claim 9 comprising a step consisting of initializing the current attitude (Ac) by an astral aiming device.

Citation Information

Patent Citations

  • Locating method and apparatus

    EP3550263A1

  • METHOD FOR POSITION DETERMINATION BY AN OPTRONIC SYSTEM IN A SCENE AND ASSOCIATED OPTRONIC SYSTEM

    FR3118523A1

  • Methods and systems for digital image-referenced indirect target aiming

    WO2022016260A1