Navigation device for an optical system for viewing and observing a scene, and method for determining an attitude for such an optical system

Abstract

The invention relates to a navigation device (3), configured to be securely mounted on an optical system for viewing and observing a scene (SC), the navigation device (3) comprising an inertial module (31), a viewing module (32), at least one database (33) storing a plurality of reference attitudes (Ari), each associated with a reference optical signature (Sri), a computer (34) configured to compare a current inertial attitude (Ac) with the reference attitudes (Ari) so as to determine the closest reference attitude (Arp) and deduce therefrom the associated reference optical signature (Srp), compare the current image (IMc) captured by the viewing module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (Δ), and determine the navigation attitude (An) based on the closest reference attitude (Arp) and on the angular offset (Δ).

Description

Navigation device for an optical system for aiming and observing a scene and method for determining an attitude for such an optical system

[0001] The present invention relates to a navigation device for determining an attitude for an optical sighting and observation system, for example, optronic binoculars or a terrestrial sight. The invention aims in particular to provide a navigation device providing an attitude with reduced drift.

[0002] An optical sighting and observation system, hereinafter "optical system", makes it possible to observe a scene remotely to determine, for example, movements of people or activities. Such an optical system is portable or fixed. In order to precisely determine the position of the observed scene, the optical system is associated with a navigation device making it possible to determine the angular orientation of the optical system. The angular orientation is known to those skilled in the art under the term "attitude". Precise knowledge of the attitude for the optical system makes it possible to carry out modeling, observe several zones associated with different angular positions quickly. This advantageously makes it possible to automate shots or firing or to geolocate friendly or enemy targets.

[0003] As is known, a navigation device comprises at least three gyroscopes to determine the attitude. During its initialization, the navigation device is calibrated with an astral aiming device or similar in order to determine an initial attitude accurately. In practice, gyroscopes generate an attitude drift that increases over time, which can distort the determined attitude. At long distances, an imprecise attitude can distort the aiming and, for example, cause a shot to fail. An immediate solution would be to carry out frequent calibration operations with the astral aiming device in order to reduce the drift. This requires interrupting the observation mission frequently, which presents a major drawback. It is therefore not possible to carry out observations lasting several hours.

[0004] In the prior art, it has been proposed to equip a navigation device with several accelerometers sensitive to the gravity field in order to correct attitude drift. However, such a solution is only applicable for an optical system moving along two axes and is not suitable for an optical system capable of moving along three axes such as a pair of optronic binoculars.

[0005] The invention thus aims to propose a navigation device, for an optical system which makes it possible to determine an attitude precisely and without imposing constraints on the operators. In addition, it is important that the navigation device maintains a low mass, a reduced size and is low energy consumption in order to be able to be used during military operations.

[0006] Patent application WO 2022 / 016260 A1 discloses an optical system for measuring absolute angular orientation step by step by overlapping images. PRESENTATION OF THE INVENTION

[0007] The invention relates to a navigation device, configured to be mounted securely on an optical system for aiming and observing a scene, the navigation device being configured to determine a navigation attitude, the navigation device comprising:at least one inertial module, configured to determine a current inertial attitude continuously,at least one vision module, configured to capture at least one current image of the scene continuously,at least one database storing a plurality of reference attitudes, each reference attitude being associated with a reference optical signature,at least one calculator configured to:Compare the current inertial attitude with the reference attitudes so as to determine the closest reference attitude and deduce therefrom the associated reference optical signature,Compare the current image captured by the vision module with the associated reference optical signature in order to determine an angular offset,Determine the navigation attitude from the nearest reference attitude and the angular offset.,

[0008] Thanks to the invention, any possible drift of the current inertial attitude can be avoided. A recalibration can be carried out dynamically when the current inertial attitude is close to a reference attitude in the database. Determining an angular deviation from the current image makes it possible to visually measure any potential drift of the inertial module. In other words, measuring the relative movements between the images makes it possible to dynamically compensate for the drift.

[0009] Advantageously, it is not necessary to perform near-near detection by overlap. An optical signature is only searched in the database for a reference optical signature that is close. This offers greater flexibility compared to near-near detection.

[0010] According to one aspect, the computer is configured to determine the associated reference optical signature only when the difference between the current inertial attitude and the closest reference attitude is less than a predetermined attitude threshold. Thus, when the reference data are too far from the point of the current attitude, any recalibration is avoided. A recalibration is only carried out in the presence of quality reference data nearby.

[0011] According to one aspect, the computer is configured to determine a new reference attitude associated with a new reference optical signature when the difference between the current inertial attitude and the closest reference attitude is greater than a predetermined attitude threshold. The database is advantageously completed when the operator observes attitudes that have not yet been listed. This makes it possible to carry out dynamic recalibrations subsequently when these attitudes are reached again.

[0012] In one aspect, the new reference attitude corresponds to the current inertial attitude and the new reference optical signature is determined from the current image.

[0013] According to one aspect, the computer is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude and, on the other hand, a second uncertainty for the navigation attitude, the computer being configured to use the current inertial attitude as the navigation attitude if the first uncertainty is less than the second uncertainty. The drift is thus controlled via the estimation of the uncertainty while avoiding an untimely correction.

[0014] In one aspect, the inertial module and the vision module are physically interdependent in their movements. It goes without saying that they could aim in different directions, in particular by using harmonization matrices defining the difference between the aiming directions.

[0015] In one aspect, the inertial module includes at least three gyroscopes to determine an accurate inertial attitude.

[0016] The invention also relates to an assembly of an observation system and a navigation device as presented previously. Preferably, the navigation device is integrated into the observation system.

[0017] In one aspect, the observation system is in the form of optronic binoculars or a terrestrial sight.

[0018] The invention also relates to a method for determining a navigation attitude by a navigation device as presented previously, the navigation device being mounted securely on an optical system for aiming and observing a scene, the method comprising steps consisting of: Comparing the current inertial attitude with the reference attitudes so as to determine the closest reference attitude and deducing therefrom the associated reference optical signature, Comparing the current image captured by the vision module with the associated reference optical signature so as to determine an angular offset, and Determining the navigation attitude from the closest reference attitude and the angular offset.

[0019] In one aspect, the method includes initializing the current attitude by an astral sighting device. This provides an ideal reference before performing an observation. This provides high-quality reference data for the database at the start of the observation.

[0020] The invention also relates to a computer program type product, comprising at least one sequence of instructions stored and readable by a processor and which, once read by this processor, causes the steps of the method as presented previously to be carried out.

[0021] The invention further relates to a computer-readable medium comprising the computer program product as presented above. PRESENTATION OF FIGURES

[0022] The invention will be better understood upon reading the following description, given by way of example, and referring to the following figures, given by way of non-limiting examples, in which identical references are given to similar objects.

[0023] This is a schematic representation of an operator observing a scene through an optical system on which a navigation device is mounted.

[0024] This is a schematic representation of a navigation device according to one embodiment of the invention.

[0025] This is a schematic representation of a sighting point on a current image.

[0026] This is a schematic representation of a first example of aiming on a scene.

[0027] This is a schematic representation of a second example of aiming at a scene.

[0028] This is a schematic representation of the evolution of an attitude drift according to the prior art and according to the invention for an example of modification of the angular position.

[0029] It should be noted that the figures set out the invention in detail to implement the invention, said figures can of course be used to better define the invention if necessary. DETAILED DESCRIPTION OF THE INVENTION

[0030] With reference to the, there is shown an operator 2 observing an external scene SC at long distance, by means of an optical system 1 for aiming and observation 1, hereinafter referred to as "optical system 1". In this example, the optical system 1 is a pair of optronic binoculars but it goes without saying that the optical system 1 could be in the form of a sighting system mounted on a rifle or a missile.

[0031] Preferably, the optical system 1 comprises an acquisition sensor, for example, a camera. Such an optical system 1 is known per se to those skilled in the art and will not be presented in further detail. In order to determine the orientation of the optical system 1, i.e. its attitude, a navigation device 3 is associated with the optical system 1.

[0032] In this example, with reference to the, the navigation device 3 is fixed to the optical system 1 in a permanent or removable manner. The navigation device 3 is thus integral in its movements with the optical system 1. Any modification of the angular orientation of the optical system 1 induces a modification of the angular orientation of the navigation device 3.

[0033] It goes without saying that the navigation device 3 and the optical system 1 could be integrated into the same equipment. For example, the navigation device 3 could be directly integrated into a housing of the optical system 1.

[0034] A navigation device 3 according to one embodiment of the invention is shown schematically. The navigation device 3 is configured to determine a navigation attitude An corresponding to that of the optical system 1.

[0035] With reference to the, the navigation device 3 comprises: an inertial module 31, configured to determine a current inertial attitude Ac continuously, a vision module 32, configured to capture at least one current image IMc of the scene SC continuously, a database 33 storing a plurality of reference attitudes Ari, each reference attitude Ari being associated with a reference optical signature Sri, a computer 34 configured to determine the navigation attitude An from the current inertial attitude Ac, the current image IMc and the database 33.

[0036] The various elements of the navigation device 3 will now be presented. They are preferably powered by an electric battery not shown.

[0037] In this example, the inertial module 31 comprises three gyroscopes determining a current inertial attitude Ac of the navigation device 3, and therefore of the optical system 1. The current inertial attitude Ac is determined by reference to an initial attitude A0 obtained by calibration from an external navigation system, in particular, an astral sighting device or a compass. The current inertial attitude Ac is for example determined by integrating the angular speeds of the three gyroscopes. As presented in the preamble, the current inertial attitude Ac has an increasing drift over time. The current inertial attitude Ac is determined continuously by the inertial module 31.

[0038] In this example, the vision module 32 comprises an optical sensor, in particular a camera, directed towards the external scene SC. The vision module 32 is configured to capture a current image IMc of the scene SC continuously. It is specified that the current image IMc is independent of the images of the scene SC which are acquired by the optical system 1. It is nevertheless possible for the current image IMc to be identical to that acquired by the optical system 1. Preferably, the vision module 32 and the inertial module 31 are integral with each other in order to maintain consistency between the data. It goes without saying that the vision module 32 could belong to the optical system 1.

[0039] In this example, still with reference to the, the database 33 stores a plurality of reference attitudes Ari associated with a reference optical signature Sri and a reference date Dri. A reference optical signature Sri is determined from at least a portion of a current image IMc captured for said reference attitude Ari by the vision module 32. Preferably, the reference optical signature Sri is determined by an image processing algorithm. By way of example, the reference optical signature Sri corresponds to a set of data (generally a few thousand values) making it possible to estimate a geometric deformation between two images, in particular between the current image IMc and the image used to form the reference optical signature Sri.A reference optical signature Sri has a reduced weight and makes it possible to characterize the image visible by the vision module 32 when it is oriented at the reference attitude Ari. This makes it possible to have a database 33 having a large number of reference attitudes Ari while having a reduced weight. Thus, the database 33 can advantageously be entirely embedded. The mass and size of the optical sighting and observation system can thus be reduced. In addition, a reference optical signature Sri of reduced weight makes it possible to reduce the computing requirements and therefore the power consumption. This is particularly advantageous when the optical system 1 is embedded.

[0040] The Dri reference date corresponds to the current date at the time of determining the Sri reference optical signature. This advantageously allows the deletion of Sri, Dri, Ari reference data which have become obsolete due to their age. The Dri reference date is optional.

[0041] By way of example, with reference to the, the current image IMc seen by the optical device 32 is schematically represented in view of a reference point Pi corresponding to the reference attitude Ari. In this example, a reference zone Zi, of rectangular shape, is determined in the vicinity of the reference point Pi and the reference optical signature Sri is determined by calculation from the pixels included in the reference zone Zi. It goes without saying that the reference zone Zi could have a different shape.

[0042] With reference to the, three reference points P1, P2, P3 are schematically represented which correspond respectively to three reference attitudes Ar1, Ar2, Ar3 associated with three reference optical signatures Sr1, Sr2, Sr3 and three reference dates Dr1, Dr2, Dr3.

[0043] The calculator 34 is in the form of a processor, a motherboard, an FPGA or the like and allows calculation operations to be carried out.

[0044] According to one aspect of the invention, as illustrated in , the computer 34 is configured, according to a first step E1, to compare the current inertial attitude Ac with the reference attitudes Ari of the database 3 so as to determine the closest reference attitude Arp and to deduce therefrom the associated reference optical signature, hereinafter referred to as “closest optical signature Srp”. The reference date Drp of the closest optical signature Srp is also obtained in this example.

[0045] With reference to the, the calculator 34 is further configured, according to a second step E2, to compare the current image IMc captured by the vision module 32 with the closest optical signature Srp so as to determine an angular offset Δ.

[0046] According to one aspect of the invention, the optical signature corresponds to the average of the pixels on the rows and on the columns of the image. For example, to determine the angular offset Δ, the translations on the rows and on the columns are first determined by correlations between the signature of the current image IMc with the reference optical signatures Sr1, Sr2, Sr3 so as to deduce a determined translation. Then, a geometric transformation is applied to transform the determined transformation into an angular offset Δ.

[0047] In another aspect, the optical signature corresponds to pixels with a strong gradient in the image. To determine the angular shift Δ, we calculate the geometric deformation that allows us to realign the pixels with a strong gradient. It goes without saying that other methods could be suitable.

[0048] In practice, the current image IMc is aligned with the nearest optical signature Srp in order to estimate the translation and rotation, i.e. a rigid deformation, between the current image IMc and the nearest optical signature Srp. The angular offset Δ thus corresponds to a measure of geometric deformation.

[0049] The computer 34 is further configured, according to a third step E3, to determine the navigation attitude An from the closest reference attitude Arp and the angular offset Δ. This advantageously makes it possible to correct any possible drift of the current inertial attitude Ac. Thus, the computer 34 makes it possible to determine a navigation attitude An which is based on measurements carried out in the past and which are deemed to be correct. Advantageously, this determination can be carried out routinely during the use of the optical system 1 by the operator 2. Preferably, the navigation attitude An, the closest reference attitude Arp and the angular offset Δ are linked by a mathematical formula which has been previously determined.

[0050] According to one aspect, the computer 34 is configured to estimate the quality of the navigation attitude An which has been determined, for example, according to the following criteria: angular speed lower than a fixed threshold, contrast level in the current image sufficiently high, etc. The computer 34 is configured to reject the navigation attitude An if the quality is too low.

[0051] Preferably, a navigation attitude An is determined only if the difference between the current inertial attitude Ac and the closest reference attitude Arp is less than or equal to a predetermined attitude threshold Sa. Indeed, if the difference is too large, the navigation attitude An which would be determined would lack precision.

[0052] Also, preferably, if the difference between the current inertial attitude Ac and the closest reference attitude Arp is greater than the predetermined attitude threshold Sa, the computer 34 is configured to store in the database 33 a new reference attitude Ari equal to the current inertial attitude Ac with a new optical reference signature Sri determined from the current image IMc. A reference date Dri is also associated with the new reference attitude Ari. This thus makes it possible to increase the size of the database 33 with reference attitudes that had not been determined in the past. When using the optical system 1, this will make it possible to accurately determine a navigation attitude An since the reference attitudes Ari will be more numerous.Similarly to previously, the calculator 34 is configured to reject the new reference attitude Ari if the quality is too low.

[0053] According to one aspect, the computer 34 is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude Ac and, on the other hand, a second uncertainty for the navigation attitude An. Preferably, the estimation of the uncertainties is carried out by computer learning or by integration of a previously calibrated error model. Preferably, the database 33 associates each reference attitude Ari with an uncertainty, that is to say, that of the current inertial attitude Ac during recording in the database 33.

[0054] If the first uncertainty is less than the second uncertainty, the computer 34 is configured to use the current inertial attitude Ac as the navigation attitude An. In other words, the navigation attitude An which has been determined is not retained due to its high uncertainty.

[0055] In order to maintain a highly relevant database, Ari reference attitudes associated with old Dri reference dates, for example older than 20 minutes, are deleted to allow the storage of more recent reference data.

[0056] An example of implementation of the invention will now be presented with reference to Figures 4 to 5. In this example, with reference to the, a scene SC is schematically represented in which three reference points P1, P2, P3 are represented which correspond respectively to three reference attitudes Ar1, Ar2, Ar3 associated with three reference optical signatures Sr1, Sr2, Sr3 and to three reference dates Dr1, Dr2, Dr3. For the sake of pedagogy, the predetermined attitude threshold Sa is represented in the form of a circle for each reference point P1, P2, P3.

[0057] In practice, at the beginning of a mission, the database 33 does not contain any reference attitudes and these are learned during the mission. In this example, three reference attitudes Ar1, Ar2, Ar3 have already been learned.

[0058] Operator 2 wishes to observe the scene with the optical system 1 and with the vision module 32 of the navigation device 3. He first carries out a calibration of the inertial module 31 of the navigation device 3 by means of the astral sighting device. Thus, the current inertial attitude Ac corresponds to the initial attitude A0.

[0059] Then, as illustrated in the, the operator orients the optical system 1 with the navigation device 3 towards the scene SC according to an aiming attitude which is represented by an aiming point Pv on the. In this example, the aiming point Pv is at the center of the current image IMc

[0060] The navigation device 3 determines the nearest reference attitude Arp. For this purpose, the different reference optical signatures Sr1, Sr2, Sr3 are compared to a zone defined in the vicinity of the aiming point Pv in the current image IMc. This comparison is carried out in this example by an image processing algorithm implementing correlation operations.

[0061] In this example, the third reference optical signature Sr3 is the closest. Also, the closest reference attitude Arp is the third reference attitude Ar3 associated with the third reference point P3. Since the difference between the current inertial attitude Ac and the third reference attitude Ar3 is less than the predetermined attitude threshold Sa as illustrated in , the navigation device 3 can determine a navigation attitude An from this third reference attitude Ar3.

[0062] The computer 34 first determines an angular offset Δ between the current image IMc captured by the vision module 32 and the third reference optical signature Sr3. It can then determine the navigation attitude An from the closest reference attitude Arp and the angular offset Δ. This practically produces a navigation attitude An which corrects any possible drift of the current inertial attitude Ac.

[0063] Preferably, as explained previously, if the current inertial attitude Ac has a low uncertainty, which is for example the case shortly after an astral calibration, the current inertial attitude Ac is used as the navigation attitude An.

[0064] During the observation, the operator modifies the orientation of the optical system 1 as illustrated in . The aiming point Pv is then modified. In this example, the third reference optical signature Sr3 is the closest. Also, the closest reference attitude Arp is still the third reference attitude Ar3 associated with the third reference point P3. In this example, given that the difference between the current inertial attitude Ac and the third reference attitude Ar3 is greater than the predetermined attitude threshold Sa, the navigation device 3 does not determine a navigation attitude An but stores in the database 33 new reference data by determining a fourth reference attitude Ar4 (corresponding to the current inertial attitude Ac) associated with a fourth reference optical signature Sr4 (determined in the current image IMc in the vicinity of the aiming point Pv) and with a fourth reference date Dr4.

[0065] Advantageously, the database 33 increases in size and allows for increased accuracy and dynamic calibrations to be performed during use of the optical system 1.

[0066] With reference to the, the evolution of an angular position Pang of the optical system 1 over time is represented on a first curve Ca. As illustrated in this figure, the angular position increases progressively to reach a plateau and then decreases again progressively in order to return to known angular positions. Thus, the angular positions reached at the time instants t0, t1, t2, t3 are identical to the angular positions reached respectively at the time instants t7, t6, t5, t4 as illustrated in the.

[0067] With reference to the, a second curve Cb shows the evolution of the attitude drift according to the prior art Daa and the evolution of the attitude drift according to the invention D. It is noted that in the prior art, the drift increases over time and can become very high, which leads to significant inaccuracies. Conversely, thanks to the invention, it is noted that the drift is reduced each time the navigation device 3 finds an angular position already encountered in the past (time instants t7, t6, t5, t4), that is to say, a reference attitude Ari determined in the database 33. As a result, the attitude drift D is corrected dynamically and can be contained over time. Thanks to the invention, it is possible to provide a precise attitude during the use of the optical system in order to carry out observations for several hours.Advantageously, the navigation device 3 maintains a low mass, a reduced size and is low energy consuming so that it can be used during military operations.

Claims

Navigation device (3), configured to be mounted securely on an optical system (1) for aiming and observing a scene (SC), the navigation device (3) being configured to determine a navigation attitude (An), the navigation device (3) comprising: at least one inertial module (31), configured to determine a current inertial attitude (Ac) continuously, at least one vision module (32), configured to capture at least one current image (IMc) of the scene (SC) continuously, the inertial module (31) and the vision module (32) being physically secured in their movements, at least one database (33) storing a plurality of reference attitudes (Ari), each reference attitude (Ari) being associated with a reference optical signature (Sri),at least one computer (34) configured to: Compare the current inertial attitude (Ac) with the reference attitudes (Ari) so as to determine the closest reference attitude (Arp) and deduce therefrom the associated reference optical signature (Srp), Compare the current image (IMc) captured by the vision module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (Δ), Determine the navigation attitude (An) from the closest reference attitude (Arp) and the angular offset (Δ)., Navigation device (3) according to claim 1, wherein the computer (34) is configured to determine the associated reference optical signature (Srp) only when the difference between the current inertial attitude (Ac) and the closest reference attitude (Arp) is less than a predetermined attitude threshold (Sa). Navigation device (3) according to one of claims 1 to 2, in which the computer (34) is configured to determine a new reference attitude (Ari) associated with a new reference optical signature (Sri) when the difference between the current inertial attitude (Ac) and the closest reference attitude (Arp) is greater than a predetermined attitude threshold (Sa). Navigation device (3) according to claim 3, in which the new reference attitude (Ari) corresponds to the current inertial attitude (Ac) and the new reference optical signature (Sri) is determined from the current image (IMc). Navigation device (3) according to one of claims 1 to 4, wherein the computer (34) is configured to estimate, on the one hand, a first uncertainty for the current inertial attitude (Ac) and, on the other hand, a second uncertainty for the navigation attitude (An), the computer (34) being configured to use the current inertial attitude (Ac) as the navigation attitude (An) if the first uncertainty is less than the second uncertainty. Assembly of an observation system (1) and a navigation device (3) according to claims 1 to 5. Assembly according to claim 6 in which the observation system (1) is in the form of optronic binoculars or a terrestrial sight. Method for determining a navigation attitude (An) by a navigation device (3) according to one of claims 1 to 5, the navigation device (3) being mounted securely on an optical system (1) for aiming and observing a scene (SC), the method comprising steps consisting of: Comparing the current inertial attitude (Ac) with the reference attitudes (Ari) so as to determine the closest reference attitude (Arp) and deducing therefrom the associated reference optical signature (Srp), Comparing the current image (IMc) captured by the vision module (32) with the associated reference optical signature (Srp) so as to determine an angular offset (Δ), and Determining the navigation attitude (An) from the closest reference attitude (Arp) and the angular offset (Δ). Determination method according to claim 8 comprising a step of initializing the current attitude (Ac) by an astral sighting device.

Images