Method for controlling an on-board optronic device and corresponding on-board optronic device
The method addresses the precision issue in orienting the optronic sensor of vehicle-mounted observation sights by estimating the rotation matrix between the inertial and optical line of sight frames using a harmonization phase with star alignment, resulting in improved accuracy of target aiming.
Patent Information
- Application Number
- FR2023015003
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-22
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2043-12-22
AI Technical Summary
The existing vehicle-mounted observation sights face challenges in precisely orienting the optronic sensor due to the offset between the inertial measurement unit's reference frame and the optronic sensor's reference frame, leading to a mismatch between the inertial line of sight and the optical line of sight.
A method is introduced that utilizes a harmonization phase to estimate the rotation matrix between the inertial measurement frame and the optical line of sight frame by selecting stars from a catalog, aligning the aiming head with the stars, and recording attitude estimates to minimize a cost function, thereby correcting for pointing errors.
This method effectively compensates for the difference between the inertial and optical line of sights, ensuring precise orientation of the optronic sensor and improving the accuracy of target aiming.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method for controlling an on-board optronic device and corresponding on-board optronic device
[0001] The present invention relates to the field of optronic devices on board vehicles, such as for example observation sights.
[0002] BACKGROUND OF THE INVENTION
[0003] A vehicle-mounted observation sight generally comprises a turret movable in bearing and a sighting head mounted on the turret to be movable in elevation so as to be able to orient the sighting head, at least one optronic sensor mounted in the sighting head to capture images along an optical line of sight normal to the plane of the optronic sensor, an inertial measurement unit mounted in the sighting head to detect movements of the sighting head, and an electronic processing unit connected to the inertial measurement unit and to drive motors of the turret about the bearing axis and of the sighting head about the elevation axis to bring the sighting head in a direction of sight and stabilize the direction of sight independently of the movements of the vehicle on which the sighting device is mounted.
[0004] The inertial measurement unit comprises: linear inertial sensors, namely accelerometers, arranged along the axes of a measurement frame linked to a frame of the inertial measurement unit to provide measurement increments of components of a specific force vector; and angular inertial sensors, namely gyroscopes or gyrometers, arranged to provide measurement increments of angular movements of the measurement frame relative to an inertial frame. These measurements are used to determine an attitude in the inertial frame and a position in the local geographic frame.
[0005] This attitude and position are used to orient and maintain the aiming head towards targets (the aiming head is said to be gyrostabilized around two axes).
[0006] However, the inertial measurement unit provides measurements relative to a reference frame linked to its installation plane which is different from the reference frame of the optronic sensor and defines a so-called inertial line of sight which may be different from the optical line of sight of the optronic sensor if the two reference frames are offset from each other. To obtain a precise orientation of the optronic sensor contained in the sighting head, it is therefore necessary to estimate the difference between these two reference frames, a difference commonly called the harmonization matrix.
[0008] The invention aims in particular to provide a new method for estimating the difference between the two reference systems. Summary of the invention
[0009] To this end, the invention provides a method for controlling an optronic device on board a vehicle, the optronic device comprising a sighting head movable in elevation and bearing, at least one optronic sensor mounted in the sighting head to provide star images, and an inertial measurement unit mounted in the sighting head to provide an estimate of the current attitude of the sighting head in an inertial measurement frame ([IMU]) and an estimate of the current position of the sighting head in a local geographical frame ([g]), and an electronic processing unit which is connected to a motor drive of the sighting head in elevation and bearing, to the optronic sensor and to the inertial measurement unit to orient the sighting head.The method implements a harmonization phase, prior to a nominal operating phase, which comprises the steps, implemented by the electronic processing unit, of selecting a number (M) of stars from a star catalog which is stored in a memory accessible by the electronic processing unit and which contains equatorial coordinates of the stars as a function of an observation position, and for each of the selected stars: . - point the aiming head towards the star (k) using horizontal coordinates of the star (k) determined from the equatorial coordinates of the star and the current position estimate; - move the aiming head as needed to center the star on an axis of an optical line of sight ([LoS]) reference point normal to the optronic sensor; - record the current attitude estimate of the aiming head provided by the inertial measurement unit; - define a matrix bk of the current attitude estimate of the aiming head for the star (k) and a matrix ak of the coordinates of the star (k) in the line-of-sight frame such that with the matrix of rotation between the inertial measurement reference frame ([IMU]) and the optical line of sight reference frame ([LOS]);
[0010] The harmonization phase then includes the steps of - pose a cost function » / y \ _ lyiV \2 and search for xz 2 । k \ kk / optimal values of the rotation matrix T to minimize said cost function; - record the rotation matrix values thus defined to allow their use in the nominal operating phase.
[0011] Thus, the method of the invention is based on the use of stars to estimate the pointing errors between an inertial reference given by the inertial measurement unit and the actual line of sight of the optronic sensor of the device. Indeed, the directions of the stars from any observation point are known and documented in the star catalogs and can therefore serve as a supposedly perfect reference for estimating the pointing errors of the aiming head.
[0012] According to optional characteristics, used individually or in whole or in part in combination: the search for the values of the rotation matrix T is carried out by setting _ ylV [f aT — USyï in which is a decomposition into singular values of B and the optimal values of the rotation matrix are U diag (1,1, det (U) det (V)) VT' the number of stars selected is about 10; - the selected stars have an elevation greater than approximately 15°.
[0013] The invention also relates to an optronic device comprising a sighting head movable in elevation and bearing, at least one optronic sensor mounted in the sighting head to capture images of stars, and an inertial measurement unit mounted in the sighting head to provide a current attitude of the sighting head in an inertial measurement frame of reference and a current position of the sighting head in a local geographical frame of reference, and an electronic processing unit which is connected to a motor drive of the sighting head in elevation and bearing, to the optronic sensor and to the inertial measurement unit and which is arranged to access at least one memory containing a catalog of stars and a computer program comprising instructions arranged to implement this method.
[0014] Other characteristics and advantages of the invention will emerge from reading the following description of a particular and non-limiting embodiment of the invention. Brief description of the drawings
[0015] Reference will be made to the accompanying drawings, among which:
[0016] [Fig.l] [Fig.l] is a schematic view provided with an optronic device according to the invention equipping a vehicle;
[0017] [Fig.2] [Fig.2] is a schematic view of the contents of the aiming head of the device optronics according to the invention;
[0018] [Fig.3] [Fig.3] is a view showing the various markers used and the matrices of rotation between said markers;
[0019] [Fig.4] [Fig.4] is a flowchart illustrating the method of the invention.
[0020] With reference to figures 1 and 2, the invention is described here in application to an observation sight, generally designated 1, on board a vehicle V.
[0021] The observation sight 1 comprises a turret 2 mounted on a base 3 to pivot about a bearing axis 4 and a sighting head 5 mounted on the turret 2 to pivot about a elevation axis 6. A motor 7 rotates the turret 2 about the bearing axis 4 and a motor 8 rotates the sighting head 5 about the elevation axis 6 so as to be able to orient the sighting head 5 in a sighting direction.
[0022] At least one optronic sensor 9 is mounted in the sighting head 5 and positioned behind an optical system for capturing images along a line of sight normal to the plane of the optronic sensor 9. The optronic sensor 9 is known per se and has characteristics (sensitivity, definition, resolution, integration time) suitable for capturing images of the vehicle's environment and of the stars present in the sky.
[0023] An inertial measurement unit 10 (or IMU) is mounted in the aiming head 5 to detect movements of the aiming head 5. The inertial measurement unit 10 comprises, in a manner known per se: linear inertial sensors, namely accelerometers, arranged along the axes of a measurement frame linked to a frame of the inertial measurement unit 10 to provide measurement increments of components of a specific force vector; and angular inertial sensors, namely gyroscopes or gyrometers, arranged to provide measurement increments of angular movements of the measurement frame relative to an inertial frame. These measurements make it possible to calculate a current estimate of attitude A(t), h(t), D(t) of the aiming head and a current estimate of position L(t), 0(t) of the aiming head (and therefore of the vehicle V) at each current instant t.
[0024] The observation sight 1 comprises an electronic processing unit 11 connected to the optronic sensor 9, to the inertial measurement unit 10, and to the motors 7, 8. The electronic processing unit 11 here comprises, in a manner known per se, at least one processor and a memory containing computer programs executable by the processor. Conventionally in the envisaged application, the programs are arranged for the processing and fusion of data by implementing, for example, navigation calculation algorithms from quaternions and rotation matrices from one reference frame to another, one or more Kalman filters, image processing algorithms, target tracking algorithms, for example by deviation measurement, servo-control algorithms for controlling the motors 7, 8, etc.
[0025] The electronic processing unit 11 is arranged to provide several conventional functions: - control motors 7 and 8 to orient the aiming head 5 in a sighting direction and point the optronic sensor 9 towards a target or a landmark; - control the motors 7 and 8 from the attitude measurements of the inertial measurement unit 10 to maintain the aiming head 5 in the aiming direction independently of the movements of the vehicle V; - determine from the attitude measurements of the inertial measurement unit 10 a bearing of the target or the landmark relative to the vehicle.
[0026] The memory of the processing unit 11 also includes a star catalog or ephemeris containing a list of stars with their equatorial coordinates in the international celestial reference system ICRS (International Celestial Reference System) on the date of January 1, 2000 at 12:00 (J2000.00). The use of such star catalogs and their updating by the electronic processing unit 11 to find the coordinates of the stars at a given date and location on Earth are known in themselves and will not be detailed here.
[0027] The electronic processing unit 11 is arranged to provide several functions: - from the current estimate of calculated position and from the measurements of the inertial measurement unit 10, select from the star catalog at least one star visible from said current position; - calculate the horizontal coordinates A and h of the selected star from the equatorial coordinates in the star catalog for the selected star; - drive the motors 7 and 8 to orient the aiming head 5 in a direction of aim corresponding to said horizontal coordinates so as to point the optronic sensor 9 towards the selected star using the attitude measurements of the inertial measurement unit 10; - drive motors 7 and 8 to correct the aiming direction by bringing the selected star to the center of the optronic sensor 5 (more precisely, to the center of the observation field of the optronic sensor 5) and memorize the attitude measurements of the inertial measurement unit 10.
[0028] As visible in figures 1 and 2 and more particularly in [Fig.3], we note: - [IMU]=(M, X1MU, Y1mu, Z1mu) the measurement reference frame of the measurement unit inertial 10 or inertial measurement reference frame; - [LdV]=(C, XLdv, YLdv, ZLdv) the line of sight reference frame of the sensor optronics 9 (XLdv normal to the plane of the optronic sensor 9; YLdv and ZLdv in the plane of the optronic sensor 9); - [g]=(O, Xg, Yg, Zg) the local geographic reference, here of the NED type; := P-(A)A(A) A(A)rotation matrix (°passage matrix) between the inertial measurement frame [IMU] and the local geographic frame [g] with the attitude angle measurements (A h,, Dj) provided by the inertial measurement unit 10; - ^[ll / V]:=P"( A Py'a matræe of ætation between the reference frame line of sight [LOS] and the local geographic reference frame [g] with A and h the actual horizontal coordinates of the selected star obtained from the star catalog (D is not used and does not appear in the star catalog); T\IMU]p . xp / \ p / x ia rotation matrix between the [Wn - A (Wz) A (Vy) A (Wx) inertial measurement frame [IMU] and the line of sight frame [LOS] with (VU vy Vx) the angular differences between the two frames of reference.
[0029] The electronic processing unit 11 is arranged to execute a harmonization phase (see [Fig.4] in particular) to estimate the rotation matrix (also called harmonization matrix) between the inertial measurement frame of reference [IMU] and the line of sight frame of reference [LdV]. This makes it possible to compensate or correct the difference between the optical line of sight (defined by the optronic sensor 9 and extending along the axis XLdv) and the inertial line of sight (defined by the inertial measurement unit 10 and extending along the axis X1MU).
[0030] In this phase, the electronic processing unit 11 selects a number M of stars from the star catalog (step 100). The stars selected here preferably have an elevation greater than approximately 15°. This makes it possible to avoid problems of modeling atmospheric refraction. For an elevation greater than 15° the refraction compensation error is negligible. For an elevation less than 15°C, to limit the impact of the refraction compensation error, it is necessary to know precisely the temperature and pressure outside the sighting head.
[0031] The number M of selected stars is at least 5 and preferably greater than or equal to approximately 10. This makes it possible to improve the precision of the harmonization matrix.
[0032] The electronic processing unit then executes a loop for each of the selected stars i (each time by incrementing by 1 an index i initially at zero: i=i+l). In this loop, the electronic processing unit 11: - calculates (step 110) the horizontal coordinates A(t) and h(t) of the star i determined from the equatorial coordinates a(J2000.00) and ô(J2000.00) of star i and the current position estimate L(t), 0(t) at the current time t (defined according to the UTC standard); controls the motors 7, 8 to point the aiming head 5 towards the star i using the horizontal coordinates A(t) and h(t) of the star i and the current attitude estimate provided by the inertial measurement unit 10 to control the motors 7, 8 in position (step 120); checks (step 130) whether the star in question is visible in the field of the optronic sensor 9 (the electronic processing unit 11 can recognize the star i from the magnitude and color of the star i which appear in the star catalogs); if not, returns to the start of the loop to go to star i+1; if so, controls the motors 7, 8 to move the aiming head as needed to center the star i on the line of sight of the optronic sensor 9 by carrying out a deviation measurement from the images provided by the optronic sensor 9 (star tracking or tracking - step 140); records the current attitude estimate A;(t), h;(t), D;(t) of the aiming head 5 provided by the inertial measurement unit 10 at the current time t (step 150).
[0033] The electronic processing unit 11 therefore has the horizontal coordinates A(t) and h(t) of the star i at time t, the current attitude estimate A;(t), h;(t), D;(t) of the aiming head 5 at time t and the current position estimate L(t), 0(t) at time t.
[0034] The electronic processing unit 11 restarts this loop as long as the index i is less than M.
[0035] At the end of the loop (i=M), the electronic processing unit 11 has for each star i observed: measurement angles of the current attitude estimate (of the aiming head 5 and therefore "pz( A.) Py()p*(D{y We therefore know perfectly the pointing direction of the inertial line of sight at the moment of the measure, given by:
[0036] COS (A / )8111^) sin^ horizontal coordinates (A, h) and the position in the [WGS84] reference frame from the star catalog. Note that the theoretical slope, noted, is not known, but we nevertheless know perfectly the theoretical direction of the star in [g], given by
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048] v = = Pz(A)P, (h)P, (D) '1' 0 .0. ■ co$( / î)cos(A) 1 cos(&)sm(A) sin(^) - of the current position estimate L, ¢) of the aiming head 5. In the above and in the following, the notation designates a measurement. It is recalled that the star is placed in the center of the optronic sensor 5 so that its coordinates in the [LoS] frame are We can pose the following equality: 0J = A)^)P / ^))9>:(A)P,(*)PA^ 0 Lo law. Please note that in the preceding formula and those that follow, the notation ()r or a? or VT designates the transpose of the matrix () or ak or V (the notation T has nothing to do with the rotation matrices T). It is understood that the number N of stars visible among the M selected stars can be either equal to M or less than M. Preferably, M is chosen according to the observation conditions in such a way that the number of stars N is at least equal to 10. For all visible stars k among the N visible stars, the electronic unit of processing 11 calculates (step 160): ^k ~ ^LdV = (PdA^PAh^P^) )TPz(At)Py(ht) ak~ALdV ~ . r 0 .0. °naAors:it = rQat. T 0 .0. The harmonization phase then comprises the step (170) of posing a cost function =411,¾¾¾ ) 2 and of searching for Topt values of the matrix of optimal rotation T to minimize said cost function. The minimization of this function is commonly referred to as the “WAHBA Problem” in the literature and Several solutions to this problem have been proposed. wk represents weighting coefficients that may be used to give more or less weight to a measurement depending on its credibility, for example (they can be given the value 1 if we do not wish to use them).
[0049] One of the resolution methods consists of carrying out a singular value decomposition of b
[0050] We then note bjflT = USVT ^ans ^aclue^e USV^ is ^a singular value decomposition of B (see for example Markley, FL, Equivalence of two solutions of Wahba's Problem, Journal of the Astronautical Science, 2015).
[0051] The optimal solution is then T = y diag ( 1,1, det ( Z7 ) det ( V ) ) VT'
[0052] We then deduce the values of the rotation matrix soa x [LdVj
[0053] "arcsa^ -
[0054] _ arcsin(22L_)
[0055] The electronic processing unit 11 then records the values of the rotation matrix thus defined to take into account (by correction or compensation) the difference between the inertial line of sight and the optical line of sight during nominal operation of the observation sight.
[0056] Of course, the invention is not limited to the embodiment described but encompasses any variant falling within the scope of the invention as defined by the claims.
[0057] In particular, the optronic device may have a structure different from that described.
[0058] The optronic device may comprise more than one optronic sensor and / or more than one inertial measurement unit.
[0059] It is possible not to resort to a singular value decomposition to search for the values of the rotation matrix T. It is for example possible to use a quaternion estimation algorithm such as the QUEST (or Quatemion Estimator) algorithm developed by Malcolm D. Shuster (see MD Shuster and SD Oh, Three-axis attitude determination from vector observations, J. Guidance and Control, No. 4, No. 1, 1981).
[0060] The processing functions may be grouped in a single processing unit or several. Thus, instead of a single electronic processing unit, the device may comprise an electronic image processing unit for identifying stars and determining the polar coordinates of the stars, an electronic processing unit in the inertial unit for providing inertial attitude and position, and an electronic processing unit calculating navigation from all the data provided by the other electronic units.
[0061] The memory containing the star catalog can be incorporated into the electronic processing unit or be transferred to a server connected to the electronic processing unit by a computer network.
[0062] The invention can be used on any type of vehicle, land, air, space, nautical, etc.
Claims
1. Claims Method for controlling an optronic device (1) on board a vehicle (V), the optronic device (1) comprising a sighting head (5) movable in elevation and bearing, at least one optronic sensor (9) mounted in the sighting head (5) to provide star images, and an inertial measurement unit (10) mounted in the sighting head (5) to provide an estimate of the current attitude of the sighting head in an inertial measurement frame ([IMU]) and an estimate of the current position of the sighting head in a local geographical frame ([g]), and an electronic processing unit (11) which is connected to a motorization (7, 8) for driving the sighting head (5) in elevation and bearing, to the optronic sensor (9) and to the inertial measurement unit (10) to orient the sighting head (5), characterized in that the method implements a harmonization phase, prior to a nominal operating phase, which comprises the steps,implemented by the electronic processing unit (11), to select a number (M) of stars from a star catalog which is stored in a memory accessible by the electronic processing unit (11) and which contains equatorial coordinates of the stars as a function of an observation position, and for each of the selected stars:, - point the aiming head (5) towards the star (k) using horizontal coordinates of the star (k) determined from the equatorial coordinates of the star and the current position estimate; - move the aiming head (5) as needed to center the star on an axis of an optical line of sight ([LoS]) reference mark normal to the optronic sensor (5); - record the current attitude estimate of the aiming head (5) provided by the inertial measurement unit (10); - define a matrix bk of the current attitude estimate of the aiming head for the star (k) and a matrix ak of the coordinates of the star (k) in the line of sight frame such that k _ with ja matrix of 4 Dk~£[UV]ak £ [LdV] rotation between the inertial measurement reference frame ([IMU]) and the optical line of sight reference frame ([LoS]); and in that the harmonization phase then includes the steps of set a cost function J(T} = and search for optimal values of the rotation matrix T to minimize said cost function; - record the values of the rotation matrix thus defined to allow their use in the nominal operating phase.
2. A method according to claim 1, wherein the search for the values of the rotation matrix T is performed by setting = VSVT in which USV? is a singular value decomposition of B and the optimal values of the rotation matrix are jj diag( det( r)det(F) ) VT-
3. Method according to claim 1 or 2, in which the number of stars selected is at least 5 and preferably greater than 10.
4. A method according to any preceding claim, wherein the selected stars have an elevation greater than 15°.
5. Optronic device comprising a sighting head (5) movable in elevation and bearing, at least one optronic sensor (9) mounted in the sighting head (5) for capturing images of stars, and an inertial measurement unit (10) mounted in the sighting head (5) for providing a current attitude of the sighting head (5) in an inertial measurement frame ([IMU]) and a current position of the sighting head (5) in a local geographical frame ([g]), and an electronic processing unit (11) which is connected to a motorization (7, 8) for driving the sighting head (5) in elevation and bearing, to the optronic sensor (9) and to the inertial measurement unit (10) and which is arranged to access at least one memory containing a catalog of stars and a computer program comprising instructions arranged to implement the control method according to any one of the preceding claims.
6. Vehicle comprising a device according to claim 5.
Citation Information
Patent Citations
An Astronomical Navigation Attitude Transfer Method Based on Optical Gyroscope Measurement Information
CN113252029B
Optical-inertial navigation system
US3370460A