Observation device with independent optronic and optical channels and vehicle equipped with such a device
The autonomous optronic viewfinder mode in vehicles addresses the cognitive load issue by allowing simultaneous use with the optical viewfinder, enhancing observation and surveillance with panoramic imaging and threat detection, reducing operator workload.
Patent Information
- Application Number
- FR2021006898
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-28
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2041-06-28
AI Technical Summary
Existing vehicles equipped with both optical and optronic viewfinders require the operator to switch between them, leading to increased cognitive load and limiting simultaneous use for enhanced observation and surveillance capabilities.
An autonomous operating mode for the optronic viewfinder that allows independent image acquisition and processing, providing additional information to the operator while using the optical viewfinder, with integrated artificial intelligence for threat detection and priority zone determination.
Reduces operator cognitive load by enabling simultaneous use of both viewfinders, enhances observation capabilities with panoramic imaging and threat assessment, and optimizes surveillance through automated threat detection and priority zone identification.
Smart Images

Figure 00000014_0000 
Figure 00000014_0001 
Figure 00000015_0000
Abstract
Description
Title of the invention: Observation device with independent optronic and optical channels and vehicle equipped with such a device
[0001] The present invention relates to the field of observation and monitoring of the environment of a vehicle such as a military vehicle, and for example a land military vehicle.
[0002] BACKGROUND OF THE INVENTION
[0003] Vehicles equipped with an optical sight (direct optical path), such as a periscope, episcope or optical telescope, are known to allow an operator (e.g., vehicle commander) to observe the vehicle's surroundings at short, medium or long distances.
[0004] Certain vehicles, particularly those equipped with a cannon, are also equipped with optronic observation and surveillance equipment, for example, an optronic sight comprising a rotating mount on which optronic sensors and a rangefinder are mounted, connected to an electronic control unit which is also connected to a motor drive for the mount. The electronic control unit is programmed to acquire images via the optronic sensors, detect threats and / or targets, and acquire information relating to said threats and / or targets, such as distance, angular position, relative velocity (this is also referred to as target acquisition)...The electronic control unit is also programmed to automatically orient the mount to track threats and / or targets (i.e., to point the mount, and therefore the weapon whose movements are slaved to those of the mount, towards the threats and / or targets) or to monitor the vehicle's surroundings over a given angular range. A human-machine interface is connected to the electronic control unit, allowing the operator to select the line of sight, the spectral channel (day / night), and the field of view of the optronic sensors (zoom level). The optronic observation sight thus enhances the operator's awareness of the vehicle's environment and ensures more precise aiming and firing than an optical sight can provide.
[0005] Since the operator cannot simultaneously use both the optical viewfinder and the optronic viewfinder, two operating modes are provided: one in which the optical viewfinder is used by the operator and the optronic viewfinder has its shooting parameters (orientation and zoom level in particular) based on those of the optical viewfinder (the optronic viewfinder is slaved to the scope); the other in which, conversely, the operator uses the optronic viewfinder and the optical viewfinder is slaved to the op- electronics.
[0006] SUBJECT OF THE INVENTION
[0007] The invention is intended in particular to improve the observation and monitoring capabilities of operators of such vehicles. Summary of the invention
[0008] For this purpose, according to the invention, a device according to claim 1 is provided.
[0009] Thus, in autonomous operating mode, the optronic sight continues its acquisitions while the operator uses the optical sight, for example, to supplement observations made by the operator via the optical sight or to perform automatic observations to relieve the operator. It is therefore possible to provide additional information to the operator while limiting the increase in the operator's cognitive load.
[0010] The invention also relates to a vehicle comprising a body surmounted by such a device.
[0011] Other features and advantages of the invention will become apparent from the following description of a particular, non-limiting embodiment of the invention. Brief description of the drawings
[0012] Reference will be made to the attached drawings, among which:
[0013] [Fig.1] [Fig.1] is a schematic front view of a vehicle according to the invention;
[0014] [Fig.2] [Fig.2] is a schematic front view of an observation device according to the invention;
[0015] [Fig.3] [Fig.3] is a schematic top view showing the areas covered respectively by the optical sight and the optronic sight in autonomous operating mode;
[0016] [Fig.4] [Fig.4] is a schematic view illustrating the partitioning of the extent covered by the optronic sight in observation sectors from a panoramic image provided by the optronic sight;
[0017] [Fig.5] [Fig.5] is a flowchart showing the viewfinder control process optronics in autonomous operating mode. DETAILED DESCRIPTION OF THE INVENTION
[0018] With reference to Figures 1 and 2, the invention is described herein in application to a vehicle, generally designated as 1, comprising a body 2 supported by wheels 3 and surmounted by a turret 4 armed with a cannon and mounted on the body 2 to pivot about a substantially vertical axis A0 when the vehicle is resting on a horizontal plane. The vehicle 1 is herein designed for a crew of at least three people, namely a driver, a gunner, and a vehicle commander.
[0019] Turret 4 of vehicle 1 is equipped with an observation device of an envi vehicle 1 control by vehicle commander H. We are interested here in the vehicle commander's control station, but it goes without saying that the driver's station, and / or the gunner's station, may be equipped with an identical or similar observation device, or benefit from the images provided by that of the vehicle commander.
[0020] The observation device includes optronic equipment, for example an optronic sight 10 and an optical sight 20.
[0021] The optronic sight 10 includes a support 1 I which is mounted to pivot on the upper surface of the turret 4 around an axis Al parallel to the axis A0 and which carries a sensor block 12 mounted on the support 11 to pivot around an axis A2 perpendicular to the axis AL. Thus, the sensor block 12, and therefore the line of sight LV10 of the optronic sight 10, is orientable in azimuth around the axis Al and in elevation around the axis A2.
[0022] The optronic sight 10 includes a motor, symbolized as 13 and known per se, for orienting the sensor block 12 in azimuth around the axis A1, and a motor mounted on the support 11, and known per se, for orienting the sensor block 12 in elevation around the axis A2. The optronic sight 10 also includes, in a manner known per se, first position sensors, such as angular encoders, for determining the orientation of the sensor block 12 in azimuth around the axis A1 and in elevation around the axis A2. Preferably, the electronic sight 10 also includes, in a manner known per se, second position sensors, such as accelerometers and gyroscopes, for determining the position of the sensor block 12 in a predetermined reference frame. The position sensors therefore make it possible to know at any given moment the direction of the LV10 line of sight of the optronic sight 10.
[0023] The sensor block 12 here includes an optronic sensor 14 and a rangefinder 15. The optronic sensor 14 includes a day channel and a night channel.
[0024] The optronic sensor 14, the motor 13, and the position sensors are connected to a first electronic unit 31 arranged to control image acquisition according to shooting parameters. These shooting parameters include the line of sight (the orientation of the sensor block 12 around the A1 and A2 axes), the spectral channel (day / night), and the field of view covered by the optronic sensors (zoom level). The electronic unit 31 includes, in a manner known to be inherent, a processor and a memory containing computer programs executable by the processor.
[0025] The rangefinder 15 is also connected to the first electronic unit 31 which is also arranged to control the execution of telemetric measurements along the line of sight LV10.
[0026] A control instrument 41, such as a joystick-type joystick, is connected to the first electronic unit 31 to allow the vehicle commander to send control signals to the first electronic unit 31 in order to orient the sensor block 12, to select the spectral channel and zoom level, and to control telemetry measurements.
[0027] The optical sight 20 here has the form of a periscope or episcope 21 mounted on top of the turret 4 so that it can be oriented in azimuth about an axis A3 parallel to axis A2. In a manner known per se, the periscope 21 comprises a lens assembly and mirrors enabling the vehicle commander to see what lies within a line of sight LV20 of the periscope 21, the light rays entering the periscope 21 through an optical input element located outside the vehicle and exiting through an optical output element 22 located inside the tank. At least one of the mirrors is oriented about an axis perpendicular to axis A3 to allow the line of sight to be oriented in elevation around said axis. The lens assembly includes at least one movable lens allowing focal adjustment, permitting several zoom levels selectable by the vehicle commander. The movement of the movable lens is ensured by a motor not shown.
[0028] The optical sight 20 is equipped with a motor, symbolized as 23 and known per se, which allows the periscope 21 to be oriented in azimuth around axis A3 and, optionally, the steerable mirror in elevation. The optical sight 20 also includes, in a manner known per se, position sensors, such as angular encoders, which allow the orientation of the periscope 21 in azimuth around axis A3 and that of the steerable mirror in elevation to be determined. The position sensors thus allow the direction of the line of sight LV20 to be determined at any given time.
[0029] The motor 23, the position sensors, and the zoom motor are connected to a second electronic unit 32, which is connected to a control instrument 42, such as a joystick, to allow the vehicle commander to send control signals to the second electronic unit 32 in order to orient the periscope 21 and the mirror, and to select the zoom level. The shooting parameters here include the line of sight (the orientation of the periscope 21 around axis A3 and of the mirror around the corresponding transverse axis) and the field of view covered by the lens group and visible through the output optical element 22 (zoom level). The electronic unit 32 includes, in a manner known to be inherent, a processor and memory containing computer programs executable by the processor.
[0030] The first electronic unit 31 and the second electronic unit are connected to a third electronic unit 33 arranged to:
[0031] - process the images provided by the optronic sensors; - allow the vehicle commander to select an operating mode between a master optical / slave optronic operating mode, a slave optical / master optronic operating mode, and an operating mode autonomous optronic operation; - transmit to the electronic unit 31 the shooting parameters received from the electronic unit 32 when the selected operating mode is the optical master / optronic slave operating mode; - transmit to the electronic unit 32 the shooting parameters received from the electronic unit 31 when the selected operating mode is the optical slave / optronic master operating mode; - display on a display device (preferably a touch screen) 50 connected to the electronic unit 33 and located in the vicinity of the vehicle leader, the images provided by the optronic sensors and processed, as well as the telemetry measurements, when the selected operating mode is the optical slave / optronic master operating mode.
[0032] The electronic unit 33 comprises in a known manner within itself a processor and a memory containing computer programs executable by the processor.
[0033] In optical master / optronic slave operating mode, the vehicle commander uses the optical sight 20 (he commands, by means of the control instrument 42, the second electronic unit 32 to orient the line of sight LV20 in the direction he wants with a level of zoom he wants) and the shooting parameters of the optronic sight 10 are fixed by the electronic unit 31 to be identical to those of the optical sight 20.
[0034] In optical slave / optronic master operating mode, the vehicle commander uses the optronic sight 10 (he commands, by means of the control instrument 41, the first electronic unit 31 to orient the line of sight LV10 in the direction he wants with a level of zoom he wants) and the shooting parameters of the optical sight 20 are set by the electronic unit 32 to be identical to those of the optronic sight 10. The first electronic unit 31 is, for example, programmed to automatically orient the mount 11 and the sensor block 12 so as to pursue threats and / or targets (i.e. to point the mount 11 and the sensor block 12, and therefore the weapon whose movements are slaved to those of the mount 11 and the sensor block 12, towards the threats and / or targets) or to ensure surveillance of the vehicle's environment over a given angular range.The captured images, usually in the form of a video stream, are displayed on screen 50.
[0035] These two modes of operation, as well as the processing carried out on the images provided by the optronic sensors, are known in themselves and will not be further detailed here.
[0036] In autonomous optronic operating mode, and in accordance with the invention, the optronic sight 10 is controlled to make acquisitions independently of the optical sight 20 shooting parameters when optical sight 20 is being used by the vehicle commander.
[0037] In particular, the first electronic unit 31 is arranged to point the optronic viewfinder 10 in a direction different from that of the optical viewfinder 20 and to acquire images in that direction. The shooting parameters are determined and communicated to the first electronic unit 31 by the third electronic unit 33.
[0038] According to a first operating mode, the electronic unit 31 commands a 360° scan of the environment of the vehicle 1 (see [Fig.3]) to form a panoramic image and, if the situation allows, telemetry measurements to carry out a telemetry map of the detected points of interest.
[0039] The third electronic unit 33 is programmed to process the images provided by the optronic sight 10, detect points and / or areas of interest, and present the vehicle commander with information relating to the detected points or areas of interest. Preferably, the electronic unit 33 creates a panoramic image displayed on the screen 50 with the points of interest and associated information. Advantageously, the output optical element 22 is provided with a liquid crystal matrix allowing information to be displayed on the output optical element 22 while also permitting a transparent view of the scene seen through the lens group.This information may include a top or bottom banner schematically representing a panoramic view of the environment with symbols representing points of interest (for example, a symbol for friends, a symbol for enemies, one for each element of the environment that may be encountered: road, building, river, cliff, ditch...) and information associated with each point of interest such as the distance obtained by telemetry.
[0040] The third electronic unit 33 is programmed to determine contextualization information enabling the spatial linking of information relating to the detected points of interest and the field covered by the optical viewfinder 20: for example, the electronic unit 33 symbolizes by a vertical line, in the displayed banner which here represents a 360° field, the line of sight of the optical viewfinder 20 and, possibly, by a frame, the limits of the field covered over these 360° by the optical viewfinder 20. Advantageously, the third electronic unit 33 is programmed to transfer, on the liquid crystal matrix, the information (distance and friend / foe symbol...) relating to the points of interest appearing in the field covered by the optical viewfinder 20, to the location where they are in the visualized scene.
[0041] With regard to these points of interest and the information concerning them, the third electronic unit 33 is advantageously programmed to, in autonomous operating mode, detect each target present in the field of the op- sensor. In tronic 10, assess the threat level of each target based on target data, and update the threat level periodically after a predetermined period. The target data is as follows:
[0042] - a target type from a target library, - a position of the target, - a trajectory of the target, - a weapon orientation of the target.
[0043] According to an advantageous embodiment of the invention, the third electronic unit 33 is also programmed to, in autonomous operating mode, determine a priority level for the areas to be observed based on the complexity level of each area and / or the danger level of each area. The greater the number of points of interest in an area, the more complex the area. The greater the number of targets (or enemies, assuming that each enemy is not considered a target) in an area, the more dangerous that area. The third electronic unit 33 then displays, in the display panel, areas with a priority number that depends on the danger level and / or the complexity level, so that the vehicle commander can choose to prioritize observations of these areas using the optical sight 20.
[0044] The display of this information by the liquid crystal matrix is controlled by the electronic unit 33 and can be activated and deactivated by the vehicle commander. It can be configured for this information to remain displayed, or not, on the screen 50 when the display on the liquid crystal matrix is deactivated.
[0045] The device according to the invention also includes particularly advantageous functionalities when several vehicles equipped with the device move in formation.
[0046] With particular reference to [Fig. 4] and according to a second operating method, considering a detachment of three vehicles IA, IB, IC arriving at an area to be monitored, the detachment leader activates the autonomous operating mode of his observation device. The third electronic unit 33 of the detachment leader's vehicle IA is programmed to:
[0047] - to scan the space to be monitored by the optronic sight 10, - to detect danger zones in the scanned environment, and - to divide the scanned environment into a plurality of surveillance sectors SI, S2, S3 having equivalent densities of danger zones.
[0048] In the present example, hazard detection includes the step of forming a panoramic image Ip of the scanned environment and processing this image to search for boundary lines F forming hazard zones (image Ip').
[0049] The division of the space to be monitored into surveillance sectors includes the steps to define boundary line densities.
[0050] Danger zone densities are calculated from boundary line densities weighted according to a boundary type defined by each boundary line and / or by the distance of the boundary lines from the device. For example, if terrain or a forest is present at a short distance, the enemy's approach may be obscured, so the danger represented by the corresponding boundary line is significant: the weighting coefficient is therefore high. Conversely, if the area to be monitored contains a large open area, the enemy may approach from that direction, but their arrival may be detected at a long distance: the weighting coefficient is therefore medium. Finally, if impassable terrain is located in a sector, the enemy's approach is impossible: the weighting coefficient is therefore low.
[0051] The third electronic unit 33 of the detachment leader's vehicle 1A is programmed to assign a surveillance sector to the observation device of each of the other vehicles IB, IC and to communicate to each electronic unit 33 identification data for the sector assigned to it. To this end, each electronic unit 33 is connected to a transceiver 60, for example of the radio type, enabling the electronic units 33 to exchange data.
[0052] The third electronic unit 33 is programmed to update the calculation of danger zone densities and the corresponding division of sectors SI, S2, S3 to be monitored, according to at least one of the following events:
[0053] - modification of the number of neighbouring vehicles equipped with an observation device (for example due to the decommissioning of a device or the arrival of a new vehicle equipped with a compatible observation device); - reception of a clock signal ensuring a predetermined periodicity of the update; - increasing or decreasing the density of danger zones in a sector.
[0054] The program executed by the third electronic unit 33 preferably includes artificial intelligence modules.
[0055] Thus, the captured images and rangefinding measurements performed by the optronic sight 10 in autonomous operating mode are processed by an AI1 perception artificial intelligence module which is arranged to:
[0056] - detect targets, - determine the positions of the targets, - to determine a classification of targets into tactical elements, - to create images in which the targets are highlighted, - detect points of interest, - determine the positions of the points of interest, - determine a classification of the points of interest, - determine the age of the last observation of each point of interest.
[0057] The position of the points of interest, their classification and the temporal validity information are exploited by an AI2 decision-making artificial intelligence module which is arranged to interpret the information in question from a tactical point of view in order to determine priority observation areas.
[0058] The positions and classifications of the targets, and the priority observation areas are exploited by an AI3 decision-making artificial intelligence module arranged to plan the surveillance from the information in question and to determine the shooting parameters which correspond to this planning and which are communicated to the first electronic unit 31.
[0059] The first electronic unit 31 sends state data from the optronic sight 10 to the AI3 decision-making artificial intelligence module and site, bearing and North data from the optronic sight 10 to the screen 50.
[0060] The AI3 decision-making artificial intelligence module sends information concerning planning to the screen 50 and receives commands from interfaces 41, 42 and the touch part of the screen 50.
[0061] Of course, the invention is not limited to the embodiment described but encompasses any variant falling within the scope of the invention as defined by the claims.
[0062] In particular, the device may have a different structure from that described in detail above.
[0063] The electronic units may belong to the same electronic circuit or to different electronic circuits.
[0064] The electronic units 31 and 32 can be connected to each other directly by electrical conductors or by radio link.
[0065] The autonomous optronic operating mode may only have some of the above functionalities. For example, only one of the operating modes, in whole or in part, may be implemented.
[0066] The device may include one or more control instruments, in the form of one or more joysticks, a keyboard, a swivel ball...
[0067] The number and type of optronic sensors may differ from those described: for example, there may be a day sensor and a night sensor, a light intensifier or a thermal camera...
[0068] Danger zones, danger zone densities and danger levels can be determined in a different way than those described, for example by taking into account only points of interest or detected threats.
[0069] The platform on which the device of the invention is mounted can be a mobile platform—that is, any type of land, water, or air vehicle—or a fixed platform such as a building. In the case of a land vehicle, this vehicle can be wheeled or tracked, with or without a turret.
Claims
Claims
1. Device for observing an environment of a platform (1) on which the device is mounted, the device comprising optronic equipment (10) and an optical viewfinder (20), the optronic viewfinder comprising a rotatable support (11) which carries at least one optronic sensor (14) and which is equipped with a motorization (13) making it possible to orient the optronic sensor, the optronic sensor and the motorization being connected to a first electronic unit (31) arranged to control the acquisition according to shooting parameters, the optical viewfinder being orientable and connected to a second electronic unit (32) arranged to communicate to the first electronic control unit shooting parameters of the optical viewfinder,the first electronic unit having a slave operating mode in which the optronic equipment is controlled to make acquisitions in accordance with the shooting parameters of the optical viewfinder when the optical viewfinder is used by an operator, characterized in that the first electronic unit is arranged to have at least one autonomous operating mode in which the optronic equipment is controlled to make acquisitions independently of the shooting parameters of the optical viewfinder when the optical viewfinder is used by an operator.,
2. Device according to claim 1, wherein, in autonomous operating mode, the optronic equipment (10) is controlled to be pointed in a direction different from that of the optical sight (20) and the device comprises a third electronic unit (33) arranged to process the images provided by the optronic equipment, detect points and / or areas of interest therein and present to the operator information relating to the detected points and / or areas of interest.
3. Device according to claim 2, in which the optronic equipment (10) comprises a telemeter (15) and the first electronic unit (31) controls, in autonomous operating mode, the optronic equipment to carry out telemetric mapping of the detected points of interest.
4. Device according to claim 2 or 3, in which the third electronic unit (33) is arranged to, in autonomous operating mode, present the information on a screen (50) adjacent to an output (22) of the optical viewfinder (20).
5. Device according to claim 4, in which the third electronic unit (33) is arranged so that the presentation of the information relating to the detected points and / or areas of interest can be activated and deactivated by the operator.
6. Device according to claim 4 or 5, in which the third electronic unit (33) is arranged to determine contextualization information making it possible to spatially link the information relating to the detected points and / or areas of interest and the field covered by the optical viewfinder (20) and to present the contextualization information with the information relating to the detected points of interest in the field covered by the optical viewfinder.
7. Device according to claim 2, in which the first electronic unit (31) is arranged to, in autonomous operating mode, control the optronic equipment (10) to carry out a scan of the environment.
8. Device according to claim 7, in which the third electronic unit (33) is arranged to detect danger zones in the scanned environment.
9. Device according to claim 8, in which the third electronic unit (33) is arranged to divide the scanned environment into a plurality of monitoring sectors (S1, S2, S3) having equivalent danger zone densities.
10. Device according to claim 8 or 9, in which the detection of dangers comprises the step of forming a panoramic image (Ip) of the scanned environment and of searching therein for boundary lines (F) forming the danger zones, and the division into surveillance sectors (SI, S2, S3) comprises the steps of defining densities of boundary lines.
11. A device according to claim 10, wherein the danger zone densities are calculated from the boundary line densities weighted according to a boundary type defined by the boundary lines and / or by a distance of the boundary lines from the device.
12. Device according to one of claims 9 to 11, in which the third electronic unit (33) is arranged to allocate a monitoring sector (SI, S2, S3) to at least one observation device mounted on a neighboring platform (IA, IB, IC) and is connected to a communication member (60) with said at least one observation device mounted on a neighboring platform to transmit data to it. identification of the surveillance sector assigned to it.
13. Device according to claim 12, in which the third electronic unit (33) is arranged to update the calculation of the densities of danger zones and the corresponding division of the sectors to be monitored (S1, S2, S3), as a function of at least one of the following events: - modification of the number of devices mounted on neighboring platforms; - reception of a clock signal ensuring a predetermined periodicity of the updating; - increase or reduction of the density of danger zones in one of the sectors to be monitored.
14. Device according to any one of claims 2 to 13, in which the third electronic unit (33) is arranged to, in autonomous operating mode, detect each target present in the field of the optronic equipment (10), evaluate a level of danger of each target as a function of data from the target, update the threat level periodically after a predetermined duration.
15. Device according to claim 14, wherein the third electronic unit (33) is arranged to determine the following target data: - a target type from a target library, - a position of the target, - a trajectory of the target, - a weapon orientation of the target.
16. Device according to any one of claims 2 to 15, in which the third electronic unit (33) is arranged to, in autonomous operating mode, determine a priority level of the zones to be observed as a function of a level of complexity of each zone and / or a level of danger of each zone.
17. Vehicle (1) having a body (2) surmounted by a device according to any one of the preceding claims.
18. A vehicle (1) according to claim 17, wherein the device is mounted on a turret (4) mounted to pivot on the body (2).