Optronic simulation bench and associated simulation method

Abstract

The invention relates to a simulation bench (10) for simulating a flight of an aircraft, comprising: - an acquisition module (16) configured to receive a flight plan (24) and a set of control data (26); - a calculation module (18) configured to calculate a set of flight data (D) and a target trajectory (T) based on the flight plan (24); - a simulation module (20) configured to determine a control signal (30); - a video module (22) comprising an optronic sensor (32) configured to transmit a real video stream (FR); the simulation module (20) being configured to determine a simulated video stream (FS) using an image database (28), based on the set of control data (26), the set of flight data (D), the target trajectory (T) and the real video stream (FR).

Description

[0001] TITLE: Optronics simulation bench and associated simulation process

[0002] The present invention relates to an optronic simulation bench suitable for simulating the flight of an aircraft.

[0003] The invention also relates to a method for simulating the flight of an aircraft, implemented by such a simulation bench.

[0004] The invention therefore relates to the field of aeronautical aircraft simulation devices, and more particularly to complex aircraft flight simulation systems.

[0005] It is well known that flight simulators are commonly used devices in the field of aeronautics. These devices serve various functions, such as mission preparation, pilot training, or can also be used simply as entertainment tools.

[0006] Modern flight simulators are generally configured to provide the user with an environment identical or nearly identical to that of the cockpit of a real aircraft, such as a commercial airliner. These simulators therefore include an onboard cockpit with aircraft controls, screens simulating images during flight, and a control stick for steering the aircraft.

[0007] In the case of a drone, flight simulators also exist, but naturally have fewer features than the airliner flight simulators presented above.

[0008] In particular, it is known that a drone includes a camera that films the drone's environment in three dimensions during its flight. This camera can be of different models, and may notably be an optronic sensor.

[0009] However, existing flight simulators designed to simulate in-flight images of a drone including an optronic sensor do not offer functionalities related to the mission of a surveillance drone system.

[0010] In particular, documents CN 102566441 and KR10-2016-0043705 describe drone flight simulation devices, but these devices do not incorporate a real optronic sensor. Consequently, the images simulated by these devices do not take into account the intrinsic characteristics of the optronic sensor actually installed on the drone.

[0011] Thus, for example, the preparation of a mission intended to be carried out by this drone, such as a surveillance mission, becomes less precise, because the 3Doffert rendering by the device is not identical to the images that will actually be filmed by the drone's optronic sensor during the mission.

[0012] For similar reasons, training a pilot to operate this drone becomes more difficult.

[0013] Therefore, there is a need to offer a drone flight simulation device that allows for more precise preparation of future aircraft missions and provides better quality training for pilots in training.

[0014] To this end, the invention relates to an optronic simulation bench suitable for performing a simulation of an aircraft flight on a first display and comprising:

[0015] - an acquisition module configured to receive a flight plan before the simulation and a set of control data during the simulation;

[0016] - a calculation module configured to calculate a set of aircraft flight data and a target flight trajectory, from the flight plan;

[0017] - a simulation module configured to receive the control data set, the flight data set, and the target trajectory, and to determine a control signal from them; and

[0018] - a video module including an optronic sensor configured to output a real video stream from the flight data set and the control signal;

[0019] the simulation module being configured to determine a simulated video stream using a database comprising images related to the target trajectory, from the control data set, the flight data set, the target trajectory and the actual video stream, and to display this simulated video stream on the first display.

[0020] In this way, the simulation bench incorporates an optronic sensor identical to the one carried by the drone, resulting in image rendering that more closely resembles real-life flight. Furthermore, thanks to this functionality, a future drone pilot training in the use of the optronic sensor will become familiar with its operation.

[0021] According to other advantageous aspects of the invention, the optronic simulation bench comprises one or more of the following features, taken individually or in all technically possible combinations:

[0022] - the flight data set includes at least one flight data selected from the group comprising: an aircraft position, an aircraft speed and an aircraft heading;

[0023] - the control data set includes pilot commands entered by a user; - the control signal includes a pan angle, a tilt angle and an optronic sensor magnification;

[0024] - the optronic sensor is a two-axis gyrostabilized turret camera;

[0025] - the calculation module is configured to periodically calculate the aircraft's flight data set;

[0026] - the actual video stream comprises a set of images captured by the optronic sensor in an optronic sensor environment;

[0027] - the calculation module is designed to be connected to a second display and to display the received flight plan, the flight data set and the target flight trajectory on the second display;

[0028] - the database is an image bank connected to the simulation module, comprising a set of images from a plurality of predefined environments, and including in particular images relating to the target trajectory;

[0029] - The aircraft is a drone.

[0030] The invention also relates to a method for simulating the flight of an aircraft, implemented by an optronic simulation bench as described above, the method comprising the following steps:

[0031] - acquisition of a flight plan before the simulation and of a set of control data during the simulation;

[0032] - calculation of a set of aircraft flight data and a target flight trajectory, from the received flight plan;

[0033] - determination of a control signal from the control data set, the flight data set and the target trajectory;

[0034] - recording of a real video stream from the flight data set and the determined control signal;

[0035] the method further comprising a processing step, in which a simulated video stream is determined using a database comprising images relating to the target trajectory, from the control data set, the flight data set, the target trajectory and the actual video stream, and in which the simulated video stream is displayed on the first display.

[0036] The invention will become clearer upon reading the following description, given solely by way of non-limiting example, and made with reference to the drawings in which:

[0037] Figure 1 is a schematic view of an optronic simulation bench according to the invention; and Figure 2 is a flowchart of the simulation method according to the invention, the method being implemented by the simulation bench of Figure 1.

[0038] An optronic simulation bench 10 is shown in Figure 1, and described below with reference to Figure 1.

[0039] The simulation bench 10 is suitable for being connected to at least one display, preferably to a first display 14 and a second display 12. Each of these displays 12, 14 presents for example a screen known in itself and intended to be placed in front of a user, for example a pilot in training.

[0040] The simulation bench 10 is for example placed in a pilot training location, such as a room, a hall, etc.

[0041] The optronic simulation bench 10 is adapted to implement a simulation of an aircraft flight, for example of a particular type of aircraft, on the first display 14 and on the second display 12.

[0042] Advantageously, the aircraft is a drone. For example, the drone is a UAS100 type drone, and the simulation bench 10 implements a simulation of a flight of the UAS100 type drone.

[0043] A person skilled in the art will understand that by "implementing a flight simulation", it is understood to implement a simulation of a plurality of flight data, for a given aircraft, following a predefined flight plan, as well as a three-dimensional simulation of the images of the environment of this flight, for this aircraft following this predefined flight plan.

[0044] For example, the simulation bench 10 is configured to receive an aircraft flight plan, calculate a set of flight data related to that flight plan, and simulate images of the drone's environment during the simulated flight. Furthermore, the simulation bench 10 implements this simulation to prepare for a future flight of the aircraft following that flight plan, thus allowing a user to preview the drone's environment during that future flight.

[0045] To do this, the simulation bench 10 includes an acquisition module 16, a calculation module 18, a simulation module 20 and a video module 22.

[0046] The acquisition module 16 is connected to the computing module 18 and the simulation module 20. The computing module 18 is connected to the simulation module 20. The simulation module 20 is connected to the video module 22, as shown in Figure 1.

[0047] The acquisition module 16 is configured to receive a flight plan 24 upstream of the simulation, and a set of control data 26 during the simulation.

[0048] Advantageously, the flight plan 24 is a document in a predefined format, comprising a plurality of data relating to the simulated flight, such as an aircraft model, a departure location of the simulated flight, an arrival location of the simulated flight and waypoints (i.e. "way points" in English) between the departure location and the arrival location.

[0049] As an optional addition, the acquisition module 16 includes a connection unit, not shown, configured to connect the simulation bench 10 to a network, in order to receive the flight plan 24.

[0050] For example, flight plan 24 is a document generated by the ScaleFlyt® application and indicates that the simulated flight involves an aircraft of a particular model, with the same departure and arrival locations. In this example, the acquisition module 16 includes a dedicated connection unit to receive flight plan 24 generated by the ScaleFlyt® application via an internet connection.

[0051] Alternatively, flight plan 24 is transmitted to acquisition module 16 using any other means, such as a human-machine interaction interface.

[0052] The control data set 26 preferably includes a set of control commands entered during the simulation by a user of the simulation bench 10.

[0053] For example, command data set 26 is a set of "left", "right", "up", "down" commands entered by a user from a keyboard or joystick or any other means of control, connected to the acquisition module 16.

[0054] The calculation module 18 is configured to receive the flight plan 24, and to calculate a set of flight data D as well as a target trajectory T of the aircraft, from the received flight plan 24.

[0055] Preferably, the calculation module 18 is configured to calculate the flight data set D periodically throughout the simulated flight, and the target trajectory T of the aircraft after receiving the flight plan 24.

[0056] The flight data set D includes at least one flight data item related to the simulated flight. This flight data item is chosen from the group comprising: an aircraft position, an aircraft speed, and an aircraft heading.

[0057] For example, the calculation module 18 is configured to calculate, after receiving the flight plan 24, a target trajectory T of the simulated flight, and periodically throughout the simulated flight, the speed of the aircraft, the position of the aircraft and the heading of the aircraft.

[0058] In addition, the calculation module 18 is connected to the second display 12, and is designed to display on the second display 12 the received flight plan 24, the flight data set D and the calculated target trajectory T, throughout the simulated flight, as shown in Figure 1. The simulation module 20 is configured to receive the control data set 26 from the acquisition module 16, as well as the flight data set D and the target trajectory T calculated by the calculation module 18.

[0059] The simulation module 20 advantageously comprises a determination unit 27 and a database 28, the two units being connected to a processing unit 29.

[0060] According to one embodiment of the invention, the simulation module 20 comprises an information processing unit, not shown, formed, for example, of a memory and a processor associated with the memory. The simulation module 20 also comprises the database 28.

[0061] According to this embodiment of the invention, each of the determination unit 27 and the processing unit 29 is implemented in the form of a software program, or a software component, executable by the processor. The memory is then capable of storing a determination program and a processing program. The processor is then capable of executing each of these programs, choosing between the determination program and the processing program.

[0062] According to an embodiment not shown, the determination unit 27 and the processing unit 29 are each implemented in the form of a programmable logic component, such as an FPGA (Field Programmable Gate Array), or in the form of a dedicated integrated circuit, such as an ASIC (Application Specific Integrated Circuit).

[0063] When the simulation module 20 is implemented as one or more software programs, that is, as a computer program, it is also capable of being stored on a computer-readable medium (not shown). A computer-readable medium is, for example, a medium capable of storing electronic instructions and being connected to a bus of a computer system. Examples of such a readable medium include an optical disc, a magneto-optical disc, ROM, RAM, any type of non-volatile memory (e.g., FLASH or NVRAM), or a magnetic card. A computer program containing software instructions is then stored on this readable medium.

[0064] The determination unit 27 is adapted to determine a control signal 30 from the flight data set D, the target trajectory T and the received control data set 26.

[0065] Advantageously, the control signal 30 includes a pan angle, a tilt angle and a zoom.

[0066] The video module 22 includes an optronic sensor 32. Preferably, the optronic sensor 32 is a camera with a two-axis gyrostabilized turret. For example, the optronic sensor 32 is a Ternis Merio ® type camera, including a two-axis gyrostabilized turret.

[0067] The optronic sensor 32 is configured to output a real FR video stream from the control signal 30 determined by the determination unit 27, as well as from the flight data set D.

[0068] The actual FR video stream includes a set of images of the environment of the optronic sensor 32 and according to the control signal 30, captured by the optronic sensor 32.

[0069] For example, the simulation bench 10 is installed in the room and the optronic sensor 32 is installed on a table in the room and connected to the simulation module 20, and the optronic sensor 32 captures a set of images of the room, in particular according to the pan angle, tilt angle and magnification included in the received control signal 30, the set of captured images thus forming the real video stream FR.

[0070] In addition, the simulation module 20 is adapted to receive the real video stream FR and to determine a simulated video stream Fs.

[0071] To do this, the database 28 included in the simulation module 20 comprises a set of images of a plurality of predefined environments, and therefore in particular images relating to the target trajectory T. For example, for each point of the target trajectory T, the database 28 may include a 360° panoramic view of the corresponding environment.

[0072] According to an alternative embodiment, the database 28 is connected to the simulation module 20, and the simulation module 20 includes a communication unit (not shown) configured to connect the simulation module 20 to the database 28.

[0073] According to an example relating to this alternative embodiment, database 28 is an image bank, for example from existing simulators, connected via a computer network to the simulation module 20.

[0074] The processing unit 29 is thus adapted to receive the real video stream FR, and to determine the simulated video stream Fs, from the real video stream FR, the control signal 30 determined by the determination unit 27, and the flight data set D.

[0075] In addition, at each moment of the simulated flight, the processing unit 29 is configured to collect, in the database 28, images relating to the flight data set D, and to the control signal 30.

[0076] For example, at a given moment in the simulated flight, the flight data set D includes a given drone position and a drone altitude of 1000 meters, and the control signal 30 includes a pan angle of 180°, a tilt angle of 0°, and a magnification of 1x. The processing unit 29 is then equipped to collect three-dimensional images of the drone's given position in the database 28, at an altitude of 1000 meters, with a pan angle of 180°, a tilt angle of 0°, and a magnification of 1x.

[0077] The processing unit 29 is then adapted to replace, at each moment of the simulated flight, the images included in the real video stream FR, with the images collected in the database 28, in order to determine the simulated video stream Fs.

[0078] Therefore, according to this operation, the simulated video stream Fs displayed by the simulation bench 10 on the first display 14 includes images relating to the environment of the aircraft, during the entire simulated flight of the aircraft, according to the set of control data 26 entered by the user of the simulation bench 10.

[0079] As an optional addition, the processing unit 29 is adapted to receive, from the optronic sensor 32, the real FR stream as well as a set of metadata relating to this real FR stream.

[0080] This metadata set includes data specific to the actual FR stream recorded by the optronic sensor 32. For example, the metadata set includes coordinates of the aiming points of the optronic sensor 32 throughout the recording of the FR video stream, GPS coordinates of the images included in the FR video stream, OR timestamps of the recordings made by the optronic sensor 32.

[0081] The processing unit 29 is then able to transmit the simulated stream Fs as well as the set of metadata received to an external system not shown.

[0082] For example, the external system is adapted to implement object detection or data processing operations, from the simulated stream Fs and this set of metadata.

[0083] The operation of the simulation bench 10 will now be explained, in particular with the help of figure 2 representing a flowchart of the simulation process according to the invention, the process being implemented by the simulation bench 10.

[0084] The simulation process initially includes an acquisition step 100, in which the acquisition module 16 receives the flight plan 24 upstream of the simulation, as well as the control data set 26 throughout the simulation of the aircraft flight.

[0085] Preferably, acquisition step 100 is implemented once during the acquisition of flight plan 24, and repeated each time the simulation bench user 10 inputs flight control commands for the aircraft flight simulation. Then, during a calculation step 110, the calculation module 18 calculates the flight data set D and the target trajectory T, relative to the flight plan 24 received during acquisition step 100.

[0086] Advantageously, calculation step 110 is implemented once after acquisition of flight plan 24, in particular to calculate target trajectory T, and reiterated according to a predetermined repetition period, during the simulation of the aircraft flight, in order to calculate in real time the flight data set D.

[0087] During a determination step 120, the determination unit 27 determines the control signal 30 from the flight data set D and the target trajectory T calculated during the calculation step 110, and from the control data set 26 received during the acquisition step 100.

[0088] During a recording step 130, the optronic sensor 32 records the actual video stream FR, according to the pan angle, tilt angle and magnification included in the control signal 30 determined during the determination step 120, as well as according to the flight data set D calculated during the calculation step 110.

[0089] Finally, during a processing step 140, the processing unit 29 determines the simulated video stream Fs which is displayed on the first display 14, by replacing the images included in the real video stream FR with images included in the database 28, and relating to the flight data set D calculated during the calculation step 110, as well as to the control signal 30 determined during the determination step 120.

[0090] Thanks to this operation, the simulation bench 10 is configured to calculate on the one hand the flight data set D in real time, as they would be during a real flight of the aircraft, and on the other hand to simulate images of what the environment of the aircraft would be, if the aircraft followed the flight plan 24 loaded upstream by the user of the simulation bench 10.

[0091] Furthermore, the integration of the optronic sensor 32 into the simulation bench 10 allows the user to control the visual rendering of the aircraft environment, in the same way as they would during an actual flight of the aircraft.

[0092] Furthermore, this advantage translates into improved user training in aircraft control, which will ultimately allow for safer aircraft piloting during actual flight.

[0093] It is also worth noting that the operation of the simulation bench 10 is advantageous when preparing a field mission, such as an observation mission. Indeed, the simulation bench 10 provides the user with a realistic simulation environment, allowing them, for example, to control the drone's trajectory and modify it if necessary.

Claims

DEMANDS 1. Optronic simulation bench (10) suitable for performing a simulation of an aircraft flight on a first display (14) and comprising: an acquisition module (16) configured to receive a flight plan (24) before the simulation and a set of control data (26) during the simulation; a computing module (18) configured to calculate a set of flight data (D) of the aircraft and a target trajectory (T) of the flight, from the flight plan (24) a simulation module (20) configured to receive the control data set (26), the flight data set (D) and the target trajectory (T), and to determine a control signal (30); and a video module (22) comprising an optronic sensor (32) configured to emit a real video stream (FR) from the flight data set (D) and the control signal (30); the simulation module (20) being configured to determine a simulated video stream (Fs) using a database (28) comprising images relating to the target trajectory (T), from the control data set (26), the flight data set (D), the target trajectory (T) and the actual video stream (FR), and to display this simulated video stream (Fs) on the first display (14).

2. Simulation bench (10) according to claim 1, wherein the flight data set (D) comprises at least one flight data selected from the group comprising: an aircraft position, an aircraft speed and an aircraft heading.

3. Simulation bench (10) according to claim 1 or 2, wherein the control data set (26) includes user-entered pilot commands.

4. Simulation bench (10) according to any one of the preceding claims, wherein the control signal (30) includes a pan angle, a tilt angle and an optronic sensor magnification.

5. Simulation bench (10) according to any one of the preceding claims, wherein the optronic sensor (32) is a two-axis gyrostabilized turret camera.

6. Simulation bench (10) according to any one of the preceding claims, wherein the computing module (18) is configured to periodically calculate the aircraft flight data set (D).

7. Simulation bench (10) according to any one of the preceding claims, wherein the actual video stream (FR) comprises a set of images captured by the optronic sensor (32) in an optronic sensor environment.

8. Simulation bench (10) according to any one of the preceding claims, wherein the computing module (18) is adapted to be connected to a second display (12) and to display the received flight plan (24), the flight data set (D) and the target trajectory (T) of the flight on the second display (12).

9. Simulation bench (10) according to any one of the preceding claims, wherein the database (28) is an image bank connected to the simulation module (20), comprising a set of images of a plurality of predefined environments, and including in particular the images relating to the target trajectory.

10. Simulation bench (10) according to any one of the preceding claims, wherein the aircraft is a drone.

11. A method for simulating the flight of an aircraft, implemented by an optronic simulation bench (10) according to any one of the preceding claims, the method comprising the following steps: acquisition (100) of a flight plan (24) before the simulation and of a set of control data (26) during the simulation; calculation (110) of a set of flight data (D) of the aircraft and a target trajectory (T) of the flight, from the flight plan (24) received; determination (120) of a control signal (30) from the control data set (26), the flight data set (D) and the target trajectory (T); recording (130) of a real video stream (FR) from the flight data set (D) and the determined control signal (30); the method further comprising a processing step (140), in which a simulated video stream (Fs) is determined using a database (28) comprising images relating to the target trajectory (T), from the control data set (26), the flight data set (D), the target trajectory (T) and the real video stream (FR), and in which the simulated video stream (Fs) is displayed on the first display (14).

Images