Method and device for assisting in visualizing the environment of an aircraft

Abstract

A method (100) for assisting in visualizing the environment of an aircraft, the method comprising the following steps: receiving (400) images acquired by cameras located at a distance from the aircraft, the images showing the environment of the aircraft; generating (402) a stereoscopic image of the environment from the acquired images; transmitting (404) the stereoscopic image to a stereoscopic display device carried by a user located on board the aircraft. Figure for abstract: Fig. 2

Description

Title of the invention: Method and device for assisting in visualizing the environment of an aircraft FIELD OF THE INVENTION

[0001] The present invention relates to a method and a device for assisting in visualizing the environment of an aircraft. STATE OF THE ART

[0002] In certain situations, some aircraft on the ground need to be moved backward. Most aircraft are pushed or pulled backward by an external tractor.

[0003] Some aircraft are equipped with an electric motor allowing them to move in reverse, without needing to be assisted by an external tractor. In this case, the maneuver is controlled by the pilot of the aircraft. However, the pilot may lack visibility in this maneuver, because the pilot is in the cockpit of the aircraft, located at the front of the aircraft.

[0004] A known solution to help the pilot in his maneuver consists of adding a reversing camera to the aircraft. Statement of the invention

[0005] An object of the invention is to provide improved assistance in visualizing the environment of an aircraft.

[0006] To this end, a method is proposed for assisting in visualizing the environment of an aircraft, the method comprising the following steps: - reception of images acquired by cameras located at a distance from the aircraft, the images showing the aircraft's environment, - generation of a stereoscopic image of the environment from the acquired images, - transmission of the stereoscopic image to a stereoscopic display device carried by a user located on board the aircraft.

[0007] The visualization assistance method may also include the following features, taken alone or combined with each other whenever technically possible.

[0008] Preferably, the reception of the acquired images and / or the transmission of the stereoscopic image is carried out by 5G type wireless communication.

[0009] Preferably, at least one of the cameras is carried by a drone.

[0010] Preferably, at least one of the cameras is a ground camera located in a airport.

[0011] Preferably, at least one of the cameras is powered by a sensor solar.

[0012] Previously, the steps of the method are implemented while the aircraft is rolling in reverse.

[0013] Preferably, the user is a pilot of the aircraft.

[0014] There is also provided a device for assisting in visualizing the environment of an aircraft, the device comprising: - a receiving interface configured to receive images acquired by cameras located remotely from the aircraft, the images showing the environment of the aircraft, - a processing unit configured to generate a stereoscopic image of the environment from the acquired images, - a transmission interface configured to transmit the stereoscopic image to a stereoscopic display device suitable for being worn by a user located on board the aircraft.

[0015] Further provided is a system comprising: - the visualization aid device mentioned above, - a stereoscopic display device configured to receive the stereoscopic image transmitted by the transmission interface.

[0016] Preferably, this system further comprises a drone, the drone comprising a camera and a transmission interface configured to transmit an image acquired by the camera to the viewing aid device. DESCRIPTION OF FIGURES

[0017] Other characteristics, aims and advantages of the invention will emerge from the following description, which is purely illustrative and non-limiting, and which must be read in conjunction with the appended drawings in which:

[0018] [Fig.l] schematically illustrates a system according to one embodiment.

[0019] [Fig.2] is a flowchart of steps of a visualization assistance method according to one embodiment.

[0020] Throughout the figures, similar elements bear identical references. DETAILED DESCRIPTION OF THE INVENTION

[0021] Referring to [Fig.l], a surveillance system 1 comprises cameras 2, a viewing aid device 4, and a stereoscopic display device 6.

[0022] At least one of the cameras 2 is located on the ground, in an airport. At least one of the cameras 2 is typically located outside on a tarmac, so as to view an aircraft taxiing area.

[0023] At least one other camera 2 is carried by a drone 3.

[0024] The cameras 2 are located at different locations, and can observe different or identical areas. In particular, two cameras 2 can observe the same object from two different points of view.

[0025] Each camera 2 comprises a geolocation module configured to generate data indicative of a position and an orientation of the camera 2 in space.

[0026] Each camera 2 further comprises a transmission interface 12 configured to allow the transmission of an image acquired by the camera 2 to the viewing assistance device.

[0027] The visualization aid device 4 comprises a reception interface 8, an image processing unit 10 and a transmission interface 12 and a memory 14.

[0028] The receiving interface 8 is configured to receive data from the cameras 2. The receiving interface 8 is of any type, wired or wireless. For example, the cameras 2 and the receiving interface 8 communicate according to a wireless radio protocol, preferably 5G, which has the advantage of offering a high transmission rate.

[0029] The image processing unit 10 is configured to generate a stereoscopic image from the images acquired by the cameras 2.

[0030] The processing unit 10 typically comprises one or more processors configured to execute an image processing program.

[0031] The transmission interface 12 is configured to enable the transmission of such a stereoscopic image to the stereoscopic display device 6. The transmission interface 12 is of any type, wired or wireless. For example, the transmission interface 12 and the stereoscopic display device 6 communicate according to a wireless radio protocol, preferably 5G.

[0032] In particular, the reception interface 8 and the transmission interface 12 may be a single communication interface adapted to communicate both with the cameras 2 and with the stereoscopic display device 6.

[0033] The memory 14 is adapted to store data received via the reception interface 8 or produced by the processing unit. The memory 14 is of any type.

[0034] The stereoscopic display device 6 comprises an interface 8 for receiving images emitted by the viewing aid device, two display screens, and means for positioning the two display screens in view of a user's eyes.

[0035] The two display screens are configured to respectively display a left view and a right view of the stereoscopic image.

[0036] The positioning means may comprise spectacle arms or a fastening band. The stereoscopic display device 6 is in this case a pair of stereoscopic spectacles. Alternatively, the positioning means comprise a headset suitable for being placed on the user's head. The stereoscopic display device 6 is then a stereoscopic headset.

[0037] The stereoscopic display device 6 further comprises a geolocation module configured to generate data indicative of a position and an orientation of the stereoscopic display device 6 in space.

[0038] A conventional aircraft A is shown schematically in [Fig.l]. The aircraft A comprises wheels R and an electric motor M adapted to roll the wheels on the ground (according to the principle of "green taxiing"). The aircraft A further comprises a cockpit C, and taxiing controls P accessible from the cockpit C. The flight controls P allow in particular a pilot of the aircraft A to command a taxi of the aircraft A in forward or reverse gear.

[0039] Now suppose that a pilot is in cockpit C and has instructions to move aircraft A by taxiing. However, the pilot may lack visibility, especially if he has to reverse.

[0040] To assist the pilot in visualizing the environment of the aircraft A, in particular in this context of ground maneuvering of the aircraft A, a method 100 using the system 1 described previously comprises the following steps with reference to [Fig.2],

[0041] It is assumed that in a preliminary step the cameras 2 have been arranged in the airport where the aircraft A is located, at different locations, as indicated previously. Furthermore, the or each drone 3 is controlled so as to fly over the airport also monitored by the or each camera 2 on the ground.

[0042] The pilot places the stereoscopic display device 6 on his head, so that the two display screens of this device are in view of the pilot's eyes.

[0043] The cameras 2 of the system acquire images of the environment of the aircraft A, for example an area of ​​tarmac located at the rear of the aircraft A.

[0044] The cameras 2 transmit these images to the viewing aid device via the reception interface 8.

[0045] The cameras 2 also transmit the geolocation data produced by their respective geolocation modules.

[0046] In the case of a fixed camera 2, the geolocation data can be transmitted once.

[0047] In the case of a camera 2 carried by a drone 3, the geolocation data are transmitted repeatedly over time. In addition, each drone 3 transmits an image acquired by the camera 2 that it carries in association with current geolocation data indicating the position and orientation of the camera 2 during the acquisition of the image.

[0048] The images and geolocation data received via the reception interface 8 are stored in memory 14.

[0049] Furthermore, the viewing assistance device 4 receives a viewing assistance request from the pilot. For example, this request is sent by the stereoscopic display device 6 that he is wearing.

[0050] The stereoscopic display device 6 also transmits geolocation data generated by the geolocation module that it integrates. The geolocation data indicates a position and possibly an orientation of the display device.

[0051] Furthermore, the stereoscopic display device 6 transmits to the visualization aid device data indicating a direction of interest to be visualized. In the case where the pilot seeks to reverse the aircraft A, this direction is a direction towards the rear of the aircraft A.

[0052] The data emanating from the stereoscopic display device 6 are received by the interface 12 and stored in the memory 14.

[0053] From the geolocation data provided by the stereoscopic display device 6 and by the cameras 2, the processing unit 10 identifies images acquired by the cameras 2 which show an area of ​​interest of the environment of the aircraft A. This area of ​​interest is an area that the pilot could observe from his position in the cockpit in the direction of interest, if by chance the aircraft A did not constitute a visual obstacle.

[0054] The processing unit 10 applies image processing generating a stereoscopic image from the identified images. The stereoscopic image shows the area of ​​interest. The stereoscopic image comprises two images: a left image and a right image.

[0055] The stereoscopic image is stored in memory 14.

[0056] The stereoscopic image is transmitted to the stereoscopic display device 6 by the viewing aid device, via the transmission interface 12.

[0057] The stereoscopic image is then displayed by the two display screens. More specifically, the left image of the stereoscopic image is displayed by one of the two display screens, and the right image of the stereoscopic image is displayed by the other display screen.

[0058] The preceding steps are repeated over time, so that a succession of stereoscopic images forming a video is presented to the pilot by the stereoscopic display device.

[0059] Thus, the pilot can observe the tarmac area located behind aircraft A, which helps him in his maneuver.

Claims

Claims

1. A method (100) for assisting in visualizing the environment of an aircraft, the method comprising the following steps: - receiving (400) images acquired by cameras located at a distance from the aircraft, the images showing the environment of the aircraft, in which at least one of the cameras is powered by a solar sensor, - generating (402) a stereoscopic image of the environment from the acquired images, - transmitting (404) the stereoscopic image to a stereoscopic display device carried by a user located on board the aircraft.

2. The method of claim 1, wherein the reception of the acquired images and / or the transmission of the stereoscopic image is carried out by 5G type wireless communication.

3. Method according to one of the preceding claims, in which at least one of the cameras is carried by a drone.

4. Method according to one of the preceding claims, in which at least one of the cameras is a ground camera located in an airport.

5. Method according to one of the preceding claims, implemented while the aircraft is rolling in reverse.

6. Method according to one of the preceding claims, in which the user is a pilot of the aircraft.

7. System (1) comprising a device (4) for assisting in viewing the environment of an aircraft and cameras suitable for being located at a distance from the aircraft, in which at least one of the cameras is configured to be powered by a solar sensor, the device (4) comprising: - a reception interface (8) configured to receive images acquired by the cameras located at a distance from the aircraft, the images showing the environment of the aircraft, - a processing unit (10) configured to generate a stereoscopic image of the environment from the acquired images, - a transmission interface (12) configured to transmit the stereoscopic image to a stereoscopic display device (6) suitable for being worn by a user located on board the aircraft.

8. System (1) according to the preceding claim, further a device

9. stereoscopic display (6) configured to receive the stereoscopic image transmitted by the transmission interface (12). System (1) according to the preceding claim, further comprising a drone (3), the drone (3) comprising a camera (2) and a transmission interface configured to transmit an image acquired by the camera (2) to the viewing aid device (4).

Images