METHOD FOR CAPTURING AND TRANSMITTING A VIDEO ENHANCED WITH AT LEAST ONE CONTEXT INFORMATION AND DEVICE FOR IMPLEMENTING THEM

Description

[0001] The present application relates to a method for acquiring and broadcasting a video enriched with at least one piece of contextual information as well as to a device for its implementation. According to one application, this video is intended for airplane passengers to provide in-flight entertainment.

[0002] Document FR3034899 describes a method and a device for allowing the occupants of an aircraft to view the aircraft's external environment. According to this document, the device comprises several cameras, positioned on the external wall of the aircraft, a central server configured to receive avionics navigation data from the aircraft's avionics systems and video signals from the cameras, as well as screens positioned in the aircraft's passenger cabin configured to receive video signals from the central server. For each camera, the video is transmitted to the central server. At the central server, the avionics navigation data is then embedded in the video. The video enriched with the avionics navigation data is transmitted to the screens. At each screen, each passenger can view the viewing angle they want by choosing the video from one or other of the cameras.

[0003] Cameras that include a geolocation module and that embed geolocation data in the video before transmitting it are also known from the prior art.

[0004] This embodiment is not fully satisfactory for the following reasons: Generally, each camera is positioned in a dome attached to the external wall of the fuselage. The presence of these domes, projecting from the fuselage, tends to impact the aerodynamic performance of the aircraft. The information used to enrich the videos comes from the aircraft's avionics equipment, which can be problematic in terms of safety. Potential stages of video compression and decompression generate latency issues that cause a significant time lag between the times of video acquisition and viewing, making the device incompatible with real-time applications.

[0005] The present invention aims to remedy all or part of the drawbacks of the prior art.

[0006] To this end, the invention relates to an acquisition and visualization method according to claim 1.

[0007] Embedding contextual information before any compression of the video acquired by the acquisition system solves latency problems. Another feature is that the contextual information is provided by the acquisition system and not by one of the aircraft's avionics systems, which allows for segregation between the data used for passenger entertainment and that used for the aircraft's flight.

[0008] The invention also relates to an aircraft according to claim 2.

[0009] Other characteristics and advantages will emerge from the description of the invention which follows, a description given by way of example only, with reference to the appended drawings, among which: There figure 1 is a side view of an airplane illustrating one embodiment of the invention, The figure 2 is a schematic representation of a screen, The figure 3 is a schematic representation of a device for acquiring and viewing a video enriched with at least one piece of contextual information which illustrates an embodiment of the invention, and The figure 4 is a schematic representation of an acquisition system that illustrates one embodiment of the invention.

[0010] On the figure 1 , we have represented an airplane 10 comprising: a fuselage 12 which extends between a front point 12.1 and a rear point 12.2, a wing 14 positioned on either side of the fuselage 12, a tailplane 16 positioned at the rear point 12.2 of the fuselage 12, and several nacelles 18 inside each of which is positioned an engine connected by a mast to the wing 14.

[0011] The fuselage 12, the wing 14, the empennage 16, the nacelles 18, the masts comprise an external wall 19 (visible on the figure 4 ), also called skin, which forms the aerodynamic surface of the aircraft 10.

[0012] The interior of the fuselage is divided into several zones which include, above a mid-floor, a pilot cabin 20 (or cockpit) positioned at the level of the forward tip 12.1, a passenger cabin 22 positioned at the rear of the pilot cabin 20 and, below the mid-floor, an avionics bay 24 positioned at the level of the forward tip 12.1 as well as a baggage bay 26 positioned at the rear of the avionics bay 24.

[0013] For the purposes of this application, a video means a stream of images that may be limited to a single image.

[0014] The aircraft 10 is equipped with a device for acquiring and viewing at least one video enriched with at least one piece of contextual information which comprises at least one screen 28 configured to receive at least one video signal, decompress it if necessary and view it. According to one configuration, the screen 28 is configured to receive several video signals. The screen 28 comprises a system for decompressing the received video signals and at least one control for enabling the video signals to be selected and the display mode of the video(s) to be modified.

[0015] The device for acquiring and viewing at least one video enriched with at least one piece of contextual information 29 generally comprises several screens 28, each being positioned in front of each passenger and connected by a wired or wireless link to an entertainment server 30.

[0016] According to one configuration, the device for acquiring and viewing at least one video enriched with at least one piece of contextual information 29 uses the in-flight entertainment (IFE) system already present in the majority of aircraft to view the video(s). Consequently, the screens 28 and the entertainment server 30 are not further described because they are known to those skilled in the art. Furthermore, the invention is not limited to a screen attached to a passenger seat. Thus, a screen present in an augmented reality headset or that of a smartphone, a tablet or any other portable device could be used.

[0017] The device for acquiring and viewing at least one video enriched with at least one piece of contextual information 29 also comprises at least one system 32 for acquiring at least one video, positioned at the external wall 19 of the aircraft 10.

[0018] According to an embodiment illustrated in the figure 4 , each acquisition system 32 comprises a camera 34 configured to generate a native video signal 36 (uncompressed), a geolocation module 38 configured to generate a geolocation signal 40 comprising at least one geolocation data item and an image processing module 42 configured to receive the native video signal 36 and the geolocation signal 40, mix the native video signals 36 and geolocation signals 40 so as to obtain an enriched video signal 44 with at least one contextual information item and compress this enriched video signal 44 so as to transmit it to the entertainment server 30.

[0019] The geolocation module 38 can be configured to transmit other information in addition to the geolocation data, such as for example speed, altitude, time, etc. The geolocation module 38 comprises an antenna T38. The geolocation module 38 is not described further because it is known to those skilled in the art.

[0020] The image processing module 42 may include other functionalities. For example, it may integrate a calculator to determine, from the data contained in the geolocation signal, other data such as, for example, the speed from the geolocation points and the time contained in the geolocation signal 40.

[0021] The image processing module 42 may also include a recorder for storing at least one video or data in a memory.

[0022] According to one embodiment, the image processing module 42 is in the form of a microprocessor.

[0023] Contextual information is not limited to geolocation data. Thus, contextual information may be text 29, graphics 29', an image and / or a video related to a point of interest (POI), a characteristic of a point of interest, data relating to the scene filmed by the camera 34 or to the flight of the aircraft 10.

[0024] Whatever its nature and form, contextual information is data that evolves according to the movement of the aircraft 10.

[0025] According to one configuration, the acquisition system 32 comprises at least one memory 46, connected to the image processing module 42, configured to store at least one piece of contextual information and / or a communication module 48, connected to the image processing module 42, configured to download at least one piece of contextual information.

[0026] According to one embodiment, the memory 46 is configured to store a database relating to points of interest likely to be filmed by the camera(s) 34. According to one application, for each flight, a database relating to points of interest likely to be filmed by the camera(s) 34 is downloaded into the memory 46.

[0027] According to one embodiment, the communication module 48 is a 4G / 5G communication module configured to download, when the aircraft is within range of a 4G / 5G terrestrial communication relay, a database relating to points of interest likely to be filmed by the camera(s) 34. The communication module 48 comprises an antenna T48.

[0028] According to one embodiment, the acquisition system 32 comprises at least one microelectromechanical system sensor 49 of the Mems type such as a gyroscopic, an accelerometer, a magnetic sensor and / or other, configured to transmit contextual information to the image processing module 42. Such a microelectromechanical system sensor 49 of the Mems type makes it possible to adjust the contextual information on the video according to the orientation of the aircraft 10.

[0029] Whatever the embodiment, the acquisition system 32 comprises a module for providing at least one piece of contextual information (the geolocation module 38, the memory 46, the communication module 48, the microelectromechanical system sensor 49 of the Mems type), positioned near the camera 34 c, 6 before compressing it to transmit it to a display screen 24. According to another advantage, this arrangement makes it possible to obtain a segregation of the data between the avionics data of the aircraft 10 used for the flight of the aircraft and the contextual information used for the entertainment of the passengers.

[0030] The acquisition system 32 may include other elements such as for example a power supply 50, a thermal regulation system, etc.

[0031] Structurally, the acquisition system 32 has a hollow body 52, for example cylindrical, containing the camera 34, the geolocation module 38, the image processing module 42, the memory 46, the communication module 48, the power supply 50 as well as a front plate 54, secured to one end of the body 52, comprising a peripheral edge forming a collar all around the body 52. ​​According to one method of implementation, the external wall 19 of the aircraft comprises an orifice 56 adjusted to the section of the body 52, the front plate 54 being pressed against the external face of the external wall 19.

[0032] Given the compactness of the acquisition system 32, the orifice 56 is small enough to be positioned between stiffeners of the external wall 19. Thus, it is not necessary to modify the structure of the aircraft to secure the acquisition system 32 to the external wall 19. According to one embodiment, the acquisition system 32 is fixed to the external wall 19 by means of fasteners 58 passing through the front plate 54 and the external wall 19. Other means could be envisaged for securing the acquisition system to the external wall 19. The front plate 54 is thin enough to limit the impact on the aerodynamic performance of the aircraft.

[0033] The front plate 54 comprises an opening 60 closed by an optic 62 positioned to the right of the camera 34. The optic 62 has a thickness less than that of the front plate 54 to limit the risks of damage to the optic 62. According to one configuration, the front plate 54 has a ring shape.

[0034] According to another characteristic, at least one antenna T38, T48 of the geolocation module 38 and / or of the communication module 48 is positioned outside the external wall 19 of the aircraft 10, integrated in the front plate 54. According to one embodiment, the two antennas T38, T48 of the geolocation module 38 and of the communication module 48 are integrated in the front plate 54 of the acquisition system 32, on the periphery of the opening 60 provided for the optics 62. This solution makes it possible to optimize the reception of the signals. According to this configuration, the ring shape allows the integration of the antennas T38, T48 of the geolocation module 38 and of the communication module 48 outside the external wall 19 of the aircraft, ensures the protection of the optics 62 and the fixing of the acquisition system 32. Its low thickness makes it possible to limit the impact on the aerodynamic performance of the aircraft 10.

[0035] According to another characteristic of the invention, the method for acquiring and viewing at least one video enriched with at least one piece of contextual information comprises: a step of acquiring a video by at least one acquisition system 32 so as to generate a native video signal 36, a step of providing at least one piece of contextual information by the acquisition system 32, a step of embedding the contextual information in the video carried out before any step of compressing the native video signal 36 so as to obtain an enriched video, a step of compressing the enriched video so as to generate an enriched video signal, a step of transmitting the enriched video signal to at least one screen 24, and a step of viewing the enriched video on the screen 24.

[0036] Carrying out the embedding step before any video signal compression step makes it possible to minimize the encoding latency and to be able to use the device for acquiring and viewing at least one video enriched with at least one piece of contextual information in real-time applications.

[0037] In the case of acquiring a video of a point of interest, the information relating to the point of interest is embedded in the video when the point of interest appears and is no longer embedded when the point of interest disappears from the video. Thus, the step of embedding at least one piece of contextual information relating to a point of interest is synchronized with the presence of the point of interest in the video. This embedding step is carried out by the image processing module 42.

[0038] According to another characteristic of the invention, the device for acquiring and viewing at least one video enriched with at least one piece of contextual information comprises a network of acquisition systems 32 distributed over the external wall 19 of the aircraft. According to a configuration visible on the figure 1 , a first acquisition system 32.1 is positioned on the upper part of the front tip 12.1 of the fuselage 12, a second acquisition system 32.2 is positioned on the top part of the empennage 16, a third acquisition system 32.3 is positioned under the front tip 12.1 of the fuselage 12, a fourth acquisition system 32.4 is positioned under the rear tip 12.2 of the fuselage and a fifth acquisition system 32.5 is positioned under the wing 14. Of course, the invention is not limited to this configuration. The acquisition systems are positioned according to the desired shots and to limit the loss for all the acquisition systems of the geolocation signals emitted by geolocation satellites simultaneously.

[0039] According to another advantage, providing several acquisition systems each equipped with a communication module 48 makes it possible to expand the bandwidth to obtain a higher download rate. Thus, the different communication modules 48 of the different acquisition systems 32 can be used to ensure a connection to the Internet as long as the aircraft remains within range of a terrestrial communication relay.

[0040] According to another characteristic of the invention visible on the figure 3, the device for acquiring and viewing at least one video enriched with at least one piece of contextual information comprises a network switch 64 to which the various acquisition systems 32 are connected and an entertainment server 30 to which the various screens 28 are connected. This network switch 64 makes it possible to return the various enriched video signals 44, coming from the various acquisition systems 32 to the entertainment server 30. Thus, each passenger can select one of the enriched video signals in order to view the view that interests them. According to the invention, the network switch 64 allows the acquisition systems 32 to exchange their contextual information.Thus, if a first acquisition system loses the geolocation signals from the geolocation satellites or no longer picks up the signals from a terrestrial telecommunications network, the missing data can be provided by a second acquisition system to the image processing module of the first acquisition system to enable it to embed them in the video acquired by the camera of the first acquisition system.

[0041] Thus, the method for acquiring and viewing at least one video enriched with at least one piece of contextual information comprises a step of exchanging between the acquisition systems 32 the contextual information acquired by each of them using the network switch 64.

[0042] According to one configuration, the network switch 64 is powered by an aircraft power supply 66 and connected to each of the acquisition systems 32 by a network cable 68.

[0043] According to one embodiment, the network switch 64 is of the POE (Power on Ethernet) type and each network cable 68 is used not only to carry the enhanced video signals or any other signal but also to power the various acquisition systems 32. According to this embodiment, the network switch 64 comprises a system 70 for regulating the power supply making it possible to supply the various acquisition systems 32 with regulated electrical energy. Thus, this embodiment makes it possible to simplify the power supply of the various acquisition systems and to maintain the power supply of the acquisition systems 32 during micro-cuts in the aircraft power supply in order to guarantee optimal operation of the acquisition systems 32 and to protect their electronic components.

Claims

1. Method for acquiring and displaying at least one video enriched with at least one piece of contextual information (29), said method comprising a step of acquiring a video by means of one acquisition system (32) among a network of acquisition systems (32) distributed over an external wall (19) of an aeroplane (10), so as to generate a native video signal (36), the method comprising: - a step of delivering at least one piece of contextual information (29) by means of a module for delivering at least one piece of contextual information of the acquisition system (32), or, if the module for delivering at least one piece of contextual information of the acquisition system (32) loses geolocation signals from geolocation satellites or no longer picks up signals from a terrestrial telecommunication network, by means of the module for delivering at least one piece of contextual information of another acquisition system of the network of acquisition systems through a step of exchanging, between the acquisition systems of the network, pieces of contextual information acquired by each thereof, - a step of embedding the contextual information into the video, before any compressing step, so as to obtain an enriched video, - a step of compressing the enriched video so as to generate an enriched video signal (44), - a step of transmitting the enriched video signal to at least one screen (28), and - a step of displaying the enriched video on the screen (28).

2. Aircraft comprising at least one device for acquiring and displaying at least one video enriched with at least one piece of contextual information, said device comprising a network of acquisition systems (32) distributed over an external wall (19) of the aircraft, each acquisition system (32) comprising at least one camera (34) configured to generate a native video signal (36), and at least one screen (28) configured to receive an enriched video signal and to display it, each acquisition system (32) comprising one module for delivering at least one piece of contextual information, said module being positioned in proximity to the camera (34), and an image-processing module (42) configured to receive the native video signal (36) and the piece of contextual information, to mix them so as to obtain a video signal (44) enriched with at least one piece of contextual information and to compress this enriched video signal (44) so as to transmit it to at least one screen (28), the device also comprising a network switch (64) to which the various acquisition systems (32) are connected, allowing the acquisition systems (32) to exchange their pieces of contextual information so that if the module for delivering at least one piece of contextual information of a first acquisition system loses geolocation signals from geolocation satellites or no longer picks up signals from a terrestrial telecommunication network, the missing data may be delivered by a second acquisition system.

3. Aircraft according to the preceding claim, characterized in that the network switch (64) comprises a system (70) for regulating a power supply and in that the device comprises network cables (68) that connect the network switch (64) to each acquisition system (32) and that are configured to supply the various acquisition systems (32) with regulated electrical power.

4. Aircraft according to either of Claims 2 and 3, characterized in that each acquisition system (32) comprises a geolocation module (38) having an antenna (T38), and at least one memory (46) configured to store at least one piece of contextual information.

5. Aircraft according to one of Claims 2 to 4, characterized in that each acquisition system (32) comprises a communication module (48) having an antenna (T48), said module being configured to download at least one piece of contextual information.

6. Aircraft according to one of Claims 2 to 5, characterized in that each acquisition system (32) has a hollow body (52), containing the camera (34) and the image-processing module (42), and a front plate (54), which is securely fastened to one end of the body (52), and which comprises a peripheral edge forming a flange all the way around the body (52), and which is configured to be pressed against an exterior face of an external wall (19) of an aircraft, the front plate (54) comprising an aperture (60) that is obturated by an optical system (62) positioned facing the camera (34).

7. Aircraft according to the preceding claim, characterized in that at least one antenna (T38, T48) of a geolocation module (38) and / or a communication module (48) is integrated into the front plate (54) of the acquisition system (32), on the periphery of the aperture (60) provided for the optical system (62).