Method and system for piloting assistance in an aircraft by means of adaptive display on a screen

The adaptive display system in the aircraft cockpit ensures relevant flight information is consistently visible and easily identifiable by aligning it with the pilot's gaze, addressing the challenge of information overload and improving response times.

FR3098900B1Active Publication Date: 2024-11-15EUROCOPTER FRANCE SA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
FR2019007975
Authority / Receiving Office
FR · FR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2019-07-15
Publication Date
2024-11-15
Estimated Expiration
2039-07-15

AI Technical Summary

Technical Problem

Pilots face difficulty in quickly identifying relevant flight information among numerous pieces of data displayed on aircraft cockpit screens, leading to potential delays in response times during critical situations.

Method used

An adaptive display system that utilizes at least one screen in the aircraft cockpit to display information based on the pilot's head position and orientation, with secondary information being centered on the pilot's gaze and highlighted using distinct light characteristics to ensure it remains visible in the primary field of view, regardless of head movements.

Benefits of technology

Enhances the readability and visibility of critical flight information by positioning it in the pilot's primary field of vision, allowing for quicker and more efficient information processing during flight operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000027_0000
    Figure 00000027_0000
  • Figure 00000028_0000
    Figure 00000028_0000
  • Figure 00000029_0000
    Figure 00000029_0000
Patent Text Reader

Abstract

The present invention relates to a method for assisting the piloting of an aircraft (1) using a screen (5.5") on which an external landscape is visible. The method comprises a step (110) for detecting the position and orientation of the head (20) of a pilot of said aircraft (1), as well as steps (210, 220, 230) for determining the position of a geographic point (50) of said landscape visible on said screen (5.5") and the positions on said screen (5.5") of a first piece of information attached to said geographic point (50) and at least one second piece of information independent of said geographic point (50). The method also comprises two steps (310, 320) for generating a primary image (A1) containing at least one piece of information and a secondary image (A2) containing at least one second piece of information.The method finally comprises two display steps (410, 420) on said screen (5, 5') of said main image (A1) and said secondary image (A2), said secondary image (A2) being centered on said orientation of said head (20) of said pilot and moving according to the movements of said head (20). Abbreviated figure: figure 1.
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Method and system for assisting in piloting an aircraft by adaptive display on a screen

[0001] The present invention is in the field of assistance in piloting an aircraft, and in particular in the restricted field of assistance in piloting an aircraft by providing information on a screen fitted to an aircraft cockpit.

[0002] The present invention relates to a method and a system for assisting in piloting an aircraft by adaptive display using at least one screen of the aircraft, a landscape outside the aircraft being visible on the screen. This external landscape can be displayed on the screen or be visible through the screen which is then transparent or semi-transparent.

[0003] Different types of display systems may be available in the cockpit of an aircraft for the benefit of the pilot and / or co-pilot of the aircraft.

[0004] For the sake of simplification, hereinafter, the term “pilot” refers to both the pilot and the co-pilot and may be replaced by the term “co-pilot” at any time.

[0005] One or more screens are generally arranged on a dashboard, these screens allowing the display of flight information as well as possibly an image of the landscape outside the aircraft.

[0006] A display system may also comprise a glass surface of the cockpit onto which the required information is projected, the landscape outside the aircraft thus being visible to the pilot through this glass surface.

[0007] For example, document EP 2361832 describes a cockpit of an aircraft comprising transparent display extensions possibly formed by a part of the windshield of the aircraft. The transparency and opacity of these display extensions can be adjusted by zones, for example according to the brightness of the exterior landscape visible through the display extensions, in order to improve the visibility of the landscape and / or the information displayed in these zones.

[0008] A display system may also be a transparent or semi-transparent screen arranged in the cockpit of the aircraft. Such a transparent or semi-transparent screen displays the required information and allows the pilot to see the landscape outside the aircraft through this transparent or semi-transparent screen.

[0009] For example, document FR 3026196 describes a display system comprising a semi-transparent screen, image generation devices and a pair of glasses to manage a parallax error problem between the displayed images and the external landscape.

[0010] A so-called "head-up display" also designated by the acronym HUD for the de The English term "Head Up Display" may also be available in the cockpit of an aircraft. This head-up display may, for example, include a transparent screen or a transparent surface onto which information is projected.

[0011] Document FR 3016448 is known in particular, which describes a display system for an aircraft, in particular a head-up display, comprising an at least partially transparent display surface and a module for displaying information on the display surface. The information displayed allows the landscape outside the aircraft to be viewed through the display surface. The display module also allows the display of a pop-up window containing information and the opacity of which can be increased, in particular depending on the brightness of the outside landscape.

[0012] According to another example, document FR 3049072 describes a head-up display system comprising a transparent screen, an image projector and at least one sensor detecting the direction of gaze of the pilot of the aircraft. The direction of gaze of the pilot is determined by the technique of eye tracking. The projector takes this direction of gaze into account in order to shift, in particular laterally, the images displayed on the transparent screen, in particular in the presence of a strong side wind.

[0013] A display system can also be integrated into the pilot's helmet. Such a display system is often referred to by the acronym HMD for "Helmet Mounted Display" or HMSD for "Helmet Mounted Sight & Display". Such a display system may, for example, include a transparent screen or a transparent surface onto which information is projected.

[0014] Furthermore, document FR 3004817 describes a hybrid display system comprising a first display device, for example a screen, a second display device worn by a helmet of the pilot of the aircraft and a device for detecting the position and orientation of the helmet. This hybrid display system makes it possible to manage the superposition in the pilot's field of vision of the images displayed respectively on the first display device and on the second display device. Depending on the circumstances, the hybrid display system makes it possible to shift a single image or both images in order to allow simultaneous viewing of all the images. The hybrid display system can also remove one image from the superposition zone in order to prioritize viewing of the other image.

[0015] One of the advantages of a head-up display and / or a visualization system integrated into a helmet is in particular to put the most relevant information in front of the pilot's eyes at the right time, in the right place, regardless of where the pilot is looking and without this information bothering the pilot.

[0016] In addition, the prior art also includes the following documents.

[0017] Document FR 3013852 describes a method and a device for displaying head-up information with improved readability. This display device comprises a transparent screen. The color of the information displayed on the screen is modified according to the color of the external scene visible through the screen so as to improve the readability of this information.

[0018] Document EP 2482114 describes a head-up display system comprising a transparent screen which can be darkened in order to form a sun visor for the pilot of the aircraft.

[0019] The present invention therefore aims to propose a system for assisting in piloting an aircraft by adaptive display using a screen of the aircraft to facilitate the viewing by the pilot of the aircraft of necessary and relevant information.

[0020] The present invention relates to a method for assisting in piloting an aircraft using at least one screen of the aircraft, a landscape outside the aircraft being visible via this at least one screen.

[0021] The landscape outside the aircraft is then visible through the screen or an image representative of this landscape is displayed on said screen. This landscape outside the aircraft is preferably located at the front of the aircraft.

[0022] The pilot assistance method according to the invention can be applied to a single screen or simultaneously to at least two screens.

[0023] The method for assisting in piloting an aircraft using at least one screen according to the invention is remarkable in that it comprises the following steps:

[0024] - first detection of a position and an orientation of the head of a pilot of the aircraft in a local reference frame of the aircraft, - first determination of a position in the local reference frame of at least one geographical point of the landscape visible via said at least one screen, - second determination of the position on said at least one screen of at least one first piece of information attached to said at least one geographical point visible via said at least one screen, - third determination of the position on said at least one screen as a function of the position and orientation of the pilot's head with respect to said at least one screen of at least one second piece of information to be displayed in a field of vision of the pilot, - first development of a main image Al comprising at least one first piece of information attached to said at least one geographical point, - second development of a secondary image A2 comprising said at least a second piece of information, - first display of the main image A1 on said at least one screen, and - second display of the secondary image A2 on said at least one screen, the secondary image A2 being centered on the orientation of the pilot's head.

[0025] In this way, at least one second piece of information is displayed on said at least one screen taking into account the position and orientation of the head of the pilot of the aircraft so that said at least one second piece of information is positioned according to the orientation of the pilot's head and consequently in the pilot's primary field of vision. The pilot thus advantageously always has each second piece of information in his primary field of vision regardless of the position and orientation of his head, including when the pilot moves his head. The pilot can then quickly and efficiently become aware of each second piece of information. A second piece of information relates in particular to the flight conditions or the piloting of the aircraft, for example the altitude of the aircraft, its height, its attitude or even its speed.

[0026] The pilot's primary field of vision is, for example, defined by angles of + / -15° on either side of a horizontal plane and by angles of + / -15° on either side of a vertical plane.

[0027] Indeed, the main image A1 may include a large amount of information. The main image A1 may include one or more first pieces of information attached respectively to one or more geographical points of the exterior landscape visible via said at least one screen. The main image A1 may also include one or more third pieces of information displayed independently of the position and orientation of the pilot's head. A third piece of information may concern, for example, the flight of the aircraft and may be displayed at a generally fixed and predetermined position on each screen. A third piece of information may also concern the operating status of an element of the aircraft such as the status of a right engine of the aircraft displayed at the top right of a screen, the status of a landing gear of the aircraft displayed at the bottom center of a screen, the status of the main rotor displayed at the top center of a screen, etc.

[0028] The pilot of the aircraft may then have difficulty in identifying, among all the information displayed on a screen, the relevant information to be taken into account at a given moment. The present invention advantageously makes it possible to overcome this risk by positioning the relevant information constituted in particular by this at least one second information in the secondary image A2 permanently centered on the orientation of the pilot's head.

[0029] Furthermore, during the first display, the main image A1 is displayed with at least one first luminous characteristic and during the second display, the secondary image A2 is displayed with at least one second luminous characteristic. Advantageously, a second value of at least one second characteristic luminous characteristic of the secondary image A2 may be different from a first value of at least one first luminous characteristic of the main image A1 in order to differentiate the secondary image A2 from the main image A1 and to advantageously improve the visibility of the secondary image A2 from the main image A1 for the pilot. Thus, at least one second luminous characteristic of the secondary image A2 and / or at least one first luminous characteristic of the main image A1 are adapted respectively during the second display and during the first display in order to advantageously improve the visibility of the secondary image A2 from the main image A1.

[0030] In this way, the secondary image A2 and said at least one second piece of information that it comprises are easily discernible by said pilot with respect to the main image A1 and the other information displayed on the screen. The secondary image A2 may be independent of the main image A1. The secondary image A2 may however be considered as being part of the main image A1.

[0031] Consequently, this at least one second piece of information located in the secondary image A2 is highlighted for the pilot among the numerous pieces of information displayed on the main image A1 and its readability is in fact improved. The pilot can thus advantageously quickly and efficiently become aware of this at least one second piece of information.

[0032] A first luminous characteristic of the main image A1 and a second luminous characteristic of the secondary image A2 may be the luminance or the opacity.

[0033] For example, when the first light characteristic and the second light characteristic are the luminance and / or the opacity, during the second display, a second value of the second light characteristic of the secondary image A2 is greater than a first value of the first light characteristic of the main image AL. In particular, when the first and second light characteristics are the luminance, said at least one second piece of information located in the secondary image A2 then appears highlighted with respect to the other information visible on the main image AL.

[0034] Typically, a difference between the first luminous characteristic of the main image A1 and the second luminous characteristic of the secondary image A2 greater than 10% of the first luminous characteristic of the main image A1 is necessary for the secondary image A2 to be highlighted with respect to the main image A1. A difference of between 10% and 30% of this first luminous characteristic is generally sufficient for the secondary image A2 to be effectively and quickly perceptible by the pilot. Such a difference can for example be obtained either by an increase in the luminance of the secondary image A2, or by an increase mentation of the opacity of the main image Al creating a partial opacity thus reducing the brightness of this main image Al. These two actions can also be carried out in parallel.

[0035] A difference greater than 30% of this first luminous characteristic can also be used to increase the contrast between the main image A1 and the secondary image A2 and thus improve the highlighting of the secondary image A2 with respect to the main image A1.

[0036] Conversely, the first value of the first luminous characteristic of the main image A1 may also be greater than the second value of the second luminous characteristic of the secondary image A2. In this case, the main image A1 outside the area covered by the secondary image A2 is highlighted with respect to the secondary image A2. The main image A1 outside the area covered by the secondary image A2 may thus be brighter than the secondary image A2 in order, for example, to highlight information located outside the central area A2 such as an operational alarm, typically the presence of another aircraft in the nearby environment, and thereby to facilitate its perception by the pilot.

[0037] According to one aspect, the method according to the invention may comprise the following additional steps:

[0038] - measurement of a third value of at least one third luminous characteristic of the landscape visible via each screen, for example in the direction of the pilot's head, and - first adaptation of the second value of at least one second light characteristic of the secondary image A2 as a function of the third value of at least one third light characteristic of the landscape in order to improve the visibility of the secondary image A2 with respect to the landscape for the pilot.

[0039] This first adaptation of the second value of at least one second luminous characteristic of the secondary image A2 as a function of the third value of at least one third luminous characteristic of the landscape makes it possible to increase in particular the contrast between, on the one hand, the secondary image A2 and, on the other hand, the landscape visible via each screen, and consequently to improve the visibility of the secondary image A2. In this way, the readability of said at least one second information located in the secondary image A2 is advantageously improved again.

[0040] The method may also comprise an additional step of second adaptation of the first value of at least one first luminous characteristic of the main image Al as a function of the third value of at least one third luminous characteristic of the landscape in order to improve the visibility of the main image Al with respect to the landscape for the pilot.

[0041] For example, when a first luminous characteristic, a second luminous characteristic and a third luminous characteristic are the luminance, during the first adaptation, a value of the luminance of the secondary image A2 is greater than a value of the luminance of the landscape visible via each screen and / or during the second adaptation, a value of the luminance of the main image A1 is greater than a value of the luminance of the landscape visible via each screen.

[0042] Typically, a difference between the second value of the second light characteristic of the secondary image A2 and the third value of the third light characteristic of the landscape greater than 10% of the second value of the second light characteristic of the secondary image A2 is necessary for the secondary image A2 to be highlighted with respect to the landscape. Similarly, a difference between the first value of the first light characteristic of the main image A1 and the third value of the third light characteristic of the landscape greater than 10% of the first value of the first light characteristic of the main image A1 is necessary for the main image A1 to be highlighted with respect to the landscape.

[0043] Furthermore, when two first light characteristics, two second light characteristics are luminance and opacity and two third light characteristics are luminance and opacity, when a third value of a third luminance of the landscape is greater than a predetermined limit, during the first adaptation, a value of an opacity of the secondary image A2 is increased and / or during the second adaptation, a value of an opacity of the main image A1 is increased in order to improve the respective visibility by the pilot of the secondary image A2 and the main image A1 with respect to the landscape.

[0044] Furthermore, the secondary image A2 preferably has a first predetermined area smaller than a second area of ​​the main image A1. The secondary image A2 therefore has a limited area corresponding for example to a small solid angle starting from the pilot's head. The secondary image A2 is for example formed by a square corresponding to a solid angle of 20°x20° along an axis aligned with the orientation of the pilot's head and centered on this axis.

[0045] Furthermore, information considered important for piloting the aircraft may also be located on the main image A1, but outside the secondary image A2. Information is for example considered important if this information concerns an alarm or if this information is attached to a geographical point or if the position of this information on the main image A1 is not predictable by the pilot and the readability of which should be improved to aid its detection in the pilot's field of vision.

[0046] In order to improve the readability of such information considered important and to facilitate its consideration by the pilot, the method according to the invention may also include an additional step of third adaptation of a fourth luminous characteristic of at least one piece of information considered important when it is located outside the secondary image A2.

[0047] For example, when the fourth light characteristic is luminance, during this third adaptation, a value of the luminance of said at least one piece of information considered important is increased.

[0048] In addition, the third adaptation may take into account the third light characteristic. For example, when the third light characteristic and the fourth light characteristic are the luminance, during the third adaptation, a value of the luminance of said at least one piece of information considered to be important is greater than a value of the luminance of the landscape. Thus, the fourth light characteristic of said at least one piece of information considered to be important is advantageously adapted so as to improve its visibility for the pilot. Here again, said at least one piece of information considered to be important is thus advantageously more easily and quickly discernible from the image of the landscape by the pilot.

[0049] Furthermore, the second determination of the position on a screen of said at least one first piece of information can be carried out by taking into account the position of the pilot's head with respect to the screen as well as the position of said at least one geographical point with respect to the screen when this screen is at least partially transparent. Indeed, with an at least partially transparent screen, each geographical point is visible to the pilot through this screen and each first piece of information relating to a geographical point visible from the outside landscape is displayed on the screen so as to be aligned with the pilot's head and this geographical point.

[0050] In this way, each first piece of information is correctly positioned on the screen according to the position of the pilot's head.

[0051] According to one aspect, the method according to the invention may comprise the following additional steps:

[0052] - third detection of a direction of the pilot's gaze in the local reference frame, - fourth determination of a targeted area A3 of said at least one screen, the target area A3 being centered in the direction of the pilot's gaze, and - fourth adaptation of at least a fifth luminous characteristic of at least one piece of information displayed in a target area A3 of said at least one screen, the target area A3 being centered on the direction of the pilot's gaze in order to improve the visibility of the at least one piece of information displayed in the target area A3 for the pilot.

[0053] In this way, at least one piece of information located in the targeted area A3 centered on the pilot's gaze is advantageously highlighted by the fourth adaptation. of at least one fifth luminous characteristic of this at least one piece of information. Consequently, the readability of this at least one piece of information located in the targeted area A3 is improved by the pilot among the numerous pieces of information displayed on the image Al and the pilot thus advantageously becomes aware of it quickly and efficiently.

[0054] For example, the fifth luminous characteristic being the luminance or the opacity, during the fourth adaptation, a fifth value of the fifth luminous characteristic of said at least one piece of information displayed in the targeted zone A3 is increased.

[0055] The fourth adaptation of at least one fifth luminous characteristic of said at least one piece of information located in the targeted zone A3 can be applied only to said at least one piece of information, in particular when the fifth luminous characteristic is the luminance.

[0056] The fourth adaptation of at least one fifth luminous characteristic of said at least one piece of information located in the targeted zone A3 can also be applied to the targeted zone A3 in its entirety, in particular when the fifth luminous characteristic is opacity.

[0057] Furthermore, the fourth adaptation of at least one fifth luminous characteristic of said at least one piece of information located in the targeted zone A3 can be carried out substantially instantaneously, namely without waiting for the direction of the pilot's gaze to be fixed for a certain duration, the pilot for example sweeping his gaze over at least one part of a screen.

[0058] The fourth adaptation of at least a fifth luminous characteristic of said at least one piece of information located in the targeted zone A3 can also be carried out after a predetermined duration during which the direction of the pilot's gaze is substantially fixed with respect to the screen and is for example aligned with information. The predetermined duration is for example equal to one second.

[0059] Furthermore, the aircraft includes in particular:

[0060] - at least one screen, - a device for displaying information on said at least one screen, - a calculator, and - sensors.

[0061] The aircraft computer allows the execution of the steps of this pilot assistance method. The computer may for example comprise at least one processor, at least one integrated circuit, at least one programmable system, at least one logic circuit or any equivalent device, these examples not limiting the scope given to the expression "computer". The computer may also comprise a memory storing in particular instructions relating to the steps of the method.

[0062] A screen of the aircraft may be at least partially transparent. The landscape outside the aircraft is then visible to a pilot of the aircraft through the at least partially transparent screen and can then be seen by the pilot of the aircraft. The screen is for example a transparent or semi-transparent screen.

[0063] A screen can also be opaque, for example arranged on the dashboard of the aircraft. The method according to the invention then comprises an additional step of third display of an image A0 of the landscape outside the aircraft on the screen. In fact, the landscape outside the aircraft is also visible to a pilot of the aircraft using this opaque screen.

[0064] The aircraft then includes at least one camera for capturing images of this exterior landscape.

[0065] The method may then also comprise an additional step of fifth adaptation of a sixth value of at least one sixth luminous characteristic of the image A0 of the landscape in order to increase the contrast between, on the one hand, said secondary image A2 and, where appropriate, said at least one piece of information considered to be important displayed on the main image A1 outside the secondary image A2 and, on the other hand, the image A0 of the landscape.

[0066] In addition, a screen may have a curved shape. In this case, the second determination is made taking into account the curvature of the screen. Similarly, the third and fourth determinations are also made taking into account the curvature of the screen.

[0067] Furthermore, the information display device may project the information onto a screen or be integrated into the screen to enable the display of this information on the screen. The information display device may also enable the display of the image A0 of the landscape outside the aircraft on the screen when the screen is opaque.

[0068] The sensors comprise in particular a first set of sensors for detecting a position and an orientation of the head of a pilot of the aircraft in a local reference frame of the aircraft. The local reference frame of the aircraft is a reference frame attached to the aircraft, for example to the nose of the aircraft. A local reference frame of the aircraft may for example be formed by the roll, pitch and yaw directions of the aircraft.

[0069] The first set of sensors is intended to determine the position and orientation of the pilot's head relative to a local reference point of the aircraft. The sensors of this first set of sensors may be magnetic, optical and / or inertial. This first set of sensors may be known in English as "Head Tracker". This first set of sensors comprises, for example, one or more sensors positioned on the pilot's helmet and one or more fixed sensors secured to the cockpit of the aircraft.

[0070] The sensors may also include a device for detecting a position of at least at least one geographical point of the landscape visible on each screen. This detection device can make it possible to determine the position of this at least one geographical point directly in the local reference of the aircraft. This detection device includes, for example, a radar.

[0071] This detection device can also make it possible to determine the position of this at least one geographical point in the local reference frame of the aircraft by using its coordinates in a terrestrial reference frame. A transfer from the terrestrial reference frame to the local reference frame of the aircraft must then be carried out. For this purpose, the first determination comprises the following sub-steps:

[0072] - a third detection of a position in a terrestrial reference frame of at least one geographical point of the landscape and, - a transfer of the position of said at least one geographical point from the terrestrial reference point to the local reference point of the aircraft.

[0073] The position of this at least one geographical point in the terrestrial reference frame can for example be stored in a memory included in the aircraft's computer, typically in a database. The position of this at least one geographical point in a terrestrial reference frame can also be received by the aircraft for example by at least one radio wave.

[0074] The sensors may also comprise a second set of sensors for detecting a direction of gaze of the pilot of the aircraft in the local reference frame of the aircraft for carrying out the additional step of second detection of a direction of gaze of the pilot. This second set of sensors uses for example the technique of eye tracking in order to determine the direction of gaze of the pilot. This second set of sensors comprises for example one or more fixed sensors positioned in the cockpit of the aircraft and capturing the direction of gaze of the pilot. This second set of sensors may also be fixed to a device secured to the head of the pilot, such as his helmet for example.

[0075] The present invention also relates to a system for assisting in piloting an aircraft by adaptive display using at least one screen of the aircraft configured to implement the method described above. The assistance system comprises:

[0076] - at least one screen, a landscape being visible on each screen, - a device for displaying information on each screen, - a calculator, - a first set of sensors for detecting a position and an orientation of the head of a pilot of the aircraft in a local reference frame of the aircraft, and - a device for detecting the position of at least one geographical point in the landscape visible on each screen.

[0077] In addition, this pilot assistance system may also comprise a second set of sensors for detecting a direction of gaze of the pilot in the local reference frame of said aircraft for carrying out the additional step of second detection of a direction of gaze of the pilot.

[0078] The invention and its advantages will appear in more detail in the context of the description which follows with examples given for illustrative purposes with reference to the appended figures which represent:

[0079] - figure 1, an aircraft comprising a piloting assistance system by adaptive display using at least one screen, - figure 2, a screen and the information displayed and - figures 3 and 4, two block diagrams of a method of assisting the piloting of the aircraft by adaptive display.

[0080] Elements present in several distinct figures are assigned a single reference.

[0081] [fig. 1] The aircraft 1 shown in figure 1 comprises a fuselage 4, a main rotor 2, a tail rotor 3, an instrument panel 8 and a pilot assistance system 10 by adaptive display using at least one 5.5' screen. The example illustrated in figure 1 therefore concerns a rotorcraft, but the pilot assistance system 10 can be used by any type of aircraft.

[0082] The piloting assistance system 10 for an aircraft 1 by adaptive display using at least one screen 5.5' comprises at least one screen 5.5', a display device 6 for displaying information on each screen 5.5' according to FIG. 1, a computer 7, a first set of sensors 12, 13 for detecting a position and an orientation of the head 20 of a pilot of the aircraft 1 in a local reference frame of the aircraft 1 and a device 16 for detecting a position of at least one geographical point 50 of the landscape visible via a screen 5. The piloting assistance system 10 may also comprise a second set of sensors 14, 15 for detecting a direction of gaze of the pilot of the aircraft 1 in the local reference frame of the aircraft 1. The aircraft 1 may also comprise a camera 18 for capturing an image A0 of the landscape outside the aircraft 1 and located at the front of aircraft 1.

[0083] According to the example shown in Figure 1, a first screen 5 is positioned above the dashboard 8 and is at least partially transparent, the landscape outside the aircraft 1 being visible through this first screen 5. A second screen 5' is integrated into the dashboard 8 and is opaque. An image A0 of the landscape outside the aircraft 1 is displayed on this screen 5', for example via the information display device 6.

[0084] In this way, the pilot of aircraft 1 can see the landscape outside aircraft 1 using each of these two 5.5' screens.

[0085] However, a pilot assistance system 10 for an aircraft 1 according to the invention may comprise a single opaque, semi-transparent or transparent 5.5' screen.

[0086] The information display device 6 allows on the one hand the display of the image A0 of the landscape outside the aircraft 1 on the second opaque screen 5' and on the other hand the display on each of the two screens 5,5' of information, in particular information necessary for the flight of the aircraft 1.

[0087] [fig.2] Different types of information can be displayed by a device display 6 on each 5.5' screen, as shown in Figures 1 and 2.

[0088] For example, a first piece of information 21 is information attached to a geographical point 50 of the landscape outside the aircraft 1 and displayed only when the landscape visible via the screen 5.5' contains this geographical point. The first piece of information 21 indicates, for example, a landing zone for the aircraft 1 as shown in FIG. 2. A first piece of information may also indicate a waypoint of the trajectory to be followed or a particular point in the environment...

[0089] A second piece of information 22, 23, 24 may be information concerning, for example, the flight conditions or the piloting of the aircraft 1. A second piece of information 22 typically indicates the altitude of the aircraft 1, its height or even its speed... A second piece of information 23 may also indicate the attitude of the aircraft 1, by means of its roll angle, its pitch angle and a horizon line. A second piece of information 24 may also indicate piloting information such as the heading of the aircraft 1...

[0090] Such second information is displayed on each 5.5' screen taking into account the position and orientation of the head 20 of the pilot of the aircraft so that this second information is positioned according to the orientation of the head 20 of the pilot and consequently in the primary field of vision of the pilot.

[0091] A third item of information may be information concerning an operating state of an element of the aircraft 1 and is displayed at a generally fixed and predetermined position on each 5.5' screen, independently of the position and orientation of the pilot's head 20. A third item of information 25 relates, for example, to the state of a landing gear of the aircraft 1 displayed at the bottom center of a 5.5' screen. A third item of information may also relate to the state of a right engine of the aircraft 1 displayed, for example, at the top right of a 5.5' screen, the state of the main rotor 2 displayed at the top center of a 5.5' screen, etc.

[0092] A fourth piece of information is information considered important for piloting the aircraft 1 and concerns, for example, an alarm. A fourth piece of information alerts the pilot, for example, of an incident on an engine of the aircraft 1, of an exceeding of a flight limitation such as its altitude or its attitude, etc. Information is also considered important if the display position of this information on a 5.5' screen is not predictable by the pilot, namely that its display is conditioned by the occurrence of a predetermined event. Information attached to a geographical point 50 of the landscape outside the aircraft 1 can possibly also be considered important.

[0093] The computer 7 comprises, for example, a processor, an integrated circuit or a programmable system enabling the execution of the steps of the method for assisting the piloting of the aircraft 1 by adaptive display. The computer 7 may also comprise a memory 71 storing in particular instructions relating to the steps of this method and possibly a terrain database comprising information on the flight environment of the aircraft 1 and in particular on particular geographical points of this environment.

[0094] The first set of sensors 12, 13 makes it possible to detect a position and an orientation of the head 20 of a pilot of the aircraft 1 in a local reference frame of the aircraft 1. The local reference frame is attached to the aircraft 1 and comprises, for example, the axes X, Y, Z formed respectively by the roll, pitch and yaw directions of the aircraft 1. The first set of sensors 12, 13 comprises, for example, a first sensor 12 positioned on the pilot's helmet and a second sensor 13 fixed and positioned in the cockpit of the aircraft 1.

[0095] The first set of sensors 12, 13 may comprise at least one magnetic sensor 12 and / or at least one optical sensor 13.

[0096] In the case of a magnetic sensor 12, a set of coils is arranged for example in the cockpit of the aircraft and produces a magnetic field. The magnetic sensor 12 mounted on a pilot's helmet detects changes in the magnetic field captured during movements of the pilot's head and thus makes it possible to determine the position and orientation of the head.

[0097] In the case of an optical sensor 13, one or more optical transmitters are for example fixed on the pilot's helmet. One or more sensors positioned in the cockpit of the aircraft capture each beam emitted respectively by one or more transmitters and make it possible to accurately deduce the position of the pilot's head. Similarly, each optical transmitter can be fixed in the cockpit of the aircraft, each sensor then being positioned on the pilot's helmet.

[0098] The detection device 16 makes it possible to determine a position of at least one geographical point 50 of the landscape visible via a 5.5' screen. This detection device 16 comprises, for example, a radar in order to determine the position of each geographical point 50 directly in the local reference frame of the aircraft 1.

[0099] This detection device 16 can also include a memory or use the memory 71 of the computer 7 storing for example the coordinates in a terrestrial reference frame of each geographical point 50 and information concerning it. A transfer from the terrestrial reference point to the local reference point of aircraft 1 must then be carried out, typically via computer 7.

[0100] The second set of sensors 14, 15 makes it possible to detect a direction of gaze of the pilot of the aircraft 1 in the local reference frame of the aircraft 1. This second set of sensors 14, 15 comprises, for example, two fixed cameras positioned in the cockpit of the aircraft 1 and uses the technique of eye tracking in order to determine this direction of gaze of the pilot. This second set of sensors 14, 15 can also be fixed to a device secured to the head 20 of a pilot of the aircraft 1, such as his helmet for example.

[0101] However, a single camera may also be sufficient to detect the direction of the pilot's gaze.

[0102] [fig.3] A first synoptic diagram of a method for assisting in the piloting of a aircraft 1 by adaptive display using the two 5.5' screens is shown in Figure 3, a landscape outside the aircraft 1 being visible on each 5.5' screen. The method comprises the following steps:

[0103] A first detection 110 makes it possible to determine a position and an orientation of the head 20 of a pilot of the aircraft 1 in the local reference frame of the aircraft 1. This first detection 110 can be carried out by means of the first set of sensors 12, 13 and the computer 7.

[0104] A first determination 210 makes it possible to determine a position in the local reference frame of at least one geographical point 50 of the landscape visible via a 5.5' screen. This first determination 210 can be carried out by means of the detection device 16, and possibly the computer 7 and its memory 71.

[0105] A second determination 220 makes it possible to determine the position on the screen 5.5' of at least one first piece of information attached to each geographical point 50 visible on the screen 5.5'. This second determination 210 can be carried out by means of the computer 7. This second determination 220 can also be carried out as a function of the position of the head 20 of the pilot with respect to the first screen 5 and the position of the at least one geographical point 50, this first screen 5 being at least partially transparent.

[0106] A third determination 230 makes it possible to determine the position on the screen 5.5' as a function of the position and orientation of the pilot's head 20 with respect to a screen 5.5' of at least a second piece of information independent of a geographical point 50. This third determination 230 can also be carried out by means of the computer 7.

[0107] A first development step 310 makes it possible to determine a main image A1 comprising at least one first piece of information attached to at least one geographical point 50. This first development step 310 can be carried out by through the calculator 7.

[0108] A second processing step 320 makes it possible to determine a secondary image A2 comprising at least one second piece of information. This second processing step 320 can be carried out via the computer 7.

[0109] A first display 410 on each screen 5.5' of the main image A1 is then produced. This first display 410 can be produced by means of the display device 6

[0110] A second display 420 on each screen 5.5' of the secondary image A2, the secondary image A2 being centered on the orientation of the pilot's head 20. This second display 420 can then be produced by means of the display device 6

[0111] The secondary image A2 may have a first area smaller than a second area of ​​the main image A1. The secondary image A2 therefore has a limited area formed for example by a square corresponding to a solid angle of 20°x20° along an axis aligned with the orientation of the pilot's head and centered on this axis.

[0112] In this way, the secondary image A2 and each second piece of information that it comprises are displayed on each 5.5' screen taking into account the position and orientation of the head 20 of the pilot of the aircraft 1. Consequently, the secondary image A2 and each second piece of information that it comprises are displayed in the primary field of vision of the pilot, facilitating the taking into account of each second piece of information. Advantageously, this secondary image A2 is displayed on the 5.5' screen following the movements of the head 20 of the pilot in order to be permanently in the primary field of vision of the pilot.

[0113] The pilot can then quickly and efficiently become aware of each second piece of information located in the secondary image A2 among all the information displayed on the main image AL.

[0114] Furthermore, the main image A1 is displayed during the first display 410 with at least one first light characteristic and the secondary image A2 is displayed during the second display 420 with at least one second light characteristic. In addition, at least one second light characteristic of the secondary image A2 and / or at least one first light characteristic of the main image A1 are adapted respectively during the second display 420 and / or the first display 410 so that said at least one second light characteristic and said at least one first light characteristic are different and make it possible to easily distinguish the secondary image A2 from the main image A1. The visibility and readability of the secondary image A2 from the main image A1 are thus facilitated for the pilot of the aircraft 1.

[0115] Consequently, each second information located in the secondary image A2 is highlighted for the pilot among the numerous information displayed on the main image Al advantageously allowing its rapid and efficient consideration.

[0116] A first luminous characteristic of the main image A1 and a second luminous characteristic of the secondary image A2 may be the luminance or the opacity. Thus, during the second display 420, a value of the luminance of the secondary image A2 is greater than a value of the luminance of the main image A1, the secondary image A2 then appearing highlighted with respect to the main image A1.

[0117] Conversely, the first value of the first light characteristic of the main image A1 may also be greater than the second value of the second light characteristic of the secondary image A2. In this case, the main image A1 outside the area covered by the secondary image A2 is highlighted with respect to the secondary image A2.

[0118] [fig.4] Furthermore, the method for assisting in piloting the aircraft 1 according to the invention may include additional steps according to the second block diagram shown in Figure 4.

[0119] For example, the method may comprise the following additional steps:

[0120] A measurement 120 of a third value of at least one third luminous characteristic of the landscape visible via said at least one 5.5' screen is carried out. This measurement may for example be carried out globally along a longitudinal direction of the aircraft 1 by a brightness sensor fixed to the structure of the aircraft 1. This measurement may also be carried out more precisely by a sensor fixed to the helmet of the pilot of the aircraft 1.

[0121] A first adaptation 510 makes it possible to adapt the second value of at least one second luminous characteristic of the secondary image A2 as a function of the third value of at least one third luminous characteristic of the landscape in order to improve the visibility of the secondary image A2 with respect to the landscape for the pilot. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one second luminous characteristic.

[0122] In this way, the contrast between the secondary image A2 and the landscape visible via the 5.5' screen is increased, making it easier for the pilot to see the secondary image A2 and the second information it contains in relation to the landscape.

[0123] Similarly and following this measurement 120, the method may also comprise an additional second adaptation step 520 making it possible to adapt the first value of at least one first luminous characteristic of the main image A1 as a function of the third value of at least one third luminous characteristic of the landscape in order to improve the visibility of the main image A1 with respect to the landscape for the pilot. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one first luminous characteristic.

[0124] In this way, the contrast between the main image Al and the landscape visible via the 5.5' screen is increased, making it easier for the pilot to see the main image Al and the information it contains in relation to the landscape.

[0125] For example, a first light characteristic, a second light characteristic and a third light characteristic being the luminance, during the first adaptation 510, the second value of the second light characteristic of the secondary image A2 is greater than the third value of the third light characteristic of the main image A1 and / or during the second adaptation 520, the first value of the first light characteristic of the main image A1 is greater than the third value of the third light characteristic of the main image A1.

[0126] Furthermore, two first light characteristics being the luminance and the opacity, two second light characteristics being the luminance and the opacity and two third light characteristics being the luminance and the opacity, when a third value of a third luminance of the landscape is greater than a predetermined limit, during the first adaptation 510, the value of an opacity of the secondary image A2 is increased and / or during the second adaptation 520, the value of an opacity of the main image A1 is increased.

[0127] This predetermined limit may be a function of the maximum luminance applicable on the 5.5' screen. For example, if the maximum luminance applicable on the 5.5' screen is equal to L1, applicable to the secondary image A2 and the main image A1, the predetermined limit is equal to 5xL1. In this case an opacity greater than or equal to 01= (1-(L1 / L2)x5) may be applied to the 5.5' screen at landscape level to facilitate the visibility of the secondary image A2 and the main image A1.

[0128] According to one aspect, the method according to the invention may also comprise an additional third adaptation step 530 making it possible to adapt a fourth light characteristic of at least one piece of information considered to be important when said information considered to be important is located outside the secondary image A2. Information considered to be important concerns, for example, an alarm or information attached to a geographical point or even information whose position on the main image A1 is not predictable by said pilot. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one fourth light characteristic.

[0129] In this way, the readability of such information considered important is improved and its consideration by the pilot is facilitated.

[0130] According to one aspect, the method may comprise the following additional steps:

[0131] A third detection 130 makes it possible to determine a direction of the pilot's gaze in the local reference frame. This third detection 130 can be carried out via the second set of sensors 14, 15 and the computer 7.

[0132] A fourth determination 240 makes it possible to determine a target area A3 of said at least one screen, the target area A3 being centered in the direction of the pilot's gaze. This fourth determination 320 can be carried out via the computer 7.

[0133] A fourth adaptation 540 makes it possible to adapt at least a fifth luminous characteristic of at least one piece of information displayed in a target area A3 of said at least one screen 5.5', the target area A3 being centered on the direction of the pilot's gaze in order to improve the visibility of said at least one piece of information displayed in the target area A3 for the pilot. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one fifth luminous characteristic.

[0134] In this way, at least one piece of information located in the target area A3 centered on the pilot's gaze is advantageously highlighted by the fourth adaptation. For example, when the fifth light characteristic is the luminance or the opacity, during the fourth adaptation 540, a fifth value of the fifth light characteristic of said at least one piece of information displayed in the target area A3 is increased in order to facilitate the readability of said at least one piece of information displayed in the target area A3 by the pilot.

[0135] The target area A3 has a third area smaller than the second area of ​​the main image A1. The target area A3 is for example formed by a square corresponding to a solid angle of 20°x20° along an axis aligned with the direction of the pilot's gaze and centered on this axis. The target area A3 can also have a third smaller area and be formed for example by a square corresponding to a solid angle of 5°x5° aligned with the direction of the pilot's gaze and centered on this direction.

[0136] According to another example, the method may comprise an additional step of third display 330 of an image A0 of the landscape on the opaque screen 5'.

[0137] In this case, the method may also comprise an additional fifth adaptation step 540 making it possible to adapt at least a sixth value of at least a sixth luminous characteristic of the image A0 of the landscape in order to increase the contrast between, for example, the secondary image A2 and this image A0 of the landscape. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one sixth luminous characteristic.

[0138] Furthermore, the position of at least one geographical point 50 of the landscape may be known in a terrestrial reference frame. The first determination 210 may then comprise the following sub-steps:

[0139] - a third detection 212 of a position in a terrestrial reference frame of said at least one geographical point 50 of the landscape and, - a transfer 215 of the position of at least one geographic point 50 from the terrestrial reference point to the local reference point.

[0140] Naturally, the present invention is subject to numerous variations as to its implementation. Although several embodiments have been described, it is understood that it is not conceivable to exhaustively identify all possible modes. It is of course conceivable to replace a means described by an equivalent means without departing from the scope of the present invention.

Claims

Claims

1. Method for assisting in piloting an aircraft (1) using at least one screen (5.5') of said aircraft (1), a landscape outside said aircraft (1) being visible via said at least one screen (5.5'), characterized in that said method comprises the following steps: - first detection (110) of a position and an orientation of the head (20) of a pilot of said aircraft (1) in a local reference frame of said aircraft (1), - first determination (210) of a position in said local reference frame of at least one geographical point (50) of said landscape visible via said at least one screen (5.5'), - second determination (220) of the position on said at least one screen (5.5') of at least one first piece of information attached to said at least one geographical point (50) visible via said at least one screen (5.5'), - third determination (230) of the position on said at least one screen (5.5') as a function of said position and said orientation of said head (20) of said pilot with respect to said at least one screen (5.5') of at least one second piece of information to be displayed in a field of vision of said pilot, - first development (310) of a main image (Al) comprising said at least one first piece of information attached to said at least one geographical point (50), - second development (320) of a secondary image (A2) comprising said at least one second piece of information, - first display (410) of said main image (Al) on said at least one screen (5.5'), said main image (Al) being displayed with a first value of at least one first light characteristic, and - second display (420) of said secondary image (A2) on said at least one screen (5.5'), said secondary image (A2) being centered on said orientation of said head (20) of said pilot and being displayed with a second value of at least one second luminous characteristic, said second value of at least one second luminous characteristic being different from said first value of said first luminous characteristic in order to improve the visibility of said secondary image (A2) with respect to said main image (Al) for said pilot.

2. Method according to claim 1, characterized in that a first luminous characteristic and a second luminous characteristic being the luminance or the opacity, during said second display (320), said second value of said second luminous characteristic of said secondary image (A2) is greater than said first value of said first luminous characteristic of said main image (Al).

3. Method according to any one of claims 1 to 2, characterized in that said method comprises said following steps: - measurement (120) of a third value of at least one third luminous characteristic of said landscape visible via said at least one screen (5,5'), and - first adaptation (510) of said second value of at least one second luminous characteristic of said secondary image (A2) as a function of said third value of at least one third luminous characteristic of said landscape in order to improve the visibility of said secondary image (A2) with respect to said landscape for said pilot.

4. Method according to claim 3, characterized in that said method comprises an additional step of second adaptation (520) of said first value of at least a first luminous characteristic of said main image (Al) as a function of said third value of at least a third luminous characteristic of said landscape in order to improve the visibility of said main image (Al) with respect to said landscape for said pilot.

5. Method according to any one of claims 3 to 4, characterized in that a first luminous characteristic, a second luminous characteristic and a third luminous characteristic being the luminance, during said first adaptation (510), said second value of said second luminous characteristic of said secondary image (A2) is greater than said third value of said third luminous characteristic of said main image (Al) and / or during said second adaptation (520), said first value of said first light characteristic of said main image (Al) is greater than said third value of said third light characteristic of said main image (Al).

6. Method according to any one of claims 4 to 5, characterized in that two first luminous characteristics, two second luminous characteristics and two third luminous characteristics being the luminance and the opacity, when a third value of a third luminance of said landscape is greater than a predetermined limit, during said first adaptation (510), said second value of a second opacity of said secondary image (A2) is increased and / or during said second adaptation (520), said first value of a first opacity of said main image (Al) is increased.

7. Method according to any one of claims 1 to 6, characterized in that said secondary image (A2) is formed by a square corresponding to a solid angle of 20°x20° along an axis aligned with said orientation of said head (20) of said pilot and centered on said

8. axis. Method according to any one of claims 1 to 7, characterized in that at least one screen (5,5') is at least partially transparent and said exterior landscape is visible through said at least one screen (5,5').

9. Method according to claim 8, characterized in that, during said second determination (220), said position on said at least one screen (5,5') of said at least one first information is determined as a function of said position and said orientation of said head (20) of said pilot and of said position of said at least one geographical point (50) with respect to said at least one screen (5,5').

10. Method according to any one of claims 1 to 9, characterized in that said main image (Al) comprises at least a third piece of information displayed independently of said position and said orientation of said head (20) of said pilot.

11. Method according to any one of claims 1 to 9, characterized in that said method comprises an additional step of third adaptation (530) of a fourth luminous characteristic of at least one piece of information considered to be important. when said information considered important is located outside the secondary image (A2), information considered important concerning an alarm or if a position of said information considered important on said main image A1 is not predictable by said pilot.

12. Method according to any one of claims 1 to 11, characterized in that said first determination (210) comprises the following sub-steps: - a third detection (212) of a position in a terrestrial reference frame of said at least one geographical point (50) of said landscape and, - a transfer (215) of said position of said at least one geographical point (50) of said terrestrial reference frame to said local reference frame.

13. Method according to any one of claims 1 to 12, characterized in that said method comprises an additional step of third display (430) of an image (AO) of said landscape on said at least one screen (5,5').

14. Method according to claim 13, characterized in that said method comprises an additional step of fifth adaptation (530) of a sixth value of at least a sixth luminous characteristic of said image (A0) of said landscape.

15. Method according to any one of claims 1 to 14, characterized in that said method comprises the following additional steps: - third detection (130) of a direction of gaze of said pilot in said local reference frame, - fourth determination (240) of a target area (A3) of said at least one screen, said target area (A3) being centered in said direction of gaze of said pilot, and - fourth adaptation (540) of at least a fifth luminous characteristic of at least one information displayed in a target area (A3) of said at least one screen (5,5'), said target area (A3) being centered on said direction of gaze of said pilot in order to improve the visibility of said at least one information displayed in said target area (A3) for said pilot.

16. Method according to claim 15, characterized in that a fifth luminous characteristic being the luminance or the opacity, during said fourth adaptation (540), a fifth value of said fifth luminous characteristic of said at least one item of information displayed in said targeted zone (A3) is increased.

17. Assistance system (10) for piloting an aircraft (1) using at least one screen (5,5') of said aircraft (1), said assistance system (10) comprising: - said at least one screen (5,5'), a landscape being visible on said at least one screen (5,5'), - a device for displaying information on said at least one screen (5,5'), - a computer (11), - a first set of sensors (12,13) for detecting a position and an orientation of the head (20) of a pilot of said aircraft (1) in a local reference frame of said aircraft (1), and - a device (16) for detecting a position of at least one geographical point (50) of said landscape visible via said at least one screen (5,5'), characterized in that said display system (10) configured to implement the method according to any one of claims 1 to 14.

18. Assistance system (10) for piloting an aircraft (1) using at least one screen (5,5') of said aircraft (1), said assistance system (10) comprising: - said at least one screen (5,5'), a landscape being visible on said at least one screen (5,5'), - a device for displaying information on said at least one screen (5,5'), - a computer (11), - a first set of sensors (12,13) for detecting a position and an orientation of the head (20) of a pilot of said aircraft (1) in a local reference frame of said aircraft (1), - a second set of sensors (14, 15) for detecting a direction of gaze of said pilot of said aircraft (1) in said local reference frame of said aircraft (1), and - a device (16) for detecting a position of at least one geographical point (50) of said landscape visible via said at least one screen (5.5'), characterized in that said display system (10) configured to implement the method according to any one of claims 15 to 16.