Remote interaction system with a means for aligning an HMI of an aircraft cockpit display system

Description

[0001] The invention relates to a remote interaction system with a pointing means for an HMI of an aircraft cockpit visualization system.

[0002] The invention relates, in general, to the way of interacting on a cockpit system consisting of a display device comprising a single large screen or a plurality of screens arranged essentially on a dashboard.

[0003] An interface between the pilot and the system of an aircraft cockpit essentially consists of multifunction displays and control devices.

[0004] Historically, control devices were separate from the main screens, in the form of control panels equipped with various physical interactors, such as switches, rotary selectors, or keys.

[0005] Subsequently, these control devices were partly integrated into the display screens, in the form of function keys located all around the screen, possibly supplemented by one or more rotary switches.

[0006] However, the interactive experience remains frustrating when compared to the world of microcomputing, which is based on the use of windows, menus, and icons that can be activated using a pointer.

[0007] As illustrated on the [ Fig.1] et [Fig.2 The current generation of cockpits has therefore seen the introduction of an interaction device with a pointing device functionally identical to a mouse, called a CCD (Control Cursor Device), based on a pointing ball, or trackball, allowing direct interaction with the cockpit screens. Such a device proves impractical in use, as moving a pointer with a trackball is less natural and efficient than with a mouse.

[0008] Such a device 1 is represented in [ Fig.1 ] in the cockpit, and in more detail in [ Fig.2 ].

[0009] The user experience of such a device is called WIMP, an acronym for "Windows, Icons, Menus and Pointer" in English, because it is based on a graphical interface composed of windows ("Windows" in English), icons ("icons" in English), menus ("Menus" in English) that can be activated by means of a pointer ("Pointer" in English).

[0010] In practice, such a device remains frustrating compared to tablets and other smartphones based on direct touch interaction on the screen.

[0011] Recently, civil aircraft cockpits have been equipped with touchscreens, allowing direct and intuitive interaction between the pilot and / or co-pilot and the screens.

[0012] Furthermore, these touchscreens are difficult to use in the presence of vibrations, or when the pilot moves his seat back into the cruise flight position.

[0013] However, in the context of a cockpit made up of large screens, or even a single screen, it is not possible to have the entire display area within reach, let alone at a distance compatible with touch gestures.

[0014] In rare cases among the most recent aircraft, multiple touchscreens are used, with the possibility of also using a CCD.

[0015] Document EP 4092509 B1, which concerns a Post Wimp CCD, is known to exist. This CCD can be problematic due to its size. Specifically, this CCD has a V-shaped top layer. The first part of the V contains a palm rest (or knob) and buttons. The second part of the V, which includes a touchpad or touchscreen, protrudes significantly from its mounting area (the mounting plate) and prevents the installation of other equipment nearby beneath the touchpad. The invention solves this space problem because the palm rest area, the touchpad, and the buttons are arranged on an inverted V-shaped layer whose surface area is substantially equal to that of the mounting plate.

[0016] One aim of the invention, i.e. of a Post WIMP CCD, is to provide the pilot and / or co-pilot with a compact medium enabling remote interaction with the cockpit HMIs, in an ergonomic and efficient manner.

[0017] Also known is document FR 3083628 B1 which discloses a system with finger grips which requires being very close to the screens, and the finger grip border requires the presence of a spacing between the different screens.

[0018] Another aim of the invention is to be able to be used by the pilot in case of turbulence when the use of touch screens is difficult (or even impossible) and / or less efficient).

[0019] Another objective of the invention is to allow comfortable use by the pilot or co-pilot in all positions, even in the rearward seating position. The forward position (close to the cockpit's HMIs) is used during critical phases (takeoff and landing), while the rearward position is used during cruise (synonymous with seating comfort). In this latter position, the advantage of the Post WIMP CCD becomes clear, as it provides the user with a medium for comfortable remote interaction with the cockpit's HMIs (without having to reach for them).

[0020] Two Post WIMP CCDs are planned for installation in the cockpit, one per pilot. It is required that the same product (single Part Number) be available for each pilot. Therefore, the CCD must be ambidextrous. This ambidextrous functionality could be useful in small cockpits where there is only one Post WIMP CCD between the two potential users.

[0021] Another goal of the invention is to be as compact as possible in the cockpit.

[0022] Another aim of the invention is to have seamless integration, ensure easy cleaning, and demonstrate intuitive use.

[0023] Another aim of the invention is to be adaptable to most cockpits, and to be adjustable by the user so that its use is ergonomic for a user with the right hand as well as the left hand typically in small cockpits where there is only room for one which will be used either by the pilot or the co-pilot.

[0024] One aim of the invention is to overcome the problems mentioned above.

[0025] According to one aspect of the invention, a remote interaction system with a pointing means for an HMI of an aircraft cockpit visualization system is proposed, comprising three layers: an inverted V-shaped top layer acting as a palm rest, comprising: a touch-sensitive flat-surface module configured to interact with the pointing device located on a front part of the inverted V; at least one physical interactor configured to interact with the HMI located on a rear part of the inverted V; two lateral edges recessed from the top surface of the top layer, each equipped with at least one physical interactor; an intermediate layer configured to allow modification of the positioning of the top layer; and a bottom layer configured to receive wired connections for power supply and data exchange; the system comprising a palm rejection module configured to allow the hand or part of the arm to be placed on the upper layer (2) acting as a pommel.

[0026] In one embodiment, the system includes a rear-facing dial configured to be accessible by the user's hand tips when using a hand rest.

[0027] According to one embodiment, the touch-sensitive flat surface module configured to interact with the pointing device on the cockpit HMIs includes a multi-touch capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

[0028] In one embodiment, the inverted V has an angular opening of the V between 135° and 179°.

[0029] According to one embodiment, the intermediate layer includes a plate configured to be adapted to its installation position in the cockpit and the aircraft.

[0030] In one embodiment, the intermediate layer includes a rotation adapter, configured to perform a rotation of the upper layer about a horizontal axis.

[0031] According to one embodiment, the intermediate layer includes a rotation adapter, configured to rotate the elements arranged above the plate, in a unified manner, around a vertical axis.

[0032] In one embodiment, the touch-sensitive flat surface module is a multi-touch capacitive touchpad equipped with a backlighting device, for example with micro-LEDs.

[0033] According to one embodiment, the plate includes screw cover devices for fixing.

[0034] The invention will be better understood upon examination of some embodiments described by way of non-limiting examples and illustrated by the accompanying drawings, in which: [ Fig.1 ] schematically illustrates a remote interaction system with a pointing device for an aircraft cockpit display system equipped with an HMI, according to the state of the art; Fig.2 ] schematically illustrates a trackball of a system of the [ Fig.1 ], according to the state of the art; [ Fig.3 ] schematically illustrates a remote interaction system with a pointing means for an HMI of an aircraft cockpit visualization system, according to one aspect of the invention; [ Fig.4a ], [ Fig.4b ], [ Fig.4c ], [ Fig.4d], et [Fig.4e ] schematically illustrate various views of the system of the [ Fig.3 ] ; ] Fig.5 ] schematically illustrates one implementation of the system of the [ Fig.3 ], comprising a micro-LED backlighting device, according to one aspect of the invention; [ Fig.6 ] schematically illustrates an embodiment in which the plate includes screw cover devices for fixing, according to one aspect of the invention; [ Fig.7a], [Fig.7b ] schematically illustrate one implementation of the system of the [ Fig.3 ], allowing rotation about a horizontal axis of the upper layer, according to one aspect of the invention; [ Fig.8a], [Fig8b ] schematically illustrate one implementation of the system of the [ Fig.3 ], allowing rotation about a vertical axis of the elements arranged above the plate, according to one aspect of the invention; [ Fig.9a] et [Fig.9b ] schematically illustrate the placement of a user's hand and arm, pilot or co-pilot, on the system of the [ Fig.3 ], according to one aspect of the invention; and [ Fig.10a] et [Fig.10b ] schematically illustrate the system of the [ Fig.3 ], in touchpad mode and in keyboard mode, according to one aspect of the invention.

[0035] Across all figures, elements with identical references are similar.

[0036] There [ Fig.3 ] schematically illustrates a remote interaction system with a pointing means of an HMI of an aircraft cockpit visualization system aspect of the invention.

[0037] The remote interaction system with a pointing device for an HMI of an aircraft cockpit visualization system, comprising three layers: an upper layer 2 in the shape of an inverted V itself acting as a palm rest, comprising: a touch-sensitive flat-surface module 3 configured to interact with the pointing means located on a front part of the inverted V; at least one physical interactor 4 configured to interact with the HMI located on a rear part of the inverted V; two lateral edges 5 recessed from the upper surface of the upper layer 2, each equipped with at least one physical interactor 6; and an intermediate layer 7 configured to allow modification of the positioning of the upper layer 2; and a lower layer 8 configured to receive wired connections for power supply and data exchange; the system comprising a palm rejection module configured to allow the hand or part of the arm to be placed on the upper layer (2) acting as a pommel.

[0038] The system's three-layer design allows it to adapt to all carriers and different locations in the cockpit (pedestal, center console or even in the armrest), while ensuring an ergonomic position for the user (pilot or co-pilot).

[0039] THE [ Fig.4a ], [ Fig.4b ], [ Fig.4c ], [ Fig.4d], et [Fig.4e ] schematically illustrate various views of the system of the [ Fig.3 ].

[0040] The inverted V has an angular opening β of the V between 135° and 179°, and the inclination α of the touch-sensitive flat surface 3 can be between 0 and 45° with respect to the horizontal.

[0041] The system includes a dial 9 on the rear face, configured to be accessible by the user's fingertips when used as a palm rest. It is positioned across the intermediate layer 7 and the upper layer 2.

[0042] The touch-sensitive flat-surface module 3 configured to interact with the pointing device on the cockpit HMIs includes a multi-touch capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

[0043] The three-layer architecture shown in the figures has the following characteristics: An upper layer 2 comprising: a touch-sensitive area with dimensions of 30 mm ≤ length ≤ 110 mm and 30 mm ≤ width ≤ 110 mm, and typically 108 mm x 48 mm; lateral edges 5 with a width R, 10 mm ≤ R ≤ 50 mm, typically R = 15 mm, and a height b, 10 mm ≤ b ≤ 40 mm, typically b = 12 mm; a knurled knob 9 at the front of the system and below the touch-sensitive area. The knurled knob 9 has a width M, 3 mm ≤ M ≤ 50 mm, typically M = 30 mm, preferably with a slight curve and knurling for better grip; An intermediate layer 7 comprising: a body around the wheel 9 set back G from the upper layer 2 to ensure a grip for the user's hand (especially in case of vibrations or shocks) with 3 mm ≤ G ≤ 20 mm, and typically G = 6 mm.A lower layer 8 or "back end" in English, common to all carriers, comprising a fixing plate 11 with, for example, four screws and a rear housing 12 with a cross-section smaller than that of the plate 11. The height of the lower layer 8 depends on the aircraft models.

[0044] The upper layer 2 and intermediate layer 7 together have width dimensions L, 50 mm ≤ L ≤ 150 mm, typically L = 140 mm and height dimensions H, 20 mm ≤ H ≤ 100 mm, typically H = 40 mm.

[0045] The materials used are those commonly used for cockpit equipment. The materials around touch-sensitive area 3 are non-metallic, specifically plastic, so as not to interfere with its operation.

[0046] For example, the top layer can be made of plastic with metallization (EMI shielding) outside the touch-sensitive area 3. Alternatively, the top layer can be made of aluminum with a transparent plastic insert above the touch-sensitive area 3, with paint (photosensitive or fluorescent) or a screen-printed sticker on the underside. The keys may or may not be visible without backlighting. Backlighting of the virtual keyboard can be enabled by a light source, such as micro-LEDs 13, as illustrated in the [ Fig.5 ].

[0047] As illustrated on the [ Fig.6 The plate 11 includes screw cover devices 14. These screw cover devices 14 improve perceived quality and offer a hygiene advantage. Repositioning a cover 14, such as a plate or flap, over a fixing screw is achieved using a spring or a permanent magnet. The movement of a cover 14 can be a translation and / or a rotation, possibly combined with a swaying motion. This system improves cleaning without compromising availability or maintainability. Indeed, access to the fixing screws requires no special or additional tools.

[0048] The intermediate layer 7 may include a rotation adapter, configured to perform a rotation of the top layer 2 about a horizontal axis, as represented by the double arrow on the [ Fig.7a] et [Fig.7b ].

[0049] The intermediate layer 7 may include a rotation adapter, configured to rotate the elements arranged above the plate 11, in a fixed manner, about a vertical axis, as represented by the double arrow on the [ Fig.8a] et [Fig.8b ].

[0050] As illustrated on the [ Fig.9a] et [Fig.9b The presence of a module configured to implement a palm rejection function allows the user to place their hand or another part of their arm on the device.

[0051] As illustrated on the [ Fig.9b The presence of a hand rest ensures the user's stability during interaction and limits their fatigue.

[0052] THE [ Fig.10a] et [Fig.10b ] are respectively examples of a system in touchpad mode and in keyboard mode, according to aspects of the invention.

Claims

1. System for interacting at a distance with a pointing means of an HMI of a viewing system of an aircraft cockpit, comprising three layers: - an upper layer (2) in the shape of an inverted V, which itself acts as a handrest knob, comprising: - a module, with a touch-sensitive flat surface (3), configured to interact with the pointing means arranged on a front portion of the inverted V; - at least one physical interactor (4) configured to interact with the HMI arranged on a rear portion of the inverted V; and - two lateral edges (5) set back from the upper surface of the upper layer (2), each provided with at least one physical interactor (6); - an intermediate layer (7) configured to make it possible to modify the positioning of the upper layer (2); and - a lower layer (8) configured to receive the wired electric power supply and data exchange connections; the system comprising a palm rejection module configured to make it possible to place the hand or a portion of the arm on the upper layer (2), which acts as a knob.

2. System according to claim 1, comprising a wheel (9) on the rear face configured so as to be able to be accessed by the tips of the hands of the user when used as a handrest.

3. System according to claim 1 or 2, wherein the module, with a touch-sensitive flat surface (3), configured to interact with the pointing device on the HMIs of the cockpit comprises a multi-contact capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

4. System according to claim 1 to 3, wherein the inverted V has an angular opening of the V of between 135° and 179°.

5. System according to any one of the preceding claims, wherein the intermediate layer (7) comprises a baseplate (11) configured to be adapted to the position in which it is installed in the cockpit and to the aircraft.

6. System according to claim 5, wherein the baseplate (11) comprises fastening screw cover devices (14).

7. System according to any one of the preceding claims, wherein the intermediate layer (7) comprises a rotary adaptor, which is configured to rotate the upper layer (2) about a horizontal axis.

8. System according to any one of the preceding claims, wherein the intermediate layer (7) comprises a rotary adaptor, which is configured to rotate the elements arranged on top of the baseplate (11) jointly about a vertical axis.

9. System according to any one of the preceding claims, wherein the module with a touch-sensitive flat surface (3) is a multi-contact capacitive touchpad provided with a backlighting device (13).