Remote interaction system with a pointing means of an HMI of an aircraft cockpit display system

Abstract

The invention relates to a system for remote interaction with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers: - an upper layer (2) in the shape of an inverted V forming a hand rest, comprising: - a touch-sensitive flat surface module configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor (4) configured to interact with the HMI arranged on a rear part of the inverted V; - two lateral edges (5) set back from the upper surface of the upper layer (2), each provided with at least one physical interactor (6); - an intermediate layer (7) configured to allow a modification of the positioning of the upper layer (2); - a lower layer (8) configured to receive the wired connections for power supply and data exchange. Figure for abstract: [Fig.3]

Description

Title of the invention: Remote interaction system with a pointing means of an HMI of an aircraft cockpit display system

[0001] The invention relates to a system for remote interaction with a pointing means of an HMI of an aircraft cockpit display system.

[0002] The invention relates, in general, to the manner of interacting on a cockpit system consisting of a display device comprising a single large screen or a plurality of screens arranged essentially on the dashboard.

[0003] An interface between the pilot and the system of an aircraft cockpit is essentially made up of multifunction screens and control devices.

[0004] Historically, the control organs were separate from the main screens, in the form of control panels equipped with various physical interactors, such as switches, rotary selectors, or keys.

[0005] Subsequently, these control organs were partly integrated into the display screens, in the form of function keys located all around the screen, possibly supplemented by one or more rotary switches.

[0006] However, the interactive experience remains frustrating if we compare it to the world of micro-computing, based on the use of windows, menus, icons activated by means of a pointer.

[0007] As illustrated in [Fig.l] and [Fig.2], the current generation of cockpits has therefore seen the introduction of an interaction device with a pointing means functionally identical to a mouse, called CCD, for acronym of "Control Cursor Device" in English, based on a pointing ball, or trackball in English, and allowing direct interaction on the cockpit screens. Such a device is not very practical to use, the movement of a pointer by a trackball being less natural and efficient than with a mouse.

[0008] Such a device 1 is shown in [Fig.l] in the cockpit, and in more detail in [Fig.2].

[0009] The user experience of such a device is called WIMP for "Windows, Icons, Menus and Pointer" in English because it is based on a graphical interface composed of windows ("Windows" in English), icons ("Icons" in English), menus ("Menus" in English) which can be activated by means of a pointer ("Pointer" in English).

[0010] In use, such a device remains frustrating compared to tablets and other smartphones based on direct touch interaction on the screen.

[0011] Recently, civil aircraft cockpits have been equipped with touch screens, which allow direct and intuitive interaction of the pilot and / or co-pilot with the screens.

[0012] In addition, these touch screens are difficult to use when there are vibrations, or when the pilot moves his seat back to the cruising flight position.

[0013] However, in the context of a cockpit consisting of large screens, or even a single screen, it is not possible to have the entire display surface within reach, and even less so at a distance compatible with touch gestures.

[0014] In rare cases among more recent aircraft, several touch screens are used, with the possibility of also using a CCD.

[0015] Document EP 4092509 B1 is known, which relates to a Post Wimp CCD, which may have the disadvantage of being bulky. Indeed, this CCD has a V-shaped upper layer. On the first part of the V, there is a hand rest (or knob) and buttons. The second part of the V, which includes a touch surface (touchpad or touchscreen), protrudes substantially from its implantation zone (fixing plate) and prevents the implantation of other equipment nearby under the touch zone. The invention solves this problem of bulk because the rest zone (knob), the touch zone and the buttons are arranged on an inverted V-shaped layer whose surface area is substantially equal to that of the fixing plate.

[0016] An aim of the invention, i.e. of a Post WIMP CCD, is to provide the pilot and / or co-pilot with a compact medium enabling remote interaction with the cockpit HMIs, in an ergonomic and efficient manner.

[0017] Also known is document FR 3083628 B1 which discloses a system equipped with finger grips which requires being very close to the screens, and the finger grip border requires the presence of a spacing between the different screens.

[0018] Another aim of the invention is to be able to be used by the pilot in the event of turbulence when the use of touch screens is difficult (or even impossible) and / or less efficient).

[0019] Another object of the invention is to be able to be used comfortably by the pilot or co-pilot in all positions, even in the rearward seat position. The forward position (close to the cockpit HMIs) is used during critical phases (takeoff and landing) while the rearward position is used in the cruising phase (synonymous with seating comfort). In this latter position, the interest of the CCD Post WIMP takes on its full meaning because it provides the user with a medium allowing them to interact remotely with the cockpit HMIs in a comfortable manner (without stretching their arm over the HMIs).

[0020] Two Post WIMP CCDs are planned to be installed in the cockpit, 1 per pilot. It is required that the same product (unique Part Number) can be installed for each pilot. The CCD must therefore be designed to be ambidextrous. The ambidextrous function could be useful in small cockpits where there would only be one Post WIMP CCD between the two potential users.

[0021] Another aim of the invention is to be as compact as possible in the cockpit.

[0022] Another aim of the invention is to have a harmonious integration, to ensure a easy cleaning, and demonstrate intuitive use.

[0023] Another object of the invention is to be adaptable to most cockpits, and to be adjustable by the user so that its use is ergonomic for a user with the right hand as well as the left hand typically in small cockpits where there is only room for one which will be used either by the pilot or the co-pilot.

[0024] One aim of the invention is to overcome the problems mentioned above.

[0025] According to one aspect of the invention, there is provided a system for remote interaction with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers: - an inverted V-shaped upper layer forming a hand rest, comprising: - a touch-sensitive flat surface module configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor configured to interact with the HMI arranged on a rear part of the inverted V; - two lateral edges set back from the upper surface of the upper layer, each provided with at least one physical interactor - an intermediate layer configured to allow modification of the positioning of the upper layer; and - a lower layer configured to receive wired power supply and data exchange connections.

[0026] In one embodiment, the system includes a rear-facing thumbwheel configured to be accessible by the user's hand end when using a hand rest.

[0027] According to one embodiment, the touch-sensitive planar surface module configured to interact with the pointing device on the cockpit HMIs comprises a multi-contact capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

[0028] In one embodiment, the inverted V has an angular opening of the V between 135° and 179°.

[0029] According to one embodiment, the intermediate layer comprises a plate configured to be adapted to its installation position in the cockpit and to the aircraft.

[0030] In one embodiment, the intermediate layer comprises an adapter of rotation, configured to rotate the top layer along a horizontal axis.

[0031] According to one embodiment, the intermediate layer comprises a rotation adapter, configured to perform a rotation of the elements arranged above the plate, in a fixed manner, along a vertical axis.

[0032] In one embodiment, the touch-sensitive flat surface module is a multi-contact capacitive touchpad provided with a backlighting device, for example micro-LEDs.

[0033] According to one embodiment, the plate comprises fixing screw cover devices.

[0034] The invention will be better understood by studying a few embodiments described as non-limiting examples and illustrated by the appended drawings in which:

[0035] [Fig.l] schematically illustrates a remote interaction system with a pointing means of an aircraft cockpit display system equipped with HMI, according to the state of the art;

[0036] [Fig.2] schematically illustrates a trackball of a system of [Fig.l], according to the state of art;

[0037] [Fig.3] schematically illustrates a remote interaction system with a means of pointing an HMI of an aircraft cockpit display system, according to one aspect of the invention;

[0038] [Fig.4a], [Fig.4b], [Fig.4c], [Fig.4d], and [Fig.4e] schematically illustrate various view of the system of [Fig.3];

[0039] [Fig.5] schematically illustrates an embodiment of the system of [Fig.3], comprising a micro-LED backlighting device, according to one aspect of the invention;

[0040] [Fig.6] schematically illustrates an embodiment in which the plate includes fixing screw cover devices, according to one aspect of the invention;

[0041] [Fig.7a], [Fig.7b] schematically illustrate an embodiment of the system of the [Fig.3], allowing rotation along a horizontal axis of the upper layer, according to one aspect of the invention;

[0042] [Fig.8a], [Fig.8b] schematically illustrate an embodiment of the system of the [Fig.3], allowing rotation along a vertical axis of the elements arranged above the plate, according to one aspect of the invention;

[0043] [Fig.9a] and [Fig.9b] schematically illustrate the hand and arm pose of a user reader, pilot or co-pilot, on the system of [Fig.3], according to one aspect of the invention; and

[0044] [Fig. 10a] and [Fig. 10b] schematically illustrate the system of [Fig.3], in touchpad mode and in keyboard mode, according to one aspect of the invention.

[0045] Throughout the figures, elements having identical references are similar.

[0046] [Fig. 3] schematically illustrates a remote interaction system with a pointing means of an HMI of an aircraft cockpit display system aspect of the invention.

[0047] The system for remote interaction with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers: - an upper layer 2 in the shape of an inverted V forming a hand rest, comprising: - a touch-sensitive flat surface module 3 configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor 4 configured to interact with the HMI arranged on a rear part of the inverted V; - two lateral edges 5 set back from the upper surface of the upper layer 2, each provided with at least one physical interactor 6; and - an intermediate layer 7 configured to allow a modification of the positioning of the upper layer 2; and - a lower layer 8 configured to receive wired power supply and data exchange connections.

[0048] The design of the three-layer system in order to adapt to all wearers and to different locations in the cockpit (pedestal, central console or even in the armrest), while ensuring an ergonomic position for the user (pilot or co-pilot).

[0049] [Fig.4a], [Fig.4b], [Fig.4c], [Fig.4d], and [Fig.4e] schematically illustrate various views of the system of [Fig.3].

[0050] The inverted V has an angular opening [3 of the V of between 135° and 179°, and the inclination a of the flat touch-sensitive surface 3 can be between 0 and 45° relative to the horizontal.

[0051] The system comprises a wheel 9 on the rear face configured so as to be accessible by the end of the user's hands when using a hand rest. It is arranged astride the intermediate 7 and upper 2 layers.

[0052] The touch-sensitive flat surface module 3 configured to interact with the pointing device on the cockpit HMIs comprises a multi-contact capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

[0053] The three-layer architecture shown in the figures has the following characteristics: - A top layer 2 comprising: - a touch-sensitive area with dimensions: 30 mm < length <110 mm and 30 mm < width <110 mm and typically 108 mm x 48 mm; - side edges 5 of width R, 10 mm < R < 50 mm, typically R = 15 mm and of height b, 10 mm < b < 40 mm, typically b = 12 mm; - a wheel 9 at the front of the system and under the touch-sensitive area. Wheel 9 has a width M, 3 mm < M < 50 mm, typically M = 30 mm preferably with a slight curve and knurling for better grip; - An intermediate layer 7 comprising: - a body around the wheel 9 set back G relative to the upper layer 2 in order to ensure grip for the user's hand (particularly in the event of vibrations or jolts) with 3 mm < G < 20 mm, and typically G = 6 mm. - A lower layer 8 or "back end" in English, common to all carriers, comprising a fixing plate 11 with for example four screws and a rear housing 12 of section smaller than that of the plate 11. The height of the lower layer 8 depends on the aircraft models.

[0054] The set of upper 2 and intermediate 7 layers has dimensions of width L, 50 mm < L < 150 mm, typically L = 140 mm and height H, 20 mm < H < 100 mm, typically H = 40 mm.

[0055] The materials used for are those commonly used for cockpit equipment. The materials around the touch-sensitive area 3 are non-metallic, in this case plastic so as not to disrupt its operation.

[0056] For example, the top layer may be plastic with metallization (EMI protection) outside the touch-sensitive area 3. Alternatively, the top layer may be aluminum with a transparent plastic insert above the touch-sensitive area 3 with paint (photosensitive or fluorescent) or screen-printed sticker on the underside. The keys may or may not be visible without backlighting. The backlighting of the virtual keyboard may be enabled by a light source, such as micro-LEDs 13, as illustrated in [Fig.5].

[0057] As illustrated in [Fig.6], the plate 11 comprises fixing screw cover devices 14. The fixing screw cover devices 14 improve the perceived quality and represent an advantage from a health point of view. The repositioning of a cover 14, such as a plate or a valve, above a fixing screw can be done using a spring or a permanent return magnet. The movement of a cover 14 can be a translation and / or a rotation possibly associated with a swaying. This system improves the cleaning of the system without degrading the availability or the maintainability. Indeed, access to the fixing screws does not require a specific tool, nor an additional tool.

[0058] The intermediate layer 7 may comprise a rotation adapter, configured to perform a rotation of the upper layer 2 along a horizontal axis, as represented by the double arrow in [Fig.7a] and [Fig.7b].

[0059] The intermediate layer 7 may comprise a rotation adapter, configured to perform a rotation of the elements arranged above the plate 11, in a fixed manner, along a vertical axis, as represented by the double arrow in [Fig.8a] and [Fig.8b].

[0060] As illustrated in [Fig.9a] and [Fig.9b] The presence of a palm rejection function makes it possible to place the user's hand or another part of the arm.

[0061] As illustrated in [Fig.9b], the presence of a hand rest ensures the stability of the user in his interaction actions and limits his fatigue.

[0062] [Fig. 10a] and [Fig. 10b] are respectively examples of a touchpad mode system and a keyboard mode system, according to aspects of the invention.

Claims

Claims

1. System for remote interaction with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers: - an upper layer (2) in the shape of an inverted V forming a hand rest, comprising: - a flat surface module (3) sensitive to touch configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor (4) configured to interact with the HMI arranged on a rear part of the inverted V; and - two lateral edges (5) set back from the upper surface of the upper layer (2), each provided with at least one physical interactor (6); - an intermediate layer (7) configured to allow a modification of the positioning of the upper layer (2); and - a lower layer (8) configured to receive the wired connections for power supply and data exchange.

2. System according to claim 1, comprising a wheel (9) on the rear face configured so as to be accessible by the end of the user's hands when using a hand rest.

3. The system of claim 1 or 2, wherein the touch-sensitive flat surface module (3) configured to interact with the pointing device on the cockpit HMIs comprises a multi-contact capacitive touchpad, or a touchscreen configured to implement an alphanumeric keyboard.

4. The system of claim 1 to 3, wherein the inverted V has an angular opening of the V of between 135° and 179°.

5. System according to one of the preceding claims, in which the intermediate layer (7) comprises a plate (11) configured to be adapted to its installation position in the cockpit and to the aircraft.

6. System according to claim 5, in which the plate (11) comprises devices (14) covering fixing screws.

7. System according to one of the preceding claims, wherein the intermediate layer (7) comprises a rotation adapter, configured to perform a rotation of the upper layer (2) along a horizontal axis.

8. System according to one of the preceding claims, in which the intermediate layer (7) comprises a rotation adapter, configured to perform a rotation of the elements arranged above the plate (11), in a secured manner, along a vertical axis.

9. System according to one of the preceding claims, in which the touch-sensitive flat surface module (3) is a multi-contact capacitive touchpad provided with a backlighting device (13).

Images