SYSTEM AND METHOD FOR CONTROLLING A HUMAN-MACHINE INTERFACE FOR A VEHICLE

Abstract

This system comprises a detector (22) configured to detect movement in a detection area (24) connected to the vehicle's steering wheel, in particular movement of at least one of the driver's fingers in this detection area (24), and a control unit connected to the detector and a display interface (14) and configured to: - to activate a menu display control on the display interface after detecting an initial movement of at least one of the driver's fingers towards the display interface, - after detecting at least one second movement of the finger of at least one driver in a first substantially horizontal or vertical direction, scrolling through the menus on the display interface based on the at least one second detected movement, selecting a menu when the driver completes the second movement, - receives a command to validate the selected menu and activates the selected menu.

Description

[0001] The present invention relates to a system for controlling a human-machine interface for a vehicle.

[0002] It also refers to an associated procedure for controlling a human-machine interface for a vehicle.

[0003] In modern vehicles, especially motor vehicles, the driver is increasingly offered more functions via buttons, and a large amount of information is displayed on the vehicle's display interfaces.

[0004] Generally, vehicles, especially motor vehicles, comprise a dashboard and a steering wheel for the driver, as well as various controls for driving the vehicle. In addition, vehicles are equipped with numerous buttons and actuators located near or directly on the steering wheel, which control additional functions related to driving the vehicle, as well as supplementary functions such as selecting an audio source, adjusting the volume, or changing the display on a screen interface. The large number of buttons and actuators can increase the driver's mental workload and thus increase the risk of distraction while driving.

[0005] Touchscreen display interfaces have also been proposed for vehicles. However, operating such interfaces requires moving one hand to the touchscreen and thus letting go of the steering wheel, which is not recommended from a driving safety perspective.

[0006] In general, it is desirable to improve the human-machine interface and simplify the selection and control of the various functions offered. For the driver of a vehicle, it is particularly important to make the controls easy to use and improve ergonomics in order to reduce mental strain and thus increase driving safety.

[0007] The subject matter of the present invention is to provide a solution by offering a system for controlling a human-machine interface for a vehicle that is easy for the driver to use without compromising driving safety.

[0008] For this purpose, the subject matter of the invention is a system for controlling a human-machine interface for a vehicle, the vehicle comprising a steering wheel to be operated by the driver of the vehicle and a display interface, the control system comprising a detector configured to detect movement in a detection area connected to the steering wheel, wherein the detector is configured to detect movement of at least one finger of the driver of the vehicle in the detection area, the control system comprising a control unit connected to the detector and the display interface, wherein the control unit is configured to: - a menu display control is activated on the display interface after an initial movement of at least one finger of the driver towards the display interface has been detected, with each menu being assigned at least one command, - after detecting at least one second movement of the finger of at least one driver in a first, substantially horizontal or vertical direction, based on the at least one detected second movement that differs from the first movement, scrolls through the menus on the display interface, selecting a menu when the driver completes the second movement, - receives a command to validate the selected menu and activates the selected menu.

[0009] Advantageously, the proposed human-machine interface control system can recognize the first and second movements of one or more of the driver's fingers in relation to the display interface. This allows the driver to easily scroll through a menu, select an option, and activate it while keeping their hands on the steering wheel.

[0010] According to further advantageous aspects of the invention, the human-machine interface control system comprises one or more of the following features, which can be used individually or in any technically possible combination:

[0011] The validation command is executed by at least a third movement of the finger of at least one driver in a second direction, which is essentially perpendicular to the first direction.

[0012] The validation command is executed via a validation element.

[0013] Receiving the validation command includes a validation display of the selected menu at a predetermined main position on the display interface, the predetermined main position being in line with at least one finger of the driver.

[0014] The detector is an infrared sensor.

[0015] The detector is integrated into a trim element of the vehicle.

[0016] The detector is elongated, and is arranged in a horizontal shelf of the vehicle or in a support element of the steering wheel.

[0017] The detector extends horizontally from one side of the steering wheel and enables the detection of movements performed by one or more of the driver's fingers when the driver places their hand on that side of the steering wheel.

[0018] The invention also relates to a method for controlling a human-machine interface for a vehicle, which is implemented by a control system as previously disclosed, the method comprising the following steps: - Activating a menu display control on the display interface after an initial movement of at least one finger towards the display interface has been detected, with each menu being assigned at least one command, - after detecting at least one second movement of the finger of at least one driver in a first, substantially horizontal or vertical direction, based on the at least one detected second movement that differs from the first movement, scrolls through the menus on the display interface, selecting a menu when the driver completes the second movement, - Receiving a command to validate the selected menu and activating the selected menu.

[0019] According to another aspect, the invention also relates to a vehicle equipped with a human-machine interface control system, as briefly described previously in the disclosure.

[0020] The invention will be better understood upon reading the following description, which is given only as a non-limiting example and was prepared with reference to the drawings, wherein: [ Fig. 1] Fig. 1 represents a schematic perspective view of a vehicle cabin section, comprising a human-machine interface control system; [ Fig. 2] Fig. 2 represents a block diagram of the main functional blocks of a human-machine interface control system according to one embodiment; [ Fig. 3] Fig. 3 a schematic representation of the components of a human-machine interface control system according to a first embodiment; [ Fig. 4] Fig. 4 is a schematic representation of the components of a human-machine interface control system according to a second embodiment, and [ Fig. 5] Fig. Figure 5 is a schematic cross-sectional view showing the driver's finger movements detected by the human-machine interface control system in separate inserts A, B and C.

[0021] Fig. Figure 1 shows part 2 of a driver's cab of a vehicle 4 equipped with a human-machine interface control system. The invention is applicable to all types of vehicles, in particular motor vehicles.

[0022] The vehicle includes a steering wheel 6, hereinafter referred to simply as the steering wheel 6, which is used by a driver, seated in a driver's seat (not shown), to control the vehicle's direction of travel. The driver operates the steering wheel 6 with his hands, specifically with his right hand 8R and his left hand 8L.

[0023] The vehicle 4 includes a trim element 10 into which a dashboard 12 comprising a display interface 14 is inserted.

[0024] Information and control menus are displayed on the display interface 14, with a command being associated with the display of a submenu or with the operation of the vehicle equipment.

[0025] In the example shown, the display interface 14 comprises a surface 16 on the vehicle interior, inclined with respect to the vertical direction specified by a Z-axis of a three-dimensional reference frame R. The three-dimensional reference frame R is an orthogonal spatial reference frame comprising a first axis X extending towards the front of the vehicle, a second axis Y orthogonal to the first axis X, with the axes (X, Y) defining a horizontal plane, and a vertically extending third axis Z orthogonal to the horizontal plane.

[0026] Preferably and as in the Fig. 3 and Fig. As shown in Figure 4, at least part of the surface 16 of the display interface 14 faces the steering wheel 6 or a side side of the steering wheel, for example the right side side.

[0027] Vehicle 4 is equipped with a human-machine interface control system 20, which is explained in more detail below.

[0028] The human-machine interface includes the display interface 14 and actuators for vehicle equipment such as loudspeakers, heating / air conditioning systems, ventilation systems and lighting systems.

[0029] The control system 20 includes a detector 22 which is configured to detect movement in an associated detection area 24.

[0030] Advantageously, the detector 22 is an infrared detector comprising at least one light source in the infrared range, for example in the near-infrared range in the wavelength range of 700 to 2,500 nm.

[0031] In one embodiment, the detector 22 has the form of an elongated beam extending longitudinally in a principal direction. Preferably, the detector 22 has a length between 5 cm and 20 cm, for example 10 cm.

[0032] According to one embodiment, the detector 22 comprises a plurality of infrared sensors arranged in a line in the longitudinal direction of the detector, with each pair of successive sensors arranged at a predetermined distance from each other.

[0033] In one embodiment as in Fig. As shown in Figure 1, the detector 22 is arranged in a horizontally extending support shelf 26 of the trim element 10 (parallel to the plane (X, Y) of the reference frame R) in order to illuminate at least a part of the steering wheel. In one embodiment, the detector 22 extends longitudinally essentially parallel to the Y-axis of the reference frame F.

[0034] For example, the detector is positioned near a side surface of the steering wheel 6, for example near the right side surface 6R of the steering wheel 6. An example of how the detector 22 is to be positioned with respect to the steering wheel 6 is shown in Fig. 3 shown.

[0035] In this embodiment, the detector 22 comprises an infrared light source configured to illuminate in a vertical direction, wherein the associated detection area 24 is a frustoconical area including the side of the steering wheel.

[0036] Alternatively, detector 22 can be used, as in the example in Fig. 4 shown, in a trim element arranged behind and near the steering wheel 6, for example a support element of the steering wheel 6, arranged in a substantially vertical plane, such that the detector 22 extends in the longitudinal direction parallel to the Z-axis (vertical axis) of the reference frame R.

[0037] Advantageously, the associated detection area 24 can detect the respective movements of one or more fingers of the driver when the driver's hands are on the steering wheel, due to the arrangement and shape of the detector 22.

[0038] The control system detects, for example, the movement of one or two fingers of the driver, the index finger and / or middle finger of the hand (e.g. the right hand) that is directed towards the detection area 24 when it is positioned on the steering wheel 6.

[0039] The control system 20 includes a control unit 30, which is connected, for example, to the detector 22 and the display interface 14 via a wired communication bus.

[0040] The control unit 30 is a programmable electronic unit, for example a microcontroller.

[0041] The control unit 30 is configured to receive motion detection information from the detector 22.

[0042] The received motion detection information indicates the direction of movement of an object, in particular the driver's fingers, in the detection area from the respective directions X, Y and Z, or enables their calculation.

[0043] The control unit 30 is further connected to the display interface 14 and configured to control and modify the display on the display interface, in particular to control the display position of menus, with each menu being assigned to a command.

[0044] The control unit 30 is configured to implement a module 32 for activating the control of the menu display on the display interface after an initial movement of one or more fingers of the driver in the direction of the display interface, i.e. essentially in the direction of the X-axis, has been detected.

[0045] Starting from a position where the driver has their hands on the steering wheel and their fingers around the steering wheel 6, the driver extends one or more fingers, for example the index and / or middle finger, towards the display interface. The detection of this initial movement activates the menu display control.

[0046] Furthermore, the control unit is configured to implement a module 34 to activate the scrolling of the displayed menus based on at least one second movement detected by detector 22, in which the driver's finger(s) are moved in a first direction, either horizontally or vertically.

[0047] Scrolling through the menu consists of changing the display on the display interface so that each menu item is shown sequentially at a selected main position 42.

[0048] Scrolling is thus advantageously controlled by the second movement of the driver's finger(s).

[0049] Finally, the control unit is configured to implement a validation module 36, which is designed to receive a validation command for a selected menu and to validate the selected menu. The selected menu is, for example, the menu displayed at the main position 42 in the display area.

[0050] In one embodiment, the validation command is executed, for example, by a third movement of the driver's fingers in a second direction that differs from the first direction and is preferably perpendicular to it.

[0051] Alternatively, the validation command is executed by means of a validation element 35, for example a button located on or near the steering wheel 6.

[0052] After validation of the selected menu, the control unit is configured to implement a module 38 to activate the command associated with the selected menu.

[0053] Activating the command either changes the display on the graphical user interface or the behavior of a piece of equipment 40 on board the vehicle by sending a signal to the actuator of the piece of equipment 40. The piece of equipment 40 is, for example, a loudspeaker, a heating / air conditioning system, or a lighting system.

[0054] In the case of a selection menu for an audio source to be played through the vehicle's speakers, the command selects the audio source (e.g., radio, external source connected via a communication link).

[0055] Alternatively or additionally, the command associated with a menu leads to the development of submenus. For example, after selecting an audio source, submenus are displayed that allow further refinement of the audio source selection, such as a radio station or an audio track (e.g., a piece of music) to be played.

[0056] In one embodiment, the modules 32, 34, 36; 38 are each manufactured as programmable logic components, such as field-programmable gate arrays (FPGA), microprocessors, general-purpose processing on graphics processing (GPGPU) components, or dedicated integrated circuits, such as application-specific integrated circuits (ASIC).

[0057] In one embodiment, modules 32, 34, 36; 38 are implemented in the form of software instructions that constitute a computer program which, when executed by a computer, implements a method for controlling a human-machine interface for a vehicle.

[0058] For example, in a first embodiment, which in Fig. Figure 3 shows that the detector 22 is positioned on the right side of the steering wheel 6, designated 6R, to enable the detection of the movement of the fingers of the driver's right hand when his right hand is positioned on the steering wheel 6.

[0059] The graphical interface 14 displays menus 25-1, 25-2, etc., for example in the form of graphical elements (symbols, text, logos, etc.).

[0060] For example, if the driver performs a second movement in the direction of arrow F (in this first embodiment essentially parallel to the Y-axis), menu 25-1 is replaced by menu 25-2 in main position 42. In other words, the direction of the second movement indicates the rotation of the menu, from right to left or vice versa.

[0061] The main position 42 is preferably in a line (i.e. along the direction X) with the finger or fingers whose movement is detected.

[0062] Alternatively or additionally, the main position is graphically marked, for example by highlighting, changing the contrast or by other graphic marking.

[0063] Alternatively, in a second embodiment, which is described in Fig. As shown in Figure 4, the detector 22 is arranged on the right side of the steering wheel 6, designated 6R, and extends substantially vertically in the longitudinal direction. The detector 22 illuminates the detection area 24. In this second embodiment, the displayed menus scroll vertically when the driver performs a second movement in the direction of arrow F (a substantially vertical movement, parallel to the Z-axis in this second embodiment). The rotation of the menu display, from top to bottom or from bottom to top, is indicated by the direction of finger movement.

[0064] As in the first embodiment, the main position 42 is preferably arranged in a line (i.e. along the direction X) with the finger or fingers whose movement is detected.

[0065] Alternatively or additionally, the main position is graphically marked, for example by highlighting, changing the contrast or by other graphic marking.

[0066] Of course, an analogous process can be provided for each of the embodiments to execute commands by movements of one or more fingers of the driver's left hand by attaching the detector 22 to the left side 6L of the steering wheel 6.

[0067] In this embodiment, it is provided that a first movement of one or two fingers of the driver in direction X, i.e. in the direction of the display interface, is detected in order to activate the menu display control, as shown in insertion A in Fig. 5 shown.

[0068] The detection of a second, essentially horizontal movement of the driver's finger(s) in the Y direction (see insertion B in Fig. 5) triggers scrolling through the menus on the display interface.

[0069] The scrolling direction is indicated, for example, by the direction of the second movement of the driver's fingers, either to the right or to the left. Based on the selected scrolling direction, the menu located to the right or left of the main menu is displayed instead. In this implementation, scrolling is performed incrementally based on every second movement of the driver's finger(s).

[0070] The detection of a third, essentially vertical finger movement in the Z direction (see insertion C in Fig. 5), which differs from the first and second movements, confirms the menu displayed at the main position as the selected menu and then triggers the activation of the command associated with the selected menu.

[0071] Alternatively, scrolling can also be controlled by a second movement of the user's fingers in the Z-direction (vertical direction), with the scrolling direction being either down or up, depending on the direction of this second movement. Optionally, confirmation can be achieved with a third movement of the fingers, essentially parallel to the Y-axis.

[0072] The control system is configured to implement a procedure for controlling a graphical interface, the procedure comprising the following steps: - Activating a menu display control on the display interface after an initial movement of at least one finger towards the display interface has been detected, with each menu being assigned at least one command, - After detecting a second movement of at least one driver in a first, essentially horizontal or vertical direction, the menus on the display interface are scrolled based on the detected second movement, which differs from the first movement, and a menu is selected when the driver completes the second movement. - Receiving a command to validate the selected menu and activating the selected menu.

[0073] Advantageously, the proposed control system allows a simplified, easy control for a driver to remotely select menus on a non-contact graphical interface and activate commands to change the display and / or vehicle equipment through simple finger movements.

Claims

[1] System for controlling a human-machine interface for a vehicle, the vehicle comprising a steering wheel (6) to be operated by the driver of the vehicle and a display interface (14), the control system comprising a detector (22) configured to detect movement in a detection area (24) connected to the steering wheel, wherein the detector is configured to detect movement of at least one finger of the driver of the vehicle in the detection area (24), the control system comprising a control unit (30) connected to the detector and the display interface, wherein the control unit (30) is configured to: - a menu display control on the display interface (14) is activated (32) after a first movement of at least one finger of the driver towards the display interface (14) has been detected, wherein each menu is assigned at least one command, - after detecting at least one second movement of the finger of at least one driver in a first, substantially horizontal or vertical direction based on the at least one detected second movement which differs from the first movement, scrolls through the menus (25-1, 25-2) on the display interface (14) (34), selecting a menu (25-1, 25-2) when the driver completes the second movement, - receives a command to validate the selected menu (36) and - the selected menu is activated (38). [2] Control system according to claim 1, wherein the validation command is executed by at least a third movement of the finger of the at least one driver in a second direction, which is substantially perpendicular to the first direction. [3] Control system according to claim 1, wherein the validation command is executed via a validation element (35). [4] Control system according to one of claims 1 to 3, wherein the reception of the validation command comprises a validation display of the selected menu at a predetermined main position (42) on the display interface (14), wherein the predetermined main position is to the right of the driver's finger. [5] Control system according to any one of claims 1 to 4, wherein the detector (22) is an infrared detector. [6] Control system according to one of claims 1 to 5, wherein the detector (22) is integrated into a fairing element (10) of the vehicle (4). [7] Control system according to one of claims 1 to 6, wherein the detector (22) is elongated, the detector is arranged in a horizontal shelf of the vehicle or the detector is arranged in a support element of the steering wheel (6). [8] Control system according to claim 7, wherein the detector extends horizontally from one side of the steering wheel and enables the detection of movements performed by one or more fingers of the driver when the driver places his hand on that side of the steering wheel. [9] Method for controlling a human-machine interface for a vehicle, which is implemented by a control system according to claims 1 to 8, the method comprising the following steps: - Activating a menu display control on the display interface after an initial movement of at least one finger towards the display interface has been detected, with each menu being assigned at least one command, - after detecting at least one second movement of the finger of at least one driver in a first, substantially horizontal or vertical direction, based on the at least one detected second movement that differs from the first movement, scrolls through the menus on the display interface, selecting a menu when the driver completes the second movement, - Receiving a command to validate the selected menu and - Activating the selected menu. [10] Vehicle equipped with a control system according to claims 1 to 8.

Images