System and method for controlling a human-machine interface for a vehicle

The control system addresses driver distraction by enabling finger-controlled menu navigation and selection on a vehicle display interface, improving ergonomics and safety through hands-free operation.

FR3169796A1Pending Publication Date: 2026-06-19FAURECIA INTERIEUR IND

Patent Information

Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
FAURECIA INTERIEUR IND
Filing Date
2024-12-16
Publication Date
2026-06-19

AI Technical Summary

Technical Problem

The accumulation of numerous buttons and actuators in vehicles increases the driver's mental workload and distraction risk, while touchscreen interfaces require hands-off operation, compromising safety.

Method used

A control system for a human-machine interface that detects finger movements on a steering wheel to control a display interface, allowing menu scrolling and selection without taking hands off the wheel, using an infrared detector and control unit to manage menu activation and validation.

Benefits of technology

Facilitates easy menu selection and control on a non-touch interface, reducing mental workload and enhancing safety by keeping hands on the steering wheel.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

System and method for controlling a human-machine interface for a vehicle This system includes a detector (22) configured to detect movement in a detection zone (24) associated with the steering wheel of the vehicle, in particular a movement of at least one finger of the driver of the vehicle in said detection zone (24);and a control unit, connected to said detector and to a display interface (14), configured to: activate a menu display control on the display interface following detection of a first movement of at least one finger of the driver directed towards the display interface, following detection of at least a second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scroll through the menus on the display interface according to said at least one second detected movement, a menu being selected when the driver stops said second movement, receive a command to validate said selected menu and activate the selected menu. Figure for the abbreviation: Figure 5;
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: System and method for controlling a human-machine interface for a vehicle

[0001] The present invention relates to a control system for a human-machine interface for a vehicle.

[0002] It also relates to a method of controlling a human-machine interface for an associated vehicle.

[0003] In recent vehicles, particularly in motor vehicles, an increasing number of features are offered to the driver, through the implementation of buttons, and a large amount of information is displayed on vehicle display interfaces.

[0004] In general, vehicles, particularly motor vehicles, include a dashboard and a steering wheel for the driver, as well as various controls for driving the vehicle. In addition, vehicles are equipped with numerous buttons and actuators, located near or directly on the steering wheel, allowing the control of additional functions associated with driving the vehicle, as well as complementary functions, such as selecting an audio source, adjusting the volume, or changing screens on a display interface. The accumulation of numerous buttons and actuators is likely to increase the driver's mental workload and thus increase the risk of distraction while driving.

[0005] Touchscreen display interfaces have also been proposed for vehicles. However, operating such display interfaces requires moving a hand towards the touchscreen and therefore taking one's hands off the steering wheel, which is not recommended from a vehicle safety perspective.

[0006] In general, it is desirable to improve human-machine interfaces and to allow for easier selection and control of the various functionalities offered. For the driver of a vehicle, it is particularly important to facilitate controls and improve ergonomics in order to reduce their mental workload and consequently improve safety while driving the vehicle.

[0007] The present invention aims to provide a solution by proposing a control system for a human-machine interface for a vehicle which is easy for the vehicle driver to use, without interfering with the safety of driving the vehicle.

[0008] To this end, the invention relates to a control system for a human-machine interface for a vehicle, the vehicle comprising a steering wheel control of steering, intended to be operated by a driver of the vehicle, and a display interface, the control system comprising a detector configured to detect movement in a detection zone associated with the steering wheel, the detector being configured to detect movement of at least one finger of the driver of the vehicle in said detection zone, the control system comprising a control unit, connected to said detector and to the display interface, the control unit being configured to: - activate a menu display control on the display interface following the detection of an initial movement of at least one finger of the driver directed towards the display interface, each menu being associated with at least one command, - following the detection of at least one second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scroll through the menus on said display interface according to said at least one second detected movement, said second movement being different from said first movement, a menu being selected when the driver stops said second movement, - receive a validation command for the selected menu and activate the selected menu.

[0009] Advantageously, the proposed human-machine interface control system makes it possible to detect the first and second movements of one or more of the driver's fingers relative to the display interface. Thus, the vehicle driver can easily scroll through and select a menu and activate the selected menu, while keeping their hands on the steering wheel.

[0010] According to other advantageous aspects of the invention, the control system of a human-machine interface comprises one or more of the following features, taken individually or in all technically possible combinations.

[0011] The validation command is performed by at least a third movement of said at least one finger of the driver in a second direction, substantially perpendicular to the first direction.

[0012] The validation command is carried out via a validation device.

[0013] The receipt of the validation command includes a validation display of said selected menu at a predetermined main location on said display interface, said predetermined main location being located to the right of said at least one finger of the driver.

[0014] The detector is an infrared detector.

[0015] The detector is integrated into a trim element of the vehicle.

[0016] The detector is elongated in shape, said detector is arranged in a horizontal shelf of the vehicle, or said detector is arranged in a steering wheel support element.

[0017] The detector extends horizontally from one side of the steering wheel, allowing detection of movements made by one or more fingers of the driver when the driver has his hand on said side of the steering wheel.

[0018] The invention also relates to a method for controlling a human-machine interface for a vehicle implemented by a control system as described above, the method comprising the following steps: - activate a menu display control on the display interface following the detection of an initial movement of at least one finger directed towards the display interface, each menu being associated with at least one command, - following the detection of at least one second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scroll through the menus on said display interface according to said at least one second detected movement, said second movement being different from said first movement, a menu being selected when the driver stops said second movement, - receive a confirmation order for the selected menu and

[0019] activate the selected menu.

[0020] According to another aspect, the invention also relates to a vehicle equipped with a human-machine interface control system as briefly described above.

[0021] The invention will become clearer upon reading the following description, given solely by way of non-limiting example, and made with reference to the drawings in which:

[0022] [Fig-1] [Fig.1] is a schematic perspective view of part of a cabin vehicle incorporating a human-machine interface control system;

[0023] [Fig.2] [Fig.2] is a block diagram of the main functional blocks of a system human-machine interface control according to an embodiment;

[0024] [Fig.3] [Fig.3] is a schematic representation of elements of a system of human-machine interface control according to a first embodiment;

[0025] [Fig.4] [Fig.4] is a schematic representation of elements of a system of human-machine interface control according to a second embodiment, and

[0026] [Fig.5] [Fig.5] is a schematic cross-sectional view illustrating, in insets A, B and C distinct, driver finger movements detected by the human-machine interface control system.

[0027] Figure 1 illustrates part 2 of a vehicle cab 4 equipped with a human-machine interface control system. The invention is applicable to any type of vehicle, in particular to motor vehicles.

[0028] The vehicle includes a steering wheel 6, hereafter referred to simply as steering wheel 6, used to control the direction of travel of the vehicle by a driver positioned in a driver's seat (not shown). The driver manipulates the steering wheel 6 with their hands, respectively their right hand 8R and their left hand 8L.

[0029] The vehicle 4 includes a trim element 10, in which is inserted a dashboard 12 having a display interface 14.

[0030] On the display interface 14 information and control menus are displayed, a command being associated with the display of a submenu or with the actuation of a vehicle equipment.

[0031] In the illustrated example, the display interface 14 has a surface 16, on the side of the interior of the vehicle, which is inclined with respect to the vertical direction indicated by an axis Z of a three-dimensional reference frame R. The three-dimensional reference frame R is an orthogonal spatial reference frame, comprising a first axis X extending towards the front of the vehicle, a second axis Y orthogonal to the first axis X, the axes (X, Y) defining a horizontal plane and a third axis Z extending vertically, orthogonal to the horizontal plane.

[0032] Preferably, and as can be seen in Figures 3 and 4, at least a part of the surface 16 of the display interface 14 is located opposite the steering wheel 6, or opposite a lateral side of the steering wheel, for example the right lateral side.

[0033] Vehicle 4 is equipped with a human-machine interface control system 20, which will be described in more detail below.

[0034] The human-machine interface includes the display interface 14 and actuators for vehicle equipment such as speakers, heating / air conditioning systems, ventilation system, lighting systems.

[0035] The control system 20 includes a detector 22 configured to detect movement in an associated detection zone 24.

[0036] Advantageously, the detector 22 is an infrared detector, comprising at least one light source in the infrared range, for example in the near infrared range in the wavelength range 700 to 2500 nm.

[0037] In one embodiment, the detector 22 has an elongated bar shape, extending longitudinally along a principal direction. Preferably, the detector 22 has a length between 5 cm and 20 cm, for example 10 cm.

[0038] According to one embodiment, the detector 22 comprises a plurality of infrared sensors, arranged in a line, along the longitudinal direction of the detector, two successive sensors being separated by a predetermined distance.

[0039] In one embodiment, as illustrated in [Fig. 1], the detector 22 is arranged in a support plate 26 of the trim element 10, extending horizontally (parallel to the (X,Y) plane of the reference frame R), so as to illuminate at least a portion of the steering wheel. In another embodiment, the detector 22 extends longitudinally substantially parallel to the Y axis of the reference frame R.

[0040] For example the detector is placed near a lateral side of the steering wheel 6, for example near the right lateral side 6R of the steering wheel 6. An example of the positioning of the detector 22 relative to the steering wheel 6 is illustrated in [Fig.3].

[0041] In this embodiment, the detector 22 comprises an infrared light source configured to illuminate in the vertical direction, the associated detection area 24 being a frustoconical area including the lateral side of the steering wheel.

[0042] Alternatively; and as illustrated in the example of [Fig.4], the detector 22 is arranged in a trim element located behind the steering wheel 6 and close to the steering wheel 6, for example a steering wheel 6 support element, in a substantially vertical plane, the detector 22 extending longitudinally parallel to the Z axis (vertical axis) of the reference frame R.

[0043] Advantageously, thanks to the arrangement and shape of the detector 22, the associated detection zone 24 makes it possible to detect the respective movements of one or more fingers of the driver of the vehicle when the driver has his hands on the steering wheel.

[0044] For example, the control system detects the movement of one or two fingers of the driver, the index and / or middle finger, of the hand (e.g. the right hand) which is opposite the detection zone 24 when it is positioned on the steering wheel 6.

[0045] The control system 20 includes a control unit 30 which is connected, for example by a wired communication bus, to the detector 22 and to the display interface 14.

[0046] The control unit 30 is a programmable electronic unit, for example a microcontroller.

[0047] The control unit 30 is configured to receive motion detection information from the detector 22.

[0048] The motion detection information received indicates or allows the calculation of a direction of movement of an object, in particular the fingers of the driver, in the detection zone, among the respective directions X, Y and Z.

[0049] The control unit 30 is further connected to the display interface 14, and is configured to control and modify the display on the display interface, in particular to control the display location of menus, each menu being associated with a command.

[0050] The control unit 30 is configured to implement a module 32 for activating the control of the display of menus on the display interface following the detection of a first movement of one or more fingers of the driver directed towards the display interface, i.e. substantially in the direction of the X axis.

[0051] For example, starting from an initial position in which the driver has their hands on the steering wheel and their fingers around the steering wheel 6, the driver extends one or more fingers, for example the index and / or middle finger, towards the display interface. The detection of this first movement triggers the activation of the menu display control.

[0052] In addition, the control unit is configured to implement a module 34 for activating the scrolling of the displayed menus based on at least one second movement, detected by the detector 22, of the driver's finger(s) in a first direction, horizontal or vertical.

[0053] Menu scrolling consists of modifying the display on the display interface to successively place each menu in a chosen main location 42.

[0054] The scrolling is thus advantageously controlled by the second movement of the driver's finger(s).

[0055] Finally, the control unit is configured to implement a validation module 36 configured to receive a validation command from a selected menu and validate the selected menu. The selected menu is, for example, the menu displayed in the main location 42 of the display area.

[0056] In one embodiment, the validation command is for example carried out by a third movement of the driver's fingers in a second distinct direction, preferably perpendicular, to the first direction.

[0057] Alternatively, the validation command is carried out by means of a validation device 35, for example a push button located on the steering wheel 6 or near the steering wheel 6.

[0058] Following validation of the selected menu, the control unit is configured to implement a module 38 for activating the command associated with the selected menu.

[0059] Activating the command either changes the display on the graphical interface or changes the behavior of a piece of equipment 40 on board the vehicle, by sending a signal to the actuator of the equipment 40. The equipment 40 is, for example, a loudspeaker, a heating / air conditioning system, a lighting system.

[0060] For example, in the case of a menu for selecting the audio source to be played back on the vehicle's speakers, the command has the effect of selecting the audio source (e.g. radio, external source connected by a communication link).

[0061] Alternatively or in addition, the command associated with a menu leads to the development of submenus. For example, following the selection of an audio source, submenus are displayed, these submenus allowing the selection of the audio source to be specified, for example a radio channel or an audio track (e.g. a musical track) to be played back.

[0062] In one embodiment, modules 32, 34, 36, and 38 are each implemented as programmable logic components, such as FPGAs (Field Programmable Gate Arrays), microprocessors, GPGPUs (General-Purpose Processing Units), or dedicated integrated circuits, such as ASICs (Application-Specific Integrated Circuits).

[0063] In one embodiment, modules 32, 34, 36; 38 are implemented in the form of software instructions forming a computer program, which, when executed by a computer, implements a method for controlling a human-machine interface for a vehicle.

[0064] By way of example, in a first embodiment illustrated in [Fig.3], the detector 22 is placed on the right side of the steering wheel 6, referenced 6R, so as to allow the detection of movement of the fingers of the driver's right hand when his right hand is positioned on the steering wheel 6.

[0065] The graphical interface 14 allows the display of menus 25-1, 25-2 etc, for example in the form of graphic items (icons, text, logos etc).

[0066] For example, when the driver makes a second movement in the direction of arrow F (substantially parallel to the Y axis in this first embodiment), menu 25-1 is replaced by menu 25-2 in the main location 42. In other words, the direction of the second movement indicates a direction of rotation of the menus, from right to left or vice versa.

[0067] The main location 42 is preferably located to the right (i.e. along the X direction) of the finger or fingers whose movement is detected.

[0068] Alternatively or in addition, the main location is marked graphically, for example by highlighting, a change in contrast or another graphic mark.

[0069] Alternatively, in a second embodiment illustrated in [Fig. 4], the detector 22 is placed on the right lateral side of the steering wheel 6, referenced 6R, the detector 22 extending longitudinally in a substantially vertical direction. The detector 22 illuminates the detection area 24. In this second embodiment, when the The driver makes a second movement in the direction of arrow F (a nearly vertical movement, parallel to the Z-axis in this second embodiment), and the displayed menus scroll vertically. The direction of rotation of the menu display, from top to bottom or bottom to top, is indicated by the direction of the finger movement.

[0070] As in the first embodiment, the main location 42 is preferably located to the right (i.e. along the X direction) of the finger or fingers whose movement is detected.

[0071] Alternatively or in addition, the main location is marked graphically, for example by highlighting, a change in contrast or another graphic mark.

[0072] Of course, an analogous operation is conceivable, for each of the embodiments, to carry out commands by movements of one or more fingers of the driver's left hand, by placing the detector 22 on the left lateral side 6L of the steering wheel 6.

[0073] In one embodiment, it is envisaged to detect a first movement of one or two fingers of the driver in the X direction, towards the display interface, to activate the menu display control, as illustrated in insert A of [Fig.5].

[0074] Detection of a second substantially horizontal movement, along the Y direction (see insert B of [Fig.5]) of the driver's finger(s) induces a scrolling of the menus on the display interface.

[0075] For example, the scrolling direction is indicated by the direction of the second movement of the driver's fingers, either to the right or to the left. Depending on the chosen scrolling direction, the menu located to the right or left of the menu displayed in the main location is shown instead of the latter. In this embodiment, the scrolling is performed step by step according to each second movement of the driver's finger(s).

[0076] Detection of a third substantially vertical finger movement, along the Z direction (see insert C of [Fig.5]), distinct from the first and second movements, allows the menu displayed in the main location to be validated as the selected menu, and then induces the activation of the command associated with the selected menu.

[0077] Of course, alternatively, the scrolling is controlled by second movements of the driver's fingers in the Z direction (vertical direction), and the direction of the scrolling is either from top to bottom or from bottom to top, depending on the direction of the second movement of the driver's fingers, and optionally, the validation is controlled by a third movement of the fingers substantially parallel to the Y axis.

[0078] The control system is configured to implement a graphical interface control method, the method comprising the following steps: - activate a menu display control on the display interface following the detection of an initial movement of at least one finger directed towards the display interface, each menu being associated with at least one command, - following the detection of a second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scroll through the menus on said display interface according to the second detected movement, said second movement being different from said first movement, a menu being selected when the driver stops said second movement, - receive a validation command for the selected menu and activate the selected menu.

[0079] Advantageously, the proposed control system allows for simplified control, easy for a vehicle driver, enabling remote selection of menus on a non-touch graphical interface, and activation of commands to modify the display and / or equipment of the vehicle by simple finger movements.

Claims

Demands

1. A vehicle human-machine interface control system, the vehicle comprising a steering wheel (6) for steering control, intended to be operated by a vehicle driver, and a display interface (14), the control system comprising a detector (22) configured to detect movement in a detection zone (24) associated with the steering wheel, the detector being configured to detect movement of at least one finger of the vehicle driver in said detection zone (24), the control system comprising a control unit (30) connected to said detector and to the display interface, the control unit (30) being characterized in that it is configured to: - activate (32) a menu display control on the display interface (14) following the detection of a first movement of at least one finger of the driver directed towards the display interface (14), each menu being associated with at least one command,- following the detection of at least one second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scroll (34) through the menus (25-1, 25-2) on said display interface (14) according to said at least one second detected movement, said second movement being different from said first movement, a menu (25-1, 25-2) being selected when the driver stops said second movement, - receive (36) a command to validate said selected menu and - activate (38) the selected menu.

2. Control system according to claim 1, wherein the validation command is performed by at least a third movement of said at least one finger of the driver in a second direction, substantially perpendicular to the first direction.

3. Control system according to claim 1, wherein the validation command is carried out via a validation member (35).

4. Control system according to any one of claims 1 to 3, wherein the receipt of the validation command includes a validation display of said selected menu at a predetermined main location (42) on said display interface (14), said predetermined main location being located at the right of said at least one finger of the driver.

5. Control system according to any one of claims 1 to 4, wherein said detector (22) is an infrared detector.

6. Control system according to any one of claims 1 to 5, wherein said detector (22) is integrated into a trim element (10) of the vehicle (4).

7. Control system according to any one of claims 1 to 6, wherein said detector (22) is elongated in shape, said detector is arranged in a horizontal shelf of the vehicle, or said detector is arranged in a steering wheel support element (6).

8. Control system according to claim 7, wherein said detector extends horizontally from one lateral side of the steering wheel, enabling detection of movements made by one or more fingers of the driver when the driver has his hand on said lateral side of the steering wheel.

9. A method for controlling a vehicle human-machine interface implemented by a control system according to claims 1 to 8, the method comprising the following steps: - activating a menu display control on the display interface upon detection of a first movement of at least one finger directed towards the display interface, each menu being associated with at least one command, - upon detection of at least a second movement of said at least one finger of the driver in a first direction, substantially horizontal or vertical, scrolling through the menus on said display interface according to said at least a second detected movement, said second movement being different from said 12 first movement, a menu being selected when the driver stops said second movement, - receive a command to validate the selected menu and - activate the selected menu.

10. Vehicle equipped with a control system conforming to claims 1 to 8.