Method for operating at least one human-machine interface in a vehicle which can be at least partially autonomously driven, device and vehicle
The method and device for a human-machine interface in partially autonomously drivable vehicles address the issue of reduced user attention by outputting visual signals indicating the current driving mode, thereby enhancing perceptibility and user comfort and improving safety.
Patent Information
- Application Number
- PCT/EP2024/082637
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-04
- Filing Date
- 2024-11-18
- Publication Date
- 2025-06-12
AI Technical Summary
In partially autonomously drivable vehicles, users may not fully attend to the driving situation, reducing the perceptibility of user information and comfort.
A method and device for operating a human-machine interface with illuminating means arranged on the steering wheel, side door, window, or exterior of the vehicle, which outputs visual signals indicating the current driving mode, enhancing perceptibility and user comfort.
The solution increases the perceptibility of user information and user comfort by allowing visual signals to be perceived in the peripheral field of vision, even when the user is not directly looking at the instrument cluster, thereby enhancing safety.
Smart Images

Figure EP2024082637_12062025_PF_FP_ABST
Abstract
Description
[0001] Description
[0002] Method for operating at least one human-machine interface in an at least partially autonomously drivable vehicle, device and vehicle
[0003] The invention relates to a method for operating at least one human-machine interface in an at least partially autonomously drivable vehicle, a corresponding device and a corresponding vehicle.
[0004] A human-machine interface is typically used in a vehicle to output user information to a user and / or process user inputs. Human-machine interfaces known from vehicles, for example, feature instrument clusters in the vehicle's dashboard and use these to communicate with the user.
[0005] When using at least partially autonomous vehicles, it may happen that a user does not pay full attention to the driving situation and, for example, shifts their gaze away from the aforementioned instrument cluster. Therefore, it is desirable to increase the perceptibility of user information and user comfort even when using at least partially autonomous vehicles.
[0006] The technical problem is to create a method for operating at least one human-machine interface in an at least partially autonomously driveable vehicle, a device and a vehicle which increase the perceptibility of user information as well as the user comfort when using at least partially autonomously driveable vehicles.
[0007] The solution to the technical problem is achieved by the subject matter having the features of the independent claims. Further advantageous embodiments of the invention are set forth in the subclaims.
[0008] A method is proposed for operating at least one human-machine interface in an at least partially autonomously drivable vehicle, wherein the at least one human-machine interface has at least one illuminating means, wherein the at least one illuminating means is arranged on a steering wheel and / or on a side door and / or along a window and / or on an outside of the vehicle, comprising the steps:
[0009] Determine a currently set driving mode,
[0010] Operating the at least one human-machine interface, wherein, depending on the determined driving mode, at least one visual signal is output by means of the at least one illuminant, wherein the at least one visual signal signals at least the currently set driving mode.
[0011] Further proposed is a device for operating at least one human-machine interface in an at least partially autonomously drivable vehicle, comprising:
[0012] - at least one human-machine interface, wherein the at least one human-machine interface has at least one illuminating means, wherein the at least one illuminating means is arranged on a steering wheel and / or on a side door and / or along a window and / or on an exterior side of the vehicle,
[0013] - at least one control device for determining a currently set driving mode and for operating the at least one human-machine interface, wherein at least one visual signal can be output by means of the at least one illuminant as a function of the determined driving mode, wherein the at least one visual signal signals at least the currently set driving mode.
[0014] The device may in particular be designed to carry out one, several or all steps of the method according to an embodiment described in this disclosure.
[0015] Further proposed is a vehicle with a device according to an embodiment described in this disclosure.
[0016] The technical effects and advantages mentioned for the proposed method also apply to the device and the vehicle.
[0017] If the at least one light source of the human-machine interface is arranged on the steering wheel, on a side door and / or along a window of the vehicle, a user, e.g. the driver, or a front passenger can perceive the visual signal, e.g. in the peripheral field of vision, without the user's or the front passenger's gaze having to be directed at the aforementioned instrument cluster. If the at least one light source of the human-machine interface is arranged on an exterior side of the vehicle, a passerby outside the vehicle can perceive the visual signal particularly easily and in this way be informed about the currently selected driving mode. Thus, the invention ensures and even increases the perceptibility of the visual signal and user comfort when using at least partially autonomous vehicles. In particular, safety is also increased.
[0018] The currently set driving mode is in particular an at least partially autonomous driving mode (SAE automation level or SAE level). The currently set driving mode can, for example, be a driving mode according to SAE Level 2 or a driving mode according to SAE Level 3. In a driving mode according to SAE Level 2, a user can, for example, remove their hands from the steering wheel without the driving mode being aborted for safety reasons. Such a driving mode is also referred to as a hands-off driving mode. In a driving mode according to SAE Level 3, the user can, for example, remove their hands from the steering wheel and also look away from the driving situation without the driving mode being aborted for safety reasons. Such a driving mode is also referred to as a hands-and-eyes-off driving mode. Of course, the currently set driving mode can also be a driving mode according to SAE Level 0, 1 or 2 or a driving mode according to SAE Level 4 or 5.
[0019] The visual signal represents, in particular, the currently selected driving mode. The visual signal can, for example, be output in a color associated with the determined driving mode.
[0020] The light source can, for example, be part of the interior and / or ambient lighting of the vehicle. The light source can, for example, be designed as a flexible light strip or a light bar or have one(s). The light source can, in particular, be elongated and narrow, i.e. a longitudinal dimension of the light source can be a multiple of a width and / or height dimension of the light source, e.g. twice the width dimension and height dimension. In this way, the light source can be arranged particularly effectively on the steering wheel, on the side door, along the window and / or on the outside of the vehicle, in particular in otherwise unused spaces such as in a joint between two components.
[0021] The control device can be designed as a microcontroller, for example, or comprise one. The control device can, for example, receive information from other devices of the vehicle, such as information about the currently selected driving mode. The control device can, for example, generate a control command for outputting the visual signal or for adjusting a property of the visual signal, such as an output duration, a color, or an intensity of the visual signal, and transmit it to the at least one human-machine device.
[0022] The vehicle's steering wheel can be operated by the user and can be a round or yoke steering wheel, for example. The light source can be arranged around or at a center point of the steering wheel, for example. This makes the visual signal easier to perceive in the user's peripheral field of vision.
[0023] The vehicle's side door can be, for example, a driver's and / or passenger door. The light source can be located on an inside of the side door. For example, the light source can be located on or around a trim strip of the side door. This improves the perceptibility of the visual signal in the user's peripheral vision.
[0024] The window of the vehicle can be, for example, a windscreen, rear window and / or side window of the vehicle. The light source can be arranged, for example, along a terminal edge of the window towards the interior of the vehicle. In this way, the perceptibility of the visual signal can be ensured when looking through the window into the surroundings of the vehicle. In particular, the light source in this case can be designed as a so-called ID. Light. Furthermore, in particular, the light source can be arranged along at least 80% of the width of the window, in particular the front window. This enables, for example, passengers or passers-by to also perceive the visual signal. The width of the windscreen is, in particular, oriented along the longest terminal edge of the windscreen or corresponds to the dimension of the longest terminal edge of the windscreen.
[0025] The exterior of the vehicle can be, for example, an outward-facing side of a fender or another outward-facing side of the vehicle's outer skin. The light source can be positioned along the vehicle's roofline, for example. This allows the visual signal to be perceived by the surrounding area, such as passersby or other vehicles.
[0026] However, other installation locations for the light source are also possible. For example, the at least one light source can be arranged on a dashboard and / or on a roof lining and / or a seat and / or on another part of the vehicle's interior. This further increases the perceptibility of the visual signal. In one embodiment, the at least one visual signal is only emitted if the determined driving mode is an at least partially autonomous driving mode of the vehicle. In this way, the visual signal can be used to signal to the user, a passenger, and / or the surroundings that the vehicle is currently driving at least partially autonomously.
[0027] In one embodiment, the at least one visual signal is output in a first color if the determined driving mode is a driving mode according to SAE Level 2 and the at least one visual signal is output in a second color if the determined driving mode is a driving mode according to SAE Level 3. The different colors make it easy to visually distinguish between the different driving modes. This is particularly advantageous if the vehicle sets the driving mode independently and thus signals to the user via the visual signal which driving mode is currently set. The first color can, for example, comprise green-colored light. The second color can, for example, comprise turquoise or cyan light. The first and / or second color can be essentially monochrome.
[0028] In one embodiment, the first color scheme exclusively comprises light with a wavelength of 492 nm to 575 nm and the second color scheme exclusively comprises light with a wavelength of 482 nm to 492 nm. Light with a wavelength of 492 nm to 575 nm is also referred to as green-colored light. Light with a wavelength of 482 nm to 492 nm is also referred to as turquoise or cyan light. Tests have shown that green-colored light is particularly suitable for not disturbing the user with regard to the perceptibility of a driving event and at the same time not reducing the perceptibility of the visual signal by the user. This is particularly advantageous when the driving mode is a driving mode according to SAE Level 2, which tends to require a higher level of attention from the user than a driving mode according to SAE Level 3. Furthermore, tests have shown that turquoise or cyan light are particularly suitable forCyan-colored light has a particularly high-quality appearance and thus increases user comfort in a driving mode according to SAE Level 3.
[0029] In one embodiment, the intensity of the visual signal is adjusted depending on the installation location of the at least one illuminating means and / or the intensity of the visual signal is adjusted depending on at least one environmental condition. The intensity of the visual signal can thus be adjusted depending on whether the at least one illuminating means is installed on the steering wheel and / or on the side door and / or along the windshield and / or on the exterior of the vehicle. For example, the intensity of the visual signal can be set to a first value if the at least one illuminating means is arranged on the steering wheel.Furthermore, for example, an intensity of the visual signal can be set to a further value if the at least one light source is arranged on the side door and / or along the window and / or on the outside of the vehicle, wherein the further value can in particular be higher than the first intensity value or vice versa. In this way, the perceptibility of the visual signal can be adapted to the installation location of the light source. Furthermore, the intensity of the visual signal can depend on at least one environmental condition. The environmental condition can be determined, for example, by means of a sensor device. The environmental condition can, for example, be a value for the need for user intervention in the driving process. For example, the value for the need for intervention can exceed a predetermined threshold value for the need for intervention.If the threshold value for the need for intervention is exceeded, the intensity of the visual signal can be changed, for example set to pulsate, to signal to the user the need for intervention. This is particularly advantageous if the currently set driving mode is a driving mode according to SAE Level 3. The ambient condition can also be a value of the intensity of the ambient light, for example. For example, the value of the intensity of the ambient light can exceed a predetermined threshold value of the intensity of the ambient light. If the threshold value of the intensity of the ambient light is exceeded, the intensity of the visual signal can be increased, for example, and / or the intensity of the visual signal can be reduced if the value of the intensity of the ambient light falls below the predetermined further threshold value.In this way, the perceptibility of the visual signal can be adapted to the at least one environmental condition. The device explained above can have the aforementioned sensor device for determining the at least one environmental condition. The sensor device can, for example, comprise a camera for monitoring the driving situation and / or an ambient light sensor.
[0030] In one embodiment, the at least one human-machine interface has at least one input means, wherein the at least one illuminating means is arranged at least partially around the at least one input means. The input means can be used, for example, to set a driving mode by the user. The input means can in particular be designed as a haptic input means and, for example, have one or more buttons. The input means can, for example, be arranged on the steering wheel of the vehicle. By arranging the illuminating means around the at least one input means, the perceptibility of the visual signal, for example, during user inputs, is improved. In one embodiment, the at least one visual signal is output continuously for at least a period of time, wherein the period of time ends at the earliest with the setting or determination of a different driving mode. The determination of a different driving mode can, for example, take place using the aforementioned control device.In this way, it can be ensured that the visual signal is permanently perceptible while the currently selected driving mode is active. In particular, the intensity of the visual signal can be set to a constant value over the period of time, i.e., the intensity can be constant.
[0031] In one embodiment, the method further comprises the steps:
[0032] ■ Determining a road section on which the vehicle is currently located,
[0033] ■ Activation of at least one at least partially autonomous driving mode depending on the specific road section,
[0034] ■ Setting at least one enabled driving mode as the current driving mode.
[0035] The road section can be, for example, a country road section or a motorway section. On the specific road section, the use of an at least partially autonomous driving mode can be permitted, for example. The road section can be determined and enabled, for example, using the control device. For example, the control device can determine a current location of the vehicle using a GNSS signal, whereby the specific location can be assigned to the road section, for example, via a road map. Activating the mode makes it possible to set the at least partially autonomous driving mode on the specific road section. The enabled driving mode can be set via user input, e.g. using the input means explained above, or the setting can be made independently, e.g. by the control device or the vehicle itself, i.e. without user input.
[0036] Furthermore, at least one additional visual signal can be emitted by the at least one light source when the at least partially autonomous driving mode has been activated. In this way, the additional visual signal can signal to the user that the driving mode has been activated.
[0037] The invention is explained in more detail using exemplary embodiments. The figures show:
[0038] Fig. 1 is a schematic representation of an embodiment of a vehicle and
[0039] Fig. 2 shows a schematic flow diagram of an embodiment of a method. In the following, like reference numerals designate elements with the same technical features.
[0040] Fig. 1 shows a schematic representation of an embodiment of a vehicle 200 with a device 100 for operating a human-machine interface 10. The device 100 comprises the human-machine interface 10 and a control device 20 designed as a microcontroller for controlling the human-machine interface 10.
[0041] The human-machine interface 10 has a plurality of lighting devices 11, 12, 13, 14 for outputting at least one visual signal. The lighting devices 11, 12, 13, 14 are arranged at different installation locations of the vehicle 200. Furthermore, the human-machine interface 10 has an input device 15 designed as a plurality of buttons (not shown), which is arranged on a steering wheel 210 of the vehicle 200. The input device 15 is identified in Fig. 1 by an ellipse around a center point of the steering wheel 210. The input device 15 serves, for example, to set a driving mode from a plurality of available driving modes of the vehicle 200. To set the driving mode, a user N, e.g. the driver, can operate the input device 15.
[0042] The control device 20 is used to determine the driving mode of the vehicle 200 currently set by the user N. Based on the determined driving mode, the human-machine interface 10 is operated by means of the control device 20. For example, the control device 20 can generate a control command for each lighting device 11, 12, 13, 14. The respective control command can be transmitted via lines (indicated by dashed lines in Fig. 1) from the control device 20 to the respective lighting devices 11, 12, 13, 14 of the human-machine interface 10. The respective control command can, for example, be designed such that the respectively controlled lighting device 11, 12, 13, 14 each outputs a visual signal which, for example, signals the currently set driving mode to the user N. The visual signals output by the lighting devices 11, 12, 13, 14 can, for example,have a common color scheme that represents the currently selected driving mode.
[0043] Furthermore, for example, the lighting means 11 designed as an LED ring (indicated in Fig. 1 by a black filled annular ellipse) is arranged around the input means 15 on the steering wheel 210. In this way, the user N can be given immediate feedback, for example after setting the driving mode, by the output visual signal that setting the driving mode was successful.
[0044] Furthermore, a light source 12 configured as an LED strip is arranged on the inside of each of the side doors 220 of the vehicle 200. The LED strips are indicated by black bars in Fig. 1.
[0045] The illuminant 13, designed as an LED strip (also indicated by black bars in Fig. 1), is arranged along a pane 230 formed as a windshield. The illuminant 13 extends over more than 80% of a width B of the pane 230. The width B of the pane 230 corresponds, for example, to the dimension of the longest end edge 235 of the pane 230 between the passenger compartment and the front of the vehicle.
[0046] Furthermore, on the driver and passenger side outside 240 of the
[0047] A light source 14 configured as an LED strip (also indicated by black bars in Fig. 1) is arranged on the vehicle 200. The light source 14 extends over more than 80% of a length L of the vehicle 200. The length L of the vehicle corresponds, for example, to the dimension of the longest outer side 240 of the vehicle 200.
[0048] Since the lighting devices 11, 12, 13, 14 are arranged at different installation locations of the vehicle 200, both the user N and, for example, a passenger (not shown) or a passerby outside the vehicle 200 (not shown) can easily perceive the visual signal in their peripheral field of vision. Thus, the device 100 shown in Fig. 1 ensures and even increases the perceptibility of the visual signal when using the at least partially autonomously drivable vehicle 200.
[0049] Fig. 2 shows a schematic flow diagram of an embodiment of a method. The method comprises the following steps.
[0050] In a step S1, a road section (not shown) on which a vehicle 200 is currently located is determined (see Fig. 1). The road section can be, for example, a motorway section. The road section can be determined, for example, with the aid of the control device 20 shown in Fig. 1.
[0051] In a step S2, at least one at least partially autonomous driving mode is enabled depending on the specific road section. For example, the use of autonomous driving functions may be permitted on a motorway section. The at least partially autonomous driving mode can, for example, be a driving mode according to SAE Level 2 or SAE Level 3. The at least partially autonomous driving mode can also be enabled, for example, using the control device 20 (see Fig. 1).
[0052] In a step S3, the enabled driving mode is set as the current driving mode F. For example, a user N sets the enabled driving mode by means of an input device 15 (see Fig. 1) or the vehicle 200 independently sets the enabled driving mode as the driving mode, e.g., depending on the specific road section.
[0053] In step S4, the currently set driving mode is determined. This determination can also be performed, for example, using the control device 20 (see Fig. 1).
[0054] In a step S5, a human-machine interface 10, which may have a plurality of lighting devices 11, 12, 13, 14 (see Fig. 1), is operated, for example, by means of the control device 20. Depending on the determined driving mode, a visual signal is output, for example, by means of the lighting devices 11, 12, 13, 14. The visual signal can visually signal the currently set driving mode to the user N (see Fig. 1).
[0055] The visual signal is in particular only output if the determined driving mode is an at least partially autonomous driving mode of the vehicle 200. If the determined driving mode is, for example, a driving mode according to SAE Level 2, the visual signal can be output in a first color. The first color, for example, exclusively comprises light with a wavelength of 492 nm to 575 nm. This corresponds to green-colored light. If the determined driving mode is, for example, a driving mode according to SAE Level 3, the visual signal can be output in a second color. The second color, for example, exclusively comprises light with a wavelength of 482 nm to 492 nm. This corresponds to turquoise or cyan light.
[0056] The intensity of the visual signal can be adjusted depending on the installation location of the respective lighting means 11, 12, 13, 14. The intensity can be adjusted, for example, using the control device 20. For example, the intensity of the visual signal for the lighting means 14 arranged on the outer sides 240 of the vehicle 200 can be set differently, in particular higher, than for the lighting means 11, 12, 13 located in an interior of the vehicle 200 (cf. Fig. 1). The intensity of the visual signal for the lighting means 11, 12, 13 arranged in the interior can, for example, be adjusted such that the visual signal is perceived as dimmed by the user N. Furthermore, the intensity of the visual signal can be adjusted in this way depending on an ambient condition, such as an intensity of the ambient light.
[0057] The visual signal can be continuously output over a period of time. During this period, the intensity of the visual signal can be set to a constant level, for example. The period can begin, for example, with the first output of the visual signal and end with the determination or setting of a different driving mode. Setting a different driving mode can be done, for example, by user N via input device 15.
[0058] List of reference symbols
[0059] 10 Human-machine interface
[0060] 11 ... 14 lamps
[0061] 15 input devices
[0062] 20 Control device
[0063] 100 device
[0064] 200 vehicles
[0065] 210 steering wheel
[0066] 220 side door
[0067] 230 disc
[0068] 235 End edge
[0069] 240 Outside
[0070] B Width of the disc
[0071] L Length of the vehicle
[0072] N users
[0073] S1 Step of determining a road section
[0074] S2 Step of unlocking a driving mode
[0075] S3 Step of setting its unlocked driving mode
[0076] S4 Step of determining a currently set driving mode
[0077] 85 Step of operating the human-machine interface
Claims
Patent claims 1. A method for operating at least one human-machine interface (10) in an at least partially autonomously drivable vehicle (200), wherein the at least one human-machine interface (10) has at least one illuminating means (11, 12, 13, 14), wherein the at least one illuminating means (11, 12, 13, 14) is arranged on a steering wheel (210) and / or on a side door (220) and / or along a window (230) and / or on an outer side (240) of the vehicle (200), comprising the steps: Determining (S4) a currently set driving mode, Operating (S5) the at least one human-machine interface (10), wherein, depending on the determined driving mode, at least one visual signal is output by means of the at least one illuminant (11, 12, 13, 14), wherein the at least one visual signal signals at least the currently set driving mode.
2. The method according to claim 1, characterized in that the at least one visual signal is only output if the determined driving mode is an at least partially autonomous driving mode of the vehicle (200).
3. Method according to claim 1 or 2, characterized in that the at least one visual signal is output in a first color scheme if the determined driving mode is a driving mode according to SAE Level 2 and the at least one visual signal is output in a second color scheme if the determined driving mode is a driving mode according to SAE Level 3.
4. The method according to claim 3, characterized in that the first coloration comprises exclusively light with a wavelength of 492 nm to 575 nm and the second coloration comprises exclusively light with a wavelength of 482 nm to 492 nm.
5. Method according to one of the preceding claims, characterized in that an intensity of the visual signal is adjusted as a function of an installation location of the at least one illuminant (11, 12, 13, 14) and / or the intensity of the visual signal is adjusted as a function of at least one environmental condition.
6. Method according to one of the preceding claims, characterized in that the at least one human-machine interface (10) has at least one input means (15), wherein the at least one lighting means (11, 12, 13, 14) is arranged at least partially around the at least one input means (15).
7. Method according to one of the preceding claims, characterized in that the at least one visual signal is continuously output at least over a period of time, the period ending at the earliest with the determination of another driving mode.
8. Method according to one of the preceding claims, characterized in that the method further comprises the steps: Determining (S1) a road section on which the vehicle (200) is currently located, Activating (S2) at least one at least partially autonomous driving mode depending on the specific road section, Setting (S3) at least one enabled driving mode as the current driving mode.
9. Device (100) for operating at least one human-machine interface (10) in an at least partially autonomously drivable vehicle (200), comprising: at least one human-machine interface (10), wherein the at least one human-machine interface (10) has at least one illuminating means (11, 12, 13, 14), wherein the at least one illuminating means (11, 12, 13, 14) is arranged on a steering wheel (210) and / or on a side door (220) and / or along a window (230) and / or on an outer side (240) of the vehicle (200), at least one control device (20) for determining a currently set driving mode and for operating the at least one human-machine interface (10), wherein, depending on the determined driving mode, at least one visual signal can be output by means of the at least one illuminating means (11, 12, 13, 14), wherein the at least one visual signal at least currently set driving mode.
10. Vehicle (200) with a device (100) according to claim 9.
Citation Information
Patent Citations
Automated driving system with a steering wheel display
DE102017205260A1
Device and method for assisting a driver of an automated vehicle
DE102020101894A1
Information provision system
JP2023171385A
Driving assistance method, and driving assistance device, information presentation device, and recording medium using same
US20180356818A1
Operation device for autonomous vehicle
US20220371611A1