Controlling a function of a motor vehicle

Abstract

An interaction device (120) for a motor vehicle (105) comprises the following elements: a display device (215) for presenting an operating element to a user (110); a gesture detection unit (210) for detecting an interaction of the user (110) with the operating element; a feedback device (205) for contactlessly providing a tactile stimulus to the user (110) on the basis of their interaction with the operating element; and a processing device (220) for controlling a function of the motor vehicle (105) on the basis of a detected interaction.

Description

[0001] Controlling a function of a motor vehicle

[0002] The present invention relates to a control system for a motor vehicle. In particular, the invention relates to an interactive control system for a motor vehicle.

[0003] A motor vehicle comprises a number of control elements, each of which controls associated functions of the motor vehicle. A control element can be assigned exclusively to a function or configured to control multiple functions. To make the selection and control of a function by a motor vehicle user easier and less prone to errors, a feedback device can be provided, which, for example, provides acoustic feedback upon interaction with the control element.

[0004] Familiar controls provide only imperfect feedback, meaning the user may not know exactly which function they are currently controlling or even which function can be controlled. Furthermore, many controls are complex and can, individually or collectively, cover an existing surface of the vehicle, making it unavailable for another purpose.

[0005] One object underlying the present invention is to provide an improved technology for user interaction with a motor vehicle. The invention achieves this object by means of the subject matter of the independent claims. Subclaims specify preferred embodiments.

[0006] An interaction device for a motor vehicle comprises a display device for presenting an operating element to a user; a gesture recognition device for detecting an interaction of the user with the operating element; a feedback device for contactlessly providing a tactile stimulus to the user depending on their interaction with the operating element; and a processing device for controlling a function of the motor vehicle depending on a detected interaction.

[0007] The interaction can in particular comprise a gesture by the user. The user can perform the interaction or gesture with a hand or another body part. By providing the tactile stimulus, the user can also operate the control element without observing the control element. Optionally, visual feedback can also be provided via the display device. The user can be more clearly informed about which function they are currently controlling and how they are controlling the function. The interaction can function better in different contexts. For example, in a dark environment the visual feedback can be perceived more strongly, whereas in a bright environment the tactile stimulus can predominate for the user. The improved feedback enables the function to be controlled with greater sensitivity.This means that a critical function or a safety function can be more easily accessible to the user.

[0008] In a preferred embodiment, the feedback device comprises an array with multiple ultrasonic transducers, wherein the ultrasonic transducers can be controlled to emit sound waves that positively overlap at a predetermined location relative to the array. Thus, a tactile stimulus can be provided at that location.

[0009] The tactile stimulus can be transmitted via ambient air, eliminating the need for the user to directly touch any element of the interaction device. This allows for particularly hygienic activation of a function. On the one hand, this prevents the user from being exposed to dirt or microorganisms when activating a control element, and on the other hand, it prevents any part of the vehicle or the interaction device from becoming contaminated through contact.

[0010] The location and / or intensity of a tactile stimulus at that location can be controlled. The location can be selected by matching the phase relationships or frequencies of differently positioned ultrasonic transducers. The intensity of a tactile stimulus can be controlled by controlling the amplitudes of the delivered sound waves. In this way, it is possible to transmit a tactile stimulus to the user at a distance of up to approximately 50 cm from the feedback device.

[0011] The display device can be implemented in different ways. In one embodiment, the display device comprises a display that is attached to the user's head and can be called a head-mounted display. The display device can enrich a directly perceivable impression of an environment with further visual information. Alternatively, the display device can shield ambient light. A visual impression of the environment can be recorded by a camera and combined with further information in order to output it on the display device. The display device can comprise sensors to determine a position of the display device relative to the motor vehicle or the interaction device. In particular, the display device can be configured to display the control element relative to a predetermined section of the motor vehicle.This representation can be independent of the position or movement of the user's head.

[0012] According to another embodiment, the display device is embedded in a surface of the motor vehicle. Preferably, the feedback device and / or gesture recognition are also embedded in the surface. The surface can be closed, so that there is no visual indication of the interaction device when it is not in operation. Accidental control of a vehicle function using the interaction device can thus be ruled out. The interface can have a tidy and clear appearance, allowing the user to control the motor vehicle more effectively.

[0013] In particular, the display device can be integrated into the surface in such a way that the display device is not recognizable when it is not providing any display. The surface can be flat or curved. The surface material can be freely selected within wide limits.

[0014] In a particularly preferred embodiment, the surface comprises an outer surface of the motor vehicle. The interaction device can be configured to be operated by the user while the user is in the vicinity of the motor vehicle. In this embodiment, it can be particularly advantageous for the control element to be invisible when it is not displayed by the display device.

[0015] In this case, the function preferably relates to an element on the exterior of the motor vehicle. The element can be located, in particular, in the area of ​​the interaction device. For example, the element can relate to a tailgate, a fuel filler flap, a door, a window, a convertible top, a cargo area cover, or a similar element. In another embodiment, the element can also operate on the interior of the motor vehicle. For example, an air conditioning system or an interior entertainment system can be controlled from the exterior of the motor vehicle.

[0016] According to a further embodiment, the interaction device further comprises an acoustic output device; wherein the processing device is configured to provide acoustic feedback depending on the user's interaction with the control element. The acoustic output device can be configured to output a tone, a noise, a melody, or synthetic sounds in a human-audible range. This range is typically between approximately 30 Hz and approximately 20,000 Hz. The acoustic output device is preferably implemented separately from the feedback device and can, in particular, comprise a loudspeaker for the aforementioned frequency range.

[0017] According to a further aspect of the present invention, a motor vehicle comprises an interaction device as described herein. The motor vehicle preferably comprises a passenger car. In further embodiments, the motor vehicle may also comprise, for example, a motorcycle, a truck, or a bus. In the case of the motorcycle, an interior and a

[0018] Outdoor space within the meaning of this description essentially coincides.

[0019] According to yet another aspect of the present invention, a method for interaction of a user with a motor vehicle comprises steps of detecting the user in the region of a display device of the motor vehicle; displaying an operating element by means of the display device; detecting an interaction of the user with the operating element; contactlessly providing a tactile stimulus to the user depending on their interaction with the operating element; and controlling a function of the motor vehicle depending on a detected interaction.

[0020] An interaction device described herein may be configured to partially or completely execute a method described herein.

[0021] For this purpose, the processing device can be implemented electronically and comprise, for example, an integrated circuit, a programmable logic module, or a programmable microcomputer. The method can be implemented in the form of a configuration or as a computer program product with program code means for the processing device. The configuration or the computer program product can be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device, or vice versa.

[0022] The invention will now be described in more detail with reference to the accompanying drawings, in which:

[0023] Figure 1 shows a system with a motor vehicle;

[0024] Figure 2 shows an interaction device on a motor vehicle;

[0025] Figure 3 shows a feedback device; and

[0026] Figure 4 illustrates a flow chart of a process.

[0027] Figure 1 shows a system 100 with a motor vehicle 105 that can be used or controlled by a human user 110. An exemplary function of the motor vehicle 105 that can be controlled by the user 110 includes opening, closing, unlocking, or locking a charging flap 115 on the motor vehicle 105. An electrical connection for charging an energy storage device of the motor vehicle 105 can be concealed behind the charging flap 115. To control the function, an interaction device 120 is provided, which is attached to an outer surface of the motor vehicle 105. In the illustrated embodiment, the interaction device 120 occupies a predetermined section of a B-pillar of the motor vehicle 105.

[0028] Figure 2 shows a schematic representation of an exemplary interaction device 120 on a motor vehicle 105. In the illustrated embodiment, the interaction device 120 comprises a feedback device 205, a gesture recognition device 210, and a processing device 220. Preferably, an interface 225 is provided for communication with a controllable device 115 on board the motor vehicle 105. Optionally, an acoustic output device 230 is provided.

[0029] The feedback device 205 can comprise multiple elements. In the illustrated embodiment, the feedback device 205 is integrated with the gesture recognition device 210. The feedback device 205 comprises an array 235 of ultrasonic transducers 240 and an optional further processing device 245. This is connected to the processing device 220 via a further interface 250. In another embodiment, the processing devices 220, 245 can also be integrated with one another.

[0030] In the illustrated embodiment, a first display device 215 is provided in the region of the array 235. The ultrasonic transducers 240 of the array 235 can occupy a predetermined two-dimensional region where the display device 215 is provided. The display device 215 preferably comprises a two-dimensional numeric, alphanumeric, or graphic display device. This can be self-luminous or passive. In another embodiment, display or image elements (pixels) of the display device 215 are distributed across the array 235.

[0031] It is proposed that a multi-channel interaction with the user 110 be controlled by means of the interaction device 120 in order to control a function of the motor vehicle 105. In particular, it is preferred that the user 110 receives an indication of an executable function via the display device 215 and can control the function using gesture control with tactile feedback. More preferably, a further feedback is provided optically via the display device 215. A third feedback can be controlled via the acoustic output device 230. It should be noted that, although the interaction device 120 is described here with particular reference to a control in the exterior of the motor vehicle 105, its use in the interior of a motor vehicle 105 is also possible. The display device 215 can comprise a device that is already comprised by the motor vehicle 105.Other content than that used for interaction with the interaction device 120 can also be displayed on the display device 215.

[0032] Figure 3 shows a feedback device 205 in a schematic representation. The arrangement 235 of ultrasonic transducers 240 is, by way of example, flat and rectangular. The ultrasonic transducers 240 are arranged in rows and columns; other arrangements are also possible. The user 110 is, by way of example, represented in the form of a hand with which they can perform a gesture in the area of ​​the arrangement 235. The hand can be detected by a camera, which can be part of the gesture recognition system 210. Multiple cameras can also be provided for three-dimensional detection.

[0033] To provide a contactless tactile stimulus to the user 110, a location can first be determined where the tactile stimulus is to be generated. For this purpose, gesture recognition 210 can be used, for example, to determine the location of the fingertip of the index finger of the person 110.

[0034] Depending on the location at which the stimulus is to be provided, two or more ultrasonic transducers 240 of the array 235 can then be selected, which are located at advantageous positions relative to the location. The selected ultrasonic transducers 240 can then be controlled to each emit ultrasound having a predetermined frequency. Typically, the frequencies of the ultrasonic transducers 240 used correspond. The phases of the generated ultrasonic waves are detuned from one another in such a way that a bundling effect results at the predetermined location when the individual ultrasonic waves overlap positively. Different tactile stimuli of varying intensity can be controlled by appropriately controlling a number or selection of ultrasonic transducers 240 and / or an amplitude of the provided ultrasound. In tests, a noticeable influence was achieved at distances of up to approximately 50 cm.The generated tactile stimulus can be quickly adjusted, for example, when a function is dynamically controlled or the position of the user 110 relative to the arrangement 235 changes.

[0035] For example, if the user 110 strokes the arrangement 235 from a certain distance, a sequence of tactile stimuli can be provided that give the user 110 the sensation of stroking a three-dimensional surface. In another embodiment, a first tactile stimulus can be provided when the user 110 is in a position where a predetermined function can be triggered, and a further stimulus can be provided when the user 110 triggers the function, for example, by moving their hand. The movement or gesture can be tracked using the gesture controller 210.

[0036] Figure 4 shows a flowchart of an exemplary method 400 for interacting with a motor vehicle 105. The method 400 can be carried out in particular by means of an interaction device 120.

[0037] In a step 405, the user 110 can be detected in the area of ​​the arrangement 235. In this case, a rough approximation of the user 110 to the interaction device 120 can first be determined. The presence of the user 110 in the area of ​​the arrangement 235 can be considered a prerequisite for further steps of the method 400.

[0038] In a step 410, a context can be determined in which a function of the motor vehicle 105 can be controlled. If it is a function that can be controlled outside the motor vehicle 105, the context can include the motor vehicle 105 being stationary. Furthermore, a state of a technical device of the motor vehicle 105 can be taken into account. For example, if central locking is to be controlled, locking doors can only be offered if all doors are closed. Conversely, unlocking doors can only be offered if at least one door is locked.

[0039] In a step 415, a control element can be presented to the user 110, which they can use to control the selected function. The control element can be presented, in particular, by means of a display device 215. The control element can comprise an object, a structure, or a shape that the user 110 can manipulate, for example, by touching, pressing, pulling, sliding, or rotating.

[0040] In a step 420, an interaction of the person 110 with the displayed control element can be detected. It should be noted that the displayed control element is typically not physically touched by the user 110, but rather that the user 110 moves a body part, usually their hand, at some distance from the control element. The interaction is preferably detected using gesture recognition 210.

[0041] Depending on the detected interaction, a tactile stimulus may be provided to the user 110 in a step 425. The tactile stimulus may accompany touching or changing the control element.

[0042] At the same time, in a step 430, visual feedback on the interaction can be provided. Here, too, different outputs can occur if the user 110, for example, touches the control element or manipulates it in different ways. In a step 435, acoustic feedback can also be provided in parallel. The acoustic feedback can, for example, include a sound when controlling a function. Different sounds can be assigned to different interactions.

[0043] In a step 440, the selected function can be controlled depending on the specific interaction. With reference to the example of Figure 1, for example, the tailgate 115 can be unlocked or opened if the user 110 performs a predetermined gesture in the area of ​​the interaction device 120.

[0044] Reference symbol

[0045] 100 systems

[0046] 105 Motor vehicle

[0047] 110 users

[0048] 115 tailgate

[0049] 120 Interaction facility

[0050] 205 Feedback device

[0051] 210 Gesture recognition

[0052] 215 Display device

[0053] 220 processing facility

[0054] 225 Interface

[0055] 230 acoustic output device

[0056] 235 Order

[0057] 240 ultrasonic transducers

[0058] 245 additional processing facilities

[0059] 250 additional interfaces

[0060] 400 procedures

[0061] Record 405 users

[0062] 410 Determine context

[0063] 415 Display control element

[0064] 420 Capture Interaction

[0065] 425 provide tactile stimulus

[0066] 430 optical feedback

[0067] 435 acoustic feedback

[0068] 440 Control function

Claims

Claims 1 . An interaction device (120) for a motor vehicle (105), the interaction device (120) comprising the following elements: a display device (215) for displaying an operating element to a user (110); a gesture recognition device (210) for recognizing an interaction of the user (110) with the operating element; a feedback device (205) for contactlessly providing a tactile stimulus to the user (110) depending on their interaction with the operating element; and a processing device (220) for controlling a function of the motor vehicle (105) depending on a recognized interaction.

2. Interaction device (120) according to claim 1, wherein the feedback device (205) comprises an arrangement (235) with a plurality of ultrasonic transducers (240), wherein the ultrasonic transducers (240) can be controlled to emit sound waves which are positively superimposed at a predetermined location with respect to the arrangement (235).

3. Interaction device (120) according to claim 2, wherein a location and / or a strength of a tactile stimulus at the location are controllable.

4. Interaction device (120) according to one of the preceding claims, wherein the display device (215) comprises a head-mounted display for the user (110).

5. Interaction device (120) according to one of claims 1 to 3, wherein the display device (215) is embedded in a surface of the motor vehicle (105).

6. The interaction device (120) according to claim 5, wherein the display device (215) is integrated into the surface in such a way that the display device (215) is not recognizable when it does not provide a display.

7. The interaction device (120) according to claim 5 or 6, wherein the surface comprises an outer surface of the motor vehicle (105).

8. Interaction device (120) according to claim 7, wherein the function relates to an element in the exterior of the motor vehicle (105).

9. The interaction device (120) according to any one of the preceding claims, further comprising an acoustic output device; wherein the processing device (220) is configured to provide acoustic feedback depending on the interaction of the user (110) with the control element.

10. Motor vehicle (105) comprising an interaction device (120) according to one of the preceding claims.

11. A method (400) for the interaction of a user (110) with a motor vehicle (105), the method (400) comprising the following steps: Detecting (405) the user (110) in the area of a display device (215) of the motor vehicle (105); Representing (415) an operating element by means of the display device (215); Detecting (420) an interaction of the user (110) with the control element; contactless provision (425) of a tactile stimulus to the user (110) depending on his interaction with the control element; and Controlling (440) a function of the motor vehicle (105) depending on a detected interaction.

Images