Controlling a function of a motor vehicle

Abstract

An interaction device (120) for a motor vehicle (105) comprises the following elements: a display device (215) for displaying an operating element to a user (110); a gesture recognition device (210) for recognizing an interaction of the user (110) with the operating element; a feedback device (205) for contactlessly providing a tactile stimulus to the user (110) depending on their interaction with the operating element; and a processing device (220) for controlling a function of the motor vehicle (105) depending on a recognized interaction.

Description

The present invention relates to a control of a motor vehicle. In particular, the invention relates to an interactive control of a motor vehicle.A motor vehicle comprises a number of operating elements in order to control respectively assigned functions of the motor vehicle. An operating element can be exclusively assigned to one function or can be configured to control a plurality of functions. In order to make the selection and control of a function simpler or less error by a user of the motor vehicle, a feedback device can be provided, which provides, for example, an acoustic feedback upon interaction with the operating element.Known control elements allow only imperfect feedback, so that the user may not know exactly which function he is controlling or which function can be controlled at all. In addition, many control elements are complex and can, individually or in their entirety, cover an existing surface of the motor vehicle, which is then no longer available for another purpose.It is an object of the present invention to provide an improved technique for interaction of a user with a motor vehicle. The invention achieves this object by means of the subject matter of the independent claims. Dependent claims represent preferred embodiments.An interaction device for a motor vehicle comprises a display device for presenting an operating element to a user; gesture recognition for recognizing an interaction of the user with the operating element; a feedback device for providing a tactile stimulus to the user in a contactless manner as a function of its interaction with the operating element; and a processing device for controlling a function of the motor vehicle as a function of a recognized interaction.The interaction can in particular comprise a gesture of the user. The user may perform the interaction or gesture with a hand or other body part. By providing the tactile stimulus, the user can also actuate the operating element without observing the operating element. Optionally, the display device can additionally provide visual feedback. The user can be clearly informed in an improved manner about which function he is controlling or how he controls the function. The interaction can function in an improved manner in different contexts. For example, the visual feedback can be perceived to be enhanced in a dark environment, while the tactile stimulus can be predominant for the user in a bright environment. The function can be controlled in an improved sensitive manner by the improved feedback. Thus, a critical function or a safety function can also be accessible to the user in an improved manner.In a preferred embodiment, the feedback device comprises an arrangement with a plurality of ultrasonic transducers, wherein the ultrasonic transducers can be controlled to emit sound waves which are positively superimposed at a predetermined location with respect to the arrangement. A tactile stimulus can thus be provided at the location.The tactile stimulus can be communicated via an ambient air, so that the user does not have to touch an element of the interaction device directly. Thus, a particularly hygienic actuation of a function can be made possible. On the one hand, it is possible to prevent the user from being exposed to dirt or microorganisms when an operating element is actuated, and on the other hand it is possible to prevent a section of the motor vehicle or of the interaction device from being soiled by touch.A location and / or a strength of a tactile stimulus at the location may be controllable. The location can be selected by matching phase relationships or frequencies of differently positioned ultrasonic transducers to one another. The strength of a tactile stimulus can be controlled by controlling amplitudes of the sound waves provided. In this way, it is possible to convey a tactile stimulus to the user at a distance of up to about 50 cm from the feedback device.The display device may be implemented in various ways. In one embodiment, the display device includes a display that is attached to a head of the user and may be called a head-mounted display. The display device can enrich an immediately perceptible impression of an environment with further optical information. Alternatively, the display device may shield ambient light. An optical impression of the environment can be recorded by means of a camera and combined with further information in order to output it on the display device. The display device can comprise sensors in order to determine a position of the display device with respect to the motor vehicle or the interaction device. In particular, the display device can be configured to position the operating element with respect to a predetermined section of the motor vehicle. This representation can be independent of a position or movement of the user's head.According to another embodiment, the display device is embedded in a surface of the motor vehicle. Preferably, the feedback device and / or the gesture recognition are also incorporated into the surface. The surface can be closed, so that no optical indication is found on the interaction device when it is not in operation. An accidental control of a vehicle function by means of the interaction device can thus be ruled out. The surface can have a cleared and clear effect, so that the user can control the motor vehicle in an improved manner.The display device can be integrated into the surface in particular in such a way that the display device cannot be seen if it does not provide a representation. The surface may be planar or follow a curve. A material of the surface can be freely chosen within wide limits.In a particularly preferred embodiment, the surface comprises an outer surface of the motor vehicle. The interaction device can be configured to be actuated by the user while the latter is located in the environment of the motor vehicle. In this embodiment, it can be particularly advantageous that the operating element is not recognizable if it is not represented by the display device.In this case, the function preferably relates to an element in the exterior of the motor vehicle. The element can be located in particular in the region of the interaction device. For example, the element may relate to a tailgate, a fuel filler flap, a door, a window, a top, a cargo space cover or a similar element. In another embodiment, the element can also act in the interior of the motor vehicle. For example, an air conditioning system or an entertainment system in the interior can be controlled from the outside of the motor vehicle.According to a further embodiment, the interaction device further comprises an acoustic output device; wherein the processing device is configured to provide acoustic feedback as a function of the interaction of the user with the operating element.The acoustic output device may be configured to output a sound, a sound, a melody, or synthetic sounds in a human audible range. This range is usually about 30 Hz to about 20,000 Hz. The acoustic output device is preferably implemented separately from the feedback device and can in particular comprise a loudspeaker for the mentioned frequency range.According to a further aspect of the present invention, a motor vehicle comprises an interaction device described herein. The motor vehicle preferably comprises a passenger car. In further embodiments, the motor vehicle can also comprise, for example, a motorcycle, a truck or an omnibus. In the case of the motorcycle, an inner space and a space may be defined.Outer space in the sense of the present description substantially coincide.According to yet another aspect of the present invention, a method for interaction of a user with a motor vehicle comprises steps of detecting the user in the region of a display device of the motor vehicle; displaying an operating element by means of the display device; detecting an interaction of the user with the operating element; providing a tactile stimulus to the user in a contactless manner as a function of its interaction with the operating element; and controlling a function of the motor vehicle as a function of a detected interaction.An interaction device described herein can be configured to partially or completely execute a method described herein.For this purpose, the processing device can be designed electronically and can comprise, for example, an integrated circuit, a programmable logic module or a programmable microcomputer. The method can be realized in the form of a configuration or as a computer program product having program code means for the processing device. The configuration or the computer program product can be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device or vice versa.The invention will now be described in more detail with reference to the accompanying drawings, in which: FIG. 1 shows a system with a motor vehicle; FIG. 2 shows an interaction device on a motor vehicle; FIG. 3 shows a feedback device; and FIG. 4 shows a flow diagram of a methodillustrated.FIG. 1 shows a system 100 with a motor vehicle 105 that can be used or controlled by a human user 110. An exemplary function of the motor vehicle 105 that is controllable by the user 110 comprises opening, closing, unlocking or locking a tailgate 115 on the motor vehicle 105. Behind the charging flap 115, an electrical connection for charging an energy store of the motor vehicle 105 can be hidden. For controlling the function, an interaction device 120 is provided, which is attached to an outer surface of the motor vehicle 105. In the illustrated embodiment, the interaction device 120 takes up a predetermined portion of a B-pillar of the motor vehicle 105.FIG. 2 shows a schematic illustration of an exemplary interaction device 120 on a motor vehicle 105. In the embodiment shown, the interaction device 120 comprises a feedback device 205, a gesture recognition 210 and a processing device 220. An interface 225 for communication with a controllable device 115 on board the motor vehicle 105 is preferably provided. Optionally, an acoustic output device 230 is provided.The feedback device 205 may include a plurality of elements. In the embodiment shown, feedback device 205 is integrated with gesture recognition 210. The feedback device 205 comprises an arrangement 235 of ultrasonic transducers 240 and an optional further processing device 245. This is connected to the processing device 220 by means of a further interface 250. In another embodiment, the processing devices 220, 245 can also be embodied integrally with one another.In the embodiment shown, a first display device 215 is provided in the region of the arrangement 235. The ultrasonic transducers 240 of the array 235 may save a predetermined two-dimensional area where the display device 215 is provided. The display device 215 preferably comprises a two-dimensional numerical, alphanumeric or graphic display device. This can be self-illuminating or passive. In another embodiment, display or image elements (pixels) of the display device 215 are distributed across the array 235.It is proposed that a multi-channel interaction with the user 110 is controlled by means of the interaction device 120 in order to control a function of the motor vehicle 105. In particular, it is preferred that the user 110 receives an indication of an executable function via the display device 215 and can control the function by means of gesture control with tactile feedback. Further preferably, further feedback takes place optically by means of the display device 215. Third feedback may be controlled via acoustic output device 230.It should be noted that, although the interaction device 120 is described in the present case with particular reference to a controller in the exterior of the motor vehicle 105, its use in the interior of a motor vehicle 105 is likewise possible. The display device 215 may include a device already included in the motor vehicle 105. Other contents can also be displayed on the display device 215 than for interaction with the interaction device 120.FIG. 3 shows a feedback device 205 in a schematic illustration. The arrangement 235 of ultrasonic transducers 240 is, for example, planar and rectangular. The ultrasonic transducers 240 are arranged in rows and columns; other arrangements are also possible. The user 110 is shown by way of example in the form of a hand with which he can perform a gesture in the region of the arrangement 235. The hand may be detected by a camera, which may be part of gesture recognition 210. A plurality of cameras can also be provided for three-dimensional detection.For the contactless provision of a tactile stimulus to the user 110, a location at which the tactile stimulus is to be generated can first be determined. For this purpose, a location at which the fingertip of an index finger of the person 110 is located can be determined, for example, by means of the gesture recognition 210.Depending on the location at which the stimulus is to be provided, two or more ultrasonic transducers 240 of the arrangement 235 may then be selected, which are located at advantageous positions with respect to the location. The selected ultrasound transducers 240 may then be controlled to respectively secrete ultrasound having a predetermined frequency. Usually, the frequencies of the ultrasonic transducers 240 used correspond to one another. Phases of the generated ultrasonic waves are detuned with respect to one another in such a way that a focusing effect results at the predetermined location if the individual ultrasonic waves are positively superimposed. In this case, different and differently strong tactile stimuli can be controlled by suitably controlling a number or a selection of ultrasound transducers 240 and / or an amplitude of provided ultrasound. In experiments, a marked influence was achieved at distances of up to about 50 cm. The tactile stimulus generated may be quickly adjusted, for example, when a function is dynamically controlled or the position of the user 110 relative to the array 235 changes.If the user 110 sweeps over the arrangement 235 at some distance, for example, a sequence of tactile stimuli can be provided which give the user 110 the feeling of sweeping over a plastic surface. In another embodiment, a first tactile stimulus may be provided when the user 110 is in a position at which a predetermined function may be triggered and another stimulus may be provided when the user 110 triggers the function by, for example, moving his hand. The movement or gesture can be tracked by means of the gesture controller 210.FIG. 4 shows a flow diagram of an example method 400 for interacting with a motor vehicle 105. The method 400 can be carried out in particular by means of an interaction device 120.In a step 405, the user 110 can be detected in the region of the arrangement 235. In this case, a rough approach of the user 110 to the interaction device 120 can first be determined. The presence of the user 110 in the region of the arrangement 235 can be considered as a prerequisite for further steps of the method 400.In a step 410, a context in which a function of the motor vehicle 105 can be controlled can be determined. If this is a function that can be controlled in the exterior of the motor vehicle 105, the context can include the motor vehicle 105 being stationary. In addition, a state of a technical device of the motor vehicle 105 can be taken into account. If, for example, a central locking mechanism is to be controlled, then a locking of doors can only be offered when all the doors are closed. Conversely, unlocking doors can only be offered if at least one door is locked.In a step 415, the user 110 can be presented with an operating element which he can use to control the selected function. The operating element can be displayed in particular by means of a display device 215. The control element can comprise an object, a structure or a shape that the user 110 can manipulate, for example by touching, pressing, pulling, pushing or turning.In a step 420, an interaction of the person 110 with the depicted operating element can be detected. It should be noted that the operating element shown is usually not physically touched by the user 110, but rather that the user 110 guides a body part, usually his hand, at some distance from the operating element. The interaction is preferably detected by means of gesture recognition 210.Depending on the detected interaction, a tactile stimulus can be provided to the user 110 in a step 425. The tactile stimulus can accompany touching or changing the operating element.At the same time, in a step 430, an optical feedback for the interaction can be provided. Here too, different outputs can be effected if the user 110 touches the operating element, for example, or manipulates it in different ways.In a step 435, acoustic feedback can likewise be provided in parallel therewith. The acoustic feedback may include, for example, a noise in controlling a function. Different sounds may be associated with different interactions.In a step 440, the selected function may be controlled depending on the determined interaction. For example, with reference to the example of FIG. 1, the tailgate 115 may be unlocked or opened when the user 110 makes a predetermined gesture in the area of the interaction device 120.Reference numerals denote reference numerals100 System 105 Motor vehicle 110 User 115 Tailgate 120 Interaction device 205 Feedback device 210 Gesture recognition 215 Display device 220 Processing device 225 Interface 230 Acoustic output device 235 Arrangement 240 Ultrasonic transducer 245 Further processing device 250 Further interface 400 Method 405 User capture 410 Context determine 415 Operator element represent 420 Interaction capture 425 Tactile stimulus provide 430 Optical feedback 435 Acoustic feedback 440 Function control

Claims

Interaction device (120) for a motor vehicle (105), wherein the interaction device (120) comprises the following elements: - a display device (215) for displaying an operating element to a user (110); - a gesture recognition (210) for recognizing an interaction of the user (110) with the operating element; - a feedback device (205) for providing a tactile stimulus to the user (110) in a contactless manner as a function of its interaction with the operating element; and - a processing device (220) for controlling a function of the motor vehicle (105) as a function of a recognized interaction.The interaction device (120) according to claim 1, wherein the feedback device (205) comprises an arrangement (235) with a plurality of ultrasonic transducers (240), wherein the ultrasonic transducers (240) can be controlled to emit sound waves which are positively superimposed at a predetermined location with respect to the arrangement (235).The interaction device (120) of claim 2, wherein a location and / or a strength of a tactile stimulus at the location are controllable.The interaction device (120) according to any one of the preceding claims, wherein the display device (215) comprises a head-mounted display for the user (110).The interaction device (120) according to any one of claims 1 to 3, wherein the display device (215) is embedded in a surface of the motor vehicle (105).The interaction device (120) of claim 5, wherein the display device (215) is integrated into the surface such that the display device (215) is not recognizable when it does not provide a representation.The interaction device (120) according to claim 5 or 6, wherein the surface comprises an outer surface of the motor vehicle (105).Interaction device (120) according to Claim 7, wherein the function relates to an element in the external region of the motor vehicle (105).The interaction device (120) according to one of the preceding claims, further comprising an acoustic output device; wherein the processing device (220) is configured to provide acoustic feedback as a function of the interaction of the user (110) with the operating element.Motor vehicle (105) comprising an interaction device (120) according to one of the preceding claims.Method (400) for interaction of a user (110) with a motor vehicle (105), wherein the method (400) comprises the following steps: - detecting (405) the user (110) in the region of a display device (215) of the motor vehicle (105); - displaying (415) an operating element by means of the display device (215); - detecting (420) an interaction of the user (110) with the operating element; - providing (425) a tactile stimulus contactless to the user (110) as a function of its interaction with the operating element; and - controlling (440) a function of the motor vehicle (105) as a function of a detected interaction.

Images