Device for interaction of a user in a motor vehicle and motor vehicle

Abstract

The invention relates to a device (1) for interaction of a user in a motor vehicle, comprising an interaction unit (300) which is arranged in an interior (10) of a motor vehicle and which is designed to provide an interaction with a user, wherein the interaction unit is designed to change a degree of interaction of the interaction unit (300) in response to a user input

Description

[0001] The invention relates to a device for interaction of a user in a motor vehicle and to a motor vehicle with such a device.

[0002] Devices for user interaction in a motor vehicle are often static and cannot be adapted to the needs of a driver.

[0003] It is therefore an object of the present invention to provide an improved device for user interaction in a motor vehicle.

[0004] This problem is solved by the subject matter of the independent claims. Advantageous further developments are specified in the dependent claims.

[0005] According to a first aspect, a device for interaction of a user in a motor vehicle is provided.

[0006] The device comprises an interaction unit which is arranged in an interior of a motor vehicle and which is designed to provide an interaction with a user, wherein the interaction unit is configured to change a degree of interaction of the interaction unit in response to a user input.

[0007] The device according to the invention serves in particular to provide a personalizable and emotional interaction option for a user of a motor vehicle.

[0008] The device, which can also be referred to as an avatar and / or companion, provides both entertainment and an information source for the user and is particularly designed to interact with and / or access other components and / or units of the motor vehicle, such as a display unit and / or an input unit and vice versa, in order to enable holistic interaction of the user.

[0009] For this purpose, the device has an interaction unit which is arranged in the interior of a motor vehicle.

[0010] The interaction unit is arranged, in particular, at a central location in the interior, for example, on or in the dashboard, in particular centrally or centrally in the direction of travel. The interaction unit is arranged, in particular, at a distance and spatially separated from a central display unit, which can also be referred to as an infotainment system and / or CID (central information display), and is particularly different from it but also optionally connected to it for signaling purposes.

[0011] The interaction unit is designed to provide interaction with a user of the motor vehicle.

[0012] In particular, an interaction includes communication with a user, for example by providing audio content, video content and / or motion content to the user and / or by receiving audio inputs and / or touch inputs from the user.

[0013] In order to provide or enable this interaction with the user and in particular to provide the functions of the interaction unit and / or the device described below, the interaction unit and / or the device may comprise and / or have access to one or more processor units, data processing units and / or storage units on which program code is stored.

[0014] For example, the interaction unit is configured to receive a voice input from the user and / or output a voice output to the user. For this purpose, the interaction unit and / or the device may comprise and / or have access to one or more microphone units, which are arranged, for example, in the interior of the motor vehicle. The interaction unit and / or the device may also comprise and / or have access to further means, devices, and / or units in order to provide further types of interaction with the user, as will be described below.

[0015] The user of the interaction unit, which can also be referred to as the operator, is a passenger and / or a driver of the motor vehicle. In particular, the user is a person sitting in the driver's seat and / or passenger seat of the motor vehicle. It is also possible for two or more users to interact with the device simultaneously, and in particular, the interaction unit is configured to distinguish who is interacting with it, as will be described below.

[0016] For example, the user makes a voice request to the interaction unit and the interaction unit answers this voice request.

[0017] The voice query can, for example, include a function, a condition, and / or a status of the motor vehicle. For example, the user can query the current speed, a distance traveled and / or travel time, and / or a distance and / or travel time to a destination, or the status of an energy storage device in the motor vehicle.

[0018] The voice request may also be associated with or include a functional activation of the motor vehicle. For example, the voice request may be a request to operate a specific function of the motor vehicle, such as playing or stopping a specific piece of music, station, and / or channel, and / or adjusting the playback volume.

[0019] The interaction can be triggered by one or more signals and / or interaction requests from the user. For example, the interaction can be initiated by providing a voice request from the user. This can be done, in particular, by a specific code word, such as "Hey Audi" or "Hey Avatar," which can also be personalized by a user.

[0020] The interaction unit is designed to change a degree of interaction of the interaction unit in response to a user input.

[0021] The interaction unit is configured to receive and process user input that defines or changes the interaction level of the interaction unit. The interaction level is a degree or level of the extent to which, or how strongly and / or frequently, the interaction unit interacts with the user. In particular, the interaction level can include whether the interaction unit can and / or may interact with the user at all and / or what can and / or should trigger an interaction with the user, as will be described further below.

[0022] The user input can be, for example, a voice input or a touch input, as will be described later.

[0023] The device makes it possible to provide a personalizable and emotional interaction option for a user of a motor vehicle.

[0024] According to a further development, the degree of interaction comprises one or more of a degree of connectivity, a degree of activity and / or a degree of monitoring.

[0025] The user-adjustable interaction level can, for example, include a connectivity level. A connectivity level is a level that determines whether and to what extent the device or interaction unit is configured to access resources located outside the motor vehicle and / or on a device that is different from the motor vehicle.

[0026] For example, the degree of connectivity includes the use or extent of use or prohibition of near-field communication connections, such as Bluetooth, and in particular access and extent of access to a mobile device, for example of the user, which is located in particular in the motor vehicle.

[0027] Likewise, for example, the degree of connectivity includes the use or scope of use or prohibition of data communication connections, such as in particular access to the Internet and / or a network storage device, such as a cloud, for example through mobile communications, WLAN and / or Car2X.

[0028] For example, when the degree of connectivity is activated or high, the device or interaction unit can retrieve weather information from the Internet.

[0029] The user-adjustable interaction level can also include, for example, an activity level. An activity level, which can also be referred to as a responsiveness level and / or frequency level, is a level that determines whether and to what extent the device or interaction unit interacts with the user at all, or what can trigger or initiate an interaction.

[0030] For example, a high level of activity may include addressing or interacting with the user frequently and, in particular, without being prompted, for example, without prior user request, interaction, and / or prompting. For example, the user may be addressed or interacted with based on another event, such as opening and / or closing a door, in particular the driver's door, starting the engine and / or ignition of the motor vehicle, and / or even without cause or periodically, regularly, and / or after a predetermined period of time, in particular a period of non-interaction.

[0031] Likewise, for example, a low or minimal activity level may include not contacting or interacting with the user unsolicited and / or only after a user request, interaction and / or prompt.

[0032] The user-adjustable level of interaction can also include, for example, a level of surveillance. A level of surveillance, which can also be referred to as a monitoring level and / or tracking level, is a level that determines whether and to what extent the device or interaction unit is configured to track or record user behavior and, in particular, to respond to it and / or use it for an interaction.

[0033] For example, past user actions, such as the last destinations visited, the duration of the journey, driving behavior, and a specific use of applications, for example on a mobile device and / or on or in the motor vehicle, can be monitored and, based on this, an interaction

[0034] For example, when the monitoring level is activated or high, the device or interaction unit can use a previously visited destination, such as a restaurant, as an opportunity to start an interaction and ask the user about the restaurant visit.

[0035] This training enables a particularly personalizable interaction that can be adapted to the occupancy situation of the vehicle.

[0036] According to a further development, the interaction unit comprises a display device which is designed to provide an interaction with the user.

[0037] The display device is comprised by the interaction unit and, in particular, is distinct from, and in particular spaced apart from, a display unit of the motor vehicle on which comprehensive motor vehicle information, such as a map or navigation, music playback, interior climate, and / or motor vehicle settings, is displayed, and which may also be comprised by the device. The term "motor vehicle information" or "information" is used herein both in the generic plural and in the generic singular and means that it can encompass both a single piece of information and multiple pieces of information.

[0038] In particular, the display device of the interaction unit is a smaller display and / or a display with a lower resolution than the main display or the CID. For example, the display device is a display with less than 200×200, 100×100, and / or 50×50 pixels.

[0039] In particular, the display device can also be a display that can only display in black and white. Alternatively, the display device can also be designed to display in color.

[0040] The display device can be used alternatively or in addition to the previously described voice interaction. For example, the interaction unit can receive a voice request from the user and provide a response on the display device, in particular exclusively. Alternatively or additionally, the interaction unit can receive a voice request from the user and provide a voice output, with additional and / or redundant information to the voice output being provided on the display device.

[0041] In particular, the interaction unit can also be designed to display its currently set level of interaction, for example by means of a graphic and / or animation.

[0042] For example, a crossed-out radio icon may be displayed when a connectivity level is low or turned off, a crossed-out ear may be displayed when a monitoring level is low or turned off, and / or a face with closed eyes and / or a “ZZZ” may be displayed when an activity level is low or turned off.

[0043] Again, for example, a radio symbol may be displayed when a connectivity level is high or switched on, an ear may be displayed when a monitoring level is high or switched on, and / or a face with open eyes and / or a regular or periodic animation, for example of a moving and / or pulsating dot or circle, may be displayed when an activity level is high or switched on.

[0044] The interaction unit can also be configured to provide an indication of a necessary interaction and / or a vehicle notification, in particular one that requires interaction or a response from the user, such as a hazard warning and / or a notice. This can be done, in particular, by a question mark and / or exclamation mark displayed on the display device.

[0045] The display device can in particular be designed such that it can display a multi-dimensional symbol, image or animation, for example by means of several layered and / or partially transparent display means.

[0046] This training enables particularly informative interaction.

[0047] According to a further development, the interaction unit is designed to determine where the user with whom it interacts is located in the interior and, in response, to direct the interaction towards the user.

[0048] In particular, the device and / or the interaction unit is designed to determine which user is currently interacting with it and / or where this user is located or where he / she is sitting.

[0049] For this purpose, the device can in particular read out a seat occupancy, for example by means of one or more weight sensors in the seats and / or evaluate the sound from several microphone units in order to detect a direction and / or a position of the user who is currently interacting with the interaction device.

[0050] The interaction unit can then, for example, display an icon and / or animation on the display device that tilts and / or points toward the user currently interacting with it. For example, a circle indicating an interaction can move to the left edge when a person in the left seat interacts with the interaction unit, and to the right edge when a person in the right seat interacts with the interaction unit.

[0051] This training enables a particularly emotional interaction.

[0052] According to a further development, the interaction unit comprises a movement unit, wherein the movement unit is designed to direct the interaction towards the user.

[0053] The movement unit can comprise one or more motors, in particular micromotors and / or servomotors, which are designed to move the interaction unit in at least one plane, in particular to incline, rotate and / or tilt it.

[0054] In particular, the movement unit can be configured to direct the interaction unit toward the user currently interacting with it, or to tilt and / or rotate toward the user. For example, the interaction unit can move toward the left seat in the direction of travel when a person in the left seat interacts with the interaction unit, and toward the right seat in the direction of travel when a person in the right seat interacts with the interaction unit.

[0055] This training enables particularly personal interaction.

[0056] Alternatively or additionally, the movement unit is configured to provide interaction both without facing the user and with the user. In particular, the movement unit is configured to indicate interaction through movement.

[0057] The movement can be used alternatively or in addition to the previously described voice interaction and / or display device for interaction. For example, the interaction unit can receive a voice request from the user and provide a response through a movement, in particular exclusively, such as a nod from top to bottom for "yes" and / or a shake from left to right for "no." Alternatively or additionally, the interaction unit can receive a voice request from the user and provide a voice output, wherein a movement provides additional and / or redundant information to the voice output.

[0058] In particular, the movement may also comprise a start movement, such as a lifting or raising, which is carried out when an interaction starts, in particular a first-time interaction and / or when an interaction level is increased, and / or a stop movement, such as a lowering or descending, which is carried out when an interaction ends and / or when an interaction level is decreased.

[0059] This training enables particularly attentive interaction.

[0060] According to a further development, the interaction unit comprises a personalization unit which is designed to provide a user preference for the interaction unit

[0061] The personalization unit can include information that includes a user preference and provides it to the interaction unit. For example, the user preference includes a specific setting, such as providing or including a color scheme, a motion scheme, an animation scheme, and / or a display scheme for the interaction unit.

[0062] The personalization unit may also provide a user preference for other components of the motor vehicle, such as a central display unit or the CID, interior lighting and / or exterior lighting, and provide these to the motor vehicle via the personalization unit.

[0063] This training enables particularly personalized interaction.

[0064] According to a further development, the personalization unit is interchangeable.

[0065] In particular, the personalization unit is arranged on the interaction unit or encompassed by it in such a way that it can be removed or attached with a single movement. For example, it is designed as a slide that can be inserted into and removed from a designated receptacle or slot. In particular, engagement elements can be provided on the personalization unit and the interaction unit, which enable engagement, in particular a sliding engagement.

[0066] In particular, the personalization unit is configured to be wireless, so that the user preference can be wirelessly transmitted to the interaction unit when the personalization unit is arranged thereon or picked up by it. For example, the personalization unit is configured to communicate with the interaction unit using near-field communication, such as NFC, RFID, and / or Bluetooth, and thus provide the user preference.

[0067] This training enables particularly easy personalization.

[0068] According to a further development, the interaction unit is designed to receive a touch input from the user.

[0069] The interaction unit can be configured to receive a touch input. For this purpose, the display device can be configured, in particular, as a touchscreen to receive and process a user touch. Alternatively or additionally, an input device can be provided, such as a touchpad, on which a touch input can be provided.

[0070] In particular, the interaction unit can be configured to perform one or more functions via a touch input, in particular one of the aforementioned functions. For example, the interaction unit is configured to initiate or begin an interaction, change a degree of connectivity, and / or provide an interaction with the interaction unit in response to receiving a touch input.

[0071] In particular, different touch inputs are provided for different functions, or different touch inputs require different functions. In particular, the interaction unit is configured to detect and distinguish between different types of touch inputs, such as tapping, holding, pressing, movement, input duration, and / or complete gestures and / or drawings, and to perform a different function based thereon.

[0072] For example, the interaction unit is configured to distinguish a swipe touch from a tap touch. Alternatively or additionally, the interaction unit is configured to distinguish a touch with one or more fingers, for example, two fingers.

[0073] This training enables particularly fast interaction.

[0074] According to a further development, the interaction unit is designed to provide the user's touch input to a display unit which is arranged in the interior of the motor vehicle at a distance from the interaction unit.

[0075] The display unit, which we described above can also be referred to as CID, is arranged further away from the user than the interaction unit in the interior and is designed separately from it.

[0076] The interaction unit receives a touch input and provides it or its content to the display unit, where a function can be performed based on it.

[0077] For example, the user can indicate by a touch input, such as a swipe gesture from left to right on the interaction unit, that he wants to trigger a change in the display content of the display unit and this change is then carried out on the display unit.

[0078] Likewise, for example, the user can provide a drawing, such as a heart, to the touch input, whereupon a piece of music that is currently playing is added to the favorites.

[0079] This training enables particularly interactive interaction.

[0080] The device according to the invention can also comprise the display unit described above. In particular, the display unit can be configured to comprise a first display section configured to display first motor vehicle information and a second display section configured to display second motor vehicle information, wherein at least the first motor vehicle information is personalized based on user behavior.

[0081] Additionally or alternatively, the device may also comprise an input unit which is arranged in the interior of the motor vehicle at a distance from the display unit and comprises a first input element, wherein the input unit is designed to display a reduced first information content corresponding to the motor vehicle information displayed on the display unit on the first input element, to receive a first touch input from a user on the first input element and to carry out a function in the motor vehicle corresponding to the first touch input.

[0082] According to a further aspect, a motor vehicle is provided, comprising a device for user interaction according to one of the preceding embodiments.

[0083] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0084] In particular, the motor vehicle may be an at least partially autonomously operated vehicle in which acceleration, braking, and / or steering actions are performed at least partially autonomously, i.e., without the intervention of a driver or operator, by the motor vehicle, for example, by a driving computer. This may be an autonomous driving mode of level 3, 4, 5, or higher.

[0085] The device according to the invention is particularly designed to be operated in an autonomous driving mode of level 3, 4, 5 or higher, in particular exclusively.

[0086] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each have a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.

[0087] Exemplary embodiments of the invention are described below. Shown are: Fig. 1 is a front view of an embodiment of a device for user interaction in a motor vehicle; Fig. 2 a perspective detailed view of the device from Fig. 1; and Fig. 3 is an exploded perspective view of the device of Fig. 1.

[0088] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0089] In the figures, the same reference symbols denote elements with the same function.

[0090] Fig. 1 shows a front view of an embodiment of a device 1 for user interaction in a motor vehicle.

[0091] The device 1 comprises a display unit 100 which is arranged in an interior 10 of the motor vehicle and which is designed to display motor vehicle information.

[0092] The display unit 100 is arranged in an upper part 11 of a dashboard in the motor vehicle and extends substantially over at least half the width of the interior 10.

[0093] The display unit 100 comprises a first display section 110 configured to display first motor vehicle information, a second display section 120 configured to display second motor vehicle information, and a third display section 130 configured to display third motor vehicle information, wherein the first, second, and third display sections are arranged side by side.

[0094] At least the first vehicle information is personalized based on user behavior.

[0095] By way of example, a left-hand drive motor vehicle with a steering wheel 14 on the left side in the direction of travel is shown here, wherein the first display section 110 is arranged closer to the steering wheel 14 and thus to a user sitting on a driver's seat not shown in detail here, and the third display section 130 is furthest away therefrom.

[0096] The display unit 100 is configured to detect a user's touch input on one of the display sections and, in response to a touch input, to change the motor vehicle information. In particular, the display unit 100 is configured to swap the first motor vehicle information and the second motor vehicle information in response to a touch input, such as a swipe gesture, in particular from right to left, or to rotate the motor vehicle information shown on the first, second, and third display sections.

[0097] The first display section 110 has more motor vehicle information than the second display section 120 and the second display section 120 has more motor vehicle information than the third display section 130.

[0098] The motor vehicle information displayed on the first, second and / or third display section has a plurality of hierarchy levels, wherein the motor vehicle information displayed in the first display section 110 comprises at least one motor vehicle information from a lower hierarchy level.

[0099] The device 1 also comprises an input unit 200, which is arranged at a distance from the display unit 100 in the interior of the motor vehicle and comprises a first input element 210, a second input element 220 and a third input element 230.

[0100] The input unit 200 is arranged in a center console 12 of the interior 10 and, in particular, is arranged closer to a driver on the driver's seat than the display unit 100 and also than the interaction unit 300 described below.

[0101] The input unit 200 is designed to display a reduced first information content corresponding to the motor vehicle information displayed on the display unit 100 on the first input element 210, to display a reduced second information content corresponding to the motor vehicle information displayed on the display unit 100 on the second input element 220 and to display a reduced third information content corresponding to the motor vehicle information displayed on the display unit 100 on the third input element 230.

[0102] The input unit 200 is also configured to receive a first touch input from a user on the first input element 210 and perform a function corresponding to the first touch input in the motor vehicle, to receive a second touch input on the second input element 220 and perform a function corresponding to the second touch input in the motor vehicle, and to receive a third touch input on the third input element 230 and perform a function corresponding to the third touch input in the motor vehicle.

[0103] The reduced first, second and / or third information content can be configured by the user.

[0104] The input unit 200 is particularly designed to distinguish between different types of touch inputs of the user on the first, second and / or third input element and to perform different functions in the motor vehicle based thereon.

[0105] In particular, the type of the first touch input may differ from the type of the second touch input and the type of the third touch input.

[0106] The device also includes an interaction unit 300, which is arranged in the interior 10 of the motor vehicle and is configured to provide interaction with a user. The interaction unit 300 is arranged centrally in a lower part 13 of the dashboard, between the display unit 100 and the input unit 200.

[0107] The interaction unit 300 is designed to change a degree of interaction of the interaction unit 300 in response to a user input.

[0108] The level of interaction includes one or more of a level of connectivity, a level of activity and / or a level of monitoring.

[0109] The interaction unit further comprises a display device, which is not provided with a reference symbol here for reasons of clarity, and which is designed to provide interaction with the user.

[0110] The interaction unit is also designed to determine where the user with whom it interacts is located in the interior space and, in response, to direct the interaction towards the user.

[0111] For this purpose, the interaction unit 300 comprises a movement unit, which is also not provided with a reference symbol and is designed to direct the interaction towards the user.

[0112] The interaction unit 300 also comprises a personalization unit, also not provided with a reference symbol, which is designed to provide a user preference for the interaction unit 300, wherein the personalization unit is replaceable.

[0113] The interaction unit 300 is also designed to receive a touch input from the user on the display device and to provide the touch input from the user to the display unit 100.

[0114] Fig. 2 shows a perspective detailed view of the device or the interaction unit 300 from Fig. 1. In particular, it can be seen that the interaction unit 300 comprises a display device 330 configured to provide interaction with the user. An example of an interaction content 331 is shown in the form of a circle, which is configured to be directed toward the user with whom the interaction unit 300 interacts.

[0115] Fig. 3 shows a perspective exploded view of the device or interaction unit 300 from Fig. 1.

[0116] In particular, the individual components of the interaction unit 300 are visible. These include, from top to bottom, a protective glass 310, which may in particular comprise bonded glass, a touch surface 320 configured to receive and process touch inputs, a display device 330 configured to display interaction content, a processor unit 340 configured to perform the functions of the interaction unit, and a movement unit 350 configured to move the movement unit 300 and, in particular, to direct it toward the user with whom it interacts.

[0117] Also shown is the replaceable personalization unit 360, which is configured to provide a user preference for the interaction unit 300. The personalization unit is depicted here as a slide that can be engaged with the interaction unit 300 by a sliding movement in direction S.

[0118] Overall, the examples show how an avatar can be provided for emotional interaction in a motor vehicle.

Claims

[1] Device (1) for interaction of a user in a motor vehicle, comprising: - an interaction unit (300) which is arranged in an interior (10) of a motor vehicle and which is designed to provide an interaction with a user, wherein the interaction unit is designed to change a degree of interaction of the interaction unit (300) in response to a user input. [2] The device (1) of claim 1, wherein the interaction level comprises one or more of a connectivity level, an activity level, and / or a monitoring level. [3] Device according to one of the preceding claims, wherein the interaction unit comprises a display device (330) configured to provide interaction with the user. [4] Apparatus according to any one of the preceding claims, wherein the interaction unit is configured to determine where the user with whom it interacts is located in the interior space and, in response thereto, to direct the interaction to the user. [5] Device (1) according to claim 4, wherein the interaction unit (300) comprises a movement unit (350) and wherein the movement unit (350) is configured to direct the interaction towards the user. [6] Device (1) according to one of the preceding claims, wherein the interaction unit (300) comprises a personalization unit (360) configured to provide a user preference for the interaction unit (300). [7] Device according to claim 6, wherein the personalization unit (360) is replaceable. [8] Device according to one of the preceding claims, wherein the interaction unit (300) is configured to receive a touch input from the user. [9] Device (1) according to claim 8, wherein the interaction unit (300) is configured to provide the user's touch input to a display unit arranged in the interior of the motor vehicle at a distance from the interaction unit (300). [10] Motor vehicle comprising a device (1) according to one of the preceding claims.

Images