Method for operating a motor vehicle with multimodal addressing of occupants and motor vehicle

Abstract

The invention relates to a motor vehicle (10) and a method for operating a motor vehicle (10) in which an occupant (16) of the motor vehicle (10) is identified by means of at least one recognition device (28) of the motor vehicle (10). A speech output device (20) of the motor vehicle (10) outputs a message (26) to the identified occupant (16). The identified occupant (16) is additionally informed, by outputting at least one non-verbal message, that the message (26) is intended for the identified occupant (16).The output of the at least one non-linguistic message comprises activating at least one light source (30, 32) of the motor vehicle (10) which is assigned to a location of the identified occupant (16) in the motor vehicle (10), and / or activating at least one actuator (34) of the motor vehicle (10) which is designed to output a stimulus perceptible to the identified occupant (16) by touch.

Description

[0001] The invention relates to a method for operating a motor vehicle, in which an occupant of the motor vehicle is identified by means of at least one recognition device of the motor vehicle. A voice output device of a motor vehicle outputs a message to the identified occupant. In addition, the identified occupant is informed by outputting at least one non-verbal message that the message is intended for the identified occupant. Furthermore, the invention relates to a motor vehicle configured to implement the method.

[0002] In today's vehicles, user interfaces that contribute to a user experience are typically focused on the driver. However, it is desirable for other vehicle occupants to also be able to interact with, for example, the vehicle's infotainment system.

[0003] US Patent 2020 / 0111489 A1 describes a procedure in which an identified occupant in a vehicle is addressed. Furthermore, an occupant's utterance can be interpreted. Subsequently, a speaker image is moved within the vehicle's display to the occupant who made the utterance.

[0004] DE 10 2016 217 026 A1 describes a voice control system for a motor vehicle in which a voice message is output depending on a previously determined characteristic of a speaker. Occupants of the vehicle can therefore be addressed based on their characteristics, for example, by name.

[0005] The object of the present invention is to provide a method of the type mentioned at the outset which is improved with regard to addressing the identified occupant, and to create a motor vehicle designed to carry out the method.

[0006] This object is achieved by a method having the features of patent claim 1 and by a motor vehicle having the features of patent claim 10. Advantageous embodiments with expedient further developments of the invention are specified in the dependent patent claims and in the following description.

[0007] In the inventive method for operating a motor vehicle, an occupant of the motor vehicle is identified by means of at least one recognition device of the motor vehicle. A voice output device of the motor vehicle issues a message to the identified occupant. In addition, the identified occupant is informed, by outputting at least one non-verbal message, that the message is intended for the identified occupant. The output of the at least one non-verbal message includes activating at least one light source of the motor vehicle, wherein the at least one light source is assigned to a location of the identified occupant in the motor vehicle.Additionally or alternatively, the output of the at least one non-linguistic message includes the activation of at least one actuator of the motor vehicle, which is designed to output a stimulus that is tactilely perceptible to the identified occupant.

[0008] By using at least one light source and / or the actuator to output at least one non-verbal message, it can be made particularly intuitive for the identified occupant that the message directed at them by the vehicle's speech output system is indeed intended for them. This improves the procedure for addressing the identified occupant.

[0009] Because at least one light source is assigned to the location of the identified occupant in the vehicle, activating this light source makes it very easy to clearly indicate to the occupant that the message or voice message emitted by the speech output device is directed at them. Similarly, or alternatively, the at least one actuator can also output a tactile or haptic stimulus to the identified occupant. This, too, ensures that the occupant readily understands that the message or voice message emitted by the speech output device is intended for them.

[0010] Advantageously, even when multiple occupants are present in the vehicle, each occupant can clearly see which occupant is currently communicating with the vehicle. For example, an individual front passenger can clearly see whether or not they are being addressed directly by the vehicle's voice output system.

[0011] In particular, the method allows the passenger to communicate directly with the vehicle. This is because, by activating at least one light source and / or at least one actuator, the identified occupant is made aware in a very easily understandable way that the message issued to the identified occupant by the vehicle's voice output system is intended for or assigned to the identified occupant.

[0012] This enables a particularly intensive user experience for a passenger in the vehicle. This, in turn, is accompanied by the vehicle's address, which is directed at each identified occupant, characterized by hospitality and empathy.

[0013] In one variant of the procedure, where the vehicle occupant is identified by means of at least one of the vehicle's recognition devices, communication with the identified occupant can be conducted exclusively via non-verbal messages. In this variant, an alternative to the message delivered to the identified occupant via the speech output device can be a (further) non-verbal message. For example, instead of the message delivered via the speech output device, a text or message can be displayed on a vehicle display.In this case too, it is helpful if, by activating at least one light source of the motor vehicle and / or by activating at least one actuator, the identified occupant recognizes that the further non-linguistic message, for example in the form of the text displayed on the display device or the message for the identified occupant, is intended.

[0014] The at least one identification device of the motor vehicle, which serves to identify the occupant, can, for example, be at least one camera designed to detect the at least one occupant located in a passenger compartment of the motor vehicle. Additionally or alternatively, other methods of identifying the respective occupant in the motor vehicle can be used, for example, by entering an identifier assigned to the respective occupant in the motor vehicle and / or by reading such an identifier, in particular automatically, by a corresponding device of the motor vehicle or the like.

[0015] The voice output device of the motor vehicle may comprise at least one loudspeaker of the motor vehicle or be provided by at least one loudspeaker of the motor vehicle.

[0016] The method is particularly easy to implement if the vehicle already has light sources that can be used to identify or visually highlight different locations for individual occupants by activating the light sources. This also applies analogously if at least one actuator is present at each possible location for occupants, which, when activated, emits a stimulus that is tactilely perceptible to the identified occupant.

[0017] By utilizing at least one light source and / or at least one actuator of the vehicle in addition to outputting the voice message or message to the identified occupant, a multimodal address to the identified occupant in the vehicle is achieved. Thus, multimodal components of the vehicle are used to signal to the respective occupant which occupant is being addressed.

[0018] Preferably, at least one light source of the motor vehicle is activated to output the at least one non-verbal message. This light source is integrated into an interior trim panel located at the occupant's seat. This is based on the understanding that, for example, lights or light sources installed in a door panel and / or in the footwell of a motor vehicle are particularly well suited to discreetly highlighting a specific location or seat of the occupant in the motor vehicle by activating the at least one light source.

[0019] If the occupant is a passenger in the vehicle, additional or alternative light sources, particularly those located on the passenger side of the center console and / or instrument panel, can be used to clearly highlight the passenger seat as the occupant's location. Accordingly, by activating at least one light source, at least one non-verbal message can be clearly conveyed to the identified occupant.

[0020] Preferably, to output the at least one non-verbal message, at least one actuator of the motor vehicle is activated, which is integrated into a vehicle seat of the motor vehicle on which the identified occupant is located. This can be implemented particularly easily if the vehicle seat of the motor vehicle has a massage function, in which corresponding actuators designed to massage the seat occupant are installed, for example, in a seat cushion and / or in a backrest of the motor vehicle. By means of such actuators integrated into the vehicle seat, it can be made clearly and understandably clear to the occupant, for example in the form of at least one vibration or the like, that the message output by the voice output device is directed at the occupant sitting in the vehicle seat.

[0021] Preferably, an output pattern for outputting the message and / or the at least one non-verbal message to the identified occupant is stored in a memory device of the motor vehicle. Upon recognition of the identified occupant, the output pattern assigned to this occupant is at least partially used. This allows the output patterns assigned to each identified occupant to be very easily customized. Furthermore, the motor vehicle advantageously learns the individual address of each identified occupant. The user or occupant, in turn, recognizes the personalized or individual address particularly easily if the output pattern assigned to the identified occupant is at least partially used.

[0022] In particular, to store the respective output pattern, the occupant can enter instructions via a corresponding user interface of the motor vehicle. In this way, the respective occupant can very easily store preferences for the output pattern assigned to him in the motor vehicle's memory device.

[0023] For example, an individual animation profile can be used as an output pattern when activating at least one light source, such as by outputting the light in a specific color or sequence of colors and / or by a specific frequency when, for example, the at least one light source is activated by blinking, and / or by a specific duration of activation of the respective light source, or the like.

[0024] Additionally or alternatively, vibration settings for the output of the tactilely perceptible stimulus, which is performed by at least one actuator and is thus performed by the identified occupant, can be stored in the memory device in order to save the output pattern assigned to the identified occupant. This also contributes to a high degree of recognizability of the output pattern by the identified occupant when the output pattern is used, at least partially.

[0025] Preferably, upon recognition of an identified occupant, the output pattern assigned to that occupant is modified depending on the occupant's current location within the vehicle. This takes into account the fact that identical light sources and / or actuators designed to emit tactile stimuli may not be available at all locations within the vehicle, such as at the individual seats. Nevertheless, the at least partial use of the output pattern makes it very easy to clearly indicate to the identified occupant that the voice message emitted by the speech output system is intended for them.

[0026] For example, an interior trim panel in the passenger seat area of ​​a motor vehicle might be equipped with ambient lighting light sources that can be activated to emit at least one non-verbal message. Additionally, the passenger seat might be a massage seat and thus have at least one actuator designed to emit a tactilely perceptible stimulus. It is possible that the identified occupant, upon subsequent use of the vehicle, does not sit in the passenger seat but in a rear seat within the passenger compartment. In this case, it is possible that the at least one actuator or light source is not present on this rear seat, or not to the same extent as on the passenger seat.This can be taken into account by changing the output pattern assigned to the identified occupant upon recognition, depending on the occupant's current location in the vehicle.

[0027] Preferably, when the presence of multiple occupants in the vehicle is detected by at least one detection device, a collective output pattern is used when issuing the message and / or the at least one non-verbal message. This collective output pattern differs from the output pattern assigned to each identified occupant. This makes it very easy for the vehicle's occupants to understand that all occupants should feel addressed.

[0028] This is particularly advantageous if the voice message issued by the speech output device states that the occupants should take at least one safety-related measure, such as putting on a seatbelt or the like.

[0029] In particular, if at least one light source of the motor vehicle is activated when using the collective output pattern, activating a plurality of light sources can, for example, visually highlight all vehicle seats occupied by the vehicle's occupants. Similarly, actuators assigned to the vehicle seats can be used for this purpose, provided the vehicle seats are equipped with the corresponding actuators designed to output the tactile audible stimulus.

[0030] Additionally or alternatively, for the collective output pattern, at least one light source can illuminate in a specific color, which differs from the respective colors assigned to each identified occupant. This makes the output of voice messages addressed to a plurality of vehicle occupants via the speech output device intuitively understandable for all occupants in the vehicle.

[0031] Preferably, if a predetermined criterion is met, the output of at least one message and / or non-verbal message available in the motor vehicle is prevented. In this way, a personalized, multimodal address can be implemented that is context-dependent. For example, the output of acoustically perceptible non-verbal messages, such as in the form of tones or the like, can be prevented if the identified occupant is currently on the phone or would otherwise be disturbed by the output of tones. This ensures an improved user experience when addressing the identified occupant multimodally.

[0032] Additionally or alternatively, a vehicle control unit can determine the sequence for outputting the message and / or at least one non-verbal message to different occupants of the vehicle. This is because it is possible for several occupants to communicate with the vehicle sequentially or simultaneously. In this case, the multimodal strategy can be adapted.

[0033] Accordingly, the speech output system can act as a moderator, for example, when the opinions of individual vehicle occupants need to be gathered one after the other. This is particularly advantageous when the occupants need to reach a consensus, such as when deciding on a specific destination or choosing a particular route to that destination. In particular, this approach can prevent disagreements among the occupants. The resulting relaxed atmosphere in the vehicle is beneficial for safe driving.

[0034] Preferably, if the identified occupant fails to respond to the message, the perceptibility of the message and / or the non-verbal message is increased upon repeated output of the message and / or the non-verbal message. This ensures particularly reliably that the identified occupant actually recognizes that the message output by the voice output device is intended for the identified occupant.

[0035] If the at least one light source is activated to output the at least one non-verbal message, the amount of light emitted by the light source or by multiple light sources can be increased, for example. Using the at least one actuator can increase the intensity of the tactile stimulus when it is output. Both of these factors contribute to improved perceptibility of the non-verbal message. And when outputting the message or voice message output by the voice output, the volume of the message can be increased, for example, to ensure that the identified occupant recognizes the message as intended for them.

[0036] Such an escalation strategy can be particularly useful when the identified occupant's response to the message is of increased importance. This applies, for example, if the driver is requested to resume manual control of the vehicle during at least partially automated driving. In such a case, increasing the perceptibility of the message and / or the non-verbal message is particularly useful in the absence of a response. This ensures that the driver can quickly resume manual driving mode.

[0037] Outputting the message and / or the at least one non-verbal message can include a personalized address to the identified occupant. In particular, when outputting the message via the voice output device, the identified occupant can be addressed by name and / or in a more confidential manner than is the case with a formal or distant address. For example, the addressed occupant can be addressed informally to emphasize the appropriate level of confidentiality.

[0038] Preferably, the output of the message and / or the at least one non-verbal message includes the use of at least one loudspeaker in the vehicle that is closer to the occupant's location than at least one other loudspeaker in the vehicle. This takes into account the fact that loudspeakers are often installed on both the left and right sides of vehicles (in the direction of travel). Additionally or alternatively, loudspeakers can be installed in both the front and rear of the vehicle's passenger compartment.By using loudspeakers located near the respective occupant, it can be made very clear to the identified occupant that the occupant closest to the respective loudspeaker is being addressed, both when the message is output by the speech output device and when at least one non-verbal message, such as a tone or the like, is output.

[0039] Additionally or alternatively, the output of at least one non-verbal message may involve the use of at least one display device in the vehicle, the message of which is more easily understood by the identified occupant than by at least one other occupant of the vehicle. For example, the vehicle may have one display device assigned to the driver and one assigned to the front passenger. Thus, by selecting the respective display device when outputting the non-verbal message, it can be clearly indicated to the driver or front passenger who is being addressed.

[0040] Additionally or alternatively, the motor vehicle can have a display device, for example in the area of ​​an instrument panel, which can extend, in particular, from an A-pillar on the left in the transverse direction of the vehicle essentially to an A-pillar on the right in the transverse direction of the vehicle. If such a particularly wide display is present in the motor vehicle, a portion of the display device or display assigned to the driver or front passenger can be used to output the non-verbal message. This makes it very easy to ensure that the non-verbal message is more easily understood by the identified occupant than by at least one other occupant of the motor vehicle.

[0041] However, a central display device of the motor vehicle can also be used, which is designed to output different content to viewers looking at the display device from different viewing directions. Such a display device can also be advantageously used to make the non-verbal message easier to understand for the identified occupant than for at least one other occupant of the motor vehicle.

[0042] The motor vehicle according to the invention comprises at least one recognition device configured to identify an occupant of the motor vehicle. A voice output device of the motor vehicle is configured to output a message to the identified occupant. The motor vehicle is further configured to additionally communicate to the identified occupant, by outputting at least one non-verbal message, that the message is intended for the identified occupant. A control device of the motor vehicle is configured to activate at least one light source of the motor vehicle, which is assigned to a location of the identified occupant within the motor vehicle, in order to output the at least one non-verbal message.Additionally or alternatively, the control device of the motor vehicle is designed to activate at least one actuator of the motor vehicle, wherein the at least one actuator is designed to emit a stimulus that is tactilely perceptible to the identified occupant.

[0043] Accordingly, the motor vehicle designed to carry out the method according to the invention is improved with regard to addressing the identified occupant.

[0044] The advantages and preferred embodiments described for the method according to the invention also apply to the motor vehicle according to the invention and vice versa.

[0045] The invention therefore also includes further developments of the motor vehicle according to the invention, which have features as already described in connection with the further developments of the method according to the invention. For this reason, the corresponding further developments of the motor vehicle according to the invention are not described again here.

[0046] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus.

[0047] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0048] The invention also includes the control unit for the motor vehicle. The control unit can comprise a data processing device or a processor unit configured to carry out an embodiment of the method according to the invention. For this purpose, the processor unit can comprise at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor unit can comprise program code configured to carry out the embodiment of the method according to the invention when executed by the processor unit. The program code can be stored in a data memory of the processor unit.The processor setup can be based on at least one circuit board and / or at least one SoC (System on Chip).

[0049] As a further solution, the invention also includes a computer-readable storage medium comprising program code which, when executed by a computer or a computer network, causes it to execute an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data storage medium (e.g., as flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data storage medium (e.g., as RAM - random access memory). The storage medium can be located within the computer or computer network. However, the storage medium can also be operated, for example, as an app store server and / or cloud server on the internet. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code may be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g. C) and / or as a program script (e.g. Python).

[0050] The invention also includes combinations of the features of the described embodiments. The invention therefore also includes realizations that each exhibit a combination of the features of several of the described embodiments, provided that the embodiments have not been described as mutually exclusive.

[0051] The following are exemplary embodiments of the invention described. This is illustrated by: Fig. 1 schematically a motor vehicle, wherein a passenger of the motor vehicle is addressed multimodally, and Fig. 2 the motor vehicle, wherein an occupant of a passenger compartment of the motor vehicle located on a rear vehicle seat is addressed multimodally.

[0052] The exemplary embodiments described below are preferred embodiments of the invention. In these exemplary embodiments, the described components each represent individual features of the invention, which can be considered independently of one another and each further develops the invention independently. Therefore, the disclosure is intended to include combinations of features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0053] In the figures, the same reference symbols designate elements with the same function.

[0054] In Fig. Figure 1 is a highly schematic representation of a motor vehicle 10, in whose passenger compartment 12 there is an occupant in the form of a driver 14 and another occupant 16. In the Fig. In the situation shown as an example, the other occupant 16 is located on a passenger seat 18 of the motor vehicle, so that the other occupant 16 is a passenger of the motor vehicle 10.

[0055] The motor vehicle 10 has a speech output device 20, which in this case is provided by a plurality of loudspeakers 22. For example, in Fig. Figure 1 shows a loudspeaker 22 arranged in the front area of ​​the passenger compartment 12 and closer to the driver 14, as well as another loudspeaker 22 arranged in the front area of ​​the passenger compartment 12 and closer to the front passenger. In addition, the following are shown in Fig. 1 Two loudspeakers 22 arranged in the area of ​​a rear vehicle seat 24 of the motor vehicle 10 are shown schematically by way of example and schematically.

[0056] In the present case, when addressing occupant 16 in a targeted manner, it should be ensured that the driver 14 different occupant 16 actually feels addressed when the speech output device 20 issues a message 26 or voice message to occupant 16.

[0057] The motor vehicle 10 has at least one recognition device, for example in the form of at least one camera 28, by means of which the occupant 16 is identified. For example, based on an evaluation of images captured by the camera 28, it can be determined that the occupant 16 is a specific person who is to be specifically addressed by the voice output device 20. The voice output device 20 can be part of a digital assistant of the motor vehicle 10, which is designed to personally address the identified occupant 16.

[0058] In order to make it clear to the identified occupant 16 or to communicate that the message 26 issued by the speech output device 20 is intended for the identified occupant 16, at least one additional non-verbal message is issued to the occupant 16 by the motor vehicle 10.

[0059] Outputting the at least one non-linguistic message to the identified occupant 16 can include activating at least one light source 30, 32 of the motor vehicle 10, wherein the at least one light source 30, 32 is assigned to a location of the identified occupant 16 in the motor vehicle 10. For example, the Fig. One example light source 30, shown in Figure 1, can be used, which is integrated into a side door panel 33 of the motor vehicle located next to the passenger seat 18. Similarly, light source 32 can be used to illuminate a footwell in the area of ​​the passenger seat 18. If at least one of these light sources 30, 32, which are assigned to the location of the identified occupant 16 in the motor vehicle 10, is activated, the occupant 16 understands, for example, in the form of the [missing information]. Fig. 1 passenger shown as an example that message 26 is addressed to him.

[0060] Additionally or alternatively, the output of the at least one non-linguistic message can include the activation of at least one actuator 34 of the motor vehicle 10, which is designed to output a stimulus that is tactilely perceptible to the identified occupant 16. For example, actuators 34 in Fig. 1. Schematic representation of vibration devices and / or massage balls or similar devices integrated into the passenger seat 18, with reference symbols. The passenger seat 18 is designed according to... Fig. 1. The driver's seat 40 of the motor vehicle 10 is also designed as a massage seat. The actuators arranged in the driver's seat 40 are shown here, but for the sake of clarity, they are not labeled. The same applies to the light sources arranged on the driver's side in the passenger compartment 12 of the motor vehicle 10.

[0061] The actuators 34 of the passenger seat 18, which is designed as a massage seat, can be arranged in the area of ​​a seat cushion 36 of the passenger seat 18 and / or in the area of ​​a backrest 38 of the passenger seat 18. Fig. Figure 1 shows only the actuators 34 arranged in the area of ​​the seat cushion 36 in a schematic representation.

[0062] For example, by briefly vibrating the passenger seat 18, which can be effected by means of the at least one actuator 34 of the passenger seat 18, it can be made clear to the occupant 16 that the voice message 26 output by the voice output device 20 is intended for the occupant 16 in the form of the passenger.

[0063] In this case, the passenger 16 in the form of the front passenger in the motor vehicle 10 is addressed individually, making it clear that this passenger 16 is being addressed. The multimodal personal addressing of the passenger 16 uses corresponding components present in the motor vehicle 10.

[0064] For example, when issuing message 26, the digital assistant can address occupant 16 personally, perhaps by name and / or using informal language or the like. Furthermore, a greeting tone can be emitted acoustically via one of the loudspeakers 22 in such a way that it is more easily perceived by occupant 16 than by the driver 14, who is located in the driver's seat 40 of the vehicle 10. In the Fig. 1, in which the driver 14 sits on the driver's seat 40 arranged on the left in the transverse direction of the vehicle and the front passenger sits on the front passenger seat 18 arranged on the right in the transverse direction of the vehicle, the loudspeaker 22 arranged on the right in the front area of ​​the passenger compartment 12 can emit the greeting tone.

[0065] Additionally, the front passenger seat 18 can be visually highlighted, in particular by activating the light sources 30, 32 associated with the ambient lighting of the vehicle 10. Since the light sources 30, 32 are associated with the location of the identified occupant 16 in the vehicle 10, the occupant 16 recognizes in a very simple and intuitive way that the message 26 is intended for him.

[0066] In Fig. Figure 1 also schematically shows a display device 42 of the motor vehicle 10, which has a comparatively large width, i.e., a comparatively large extent in the transverse direction y of the vehicle. The transverse direction y, the longitudinal direction x, and the vertical direction z are shown in Fig. 1 illustrated by a coordinate system.

[0067] During the output of the message 26 by means of the voice output device 20, a speaker can be represented, in particular symbolically, on the display device 42 or display. Unlike in Fig. As shown in Figure 1, the motor vehicle 10 can have a passenger display instead of the shared display unit 42 for the driver 14 and the other occupants 16, on which the digital assistant or speaker that outputs the message 26 can be visualized. In this way, it can also be made clear to the identified occupant 16 that the message 26 is intended for him / her.

[0068] Preferably, the respective occupants of the motor vehicle 10, i.e., for example, the one in Fig. 1. The driver 14 and the passenger 16 shown, store preferences for preferential addressing, for example in a storage device 43 of the motor vehicle 10, which is located in Fig. 1 is only shown in a highly schematic form. The storage device 43 can be used to store an individual task pattern for outputting the message 26 and / or the at least one non-linguistic message to the identified inmate 16.

[0069] For example, the occupant 16 can store an individual animation profile in the memory device 43 when activating the at least one light source 30, 32 and / or vibration settings when activating the at least one actuator 34. Additionally or alternatively, the occupant 16 can indicate that they should be addressed by name and / or informally by the digital assistant. This allows the motor vehicle to learn the individual address of the respective occupant 16. And the user, in the form of the occupant 16, can very easily recognize the individual output pattern when outputting the message 26 and the non-verbal message.

[0070] In Fig. Figure 1 shows, by way of example and schematically, that the storage device 43 can be integrated into a control device 44, for example in the form of a control unit of the motor vehicle 10. However, the storage device 43 can also be designed separately from the control device 44.

[0071] In the present case, the control device 44 is configured to activate the at least one light source 30, 32 associated with the location of the identified occupant 16 in the motor vehicle 10. Additionally or alternatively, the control device 44 is configured to activate the at least one actuator 34 of the motor vehicle 10, which is configured to output the stimulus tactilely perceptible by the identified occupant 16, for example, in the form of a vibration or the like.

[0072] Preferably, the control device 44 is configured to evaluate images captured by the recognition device, for example in the form of at least one camera 28, in order to identify the respective occupant 16. In particular, the control device 44 may be able to distinguish between a previously known passenger and a new passenger.

[0073] If the occupant 16 is an already known passenger, the output pattern assigned to this passenger can be used when outputting the message 26 or when activating the at least one light source 30, 32 and / or the at least one actuator 34. If, on the other hand, the new passenger is a previously unidentified occupant 16 of the motor vehicle 10, a correspondingly new output pattern for outputting the message 26 and / or the at least one non-verbal message to the occupant 16, who has now been identified for the first time, can be created and stored in the memory device 43.

[0074] In Fig. Figure 2 shows a situation in which the occupant 16, identified by means of the recognition device, for example in the form of at least one camera 28, has not taken a seat in the front passenger seat 18, but in the rear vehicle seat 24. Preferably, the preferences in the form of the output pattern assigned to the identified occupant 16 are transferred to this other seat of the occupant 16 in the motor vehicle 10.

[0075] In Fig. Figure 2 shows a configuration in which the rear vehicle seat 24 is not designed as a massage seat like the driver's seat 40 and the front passenger seat 18, and therefore does not have at least one actuator 34. In this case, the output pattern assigned to the identified occupant 16 can be used in a modified or restricted form.

[0076] Furthermore, in Fig. 2 shows an example of a situation in which there is no light source for ambient lighting in the footwell of the rear vehicle seat 24, by means of which the location or seat of the occupant 16 on the rear vehicle seat 24 could be highlighted. However, according to Fig. 2 a light source 48 is integrated in a rear door panel 46 which is adjacent to the rear vehicle seat 24, or in another interior panel part of the motor vehicle 10 assigned to the rear vehicle seat 24.

[0077] For example, at least one light source 48 can be integrated into the door panel 46, which belongs to a (not shown) door of the motor vehicle 10 that the occupant 16 can open to take a seat in the rear vehicle seat 24. If this light source 48 is now activated, the occupant 16, who is in the rear vehicle seat 24, understands very reliably that the message 26 issued by the speech output device 20 is addressed to him. Furthermore, as in Fig. 2, the loudspeaker 22 of the voice output device 20 closest to the occupant 16 can be used to output the message 26.

[0078] In the present case, components present in the motor vehicle 10 are linked for communication with the identified occupant 16, for example in the form of at least one loudspeaker 22 and / or the ambient lighting, provided these components are available at the respective location of the identified occupant 16. The same applies to the at least one actuator 34, provided this actuator 34 is available at the respective location of the identified occupant 16. In this way, the individual addressing of the identified occupant 16 can be supported.

[0079] If several occupants 16 are present in the passenger compartment 12 of the motor vehicle 10, all occupants 16 can be addressed simultaneously. For this purpose, a further, collective output pattern or a collective address mode can be activated. The output patterns or modes assigned to the respective identified occupant 16 do not apply in this case.

[0080] For example, all light sources present in the passenger compartment 12 of the motor vehicle 10, in particular ambient lighting of the motor vehicle 10, can be activated in order to make it clear to all occupants 16 that the message 26 is addressed to all occupants 16.

[0081] Additionally or alternatively, a specific color can be used to provide this collective output pattern, in which the light sources of the motor vehicle 10 illuminate, wherein this color is preferably different from the color which is used upon individual activation of the light sources 30, 32 assigned to the passenger seat 18 (cf. Fig. 1) or the light source 48 assigned to the rear vehicle seat 24 (compare Fig. 2) is used.

[0082] Preferably, the individual, multimodal address is context-dependent. For example, it may be provided that certain modalities or output devices recede into the background or become more prominent during the address. Thus, a greeting tone may be omitted if the occupant 16 in the front passenger seat 18 is currently on the phone or if, for other reasons, an acoustic disturbance to the occupant 16 would be undesirable.

[0083] The multimodal strategy can also be adapted for the case where several occupants in the motor vehicle 10 communicate with the motor vehicle 10 successively or simultaneously, for example by sending respective voice messages to at least one (not shown) receiving device of the motor vehicle 10.

[0084] Preferably, the multimodal address directed at the respective identified occupant 16 has an escalation mechanism. For example, if the individual occupant 16 does not react because he has not understood that he is being specifically addressed, the light animation upon activation of the at least one light source 30, 32, 48 and / or the vibration animation, which can be effected by means of the at least one actuator 34, can be intensified.

[0085] The control device 44 can determine the escalation strategy to be used in each case, particularly depending on the importance of a reaction of the occupant 16 to the message 26 issued to the occupant. Furthermore, the control device 44 is preferably configured to perform a weighing exercise when addressing multiple occupants 16 in the passenger compartment 12 of the motor vehicle 10.

[0086] Overall, the examples show how a multimodal approach to occupants 16 of the motor vehicle 10 can be provided. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 2020 / 0111489 A1

[0003] DE 10 2016 217 026 A1

[0004]

Claims

[1] Method for operating a motor vehicle (10), in which an occupant (16) of the motor vehicle (10) is identified by means of at least one recognition device (28) of the motor vehicle (10), in which a voice output device (20) of the motor vehicle (10) outputs a message (26) to the identified occupant (16), and in which the identified occupant (16) is additionally informed by outputting at least one non-verbal message that the message (26) is intended for the identified occupant (16), characterized bythat the output of the at least one non-verbal message comprises activating at least one light source (30, 32) of the motor vehicle (10), which is assigned to a location of the identified occupant (16) in the motor vehicle (10), and / or activating at least one actuator (34) of the motor vehicle (10), which is designed to output a stimulus that can be perceived tactilely by the identified occupant (16). [2] Method according to claim 1, characterized by in that, in order to output the at least one non-verbal message, at least one light source (30, 32) of the motor vehicle (10) is activated, which light source is integrated into an interior trim part (33) of the motor vehicle (10) arranged at the location of the occupant (16). [3] Method according to one of the preceding claims, characterized byin that, in order to output the at least one non-verbal message, at least one actuator (34) of the motor vehicle (10) is activated, which actuator is integrated into a vehicle seat (18) of the motor vehicle (10) on which the identified occupant (16) is located. [4] Method according to one of the preceding claims, characterized by that an output pattern of the output of the message (26) and / or the at least one non-verbal message to the identified occupant (16) is stored by means of a storage device (43) of the motor vehicle (10), wherein upon recognition of the identified occupant (16), the output pattern assigned to this occupant (16) is at least partially used. [5] Method according to claim 4, characterized bythat when the identified occupant (16) is recognized, the output pattern assigned to this occupant (16) is changed depending on the current location of the occupant (16) in the motor vehicle (10). [6] Method according to one of claims 4 or 5, characterized by that when the presence of a plurality of occupants (14, 16) in the motor vehicle (10) is detected by means of the at least one recognition device (28), a collective output pattern is used when outputting the message (26) and / or the at least one non-verbal message, which is different from the output pattern assigned to a respective identified occupant (16). [7] Method according to one of the preceding claims, characterized bythat if a predetermined criterion is met, the output of at least one message (26) and / or non-verbal message available in the motor vehicle (10) is prevented and / or a control device (44) of the motor vehicle (10) determines an order in which the message (26) and / or the at least one non-verbal message are output to different occupants (14, 16) of the motor vehicle (10). [8] Method according to one of the preceding claims, characterized by that if the identified occupant (16) does not react to the message (26), the perceptibility of the message (26) and / or the non-verbal message is increased when the message (26) and / or the non-verbal message is output again. [9] Method according to one of the preceding claims, characterized by that the output of the message (26) and / or the at least one non-linguistic message - a personalized response to the identified occupant (16) and / or - a use of at least one loudspeaker (22) of the motor vehicle (10) which is closer to the location of the occupant (16) than at least one other loudspeaker (22) of the motor vehicle (10), and / or - a use of at least one display device (42) of the motor vehicle (10), the message of which is more easily understood by the identified occupant (16) than by at least one other occupant (14) of the motor vehicle (10). [10] Motor vehicle (10) with at least one recognition device (28) which is designed to identify an occupant (16) of the motor vehicle (10), with a voice output device (20) which is designed to output a message (26) to the identified occupant (16), wherein the motor vehicle (10) is designed to additionally communicate to the identified occupant (16) by outputting at least one non-verbal message that the message (26) is intended for the identified occupant (16), characterized byin that a control device (44) of the motor vehicle (10) is designed to cause an activation of at least one light source (30, 32) of the motor vehicle (10) in order to output the at least one non-verbal message, which is assigned to a location of the identified occupant (16) in the motor vehicle (10), and / or to cause an activation of at least one actuator (34) of the motor vehicle (10) which is designed to output a stimulus that can be perceived tactilely by the identified occupant (16).

Images