Method, computer readable medium, system, and vehicle for providing a conversion control object of a digital assistant of a vehicle to a user of

Abstract

The invention relates to a method for providing a dialog control object of a digital assistant of a vehicle to a user of the vehicle, the method comprising: identifying, by the digital assistant of the vehicle, a trigger event of a software application of the vehicle; transmitting a trigger event of the software application from the digital assistant of the vehicle to a dialog control application of a server external to the vehicle; receiving, by the digital assistant of the vehicle, a dialog control message according to a trigger event of a software application of the vehicle from a dialog control application of a server external to the vehicle; generating, by the digital assistant of the vehicle, a dialogue control object using a dialogue control message of a server external to the vehicle and one of a plurality of dialogue control object templates of the vehicle; and providing the dialog control object to a user of the vehicle on an output device of the vehicle by a digital assistant of the vehicle.

Description

Technical Field

[0001] The present invention relates to a method for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle. The present invention also relates to a computer-readable medium for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, a system for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, and a vehicle including a system for providing a dialogue control object of a digital assistant of the vehicle to a user of the vehicle. Background Art

[0002] Digital assistants are known in vehicles, which can output voice messages to the users of the vehicles. Herein, the digital assistants in vehicles are limited to outputting voice messages to the users of the vehicles. Summary of the Invention

[0003] Therefore, the task of the present invention is to more efficiently implement the provision of the dialogue control object of the digital assistant of the vehicle. In particular, the task of the present invention is to more flexibly provide the dialogue control object to the user of the vehicle on one or more output devices of the vehicle through the digital assistant of the vehicle.

[0004] The above task is solved by the features of the independent claims. Advantageous embodiments and further improvements of the present invention are derived from the dependent claims.

[0005] According to a first aspect, the present invention is characterized in a method for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle. The method can be a computer-implemented method or a controller-implemented method. The dialogue control object can include voice messages and / or graphical user interface elements for controlling the dialogue with the digital assistant of the vehicle. The digital assistant can be a digital assistant that the user of the vehicle operates in different, multimodal interactions (hereinafter also referred to as interaction modes). For example, the digital assistant can be a voice-based digital assistant, which can additionally or alternatively be operated by gestures based on touch by means of a touch-sensitive input device or an input / output device of the vehicle. The user of the vehicle can be the driver of the vehicle, the co-driver of the vehicle, and / or other occupants of the vehicle. Preferably, the user of the vehicle is the driver of the vehicle.

[0006] The method includes: identifying, by a digital assistant of a vehicle, a trigger event of a software application of the vehicle; transmitting the trigger event of the software application from the digital assistant of the vehicle to a dialogue control application of a server external to the vehicle. The method further includes: receiving, by the digital assistant of the vehicle, a dialogue control message according to the trigger event of the software application from the dialogue control application of the server external to the vehicle; generating, by the digital assistant of the vehicle, a dialogue control object in the case of using the dialogue control message of the server external to the vehicle and one dialogue control object template among a plurality of dialogue control object templates of the vehicle; and providing, by the digital assistant of the vehicle, the dialogue control object to a user of the vehicle on an output device of the vehicle, preferably a plurality of output devices.

[0007] Advantageously, the method can provide the dialogue control object to the user of the vehicle more flexibly. The method can efficiently associate the dialogue control message received from the server external to the vehicle with the provision of the dialogue control object in the case of using the dialogue control message and the dialogue control object template executed in the vehicle. The server external to the vehicle does not need information about generating and providing the dialogue control object in the vehicle, and thus can provide the dialogue control message to the vehicle and particularly to the digital assistant of the vehicle independently of the provision in the vehicle. Thus, the dialogue control message of the server external to the vehicle can be received independently of the individual capabilities of the vehicle in terms of providing the dialogue control message through the dialogue control object. Each vehicle can use a suitably predetermined number of dialogue control object templates for the vehicle to provide the dialogue control message to the user of the vehicle. Thus, the provision of the dialogue control message can be achieved more flexibly and more independently of the content of the dialogue control message by means of the dialogue control object. Therefore, different dialogue control messages in different dialogue control applications can be uniformly provided to the user of the vehicle in the case of using the plurality of dialogue control templates. This may result in the user being able to perform an interactive dialogue with the digital assistant more simply. If the user is the driver of the vehicle, the distraction of the vehicle driver can be efficiently reduced by more simply operating the dialogue of the digital assistant.

[0008] According to an advantageous embodiment, providing the dialogue control object to the user of the vehicle on the output device of the vehicle by the digital assistant of the vehicle may include: determining output device information in the case of using the dialogue control object template; and providing, by the digital assistant of the vehicle, the dialogue control object to the user of the vehicle on the output device of the vehicle, wherein the output device is specified by the output device information of the dialogue control object template. Thus, the output device in the vehicle can be efficiently controlled independently of the dialogue control message of the external server.

[0009] According to another advantageous embodiment, the method may also receive coding information of the vehicle, wherein the coding information preferably specifies the vehicle type. The method may also determine a partial set of the dialogue control object templates from the plurality of dialogue control object templates according to the coding information of the vehicle, and generate a dialogue control object by means of a digital assistant of the vehicle in the case of using a dialogue control message of a server external to the vehicle and a dialogue control object template in the partial set of the dialogue control object templates of the vehicle. Thereby, the dialogue control element can be efficiently adapted to the vehicle type.

[0010] According to another advantageous embodiment, generating a dialogue control object by means of a digital assistant of the vehicle in the case of using a dialogue control message of a server external to the vehicle and a dialogue control object template in the partial set of the dialogue control object templates or a dialogue control object template in the plurality of dialogue control object templates may include: determining an icon of a software application; determining a main color of the icon of the software application; adapting the color of the dialogue control object template according to the main color of the icon of the software application; adapting the output information of the dialogue control object template according to the dialogue control message; and generating a dialogue control object in the case of using the adapted dialogue control object template. Thereby, the dialogue control object can be efficiently adapted so that the user of the vehicle can simply recognize the visual representation of the dialogue control object on the display device of the vehicle. Thereby, the interaction with the dialogue control object, especially the multimodal interaction, can be efficiently simplified.

[0011] According to another advantageous embodiment, the method may further include: determining a level of the dialogue control object template according to the software application; determining relevance information according to the determined level of the dialogue control object template; and providing the dialogue control object to the user of the vehicle on an output device of the vehicle by means of a digital assistant of the vehicle according to the determined relevance information. Thereby, the dialogue control object template can be efficiently determined.

[0012] According to another advantageous embodiment, when providing the dialogue control object on an output device of the vehicle by means of a digital assistant of the vehicle, the output time and / or the output duration may be controlled according to the determined relevance information; and / or when providing the dialogue control object on an output device of the vehicle by means of a digital assistant of the vehicle, the output type may be controlled according to the determined relevance information. Thereby, the provision of the dialogue control object can be efficiently controlled.

[0013] According to another advantageous embodiment, the dialogue control object may be provided to the user of the vehicle on an output device of the vehicle by means of a digital assistant of the vehicle according to the validity information of the dialogue control message. Thereby, the provision of the dialogue control object can be efficiently controlled.

[0014] According to another advantageous embodiment, the waiting dialogue control object can provide an active dialogue with the user of the vehicle. Thereby, the method can efficiently control the active dialogue with the user of the vehicle.

[0015] According to another advantageous embodiment, the dialogue control object template can be determined by the category of the software application, and the category of the software application can be consistent with the level of the dialogue control object template. Thereby, the dialogue control object template can be efficiently determined.

[0016] According to another advantageous embodiment, one of the multiple dialogue control object templates can specify multiple interaction modalities between the user of the vehicle and the provided dialogue control object based on this dialogue control object template, wherein the multiple interaction modalities can include at least one of the following interaction modalities, preferably multiple interaction modalities: voice-based interaction, gesture-based interaction, gaze-based interaction, and / or touch-based interaction. Thereby, the method can implement multi-modal interaction between the user of the vehicle and the dialogue control object without the need for a dialogue control application of a server external to the vehicle to pre-determine and / or specify multi-modal interaction in the dialogue control message. The digital assistant of the vehicle can specify the multi-modal interaction with the dialogue control object according to the used dialogue control object template.

[0017] According to another aspect, the present invention is characterized in a computer-readable medium for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, the computer-readable medium including instructions that, when executed on a computer or a controller, execute the above method.

[0018] According to another aspect, the present invention is characterized in a system for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, wherein the system is configured to execute the above method.

[0019] According to another aspect, the present invention is characterized in a vehicle that includes the above system for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle.

[0020] Other features of the present invention are derived from the claims, the drawings, and the description of the drawings. All features and combinations of features mentioned above in the description and all features and combinations of features mentioned and / or shown separately in the description of the drawings and / or in the drawings can be used not only in the respectively given combinations but also in other combinations or individually. Description of the Drawings

[0021] The following describes a preferred embodiment of the present invention with the aid of the drawings. Other details, advantageous embodiments, and further expansion schemes of the present invention are derived therefrom. Specifically, it is schematically shown:

[0022] Figure 1 An exemplary method for presenting a dialogue control object for providing a digital assistant for a vehicle to a user of the vehicle, and

[0023] Figure 2 An exemplary flowchart for presenting a dialogue control object for providing missed calls to a user of the vehicle. DETAILED DESCRIPTION

[0024] Specifically, Figure 1 An exemplary method 100 for presenting a dialogue control object for providing a digital assistant for a vehicle to a user of the vehicle is shown. The method 100 may identify a trigger event of a software application of the vehicle by a digital assistant of the vehicle. For example, the trigger event may be an event of an application of the vehicle infotainment system. For example, the trigger event may be an event identified in the case of using sensor data of the vehicle. The software application may be, for example, an application of the vehicle infotainment system. The software application may be a driver assistance software application of the vehicle.

[0025] The method 100 may transmit 104 the trigger event of the software application from the digital assistant of the vehicle to a dialogue control application of a server external to the vehicle. The transmission 104 of the trigger event may be transmitted from the vehicle to the external server in the case of using a communication channel of the vehicle, for example, in the case of using a mobile radio communication channel of the vehicle. The dialogue control application includes application logic for one or more dialogues, in particular for one or more active dialogues, and the application logic may transmit feedback to the vehicle in the form of a dialogue control message according to the trigger event. The server external to the vehicle may be a server of a cloud computing system. The server external to the vehicle may include a plurality of dialogue control applications. For example, the server external to the vehicle may include a dialogue control application for each trigger event and / or for each software application. The dialogue control application of the vehicle preferably includes only application logic for one or more dialogues. The graphic design of one or more dialogues and / or the decision regarding the output device of the vehicle are preferably specified by a dialogue control object template of the vehicle, rather than by the dialogue control application of the server external to the vehicle.

[0026] The method 100 may receive 106 a dialogue control message according to the trigger event of the software application of the vehicle from the dialogue control application of the server external to the vehicle by the digital assistant of the vehicle. The dialogue control application may include a payload of a dialogue control object template. For example, the dialogue control message may include the text, date of the dialogue, and / or data necessary for controlling a function of the vehicle (e.g., a function of a software application of the vehicle) and / or validity information of the dialogue in the case of using the dialogue.

[0027] Method 100 can generate 108 a dialogue control object via a digital assistant of a vehicle in the case of using a dialogue control message of an external server of the vehicle and one of a plurality of dialogue control object templates of the vehicle. One of the plurality of dialogue control object templates may include one or more design elements of the dialogue control object and / or be adapted to a display operation concept (Anzeige-Bedien-Konzept) of the vehicle. The unified display operation concept of the dialogue control object template adapted to the vehicle may stipulate the display of the dialogue control object, the output of the dialogue control object, the operation of the dialogue control object, the interaction with the dialogue control object, and / or the control of an output device and / or an interaction channel used by the dialogue control template. Independent of the dialogue control application of the external server of the vehicle, a user of the vehicle obtains the unified display operation concept via the digital assistant of the vehicle. Thereby, the user of the vehicle can simply operate the dialogue control object.

[0028] Method 100 can provide 110 the dialogue control object to the user of the vehicle on an output device of the vehicle via the digital assistant of the vehicle. The provision of the dialogue control object can be controlled by a dialogue control message and / or one or more parameters of the dialogue control object template, and the dialogue control object is based on the dialogue control object template.

[0029] Specifically, Figure 2 An exemplary flowchart 200 showing the provision of a dialogue control object 202 for an unanswered call to a user 204 of a vehicle 206 is shown. Method 100 can identify a trigger event 208, i.e., an unanswered call of a telephone software application, and transmit it to a dialogue control application 210 of an external server 212 of the vehicle. The dialogue control application 210 of the external server 212 of the vehicle can be a callback reminder application. The callback reminder application can transmit a dialogue control message with a callback reminder to the vehicle. The callback reminder may include, for example, a name, a telephone number, and the validity of the callback reminder. The vehicle, in particular the digital assistant of the vehicle, can receive the dialogue control message and generate a dialogue control object.

[0030] In order to generate the dialogue control object, the digital assistant of the vehicle can determine a dialogue control object template 214 according to the category of the software application triggered by the trigger event. Then, the digital assistant of the vehicle can adapt the dialogue control object template. For example, the digital assistant of the vehicle can adapt the color of the dialogue control object template according to the icon of the telephone software application. For example, the digital assistant of the vehicle can adapt the validity of the dialogue control object template according to the validity of the callback reminder.

[0031] The generated dialogue control object 202 can be provided to the user 204 of the vehicle 206 on one or more output devices as specified in the object control template. For example, the dialogue control object can include graphical elements provided on a display device that require the user to make a callback. Additionally, the dialogue control object can include voice output and / or audio output that reminds the user of the vehicle to make a callback. The dialogue control object can provide the possibility of initiating a callback through an operation input or a voice command.

[0032] Advantageously, by using the dialogue control object template, the unified operation and / or unified visual representation of the dialogue control object can be efficiently implemented by the digital assistant of the vehicle. The dialogue control object can be seamlessly integrated into the existing display operation plan of the vehicle, and the dialogue control application of an external server does not need to know the display operation plan of the vehicle. In addition, the dialogue control object template can be changed independently of the dialogue control application, for example, to adapt to the display operation plan. Similarly, the dialogue control message can be changed independently of the dialogue control object template, for example, to provide a new or changed dialogue to the user of the vehicle.

[0033] List of reference numerals

[0034] 100 Method

[0035] 102 Identify trigger event

[0036] 104 Transmit trigger event

[0037] 106 Receive dialogue control message

[0038] 108 Generate dialogue control object

[0039] 110 Provide dialogue control object

[0040] 200 Flowchart

[0041] 202 Dialogue control object

[0042] 204 User

[0043] 206 Vehicle

[0044] 208 Trigger event

[0045] 210 Dialogue control application

[0046] 212 Server external to the vehicle

[0047] 214 Dialogue control object template

Claims

1. A method for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, the method comprising: identifying, by a digital assistant of the vehicle, a trigger event of a software application of the vehicle; transmitting the trigger event of the software application from the digital assistant of the vehicle to a dialogue control application of a server external to the vehicle; receiving, by the digital assistant of the vehicle, a dialogue control message according to the trigger event of the software application from the dialogue control application of the server external to the vehicle; generating, by the digital assistant of the vehicle, a dialogue control object in the case of using the dialogue control message of the server external to the vehicle and one dialogue control object template among a plurality of dialogue control object templates of the vehicle; and providing, by the digital assistant of the vehicle, the dialogue control object to the user of the vehicle on an output device of the vehicle.

2. The method according to claim 1, wherein Providing, by the digital assistant of the vehicle, the dialogue control object to the user of the vehicle on an output device of the vehicle includes: determining output device information in the case of using a dialogue control object template; and providing, by the digital assistant of the vehicle, the dialogue control object to the user of the vehicle on an output device of the vehicle, wherein the output device is specified by the output device information of the dialogue control object template.

3. The method according to any one of the above claims, the method further comprising: receiving coding information of the vehicle, wherein the coding information preferably specifies a vehicle type; determining a partial set of the dialogue control object templates from the plurality of dialogue control object templates according to the coding information of the vehicle; and generating, by the digital assistant of the vehicle, a dialogue control object in the case of using the dialogue control message of the server external to the vehicle and one dialogue control object template among the partial set of the dialogue control object templates of the vehicle.

4. The method according to any one of the preceding claims, wherein, Generating, by the digital assistant of the vehicle, a dialogue control object in the case of using the dialogue control message of the server external to the vehicle and one dialogue control object template among the partial set of the dialogue control object templates of the vehicle or one dialogue control object template among a plurality of dialogue control object templates includes: determining an icon of the software application; determining a main color of the icon of the software application; adapting the color of the dialogue control object template according to the main color of the icon of the software application; and adapting the output information of the dialogue control object template according to the dialogue control message; and generating a dialogue control object in the case of using the adapted dialogue control object template.

5. The method according to any one of the above claims, the method further comprising: determining a level of the dialogue control object template according to the software application; determining relevance information according to the determined level of the dialogue control object template; and providing, by the digital assistant of the vehicle, the dialogue control object to the user of the vehicle on the output device of the vehicle according to the determined relevance information.

6. The method according to claim 5, wherein When providing the dialogue control object on the output device of the vehicle by the digital assistant of the vehicle, controlling the output moment and / or output duration according to the determined relevance information; and / or When providing the dialogue control object on the output device of the vehicle by the digital assistant of the vehicle, controlling the output type according to the determined relevance information.

7. The method according to any one of the preceding claims, wherein, A digital assistant of a vehicle provides a dialogue control object to a user of the vehicle on an output device of the vehicle according to dialogue control message validity information.

8. The method according to any one of the above claims, wherein, The dialogue control object provides an active dialogue with the user of the vehicle.

9. The method according to any one of the preceding claims, wherein, The dialogue control object template is determined by a category of a software application; and Preferably, the category of the software application is consistent with the level of the dialogue control object template.

10. The method according to any one of the preceding claims, wherein, One of a plurality of dialogue control object templates specifies a plurality of interaction modalities between the user of the vehicle and the provided dialogue control object based on the dialogue control object template; Wherein, the plurality of interaction modalities include at least one of the following interaction modalities, preferably a plurality of interaction modalities: voice-based interaction, gesture-based interaction, gaze-based interaction, and / or touch-based interaction.

11. A computer-readable medium for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, wherein, The computer-readable medium includes instructions that, when executed on a computer or a controller, perform the method according to any one of claims 1 to 10.

12. A system for providing a dialogue control object of a digital assistant of a vehicle to a user of the vehicle, wherein, The system is configured to perform the method according to any one of claims 1 to 10.

13. A vehicle, the vehicle including the system according to claim 12 for providing a dialogue control object of a digital assistant of the vehicle to a user of the vehicle.

Images