Method for operating a digital assistant of a vehicle, computer-readable medium, system, and vehicle

Abstract

The invention relates to a method for operating a digital assistant of a vehicle, wherein the digital assistant comprises a rule-based dialog system and an artificial-intelligence-based dialog system, wherein the method comprises: activating a dialog-based user guidance of the rule-based dialog system for a functioning of the vehicle using the rule-based dialog system of the digital assistant; providing a first message of the dialog-based user guidance via the rule-based dialog system of the digital assistant to a user of the vehicle after activating the dialog-based user guidance; transmitting the first message of the dialog-based user guidance from the rule-based dialog system of the digital assistant to the artificial-intelligence-based dialog system of the digital assistant as context information; receiving a message of the user during the dialog-based user guidance of the rule-based dialog system via the rule-based dialog system of the digital assistant; transmitting the message of the user from the rule-based dialog system of the digital assistant to the artificial-intelligence-based dialog system of the digital assistant.

Description

[0001] Method for operating a digital assistant of a vehicle, computer-readable medium, system, and vehicle

[0002] The invention relates to a method for operating a digital assistant of a vehicle. The invention further relates to a computer-readable medium for operating a digital assistant of a vehicle, a system for operating a digital assistant of a vehicle, and a vehicle comprising the system for operating a digital assistant of a vehicle.

[0003] Digital assistants in vehicles that enable rule-based dialogues about vehicle functions are known from the state of the art. Digital assistants based on artificial intelligence are also known. A combination of a rule-based digital assistant and an artificial intelligence-based digital assistant in the vehicle is not known from the state of the art.

[0004] It is therefore an object of the invention to operate a digital assistant more efficiently. In particular, an object of the invention is to provide improved response messages regarding a function of a vehicle from a digital assistant of the vehicle to a user of the vehicle.

[0005] This object is achieved by the features of the independent claims. Advantageous embodiments and further developments of the invention emerge from the dependent claims.

[0006] According to a first aspect, the invention is characterized by a method for operating a digital assistant of a vehicle, wherein the digital assistant comprises a rule-based dialogue system and a dialogue system based on artificial intelligence. The method can be a computer-implemented method and / or a control unit-implemented method. The artificial intelligence-based dialogue system can, for example, be a chatbot that uses artificial intelligence to generate text- and / or voice-based response messages to messages from a user. The digital assistant can be a digital voice assistant. The rule-based dialogue system preferably comprises a predefined dialogue sequence determined by one or more rules.The rule-based dialogue system can directly process a status datum, status data, sensor datum, and / or sensor data relating to a vehicle function, for example, through a rule and / or a data processing module of the rule-based dialogue system. The artificial intelligence-based dialogue system is preferably text- and / or voice-based. For example, the artificial intelligence-based dialogue system cannot directly process function-specific status and / or sensor data, i.e., converting the function-specific status and / or sensor data into a text format understandable by the artificial intelligence-based dialogue system is necessary.

[0007] The method comprises activating a dialog-based user guidance of the rule-based dialog system for a function of the vehicle by the rule-based dialog system of the digital assistant. The method further comprises providing a first message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle after activating the dialog-based user guidance, and transmitting the first message of the dialog-based user guidance from the rule-based dialog system of the digital assistant to the artificial intelligence-based dialog system of the digital assistant as context information.The method further comprises receiving a user message during the dialog-based user guidance of the rule-based dialog system by the digital assistant's rule-based dialog system, and transmitting the user message from the rule-based dialog system of the digital assistant to the artificial intelligence-based dialog system of the digital assistant. The method recognizes an intent of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle based on the user message received by the digital assistant's rule-based dialog system.If no intention of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle was detected by the rule-based dialog system of the digital assistant, the method provides a context-based response message to the user of the vehicle through the artificial intelligence-based dialog system of the digital assistant using the transmitted context information and depending on the transmitted user message. If an intention of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle was detected by the rule-based dialog system of the digital assistant, the method provides a response message to the user of the vehicle depending on the detected intention of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle through the vehicle's rule-based dialog system.

[0008] Advantageously, the method can operate a digital assistant, for example, a digital voice assistant, more efficiently. By combining the rule-based dialogue system with the artificial intelligence-based dialogue system, a user of the vehicle can receive a context-based response message from the artificial intelligence-based dialogue system using the method, with the rule-based dialogue system providing the context for the context-based response message from the artificial intelligence-based dialogue system. The user can thus receive a more precise response message from the artificial intelligence-based dialogue system to a user message whose intent is not recognized by the rule-based dialogue system and / or not recognized with a confidence above a predefined confidence threshold.Furthermore, the method efficiently prevents an inappropriate response message and / or an incorrect response message of the artificial intelligence-based dialogue system by the rule-based dialogue system determining the context of the artificial intelligence-based dialogue system.

[0009] According to an advantageous embodiment, the activation of the dialogue-based user guidance regarding the function of the vehicle by the rule-based dialogue system of the digital assistant can comprise providing a recommendation message regarding a function of a vehicle by the rule-based dialogue system of the digital assistant to a user of the vehicle, transmitting the recommendation message to the artificial intelligence-based dialogue system as context information, receiving a confirmation message from the user of the vehicle in response to the provided recommendation message by the rule-based dialogue system of the digital assistant for activating the dialogue-based user guidance regarding the function of the vehicle, activating the dialogue-based user guidance regarding the function of the vehicle by the rule-based dialogue system of the digital assistant,and transmitting the confirmation message to the artificial intelligence-based dialog system as context information. This allows for efficient, proactive initiation of dialog-based user guidance.

[0010] According to a further advantageous embodiment, the provision of a first

[0011] A message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle after activation of the dialog-based user guidance may include receiving a system state of the function of the vehicle by the rule-based dialog system of the digital assistant, transmitting a text message representative of the system state of the function of the vehicle to the artificial intelligence-based dialog system by the rule-based dialog system of the digital assistant as context information, and providing the first message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle depending on the system state of the function of the vehicle. This allows an efficient system state of the function of the vehicle to be provided as context information to the artificial intelligence-based dialog system.

[0012] According to a further advantageous embodiment, the detection of the intention of the dialog-based user guidance of the rule-based dialog system based on the user message received by the rule-based dialog system of the digital assistant can include determining a confidence value of the intention of the dialog-based user guidance of the rule-based dialog system based on the user message received by the rule-based dialog system of the digital assistant. This allows the intention to be determined more precisely by the rule-based dialog system.

[0013] According to a further advantageous embodiment, if no intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle was detected by the rule-based dialogue system of the digital assistant or the confidence value of the detected intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle by the rule-based dialogue system of the digital assistant is smaller than a predetermined confidence threshold, the method can further comprise providing a context-based response message to the user of the vehicle by the artificial intelligence-based dialogue system of the digital assistant using the transmitted context information and depending on the transmitted message of the user,and if the confidence value of the detected intent of the dialog-based user guidance of the rule-based dialog system regarding the vehicle's function by the digital assistant's rule-based dialog system is greater than or equal to the specified confidence threshold, include providing a response message to the vehicle user depending on the detected intent of the dialog-based user guidance of the rule-based dialog system regarding the vehicle's function by the vehicle's rule-based dialog system. This allows the provision of the context-based response message to be controlled more efficiently.

[0014] According to a further advantageous embodiment, the context-based response message can be provided to the vehicle user by the artificial intelligence-based dialog system of the digital assistant using all context information transmitted to the artificial intelligence-based dialog system by the rule-based dialog system after the dialog-based user guidance has been activated. This allows a dialog-based context to be efficiently defined for the artificial intelligence-based dialog system.

[0015] According to a further advantageous embodiment, the context-based response message can be provided to the vehicle user by the artificial intelligence-based dialog system of the digital assistant using at least one or all of the context information transmitted to the artificial intelligence-based dialog system after the activation of the dialog-based user guidance from the rule-based dialog system, and depending on the intention and / or the confidence value of the intention of the dialog-based user guidance of the rule-based dialog system of the digital assistant. This allows a dialog-based context for the artificial intelligence-based dialog system to be efficiently defined.

[0016] According to a further aspect, the invention is characterized by a computer-readable medium for operating a digital assistant of a vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer and / or a control unit, carry out the method described above.

[0017] According to a further aspect, the invention is characterized by a system for operating a digital assistant of a vehicle, wherein the system is designed to carry out the method described above.

[0018] According to a further aspect, the invention is characterized by a vehicle comprising the above-described system for operating a digital assistant of the vehicle. Further features of the invention emerge from the claims, the figure, and the description of the figure. All features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figure and / or shown alone in the figure, can be used not only in the respective specified combination, but also in other combinations or even on their own.

[0019] A preferred embodiment of the invention is described below with reference to the accompanying drawings. Further details, preferred embodiments, and developments of the invention will emerge from these. In detail, schematically

[0020] Fig. 1 shows an exemplary method for operating a digital assistant of a vehicle.

[0021] In detail, Fig. 1 shows an exemplary method 100 for operating a digital assistant of a vehicle. The digital assistant of the vehicle can comprise a rule-based dialog system and a dialog system based on artificial intelligence. For example, the rule-based dialog system can comprise a deterministic language model. The deterministic language model can recognize pre-modeled intents and generate corresponding deterministic response messages and / or provide them to a user of the vehicle. For example, the rule-based dialog system can comprise a predefined multi-stage dialog regarding a function of the vehicle. The predefined multi-stage dialog regarding a function of the vehicle can comprise technically correct user guidance regarding a function of the vehicle.

[0022] For example, the artificial intelligence-based dialogue system can be a chatbot that uses artificial intelligence, for example a machine learning method, to generate and / or provide voice-based and / or text-based response messages for a user. The artificial intelligence-based dialogue system can, for example, be trained in several steps using a language model. The artificial intelligence-based dialogue system can be trained with technically correct data relating to a function of the vehicle as training data. For example, the artificial intelligence-based dialogue system can be trained with a user manual and / or a technical specification of the vehicle, and in particular with a user manual and / or a technical specification relating to a function of the vehicle, as training data.The method 100 comprises activating 102 a dialog-based user guidance of the rule-based dialog system regarding a function of the vehicle by the rule-based dialog system of the digital assistant. The dialog-based user guidance can comprise multiple dialog steps. The dialog-based user guidance can explain, step by step, the correct use of the vehicle function to the user of the vehicle using a predefined sequence of dialog steps. For example, the function of the vehicle can be a parking assistance function of the vehicle. The dialog-based user guidance of the parking assistance function of the vehicle can comprise multiple dialog steps which indicate which actions the user must perform for correct use of the parking assistance function. For example, a first dialog step can instruct the user to drive at a predefined maximum speed and at a predefined maximum distance from parked vehicles.In a second dialog step, the vehicle can offer the user a parking space that suits the user's vehicle and further actions by the user based on the parking space offered by the vehicle. In a third dialog step, the vehicle can request the user to take their hands off the steering wheel. In a fourth dialog step, the vehicle can request the user to take their foot off the brake pedal. In a fifth dialog step, the vehicle can instruct the user to let the vehicle park the vehicle, whereby the speed of the vehicle can be controlled by the user by pressing the brake pedal. In a sixth dialog step, the vehicle can transmit a message to the user of the vehicle about the successful parking of the vehicle.

[0023] The method 100 includes providing 104 a first message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle after activating the dialog-based user guidance. The first message can be a proactive recommendation regarding a function of the vehicle. Furthermore, the method 100 can transmit 106 the first message of the dialog-based user guidance from the rule-based dialog system of the digital assistant to the artificial intelligence-based dialog system of the digital assistant as context information. The user can optionally transmit a message to the rule-based dialog system for accepting or rejecting the recommendation regarding the function of the vehicle. If the user accepts the recommendation regarding the function of the vehicle, the method can execute the dialog-based user guidance regarding the function of the vehicle.Each dialog step of the dialog-based user guidance can be transmitted from the rule-based dialog system to the artificial intelligence-based dialog system as context information. In the example of dialog-based user guidance for the parking assistant, the rule-based dialog system can transmit messages to the vehicle user and / or sensor information from the respective dialog step to the artificial intelligence-based dialog system as context information.

[0024] The method 100 can receive 108 a message from the user during the dialog-based user guidance of the rule-based dialog system by the rule-based dialog system of the digital assistant and transmit 110 the user message from the rule-based dialog system of the digital assistant to the artificial intelligence-based dialog system of the digital assistant. Furthermore, the method 100 can recognize 112 an intention of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle depending on the message from the user received by the rule-based dialog system of the digital assistant. In the example of the dialog-based user guidance of the parking assistant, taking your hands off the steering wheel in the third dialog step can be a message from the user that is recognized by the method 100 as an intention to continue the dialog-based user guidance of the parking assistant.Furthermore, the message can, for example, be a voice message from the user, with which the vehicle user wants to inquire whether they are doing everything correctly or are unsure whether the operation is correct. If no intention is specified for this voice message in the rule-based dialog system, method 100 cannot recognize any intention either.

[0025] If no intention of the dialog-based user guidance of the rule-based dialog system regarding the function of the vehicle was detected by the rule-based dialog system of the digital assistant, the method 100 can provide a context-based response message to the user of the vehicle by the artificial intelligence-based dialog system of the digital assistant using the transmitted context information and depending on the transmitted message of the user 114.If an intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle has been recognized by the rule-based dialogue system of the digital assistant, the method can provide a response message, in particular a predefined response message, to the user of the vehicle depending on the recognized intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle by the rule-based dialogue system of the vehicle 116. Advantageously, the artificial intelligence-based dialogue system, for example a dialogue system which uses a large language model and one or more machine learning methods, can provide a response message to a message to the user for which no intention can be recognized by the rule-based dialogue system.The rule-based dialogue system can, for example, comprise a deterministic language model that enables the recognition of intentions, and a communicative coupling to on-board network signals and / or on-board network messages that can be used by the rule-based dialogue system to control the dialogue-based user guidance. The dialogue-based user guidance of the rule-based dialogue system can use the method as a context for the artificial intelligence-based dialogue system to respond to user messages in a context-based manner, in particular when no intention or the confidence of a recognized intention falls below a predetermined confidence threshold. The rule-based dialogue system leads to increased functional and / or user safety of the digital assistant, since the rule-based dialogue system provides correct and secure, safety-relevant information in the dialogue-based user guidance.In addition, the digital assistant can freely interpret user messages in the context of a currently executed dialog-based user guidance and the learned factual knowledge and thus efficiently provide the user with further information in context-based response messages.

[0026] List of reference symbols

[0027] 100 procedures

[0028] 102 Activating a dialog-based user interface

[0029] 104 Providing a first message

[0030] 106 Sending the first message

[0031] 108 Receiving a message

[0032] 110 Transmitting the message

[0033] 112 Recognizing an Intention

[0034] 114 Providing a context-based response message

[0035] 116 Providing a response message

Claims

Patent claims 1. A method for operating a digital assistant of a vehicle, wherein the digital assistant comprises a rule-based dialogue system and an artificial intelligence-based dialogue system, the method comprising: Activating a dialogue-based user guidance of the rule-based dialogue system to a function of the vehicle through the rule-based dialogue system of the digital assistant; Providing a first message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle after activating the dialog-based user guidance; Transmitting the first message of the dialog-based user guidance from the rule-based dialog system of the digital assistant to the artificial intelligence-based dialog system of the digital assistant as context information; Receiving a message from the user during the dialog-based user guidance of the rule-based dialog system by the rule-based dialog system of the digital assistant; Transmitting the user’s message from the digital assistant’s rule-based dialogue system to the digital assistant’s artificial intelligence-based dialogue system; Recognition of an intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle depending on the received message from the user by the rule-based dialogue system of the digital assistant; If no intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle was recognized by the rule-based dialogue system of the digital assistant: Providing a context-based response message to the user of the vehicle by the artificial intelligence-based dialogue system of the digital assistant using the transmitted context information and depending on the user's transmitted message; and If an intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle was recognized by the rule-based dialogue system of the digital assistant: Providing a response message to the user of the vehicle depending on the detected intention of the dialogue-based user guidance of the rule-based dialogue system about the function of the vehicle through the vehicle's rule-based dialogue system.

2. The method according to claim 1, wherein activating the dialog-based user guidance to the function of the vehicle by the rule-based dialog system of the digital assistant comprises: Providing a recommendation message regarding a function of a vehicle to a user of the vehicle through the rule-based dialogue system of the digital assistant; Transmitting the recommendation message to the artificial intelligence-based dialogue system as context information; Receiving a confirmation message from the user of the vehicle in response to the provided recommendation message by the rule-based dialogue system of the digital assistant to activate the dialogue-based user guidance to the function of the vehicle; Activating the dialogue-based user guidance of the vehicle’s function through the rule-based dialogue system of the digital assistant; and Transmitting the confirmation message to the artificial intelligence-based dialogue system as context information.

3. The method according to any one of the preceding claims, wherein providing a first message of the dialog-based user guidance by the rule-based dialog system of the digital assistant to a user of the vehicle after activating the dialog-based user guidance comprises: Receiving a system status of the vehicle’s function through the digital assistant’s rule-based dialogue system; Transmitting a text message representative of the system status of the vehicle's function to the artificial intelligence-based dialogue system by the digital assistant's rule-based dialogue system as context information; and Providing the first message of the dialog-based user guidance through the rule-based dialog system of the digital assistant to a user of the vehicle depending on the system status of the vehicle's function.

4. Method according to one of the preceding claims, wherein the recognition of an intention of the dialogue-based user guidance of the rule-based dialogue system is dependent on the received message from the user through the digital assistant's rule-based dialogue system includes: Determining a confidence value of the intention of the dialog-based user guidance of the rule-based dialog system depending on the user message received by the rule-based dialog system of the digital assistant.

5. A method according to any one of the preceding claims, the method further comprising: If there is no intention of dialog-based user guidance of the rule-based Dialogue system to the function of the vehicle was recognised by the rule-based dialogue system of the digital assistant or the confidence value of the recognised intention of the dialogue-based user guidance of the rule-based dialogue system to the function of the vehicle by the rule-based dialogue system of the digital assistant is less than a predefined confidence threshold: Providing a context-based response message to the user of the vehicle by the artificial intelligence-based dialogue system of the digital assistant using the transmitted context information and depending on the user's transmitted message; and If the confidence value of the detected intention of the dialogue-based user guidance of the rule-based dialogue system regarding the function of the vehicle by the rule-based dialogue system of the digital assistant is greater than or equal to the specified confidence threshold: Providing a response message to the user of the vehicle depending on the recognized intention of the dialog-based user guidance of the rule-based dialog system to the function of the vehicle by the rule-based dialog system of the vehicle.

6. The method according to any one of the preceding claims, wherein the context-based response message is provided to the user of the vehicle by the artificial intelligence-based dialogue system of the digital assistant using all context information transmitted to the artificial intelligence-based dialogue system after activation of the dialogue-based user guidance from the rule-based dialogue system.

7. Method according to one of the preceding claims, wherein the context-based response message to the user of the vehicle is sent by the artificial intelligence-based Dialogue system of the digital assistant using at least one or all of the context information that was transmitted to the artificial intelligence-based dialogue system after activation of the dialogue-based user guidance from the rule-based dialogue system, and is provided depending on the intention and / or the confidence value of the intention of the dialogue-based user guidance of the rule-based dialogue system of the digital assistant.

8. A computer-readable medium for operating a digital assistant of a vehicle, the computer-readable medium comprising instructions which, when executed on a computer and / or a control unit, carry out the method according to any one of claims 1 to 7.

9. System for operating a digital assistant of a vehicle, wherein the system is designed to carry out the method according to one of claims 1 to 7.

10. A vehicle comprising the system for operating a digital assistant of a vehicle according to claim 9.

Images