Method and system for dialog control of motor vehicle

Abstract

The invention relates to a method for dialogue control of a motor vehicle, comprising the following automated steps: (i) determining a selection of a plurality of options with respect to a prompt function of the motor vehicle after an event occurs; (ii) providing the selection for the user input on the first human-machine interface by outputting a first signal of a first type; (iii) acquiring a user input having a second signal of a second type on a second human-machine interface; (iv) activating the selected option.

Description

Technical Field

[0001] The present invention relates to a method, in particular a computer-implemented method, and a system for dialog control of a motor vehicle. Background Art

[0002] Modern motor vehicles use human-machine interfaces (HMIs). These include displays through which vehicle occupants receive information or make inputs. For example, navigation routes are displayed on such displays. Vehicle occupants can use these displays to enter starting and ending points, as well as other settings. These displays can be located in the center console area, behind the driver's or passenger's headrests, and / or behind the steering wheel from the driver's perspective, or projected onto a surface, particularly the windshield, as a so-called "head-up display." Vehicle functions can now also be operated via voice input using voice recognition. Summary of the Invention

[0003] The object of the present invention is to provide an improved dialog control for a motor vehicle.

[0004] This object is achieved by the teaching of the independent claims. Various embodiments and improvements of the invention are the subject matter of the dependent claims.

[0005] A first aspect of the solution relates to a method, in particular a computer-implemented method, for dialog control of a motor vehicle, comprising the following automated steps: (i) determining a selection of a plurality of options, in particular regarding the activation or deactivation of a reminder function after an event, in particular a driving situation; (ii) providing said selection for user input on a first human-machine interface by outputting a first signal of a first type; (iii) obtaining user input with a second signal of a second type on a second human-machine interface; and (iv) activating the selected option.

[0006] As used herein, the terms "comprises," "includes," "comprising," "having," "with," or any other variations thereof, shall mean a non-exclusive inclusion. For example, a method or apparatus that comprises or has a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such method or apparatus.

[0007] In addition, unless expressly stated to the contrary, "or" refers to an inclusive "or" and not an exclusive "or." For example, condition A or B is satisfied by one of the following conditions: A is true (or exists) and B is false (or does not exist), A is false (or does not exist) and B is true (or exists), and both A and B are true (or exist).

[0008] "A" or "an," as used herein, should be defined as "one or more." The terms "another" and "another" and any other variations thereof should be construed to mean "at least one other."

[0009] As used herein, "plurality" should be understood as "two or more."

[0010] The terms "configure" or "set up" to perform a particular function (and their corresponding variations) are understood to mean that the corresponding device is already in a configuration or setting capable of performing the function, or at least is configurable—i.e., configurable—so that it can perform the function after being configured accordingly. Configuration can be achieved, for example, by setting parameters of a process flow or activating or deactivating a function or setting using a switch or the like. In particular, a device may have multiple predefined configurations or operating modes, and configuration can be performed by selecting one of these configurations or operating modes.

[0011] The term "signal type" as used herein should be understood in particular to mean a physical property of the respective signal. In particular, the signal type may include an optical signal, an acoustic signal, a tactile signal or a gesture-based signal.

[0012] As used herein, the term "optical signal" should be understood to mean, in particular, an electromagnetic signal that is perceptible to the human eye. This perceptibility can occur, in particular, when the electromagnetic wave has a wavelength in the range of approximately 400 nm to 760 nm. In particular, the optical signal can visually present content to a user via a display.

[0013] The term "acoustic signal" as used herein should be understood in particular to be a signal based on sound waves, in particular sound waves perceptible to the human ear. Furthermore, this can be understood to be a sound wave produced by the human voice, in particular speech.

[0014] As used herein, the term "haptic signal" should be understood to mean, in particular, a signal generated by contact between a human hand or other body part and an object, in particular an object in a motor vehicle. In particular, functions of the motor vehicle can be triggered by haptic signals, in particular by a human hand. Similarly, haptic signals can include movement, in particular vibration, of an object in the motor vehicle, wherein the haptic signal can be perceptible to the user.

[0015] The term “gesture signal” as used here is to be understood in particular to mean the control or triggering of a function by the recognition of a gesture of a user, in particular by a camera in a motor vehicle.

[0016] The term "human-machine interface" as used herein is understood to mean input devices or operating elements via which a user can trigger functions. In motor vehicles, these input devices may include, in particular, a steering wheel, pedals, and manually operable mechanical or electronic operating elements such as buttons, knobs, joysticks, sliding or rotary switches, touch-sensitive surfaces (such as touchpads), or screens (touchscreens). Furthermore, the human-machine interface may include, in particular, voice control, which may be designed to distinguish and recognize a limited list of predefined voice commands. Furthermore, the human-machine interface may include, in particular, sensor-assisted (in particular camera-assisted) individual gesture recognition for controlling selected vehicle functions.

[0017] The term "event" as used herein is to be understood as meaning in particular a specific driving situation, such as exceeding a predetermined speed. Likewise, an "event" may be understood as meaning in particular an engine start, or the activation of a function in a motor vehicle, such as the activation of windshield wipers or the activation of an air conditioner.

[0018] The method according to the first aspect allows for greater flexibility in outputting option selections and subsequent user input to select an option, thereby enabling an adaptation optimized for the situation. This can be achieved in an improved manner by using different types of signals (i.e., a first signal of a first type and a second signal of a second type). Thus, the type of signal used for providing can be different from the type of signal used for receiving.

[0019] Preferred embodiments of the method are described below, which can be combined with one another and with other aspects described as desired, unless expressly excluded or technically infeasible.

[0020] In some embodiments, the method further comprises: considering the selected option when determining future selections regarding the same prompt function.By considering the completed selected options, improved future option selections can be determined.

[0021] In some embodiments, the selection is determined by an evaluation device located externally to the vehicle, and the determined selection is transmitted to the first human-machine interface of the vehicle to provide the selection. By disposing the evaluation device externally to the vehicle, the computing power required for the determination in the vehicle can be reduced. Furthermore, the evaluation device located externally to the vehicle can be equipped with a relatively larger capacity and, therefore, higher computing power. This allows for a faster and / or more comprehensive determination of the selection of the option.

[0022] In some embodiments, the first signal of the first type and the second signal of the second type are determined by the evaluation device taking into account the event that has occurred. In particular, it can be provided that, in the event of a critical driving event (e.g., unexpected braking), a light signal is determined as the first type for providing a selection to avoid unnecessary distraction of the driver (as might be the case with an acoustic signal). In this case, the driver can later select one of the options using a voice signal. This enables improved adaptation of the use of the first signal of the first type and the second signal of the second type depending on the event.

[0023] In some embodiments, the selected options enable prioritization of prompt functions, particularly time-based or display-based prioritization. Thus, obtaining user input can proactively influence which prompt functions are prioritized in the future. This can mean prompt functions are executed more frequently, or prompt functions are executed audibly to improve user perception.

[0024] In some embodiments, the first signal of the first type or the second signal of the first type is selected from the group consisting of light, sound, gesture, or tactile. Providing a selection by means of a light signal (particularly via a display) may be advantageous for displaying multiple options simultaneously. Sound signals can be perceived more strongly by the user. User input by means of a voice signal (particularly a word or a short instruction) is particularly advantageous for the driver because the driver does not need to remove his hands from the steering wheel. Haptic signals, particularly haptic signals via the steering wheel, are advantageous for the driver because the driver does not need to remove his eyes from the traffic situation. Signals via gestures can be intuitively executed by the user.

[0025] A second aspect of the solution relates to a system for dialogue control of a motor vehicle, wherein the system is configured to carry out a method according to the first aspect, wherein the system comprises an on-board device of the motor vehicle and an evaluation device arranged outside the motor vehicle and connected to the on-board device of the motor vehicle in terms of signal technology.

[0026] A third aspect of the solution relates to a computer program having instructions which, when executed on a system according to the second aspect, cause the system to perform the method according to the first aspect.

[0027] The computer program can be stored in particular on a non-volatile storage medium. Preferably, this is a storage medium in the form of an optical storage medium or a flash memory module. This may be advantageous when the computer program itself should be independent of the processor platform on which one or more programs are to be executed. In another implementation, the computer program can be present as a file on a data processing unit (especially a server) and can be downloaded via a data connection (such as the Internet or a dedicated data connection, such as a proprietary or local network). In addition, the computer program can have a plurality of mutually cooperating single program modules. These modules can be configured as or at least can be used in such a way that they are executed in a distributed computing (English "Distributed computing") manner on different devices (computers or processor units) that are geographically separated and interconnected via a data network.

[0028] The system (in particular the evaluation device) can accordingly have a program memory in which the computer program is stored. Alternatively, the system can also be configured to access an external computer program (for example a computer program available on one or more servers or other data processing units) via a communication connection, in particular in order to exchange data with the computer program that is used during the execution of the method or the computer program or that represents output of the computer program.

[0029] The features and advantages explained with respect to the solution of the first aspect also apply correspondingly to the other described aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Further advantages, features and application possibilities result from the following description of preferred embodiments in conjunction with the drawings.

[0031] In the attached figure:

[0032] Figure 1 A flow chart for illustrating a preferred embodiment of a method for operating a system of a motor vehicle is schematically shown; and

[0033] Figure 2 A block diagram of a system according to one embodiment is schematically shown. DETAILED DESCRIPTION

[0034] Throughout the drawings, the same reference numerals are used for elements that are identical or correspond to each other.

[0035] exist Figure 1 Schematically shows a flow chart 100 for illustrating a preferred specific embodiment of a method for dialog control of a motor vehicle, which method has the following automated steps:

[0036] In the first step 110 of the method, an evaluation device 240 located outside the vehicle determines a selection of multiple options for a warning function of the vehicle after an event has occurred. These options can include activating or deactivating the warning function. Similarly, a selection can mean that the warning function is displayed within a predetermined time interval.

[0037] In another step 120 of the method, the selection is provided for user input on a first human-machine interface by outputting a first signal of a first type. In particular, the provision can be achieved by displaying content on a display.

[0038] In another step 130 of the method, a user input having a second signal of a second type is acquired on the second human-machine interface. The second signal of the second type may include an acoustic signal, in particular a voice command by the user.

[0039] In a further step 140 of the method, the selected option is activated.

[0040] exist Figure 2 Schematically shows a block diagram of a system 200 according to one embodiment.

[0041] System 200 includes an onboard device 210 (not shown here) of a motor vehicle and an external evaluation device 240 arranged outside the motor vehicle. Onboard device 210 and external evaluation device 240 are connected in terms of signaling, in particular via a wireless connection, in particular in accordance with a mobile communication standard such as LTE or 5G. This is schematically illustrated by corresponding arrows.

[0042] The onboard device 210 includes a human-machine interface system 220 having at least a first human-machine interface and a second human-machine interface. Information can be output to the user via the first human-machine interface using a first type of signal, and user input can be received via the second human-machine interface using a second type of second signal. The first signal of the first type and the second signal of the second type can be optical, acoustic, tactile, or gestural. Provision is made for the output and subsequent user input to be performed using different types of signals. For example, the output can be performed optically via a display, while the user input can be performed acoustically via voice. Within the scope of the output, a selection of options is presented to the user, and the user can select one of these options via input, thereby triggering a function in the motor vehicle.

[0043] The determination of the option selection is triggered by an event, such as a vehicle traveling too fast. Through the event, the event is acquired in the processing module 230 and signal processed to be transmitted to the capability module for determining the selection.

[0044] The selection of an option is determined in the external evaluation device 240 and sent to the onboard device 210 for output. Information about the selected option is sent back to the external evaluation device 240 for use in determining future selections.

[0045] Furthermore, it includes information about automatic warning messages in the vehicle, such as those concerning speeding or the vehicle's status.

[0046] The external evaluation device 240 has a plurality of evaluation algorithms, which are used to determine the selection of an option individually or in combination. The evaluation algorithms are ideally stored in a cloud storage so as to enable location-flexible access.

[0047] The evaluation algorithm includes a capability network module 250, which can also be referred to as a "skill router." The capability network module 250 includes multiple modules, specifically a dialog persistence module 252, a routine logic module 254, a modality management module 256, and an interaction feedback module 258. The results determined by these modules 252, 254, 256, and 258 are combined in a capability integration module 251, thereby determining the selection of an option and sending it to the human-machine interface system 220 for output via the first human-machine interface.

[0048] To determine the selection of an option, information is also exchanged between the capability network module 250 and, on the one hand, the voice configuration module 260 and, on the other hand, the capability configuration runtime module 270 (which includes a capability management module 275). The voice configuration module 260 includes a dialog management module 265. This allows, for example, to determine whether a transmitted message should be repeated. Similarly, the dialog management module 265 can determine whether the next message should be transmitted acoustically via a loudspeaker in the vehicle or visually via a display.

[0049] Based on the information received in capability network module 250 due to user input at the second human-machine interface, and possibly other information about the current state in the vehicle, an algorithm of external evaluation device 240 (and in particular capability network module 250) determines which options to offer the user. Therefore, capability network module 250 does not generate a prompt for transmission to the first human-machine interface. The current prompt is also associated with a selection of how future prompts should be handled. For example, the user can select whether the prompt should be deactivated in the future or should be performed periodically.

[0050] Thus, the user can influence the manner and frequency of future prompts by the selection of options. At the same time, the information received by the capability network module 250 about this is evaluated. The result is a continuous optimization of the option selection and the prompts given to the user.

[0051] In addition, the dialog management module 258 controls which signal type should be used for the next output of the same function.

[0052] The first reminder may also be given audibly, while the second reminder relating to the same subject may be given at a later time only visually.

[0053] In this case, for example, functions that cannot be permanently deactivated can be manually deactivated at the beginning of each drive by providing the option to do so, taking into account legal regulations. Thus, the vehicle can be configured semi-automatically, so that the user is presented with a number of options and can configure the vehicle by selecting the appropriate options.

[0054] Although at least one exemplary embodiment has been described above, it should be noted that a large number of variations exist. It should also be noted that the exemplary embodiments described are merely non-limiting examples and are not intended to limit the scope, applicability, or configuration of the apparatus and methods described herein. Instead, the foregoing description will provide guidance to those skilled in the art for implementing at least one exemplary embodiment, with the understanding that various changes may be made to the function and arrangement of the elements described in the exemplary embodiments without departing from the subject matter defined in the appended claims and their legal equivalents.

[0055] List of reference numerals:

[0056] 100 is a flowchart illustrating a preferred embodiment of the method

[0057] 110 Confirm selection

[0058] 120 offers options

[0059] 130 Get user input

[0060] 140 Activation Options

[0061] 200 system

[0062] 210 vehicle-mounted device

[0063] 220 human-machine interface system

[0064] 230 processing module

[0065] 240 evaluation device

[0066] 250-capacity network module

[0067] 251 Capability Integration Module

[0068] 252 Conversation Persistence Module

[0069] 254 routine logic modules

[0070] 256 mode management module

[0071] 258 interactive feedback module

[0072] 260 Voice Design Module

[0073] 265 dialogue management module

[0074] 270 Capability Design Runtime Module

[0075] 275 Capacity Management Module.

Claims

1. A method for dialog control of a motor vehicle, comprising the following automated steps: Determining the selection of multiple options regarding a prompt function of a motor vehicle after an incident occurs; providing the selection for user input on a first human-machine interface by outputting a first signal of a first type; obtaining a user input having a second signal of a second type on a second human-machine interface; Activates the selected option.

2. The method according to claim 1, wherein The selected option is taken into consideration when determining future choices regarding the same prompt function.

3. The method according to claim 1 or 2, wherein: The selection is determined by an evaluation device (240) arranged outside the motor vehicle, and the determined selection is transmitted to a first human-machine interface of the motor vehicle in order to provide the selection.

4. The method according to any one of the preceding claims, wherein The first signal of the first type and the second signal of the second type are determined by an evaluation device (240) taking into account an event that occurs.

5. The method according to any one of the preceding claims, wherein The selected options allow for prioritization of the notification functionality.

6. A method according to any one of the preceding claims, wherein: The first signal of the first type or the second signal of the first type is selected from the group of light, sound, gesture or tactile type.

7. A system (200) for dialog control of a motor vehicle, wherein: The system (200) is configured to carry out a method according to any one of the preceding claims, wherein the system (200) comprises an onboard device (210) of a motor vehicle and an evaluation device (240) which is arranged outside the motor vehicle and is connected to the onboard device (210) of the motor vehicle in terms of signal technology.

8. A computer program comprising instructions which, when executed on a system (200) according to claim 7, cause the system to perform the method according to any one of claims 1 to 6.

Images