Method and system for checking the availability of an online function of a speech recognition system in a motor vehicle
The method and system address the issue of user frustration by continuously monitoring the communication connection and providing timely notifications when online functions in a speech recognition system are unavailable, ensuring user awareness and enabling proactive restoration.
Patent Information
- Application Number
- DE102021205528
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-31
- Publication Date
- 2025-11-13
- Estimated Expiration
- 2041-05-31
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for checking the availability of an online function of a speech recognition system in a motor vehicle. Furthermore, the invention relates to a system for checking the availability of an online function of a speech recognition system in a motor vehicle, wherein the system is ultimately configured to carry out the method according to the invention.
[0002] In a motor vehicle, it may be possible for a user to control and / or activate a function of the vehicle using voice input that is captured and processed within the vehicle. For this purpose, the vehicle is equipped with a voice recognition system. Using this system, for example, the vehicle's navigation system can be controlled; a destination can be specified and selected via voice input. Alternatively or additionally, the voice recognition system can be used to control the vehicle's multimedia system and / or initiate a telephone call, for example, from a mobile phone located in the vehicle.
[0003] The speech recognition system in a motor vehicle typically has at least one function that can be performed entirely within the vehicle itself at all times. Such a function is referred to as an onboard or offline function of the speech recognition system. In contrast, the speech recognition system typically has at least one other function that is only available when a communication link exists between the vehicle and an external device, such as an internet connection to a server located outside the vehicle. This may be because information from the external server is required to execute this additional function. Such a communication-link-dependent function is referred to as an online function of the speech recognition system.The online function can be used, for example, to query current weather information in the vehicle, to support a search for a special destination in the vehicle's navigation system and / or to play music and / or other media content not loaded in the vehicle.
[0004] German patent application DE 10 2017 220 266 B3 discloses a method for checking an onboard speech recognition system in a motor vehicle. If a communication connection for executing an online function of the speech recognition system in the vehicle is interrupted, the system determines whether a deviation from a comparison result stored in the vehicle is detected when the speech recognition system is used in offline mode. If so, a message about the interrupted communication connection in the vehicle is displayed. Thus, the user is only informed about the interrupted communication connection when using the speech recognition system with the communication connection already interrupted.
[0005] German patent DE 10 2014 019 192 A1 discloses a motor vehicle equipped to establish a communication link to an external server and to provide online voice control of the vehicle's speech recognition system via this link. Two different display modes can be shown using an output unit: the first mode displays only the onboard voice control, while the second mode also displays the online voice control. The display mode is selected based on the status of the current communication link.
[0006] The object of the invention is to provide a solution by means of which a user can be easily and clearly informed of the availability of an online function of a speech recognition system in a motor vehicle.
[0007] This problem is solved by the subject matter of the independent patent claims.
[0008] A first aspect of the invention relates to a method by which the availability of an online function of a speech recognition system in a motor vehicle can be checked. The invention is based on the finding that typically, a notification regarding the availability of the online function of the speech recognition system in the motor vehicle is only provided when a user of the motor vehicle wants to use the speech recognition system and activates it for this purpose. Thus, there is currently no proactive notification regarding the availability, or the possible lack thereof, of the online function of the speech recognition system in the motor vehicle.However, it is advisable to continuously monitor the availability of the online function and display the result of this check in the vehicle. This allows the user to determine whether the online function of the speech recognition system is currently available even before attempting to access it. Therefore, the user should be notified early on to avoid frustration and / or surprise due to at least a temporary unavailability of the online function. The speech recognition system may be integrated with an intelligent digital assistant.
[0009] The method according to the invention comprises the following steps: First, a communication connection is established between a communication interface in the motor vehicle and an external device. The communication interface in the motor vehicle is preferably a component of the motor vehicle itself. Alternatively or additionally, a mobile device positioned in the motor vehicle, for example a mobile phone such as a smartphone or a tablet, can have the communication interface and provide it in the motor vehicle. The external device is, for example, a server and / or computing device located outside the motor vehicle, which is configured to provide the online function of the speech recognition system for the motor vehicle. The external device thus includes, for example, an evaluation protocol and / or information by means of which the online function can be performed.The external system may, for example, have access to current weather data for the current position of the vehicle and / or details of points of interest from a navigation system. Information within the meaning of the invention can comprise data, for example, a data package.
[0010] The communication link between the communication interface in the vehicle and the external device can be a wireless connection, for example via a wireless local area network (WLAN) and / or a mobile data network, for example based on the mobile communication standards Long Term Evolution (LTE), Long Term Evolution Advanced (LTE-A), or 5th Generation (5G). The communication link is preferably established immediately after or upon activation, i.e., when the vehicle is switched on. The communication link is designed to be available for the entire duration of the vehicle's activation or operation, i.e., to be maintained for the entire duration of the vehicle's use, from activation until deactivation, such as switching off the vehicle.
[0011] In the next step of the process, it is continuously determined whether the provided communication link is active or interrupted at any given time. Continuous monitoring means, for example, checking the status of the communication link at predefined intervals. These predefined intervals can range from 1 millisecond to several seconds; specifically, the interval between two successive checks can be 5 milliseconds, 10 milliseconds, 15 milliseconds, 20 milliseconds, 30 milliseconds, 45 milliseconds, 1 second, 1.5 seconds, 2 seconds, 3 seconds, 5 seconds, or 10 seconds, or any value in between.The communication link is therefore repeatedly checked to determine whether it still exists at the time of the check, i.e., at the current time, or whether it has been interrupted, at least temporarily. An interrupted communication link can alternatively be referred to as a dropped communication link. Thus, the current status of the communication link is continuously determined from the moment the vehicle is activated and / or switched on.
[0012] If a communication link currently exists, the next step in the process checks whether an online function of the vehicle's speech recognition system is available via this link. Specifically, it verifies whether the communication link is configured in such a way that the online function of the speech recognition system is indeed accessible. This online function relies on the transmission of information, for example, in the form of at least one data packet, from the vehicle to the external device and / or from the external server to the vehicle via the communication link.However, if, for example, the wireless communication link between the external device and the communication interface in the vehicle is currently weak—meaning, for instance, that information can only be transmitted at a data rate below a certain threshold—then while the communication link exists at that moment, the online function may still be unavailable. This is because, in this case, the communication link is too weak to execute the online function.
[0013] Alternatively or additionally, it is possible that the communication connection is available, but that, for example, information and / or a required information package for executing the online function, which might contain software and / or at least some information necessary for executing the online function, has not yet been loaded into the vehicle. In such a situation, it is also possible that the online function of the speech recognition system will ultimately not be available in the vehicle via the existing communication connection.
[0014] If the online function is unavailable and / or the communication link is interrupted, the next step involves displaying a message in the vehicle indicating the lack of availability of the speech recognition system's online function. This message is a notification, alert, and / or message addressed, for example, to the user. The message is not designed to be merely a display; it includes at least one symbol displayed in the vehicle indicating the message. The message is displayed regardless of whether the speech recognition system is actually activated or used.If it is determined that the communication connection is currently interrupted, for example, because the communication link between the communication interface in the vehicle and the external device has been broken, the vehicle user will be notified by a message displayed in the vehicle. Alternatively or additionally, a message will also be displayed in the vehicle whenever the online function is completely unavailable, for example, because the information required to execute the online function has not yet been loaded into the vehicle.
[0015] The message can be displayed and thus provided via an output device in the vehicle. A visual and / or audible message in the vehicle is suitable for this purpose. Alternatively or additionally, the message can be provided via a mobile device positioned in the vehicle. The message can indicate that the communication connection is currently interrupted and / or the online function of the speech recognition system is unavailable. In both situations, the online function of the speech recognition system is currently unavailable. "Unavailable" therefore refers to either the interrupted communication connection, the unavailable online function, or both. In these cases, the online function cannot be used. In other words, the online function is unavailable in these situations.In these cases, the problem is the lack of availability of the online function.
[0016] Checking the existence of the communication connection and the availability of the speech recognition system's online function within that connection is independent of any current use of the speech recognition system. Whether or not the speech recognition system has actually been activated and / or used by the vehicle's user is therefore irrelevant for displaying the notification in the vehicle. The user is thus proactively notified, typically before even attempting to use the online function of the speech recognition system, if the online function is currently unavailable. This reduces frustration and / or surprise for the user caused by the potentially unexpected unavailability of the online function.The user is therefore always clearly and simply informed about the availability of the online function of the speech recognition system in the vehicle, as they are informed about its lack of availability immediately after the occurrence of the lack of availability by means of the provided message.
[0017] According to the invention, it is provided that it is determined whether the online function is unavailable for a minimum duration and / or whether the communication connection is interrupted for a minimum duration. Only after it has been determined that the online function was unavailable for at least the minimum duration and / or that the communication connection was interrupted for at least the minimum duration is the message made available in the vehicle. The minimum duration is, for example, 30 seconds. This means that only when it has actually been determined, through continuous monitoring for 30 seconds, that the provided communication connection has already been interrupted for at least 30 seconds, is the communication connection identified as actually interrupted and the message then made available in the vehicle.Furthermore, even if a communication connection exists at the current time, but the online function is nevertheless unavailable, the system checks whether the online function of the speech recognition system is unavailable for at least the minimum duration, i.e., for at least 30 seconds. Only then is the message displayed in the vehicle due to the unavailability of the online function.
[0018] This ensures that the notification is not repeatedly displayed and unavailable in the vehicle in quick succession. Instead, the notification is only displayed when the online function of the speech recognition system has actually been unavailable for a predetermined period, i.e., for a minimum duration of, for example, 30 seconds. Therefore, the vehicle user is not notified of periods of unavailability shorter than the minimum duration. This is the case, for example, if the unavailability lasts only 3 seconds, provided the minimum duration is 30 seconds.By taking the minimum duration into account, distraction of the vehicle user is prevented, for example, by the message changing and then disappearing in the vehicle at short intervals of a few seconds or even fractions of a second.
[0019] Alternatively or additionally, the notification can be set to disappear as soon as the online function is available again. This is because the notification is only displayed when the online function is unavailable and / or the communication connection is interrupted. Ideally, the online function and / or the communication connection must be available or maintained for at least the minimum duration before the notification disappears, meaning its display is discontinued. This ensures that the notification is only removed when the availability of the online function is reliably guaranteed, at least for the minimum duration.
[0020] The invention also includes exemplary embodiments that offer additional advantages.
[0021] An advantageous embodiment provides that the minimum duration is between one second and one minute. In particular, the minimum duration can be between 20 seconds and 35 seconds. A minimum duration of 30 seconds is especially preferred. However, the minimum duration can be, for example, 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds, 10 seconds, 15 seconds, 20 seconds, 25 seconds, 30 seconds, 35 seconds, 40 seconds, 45 seconds, 50 seconds, 55 seconds, or one minute. Alternatively, the minimum duration can be longer than one minute, for example, 90 seconds, 2 minutes, and / or 3 minutes. The minimum duration can alternatively be any value between the aforementioned values.Ultimately, this ensures that an optimal minimum duration can always be chosen to inform the vehicle user with sufficient timeliness after the initial detection of the lack of availability of the online function.
[0022] Another embodiment provides that the message contains at least one of the following pieces of information: Firstly, the message can include the information that the communication connection is currently interrupted. This message is displayed, for example, whenever there has been a continuous or at least temporary interruption of the provided communication connection. The interruption can also be referred to as a termination of the communication connection. Preferably, the corresponding message is only displayed when the communication connection has been interrupted for at least the minimum duration.
[0023] Alternatively or additionally, the message may indicate that the existing communication connection is currently too weak for the online function to be available. This can occur, for example, if the internet connection, i.e., the communication connection, is configured in such a way that the current data rate of the provided communication connection—that is, the amount of digital data that can be transmitted over the communication connection within a given time period—is below a predefined threshold, preventing the online function of the speech recognition system from being available. This presupposes that the online function specifies such a threshold, meaning that a certain minimum data rate is required for the online function to be used in the vehicle.The data rate can alternatively be referred to as the data transfer rate, whereby any information required by the online function can be included in the amount of digital data transferred during the time period.
[0024] Alternatively or additionally, the message may indicate that data required to execute the online function is missing from the vehicle. This is always the case, for example, if the relevant data, which describes, for instance, specific information and / or a specific information package of the online function, has not yet been loaded into the vehicle, perhaps because this loading process has not been activated and / or a corresponding booking has not been made. This can occur, for example, if the required data can only be loaded into the vehicle for a fee and the paid loading process has not yet been initiated. In this example, the vehicle is ultimately not equipped with the online function because the necessary data is missing.The required data may, alternatively or additionally, include basic information for executing the online function and / or an add-on package containing, for example, updated supplementary information. Alternatively or additionally, the required data may be an update for executing the online function.
[0025] Alternatively or additionally, the message may indicate that the online function is not currently activated. For example, if a subscription system is required for the online function to be available in the vehicle, the message may state that a booking period for the online function has expired and / or that no such booking has yet been made.
[0026] Alternatively or additionally, the message may state that the online function is unavailable due to at least one setting related to the speech recognition system. This could be, for example, a system setting that has been preselected for data protection reasons and / or chosen by the vehicle user in such a way that the online function is unavailable.
[0027] The notification provides at least one piece of information to the user explaining why the online function is unavailable. This information can be displayed or output directly when the notification is provided. Alternatively or additionally, the notification may require the user to select or activate it, for example, via a control element in the vehicle, to ensure that this information is readily available. Therefore, when checking availability, the system always determines the reasons why the online function is unavailable and / or the communication connection is interrupted. This is particularly beneficial for the user, as it provides them with an informative and satisfactory explanation for the lack of availability.
[0028] Another embodiment is characterized by the fact that the notification includes at least one of the following: A note on how to activate the online function if it is not currently activated. For example, instructions could be provided that clearly show and explain to the user how to activate the previously inactive online function in the vehicle. For this purpose, a selection function for subscribing to the corresponding service could be provided. This selection function could allow the user to subscribe, for example, by pressing a control button in the vehicle. Preferably, activating the online function immediately enables its availability when a communication connection is established.
[0029] Alternatively or additionally, the notification can provide instructions on how to load the missing but required data into the vehicle. For example, the notification can include instructions on how to initiate the loading process. A corresponding selection function can be provided for this purpose. Using this function, the loading of the missing data can be initiated, for example, via the communication connection, either free of charge or for a fee. Preferably, the loaded data is stored in a storage device within the vehicle and made available to the speech recognition system.
[0030] The notification can alternatively or additionally include a list of all functions of the speech recognition system that are unavailable in the vehicle when the online function is unavailable. This allows the user to see which functions of the speech recognition system are affected by the unavailability of the online function and / or the interruption of the communication connection and therefore cannot be used. Alternatively or additionally, the notification can list all functions of the speech recognition system in general, including details of individual online and offline functions, with, for example, the online functions that are only available online being visually highlighted.Furthermore, it may be intended that only functions available exclusively as online functions are listed in the vehicle's documentation. This allows a technician to assess whether, for example, activating the online function would be worthwhile.
[0031] Alternatively or additionally, instructions can be provided on how to change at least one setting so that the online function is available, at least when a communication connection exists. For example, instructions can be provided on how to change the relevant system setting, which may currently be configured for data protection reasons, so that the online function is at least available in principle.
[0032] Alternatively or additionally, guidance can be provided on how to modify a query that can only be answered when online functionality is available, and how to modify it when online functionality is unavailable. For example, a tip or tutorial can be provided to the user, explaining, preferably in detail, what type of query can only be answered when online functionality is available and, if necessary, how to modify the query to obtain the desired information. For instance, a voice-based search for a specific destination might only be possible when online functionality is available.However, it may be possible that, for example, a special destination can be provided via text input in the navigation system even without online functionality, i.e., independently of a communication connection. However, this would only be possible as a manual command, for example, entered via the control panel, and not as a voice command. A notification can point this out, thus assisting the user in adjusting their request so that they can receive the desired answer without needing the online function. This is particularly useful when the communication connection is interrupted and it is unclear when it will be restored. This ensures that the user can access the information they need at any time.
[0033] The last point mentioned is, of course, only possible if an offline function exists for the desired query. For example, if the desired query is for current weather information, it may be impossible to obtain the answer by modifying the query, as it cannot be provided without an existing communication connection. In this example, the relevant weather information cannot be loaded into the vehicle without a communication connection. Overall, user support is provided by clarifying any questions the user may have regarding the availability of the online function.
[0034] Furthermore, the described information and / or instructions may be provided in a web application. This web application can be run on a mobile device or in a vehicle. Within the web application, users can, for example, change settings, activate online functions (such as subscribing), and / or initiate the download of missing data. The actions performed in the web application are transmitted to the speech recognition system via a communication link. The information and / or instructions can be provided in the web application at a later time, after a journey in the vehicle during which the lack of availability occurred. The web application can be accessed and / or controlled using a voice command.
[0035] Another aspect of the invention relates to the system for checking the availability of the online function of the speech recognition system in the motor vehicle. The system is configured to carry out the method according to the invention. Individual components of the system can be configured to perform the individual process steps of the method according to the invention, the exemplary embodiments of the method according to the invention, as well as the combination of the individual exemplary embodiments of the method according to the invention. The preferred exemplary embodiments and their advantages presented in connection with the method according to the invention therefore apply accordingly, insofar as applicable, to the system according to the invention and can be carried out by corresponding components of the system according to the invention.
[0036] The system comprises the motor vehicle and the speech recognition system, which has an online function. The system also includes a control unit, an output unit, a communication interface, and an external device. The communication interface is configured to provide a communication link between the motor vehicle and the external device. The control unit is configured to continuously determine whether the provided communication link is active or interrupted at any given time. Furthermore, the control unit is configured to check whether the online function of the speech recognition system is available via the existing communication link, if the communication link is active at any given time, and to determine whether the online function is unavailable for a minimum period and / or whether the communication link is interrupted for a minimum period.The output device is designed to provide a message indicating the unavailability of the speech recognition system's online function. This occurs whenever the online function is unavailable and / or the communication link is interrupted, but only after it has been determined that the online function was unavailable and / or the communication link was interrupted for at least the minimum required duration.
[0037] An advantageous embodiment of the system according to the invention provides that the motor vehicle includes the speech recognition system, the control unit, the output device, and / or the communication interface. The motor vehicle can thus be configured to perform all the aforementioned process steps of the system, or at least to perform them together with the external device. Alternatively or additionally, it can be provided that the speech recognition system, the control unit, the output device, and / or the communication interface are not components of the motor vehicle itself, but rather components of the mobile device positioned in the motor vehicle. In this case, the communication connection to the external device, its verification, and the generation of the message regarding the lack of availability of the online function of the speech recognition system are provided by the mobile device.
[0038] Another embodiment provides that the output device is configured to display the message visually on a screen in the vehicle. The message can be displayed on this screen. By visually displaying the message there, it is communicated to the vehicle's user and ultimately made available to them. The screen is, in particular, a monitor, a touchscreen, a head-up display, an instrument cluster, and / or located on the vehicle's steering wheel. Additionally, a control device can be provided by means of which the information and / or instructions contained in the message can be selected so that they are at least displayed. Furthermore, it can be provided that individual further procedural steps provided by the instructions can be selected and carried out using the control device.Alternatively or additionally, the message can be issued acoustically via a loudspeaker system in the vehicle and / or the user's mobile device in the vehicle.
[0039] Another aspect of the invention relates to the motor vehicle, which is designed to carry out the individual process steps. The motor vehicle according to the invention can be configured as a car, in particular as a passenger car or truck, or as a passenger bus or motorcycle. The motor vehicle includes the speech recognition system, the communication interface, the control unit, and the output unit. The exemplary embodiments and their advantages presented in connection with the method and / or the system according to the invention, as well as the combination of the exemplary embodiments, apply accordingly, insofar as applicable, to the motor vehicle according to the invention and can be implemented by corresponding components of the motor vehicle according to the invention.
[0040] The invention also includes the control unit for the system or the motor vehicle. The control unit comprises a processor unit configured to execute the method according to the invention and / or an embodiment thereof. For this purpose, the processor unit may comprise at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor unit may comprise program code configured to execute the method according to the invention, one of the embodiments, or a combination of embodiments of the method according to the invention when executed by the processor unit. The program code may be stored in a data memory of the processor unit.
[0041] The specified specific values for the minimum duration are also to be considered as included in the scope of the invention, even in the event of deviations, for example due to measurement errors, system errors, DIN tolerances, etc.
[0042] The invention also includes combinations of the features of the described embodiments.
[0043] The following describes exemplary embodiments of the invention. This is illustrated by: Fig. 1. A schematic representation of a system for checking the availability of an online function of a speech recognition system in a motor vehicle; and Fig. 2. A schematic representation of a signal flow graph for a method for checking the availability of an online function of a speech recognition system in a motor vehicle.
[0044] The embodiments described below are preferred embodiments of the invention. In these embodiments, the described components each represent individual features of the invention that can be considered independently of one another. Each of these features further develops the invention independently and can therefore be considered part of the invention individually or in a combination other than that shown. Furthermore, the described embodiments can also be supplemented by other features of the invention already described.
[0045] In the figures, functionally identical elements are each provided with the same reference symbols.
[0046] In Fig. Figure 1 depicts a motor vehicle 1. The motor vehicle 1 is a component of a system 2. The system 2 also includes an external device 3, located outside the motor vehicle 1, which is ultimately a computing device, for example, a server. The motor vehicle 1 has a speech recognition system 4, which has an online function 5 and an onboard function 6, which can also be referred to as an offline function. The online function 5 is characterized by the fact that it is only available when information transmission to and / or from and / or information exchange with the external device 3 is possible. The onboard function 6 is available in the motor vehicle 1 at all times and is based on evaluation information and algorithms stored in the motor vehicle 1. Evaluation information can include data.
[0047] The motor vehicle 1 has a microphone device 8 and a loudspeaker device 9. The microphone device 8 can capture voice input from a user of the motor vehicle 1 for the speech recognition system 4. The loudspeaker device 9 can, for example, output an audible response from the speech recognition system 4 to the previously captured voice input in the motor vehicle 1.
[0048] The motor vehicle 1 has a control unit 7. The control unit 7 is assigned here to the speech recognition system 4 and can, for example, be configured to execute the online function 5 and / or the onboard function 6.
[0049] The motor vehicle 1 also has an output device 10, which in this case has a display area 11 in the motor vehicle 1. The display area 11 is designed as a touch-sensitive screen in the area of a center console of the motor vehicle 1. Alternatively or additionally, the display area 11 can be designed as a non-touch-sensitive screen, a head-up display, a display in a combination instrument, and / or a display on a steering wheel in the motor vehicle 1.
[0050] The motor vehicle 1 also has a communication interface 12. Furthermore, the external device 3 also has a communication interface 12. A communication connection 13 can be established between the communication interface 12 in the motor vehicle 1 and the communication interface 12 of the external device 3. Via the communication connection 13, which is preferably designed as a wireless communication connection 13 and thus, for example, as an internet connection, at least one online function information relating to the online function 5 can be transmitted from the motor vehicle 1 to the external device 3 and / or from the external device 3 to the motor vehicle 1.
[0051] Preferably, a request from the user of the vehicle 1, captured by the speech recognition system 4, is transmitted via communication link 13 to the external device 3. The external device 3 processes the request, for example, using an evaluation unit (not shown here), and transmits corresponding response information, matching the requested input, back to the vehicle 1 via communication link 13. The vehicle 1 then uses the response information received, for example, to display it on the output device 10 as a reply to the user's request. Alternatively or additionally, the response can be output via the loudspeaker device 9 in the vehicle 1 and / or displayed on the display area 11 of the output device 10.
[0052] The online function 5 includes, for example, a search for a special destination entered into a navigation system of the vehicle 1 via voice input, a request regarding multimedia content not stored in the vehicle 1, for example, playing music that is not downloaded and therefore only available online, and / or access to online-based weather information on the current weather, the charge level of a battery of the vehicle 1 and / or other functions that are only available online, such as a search for a parking space in the vicinity of the vehicle 1.
[0053] In Fig. Figure 2 shows a procedure for checking the availability of the online function 5 of the speech recognition system 4 of the motor vehicle 1. This procedure is carried out using system 2. Alternatively, instead of the one shown in Figure 2, the following procedure is used: Fig.In the arrangement of the individual system components shown in Figure 1, a mobile device, positioned in the motor vehicle 1 and which may be a smartphone or tablet, can include the control unit 7, the output device 10 and / or the communication interface 12. Furthermore, the speech recognition system 4 could be integrated into the mobile device.
[0054] In a first process step S1, the communication connection 13 is established between the communication interface 12 in the vehicle 1 and the external device 3. Subsequently, in a process step S2, it is continuously determined whether the established communication connection 13 is active or interrupted at any given time. For example, when the vehicle 1 is started, the communication connection 13 is established and then repeatedly checked, for example at continuous intervals of a few milliseconds, whether the established communication connection 13 is still active or whether it has been interrupted or terminated. If it is determined that the communication connection 13 is interrupted, it can first be checked whether this interruption has lasted for at least a minimum duration 14.If this is the case, that is, if it is determined that the communication link 13 is interrupted for the minimum duration 14, this is determined in step S4 and then the process proceeds to step S5.
[0055] If step S2 determines that communication link 13 exists at the current time, step S3 first checks whether the online function 5 of the speech recognition system 4 of the vehicle 1 is available via the existing communication link 13. If online function 5 is not available, step S4 also checks whether this unavailability lasts for at least the minimum duration of 14. If this is the case, i.e., if online function 5 is indeed unavailable for at least the minimum duration of 14, the process proceeds to step S5.
[0056] In process step S5, a message 15 is provided to the vehicle 1, describing the lack of availability of the online function 5 of the speech recognition system 4. Whether the communication connection 13 is interrupted or the online function 5 is unavailable, the consequence is always that the online function 5 is currently unavailable; that is, it is unavailable. The message 15 is provided regardless of whether the speech recognition system 4 is actually activated and / or used, for example, by the user of the vehicle 1.
[0057] The minimum duration 14 is preferably 30 seconds. Alternatively, the minimum duration 14 can be between one second and one minute, in particular between 20 seconds and 35 seconds.
[0058] The message 15 may contain at least one piece of information 16 and / or one note 17. The information 16 may include that the communication link 13 is currently interrupted; that the existing communication link 13 is currently too weak for the availability of the online function 5; that data required for executing the online function 5 is missing in the vehicle 1; that the online function 5 is not currently activated; and / or that the online function 5 is not available due to at least one setting relating to the speech recognition system 4, which is stored, for example, in the control unit 7.
[0059] Note 17 may contain at least one of the following: a note 17 to activate online function 5 if it is not currently activated; a note 17 to load the missing data in the vehicle 1; a list of all functions that the speech recognition system 4 has but that are not available in the vehicle 1 when online function 5 is unavailable; a note on how to change at least one setting so that online function 5 is available at least with the existing communication connection 13; and / or a note on how to change a desired request that can only be answered when online function 5 is available to a modified request that could be answered when online function 5 is unavailable.
[0060] Overall, the examples demonstrate situational and temporary operating suggestions for a system notification in the form of message 15, indicating that, for example, an intelligent digital assistant that can be used via voice control, and thus the online function 5 of the speech recognition system 4, is currently offline. The inventive method and the inventive system 2 are therefore suitable for checking the availability of the online function 5 of the speech recognition system 4, since message 15 indicates that the online function 5 is currently unavailable. By means of the provided message 15, the user receives a notification 17 and information 16 indicating that the online function 5 is currently unavailable, for example, due to a missing communication connection 13 to the external device 3.Therefore, if the functions of, for example, the intelligent digital assistant, i.e., the functions of the speech recognition system 4, are not currently fully available, notification 15 will be provided.
[0061] The unavailability of online function 5 can, for example, result in a limited search for a special destination in the navigation system of vehicle 1 using voice input. Furthermore, the unavailability of this function may also mean that the so-called Media on Demand function and / or individual functions of an internal web application, such as a weather forecast and / or battery charge status information for vehicle 1, are currently unavailable.
[0062] The underlying principle is that the speech recognition system 4 is, in principle, available both online and offline. However, offline operation and functionality of the speech recognition system 4 are typically limited. To ensure that the user is always transparently informed about the currently available functionality and to minimize user frustration, the provided message 15 appears as soon as the online function 5 is generally unavailable, whether due to the unavailability of the online function 5 itself and / or an interrupted communication connection 13. Message 15 also displays possible reasons for the offline state; that is, at least one of the information 16 and / or the instructions 17 can be provided, for example, by displaying them.This is possible, for example, if the user activates a symbol representing message 15 on a touch-sensitive screen as display area 11 and then receives information 16 and / or the note 17.
[0063] As soon as online function 5 is available again, message 15 can disappear, since message 15 is only displayed when online function 5 is unavailable and / or communication link 13 is interrupted. Ideally, online function 5 and / or communication link 13 must be available or provided for at least a minimum duration of 14 before message 15 disappears. This ensures that message 15 is only removed when the availability of online function is reliably guaranteed. Reference symbol list 1 motor vehicle 2 System 3 external institution 4 Speech recognition system 5 Online Function 6 Onboard function 7 Control unit 8 Microphone setup 9 speaker setup 10 Output device 11 Display area 12 Communication interface 13 Communication link 14 Minimum duration 15 Notice 16 Information 17 Note S1 to S5 process steps
Claims
[1] Method for checking the availability of an online function (5) of a speech recognition system (4) in a motor vehicle (1), the method comprising the following steps: - Providing (S1) a communication link (13) between a communication interface (12) in the motor vehicle (1) and an external device (3); - continuously determining (S2) whether the provided communication link (13) exists or is interrupted at any given time; - if the communication link (13) exists at the current time, check (S3) whether the online function (5) of the speech recognition system (4) of the motor vehicle (1) is available via the existing communication link (13); - if the online function (5) is unavailable and / or the communication link (13) is interrupted, determine (S4) whether the online function (5) is unavailable for a minimum duration (14) and / or the communication link (13) is interrupted for a minimum duration (14), and - only after it has been determined that the online function (5) was unavailable for at least the minimum duration (14) and / or the communication link (13) was interrupted for at least the minimum duration (14), provide (S5) a message (15) in the motor vehicle (1) describing a lack of availability of the online function (5) of the speech recognition system (4), the message (15) being provided regardless of whether the speech recognition system (4) is actually activated and / or used. [2] Method according to claim 1, wherein the minimum duration (14) is between one second and one minute, in particular between 20 seconds and 35 seconds, in particular 30 seconds. [3] Method according to any of the preceding claims, wherein the communication (15) includes at least one of the following pieces of information (16): - the communication link (13) is currently interrupted; - the existing communication link (13) is currently too weak for the availability of the online function (5); - the motor vehicle (1) lacks the data required to execute the online function (5); - the online function (5) is not activated at the current time; - the online function (5) is not available due to at least one setting relating to the speech recognition system (4). [4] Method according to claim 3 or any of the preceding claims, wherein the communication (15) includes at least one of the following indications (17): - a notification (17) to activate the online function (5) if it is not activated at the current time; - a notice (17) about loading missing data in the motor vehicle (1); - a list of all functions that the speech recognition system (4) has, but which are not available in the motor vehicle (1) when the online function (5) is unavailable; - a hint (17) on how to change at least one setting so that the online function (5) is available at least with the existing communication connection (13); - a note (17) on how to change a desired request that can only be answered when the online function (5) is available to a modified request that can be answered when the online function (5) is not available. [5] System (2) for checking the availability of an online function (5) of a speech recognition system (4) in a motor vehicle (1), wherein the system (2) comprises the motor vehicle (1), the speech recognition system (4) having the online function (5), a control unit (7), an output unit (10), a communication interface (12) and an external unit (3), wherein - the communication interface (12) is designed to provide a communication link (13) between the motor vehicle (1) and the external device (3); - the control device (7) is designed to continuously determine whether the provided communication link (13) exists or is interrupted at any given time, and to check whether the online function (5) of the speech recognition system (4) is available via the existing communication link (13) if the communication link (13) exists at any given time;and to determine whether the online function (5) is unavailable for a minimum duration (14) and / or the communication link (13) is interrupted for the minimum duration (14), and the output device (10) is designed to provide a message (15) describing the unavailability of the online function (5) of the speech recognition system (4) only after it has been determined that the online function (5) was unavailable for at least the minimum duration (14) and / or the communication link (13) was interrupted for at least the minimum duration (14). [6] System (2) according to claim 5, wherein the motor vehicle (1) comprises the speech recognition system (4), the control unit (7), the output unit (10) and / or the communication interface (12). [7] System (2) according to one of claims 5 or 6, wherein the output device (10) is configured to visually output the message (15) on a display surface (11) in the motor vehicle (1), in particular on a screen, a touch-sensitive screen, a head-up display, a combination instrument and / or a steering wheel.
Citation Information
Patent Citations
display of the online status of a hybrid voice control
DE102014019192A1
Method for checking an onboard speech recognizer of a motor vehicle and control device and motor vehicle
DE102017220266B3