Infotainment system control

Abstract

Infotainment system (100, 200, 300) for a motor vehicle, the system comprising: a navigation system (202); an entertainment system (110, 204); an audio output device (108, 206); and a control system (102) coupled to the navigation system (202), the entertainment system (110, 204), and the audio output device (108, 206), controlling access to the audio output device (108, 206) by the navigation system (202) and the entertainment system (110, 204), comprising a call detection device (212) that determines whether a call is being conducted, alters the operation of the audio output device (108, 206) if a call is being conducted, and alters the operation of the audio output device (108, 206) by delaying the playback of a navigation announcement on the audio output device (108, 206) during at least a portion of the call by delaying the navigation announcement for a portion of the call until a location-based limit is reached at which the motor vehicle has reached a specified minimum distance before a corresponding driver action should be taken,The navigation announcement is preceded by an introduction if the call is interrupted by the navigation announcement.

Description

FIELD OF THE INVENTION

[0001] The invention relates to an infotainment system for a vehicle and a computer-controlled method for operating such an infotainment system in a vehicle and in particular to controlling the transmission of the infotainment system in the motor vehicle. BACKGROUND

[0002] Motor vehicles, including cars and trucks, have long included entertainment systems. In particular, motor vehicles have long included radio tuners, compact disc players, and other means of delivering audio entertainment to occupants. Typically, either a knob or buttons on the steering wheel control the volume of entertainment systems.

[0003] A car navigation system is a satellite navigation system designed for use in motor vehicles. A navigation system typically uses a Global Positioning System (GPS) navigation device to acquire position data to locate the motor vehicle along a road in the unit's map database. Using the map database, the unit can provide guidance to other locations along roads also in its database.

[0004] In some motor vehicles, the entertainment system is linked to the navigation system. This allows the navigation system to provide audio guidance ("announcements") to the occupants using speakers linked to the entertainment system. A system with both entertainment and navigation capabilities will be referred to herein as an "infotainment" system.

[0005] During operation, the infotainment system typically provides entertainment at a user-selected volume level. The user typically either turns a knob or presses a button to adjust the volume. In some cases, entertainment and navigation systems can operate at different volume levels.

[0006] However, it has been found that conversations between occupants can be interrupted by navigation prompts and / or entertainment content. For example, this may result in users missing navigation prompts because the user was engaged in a conversation when the prompt was delivered. Furthermore, users may be forced to turn down the radio volume and / or navigation prompts when having a conversation in the vehicle. In some cases, the user may actually mute the navigation prompts to avoid interrupting conversations.

[0007] DE 100 52 654 A1 describes a device for controlling acoustic information in a motor vehicle, which device comprises an acoustic output unit whose output can be controlled by a control unit. A current vehicle situation is determined and classified using data from a vehicle assistance system or a vehicle condition sensor. The acoustic playback can be delayed depending on the determined and classified current vehicle situation, which is the case, for example, if the vehicle is currently frequently negotiating curves or frequently changing direction. In addition, the urgency of a traffic report can be estimated based on the calculated route. If necessary, an upcoming traffic report can be stored until the current traffic situation is no longer critical or the traffic report becomes urgent due to the current position.To improve the perception of acoustic information, particularly traffic reports, the noises inside the vehicle can be monitored using a microphone in order to, for example, play a buffered traffic report during a gap in the conversation.

[0008] US 2007 / 0213092 A1 describes a portable GPS navigation device for displaying map information and navigation instructions. The device is equipped with a wireless two-way transceiver for connection to a mobile phone. The device also features an audio output and a microphone. One or more functions of the mobile phone can be controlled via the device and voice calls can also be made using the mobile phone. As soon as a voice call is received, navigation instructions from the navigation device are replaced by acoustic signals or suppressed without such acoustic signals. Any playback from an external audio system is muted during an incoming phone call. Any music playback can be turned down or completely stopped during a respective navigation instruction.

[0009] DE 101 23 179 A1 describes a communication system for a vehicle interior, via whose central control the volume of radio broadcasts and audio presentations is automatically reduced as soon as microphones provided in the area of ​​the vehicle seats are exposed to speech sound in order to improve acoustic communication between the vehicle occupants. SUMMARY

[0010] The invention is based on the object of specifying an infotainment system and a computer-assisted method of the type mentioned at the outset, which on the one hand ensures that conversations between vehicle occupants are interrupted as little as possible by the playback of a navigation system and an entertainment system, but at the same time always ensures that urgent navigation announcements are not only issued in a timely manner, but are also not missed by the vehicle occupants despite an interruption of the conversation.

[0011] According to the invention, the object is achieved by an infotainment system having the features of claim 1 or a computer-aided method having the features of claim 4. Preferred embodiments of the infotainment system according to the invention emerge from the subclaims.

[0012] In one embodiment, an infotainment system for a motor vehicle is provided. The system of this embodiment includes a navigation system, an entertainment system, an audio output device, and a control system coupled to the navigation system, the entertainment system, and the audio output device. The control system controls access to the audio output device by the navigation system and the entertainment system and includes a call detection device that determines whether a call is in progress. The control system of this embodiment modifies the operation of the audio output device if a call is in progress.

[0013] Another embodiment of the present invention is directed to a method for operating an infotainment system in a motor vehicle, wherein the infotainment system comprises at least a navigation system and an entertainment system. The method of this embodiment comprises: receiving a navigation announcement at a computerized control system of the infotainment system; receiving an announcement playback command from the navigation system at the computerized control system to play the navigation announcement; determining that a conversation is being conducted by at least one occupant in the motor vehicle; and delaying playback of the navigation announcement at an audio output device during at least a portion of the conversation.

[0014] Another embodiment of the present invention is directed to a computer program product comprising a computer-readable medium having program segments for, when executed on a computing device, causing the computing device to implement a method for operating an infotainment system. The method comprises: receiving a navigation announcement; receiving an announcement play command from the navigation system to play the navigation announcement; determining that a conversation is being conducted by at least one occupant in the motor vehicle; and delaying playback of the navigation announcement on an audio output device during at least a portion of the conversation.

[0015] The above features and advantages and other features and advantages of the present invention will be readily apparent from the following detailed description of the best modes for carrying out the invention when taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 shows an example of an infotainment system that can be implemented in a motor vehicle; Fig. 2 shows a more detailed infotainment system according to an embodiment of the invention; Fig. 3 shows a more detailed system diagram of a section of the Fig. 2 shown system; Fig. 4 shows a method for operating an infotainment system according to an embodiment of the invention; and Fig. 5 shows a block diagram of a computing system on which embodiments of the present invention may be implemented. DESCRIPTION OF THE EMBODIMENTS

[0016] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses. It should be understood that throughout the drawings, corresponding reference characters indicate like or corresponding parts and features.

[0017] Some of the deficiencies or problems described above may be eliminated or mitigated by one or more of the embodiments disclosed herein. In particular, one embodiment is directed to an infotainment system that monitors conversation levels in a motor vehicle and adjusts the audio volume for one or both of the entertainment and navigation systems. In a particular embodiment, the infotainment system identifies a break / pause in the conversation before announcing a navigation announcement to prevent the user from missing the announcement while responding to the conversation in the motor vehicle. This may prevent or mitigate the interruption of conversations in the motor vehicle, which may cause the user to turn off the navigation voice instructions or manually adjust the volume.

[0018] In one embodiment, the navigation system listens to the conversation and waits for a break in the conversation before providing an announcement. This also helps prevent the case where the user is in the middle of a conversation and misses an audible maneuver announcement because they were talking over it. If the announcement can be better delivered, this can reduce the number of missed announcements. The system can also use the conversation detection system to deliver navigation announcements in a polite manner while interrupting the conversation. For example, if a conversation is interrupted, an "excuse me" can precede a navigation announcement.

[0019] According to an exemplary embodiment, Fig. 1 schematically illustrates an infotainment system 100 that may be used, for example, in a motor vehicle (not shown). Although the following discussion is based on implementation in a motor vehicle, the teachings herein may be applied in other contexts. The infotainment system 100 could be used, for example, on a motorcycle, an off-road vehicle, or in a home entertainment system.

[0020] The infotainment system 100 (also referred to generally herein as the "system") may include an infotainment control system 102. The control system 102 receives inputs from various sources and controls access to the audio output device(s) 108.

[0021] The control system 102 may receive input signals from an information system 106. The information system 106 may include, but is not limited to, a navigation system, a personal digital assistant (PDA), a radio tuner, a cellular phone, an internet connection, a microphone, or any other device capable of providing information to the control system 102.

[0022] The control system 102 may also receive input signals from an entertainment system 110. The entertainment system 110 may include, but is not limited to, one or more of a compact disc (CD) player, a radio tuner, a digital video disc (DVD) player, a portable media player, or other now-available or later-produced devices that provide entertainment.

[0023] In order for the information or entertainment provided by the information source 106 or the entertainment system 110 to be experienced by an occupant, the control system 102 delivers the information or entertainment to one or both of the audio output 108 or the video output 112. The audio output 108 may be a system of one or more speakers and the video output 112 may be, for example, one or more display screens arranged at one or more locations in the motor vehicle.

[0024] Typically, a user may control some or all of the infotainment system 100 through a user input device 104. Based on inputs received from the user input device 104, the control system 102 may determine the device that has access to one or both of the outputs 108 and 112 and a volume level for at least the audio output 108.

[0025] Fig. Figure 2 shows a more detailed diagram of an infotainment system 200 according to an embodiment of the present invention. The system 200 includes a control system 102. The control system 102 receives inputs from various sources and controls access to the audio output(s) 206 (typically speakers) and optionally also the video output 208.

[0026] The system 200 may include an entertainment system 204. The entertainment system 204 provides at least one piece of audio information to the control system 102. The control system 102 may adjust the volume of the audio information before providing it to the audio output 206.

[0027] In one embodiment, system 200 may include a microphone 210 coupled to control system 102. Microphone 210 may, for example, be located in the passenger compartment of a motor vehicle. Microphone 210 detects the sounds in the passenger compartment and provides them to control system 102. In one embodiment, control system 102 may include a conversation detector 212 configured to detect when a conversation is taking place in the passenger compartment. In one embodiment, when conversation detector 212 detects that a conversation is taking place, control system 102 may cause a change in audio output 206. For example, control system 102 may decrease the volume of audio output 206. In a specific embodiment, control system 102 may decrease the volume of audio output 206 when audio output 206 is playing information received from an entertainment system.In such an embodiment, the control system may increase the volume of the audio output 206 when the call detection device 212 indicates that the call is no longer in progress.

[0028] The system may also include a navigation system 202. The navigation system 202 may include a Global Positioning System (GPS) navigation device to acquire position data to locate the motor vehicle on a road in the unit's map database. Using the map database, the unit may provide guidance to other locations along roads also located in its database. The guidance may be provided as a series of audio announcements ("announcements"). The control system 102 receives these announcements and generally delivers them to the audio output 206.

[0029] As discussed above, it has been found that conversations (between occupants, on a telephone, or otherwise) may be interrupted by navigation announcements. Such interruptions may be undesirable. To avoid such interruptions, users may, in some cases, mute navigation announcements to avoid interrupting conversations.

[0030] The control system 102 may include a navigation announcement controller 214. The navigation announcement controller 214 receives the announcements from the navigation system 202 and determines if and when they should be transmitted to the audio output 206. When an announcement is received, it may, for example, be delayed until it is determined that a previously initiated call has ended. If the call has changed, the announcement may be played. However, in some cases, the call may not end in a timely manner. In one embodiment, the navigation announcement controller 214 may interrupt the call in such a case, but it may do so by including a polite introduction in the announcement. The announcement may, for example, be preceded by the phrase "Excuse me" or "Sorry to interrupt, but..."

[0031] Fig. 3 shows a more detailed system diagram of a section of the Fig. 2 shown system. The Fig. 3 includes a navigation system 202, a microphone 210, an entertainment system 204, a control system 102, and an audio output 206.

[0032] In one embodiment, microphone 210 may continuously sample the noise in the passenger compartment of a motor vehicle. In such an embodiment, system 300 may include the aforementioned functionality for reducing the volume of audio output 206 as soon as a conversation is detected. Of course, in some embodiments, microphone 210 may only operate during specific periods to conserve power or processing cycles. These periods may, for example, include a time after an announcement is received from the navigation system and until that announcement is transmitted.

[0033] To determine whether a conversation is taking place in the motor vehicle, the control system 102 may include a conversation detection device 212. If the conversation detection device 212 detects that a conversation is taking place, in one embodiment, it may signal the mixer / volume controller 310 to reduce the volume of the signal delivered to the audio output 206. Furthermore, the mixer / volume controller 310 may control which of the many received inputs is delivered to the audio output 206 or dominates the signal delivered thereto.

[0034] The conversation detection device 212 may include an echo canceller 306. The echo canceller 306 may be coupled to an output of the mixer / volume controller 310. That is, the echo canceller 306 receives information representing the audio information transmitted to the audio output 206. The echo canceller 306 also receives information from the microphone 210. Echo cancellation involves first detecting the originally transmitted signal, which reappears with some delay in the transmitted or received signal. Once the echo is detected, it can be removed by "subtracting" it from the transmitted or received signal. This process is generally implemented using a digital signal processor (DSP), but can also be implemented in software. Here, the originally transmitted signal is received by the mixer 310.The originally transmitted signal is then removed from the signal received by the microphone 210 by the echo canceller 306.

[0035] The echo canceller 306 delivers the signal from the microphone, with the signal delivered to the audio output 206 removed from it (an anechoic signal), to a voice activity detector (VAD) 308. The VAD 308 generally determines when a conversation is taking place in the motor vehicle. Voice activity detection (also known as speech activity detection or simply speech detection) is a technique used in speech processing whereby the presence or absence of human speech is detected in portions of audio (which may also contain music, hiss, or other noise). Voice activity detection is an important enabling technology for a variety of speech-based applications. Therefore, various detection algorithms have been proposed that provide different trade-offs between latency, sensitivity, accuracy, and computational complexity.Some algorithms also provide additional analysis, such as whether the speech is voiced, unvoiced, or sustained. Speech activity detection usually depends on the local language. The VAD 308 can use any known or later developed speech detection algorithms.

[0036] The VAD 308 can cause the speech recognition device 212 to cause the mixer / volume controller 310 to attenuate the volume of the audio output 206 if a conversation is ongoing. In one embodiment, the volume can remain attenuated until the conversation ends. Such functionality can always operate or can be selectively enabled or disabled.

[0037] The control system 102 may include an announcement controller 214. The announcement controller 214 generally receives, stores, and delivers navigation announcements to the audio output 206. In particular, the announcement controller 214 may receive navigation announcements from the navigation system 202. In one embodiment, the announcement controller 214 may include an announcement memory 302 in which the navigation announcements may be stored. The navigation announcements in the announcement memory may be retrieved and sent to the occupants via an announcement playback device 304. The announcement playback device 304 may receive commands from the announcement control element 305. The announcement control element 305 may receive indications from the VAD 308 regarding when to cause an announcement to be played from the navigation system 202 and when to pause or delay an announcement.

[0038] Prior to the invention disclosed herein, the navigation system 202, in operation, may have either provided an ordered list of announcements to be played once the motor vehicle was at specific locations, or may have generated the announcements as the locations were reached. However, it did not consider whether the people were talking (having a conversation) before the announcements were played. This may, in some cases, have resulted in missed announcements or occupants deactivating the navigation system (or at least the audio portions thereof).

[0039] In one embodiment, the announcement control element 305 may be configured to delay or otherwise alter the timing of an announcement based on whether a call is in progress. That is, in one embodiment, determining that a call is in progress may also affect the operation of the announcement controller 214. In such an embodiment, the VAD 308 may provide a "speech detected" indication to the announcement control element 305. The announcement control element 305, in one embodiment, may prevent the announcement playback device 304 from delivering an announcement stored in the announcement memory 302 to the mixer 310 until the VAD 308 determines that the speech has ended. In one embodiment, the speech / conversation may be required to end for a minimum amount of time before the VAD 308 indicates that the conversation is complete.That is, a predetermined quiet period may be required before the VAD 308 indicates that a call is complete to allow for brief pauses in the call.

[0040] Fig. 4 shows a flowchart of a method that can be implemented by the announcement control element 305 in one embodiment. Fig. The state diagram shown in Figure 4 refers to the state diagram shown in Fig. 3. The method is initiated in one embodiment when the navigation system 202 has been activated and a destination has been selected. The navigation system 202 then delivers one or more announcements to the announcement memory 302 in a block 402. The announcements may be delivered as an ordered list or may be received sequentially.

[0041] In block 404, an announcement playback command is received. In one embodiment, the navigation system 202 may provide the announcement playback command based on a location of the motor vehicle. In one embodiment, in block 402, the announcement playback command is either provided as part of the announcements or the announcements are received simultaneously. In one embodiment, the announcements may be pre-stored and have identifiers attached to them. In such an embodiment, the announcement command may then consist of only an identifier.

[0042] Regardless of the manner in which the announcement is received, a determination is made in block 406 as to whether a call is in progress. Due to power and processing constraints, it may be advantageous to activate the call detection device 212 only after an announcement playback command has been received. However, the call detection device 212 may be running continuously in one embodiment.

[0043] If a call is in progress, the announcement is interrupted in a block 408. That is, the announcement either does not begin or is interrupted until the call is completed. Of course, however, in some embodiments, a location-based boundary condition may exist that may be imposed on the interruption of an announcement. For example, an announcement may be delayed until the motor vehicle has reached a specified minimum distance before a driver action is to be taken. In such an embodiment, block 408 may cause a delay until the call is completed or until the boundary condition is reached. The boundary functionality may, of course, be optional or a feature that can be enabled or disabled by a user.

[0044] If a limit functionality is enabled or otherwise available, a block 410 determines whether the limit has been reached or the call has ended. If it was a limit that caused the process to move from block 408 to block 410, the announcement is played in a block 412. Since it is known that this announcement is played while a call is ongoing, a polite interruption may be added in one embodiment. In one embodiment, the entire announcement is played in block 412. After the announcement is played, control is transferred to block 420, described below.

[0045] In the event that the call has ended (i.e., block 410 has not determined that a limit had been reached), the announcement begins in a block 414 or a delayed announcement continues. In a block 416, the announcement is played until it is completed or until it is interrupted by a call. If the announcement is interrupted by a call, as determined in block 418, processing returns to block 408. Otherwise, block 418 determines that the announcement is completed, and in a block 420 it is determined whether navigation is complete. This may include, for example, receiving a signal that navigation is complete. If navigation is complete, the process ends. Otherwise, processing returns to block 404.

[0046] It is further noted that embodiments of the invention may be embodied in the form of computer-implemented processes and devices for performing those processes. Therefore, according to an exemplary embodiment, the methodologies described above may be implemented by a computer system or device. Fig.5, for example, illustrates a computer system according to an exemplary embodiment. Thus, parts or all of the methodologies described herein may be executed as instructions in a processor 502 of computer system 500. Computer system 500 includes a memory 501 for storing instructions and information and input device(s) 503 for computer communication. Thus, the present invention may be implemented in software, for example, as any suitable computer program on a computer system somewhat similar to computer system 500. A program according to the present invention may, for example, be a computer program product that causes a computer to perform the example methods described herein. In one embodiment, computer system 500 may constitute some or all of the infotainment system described above.In one embodiment, computer system 500 may constitute some or all of control system 102 described above.

[0047] The computer program product may comprise a computer-readable medium having computer program logic or code portions embodied thereon to enable a processor (e.g., 502) of a computer system (e.g., 500) to perform one or more functions according to one or more of the example methodologies described above. The computer program logic may thus cause the processor to perform one or more of the example methodologies or one or more functions of a given methodology described herein.

[0048] The computer-readable storage medium may be a built-in medium installed within a computer main body or a removable medium configured to be separated from the computer main body. Examples of the built-in medium include, but are not limited to, rewritable non-volatile memories such as RAMs, ROMs, flash memories, and hard disks. Examples of a removable medium may include, but are not limited to, optical storage media such as CD-ROMs and DVDs; magneto-optical storage media such as MOs; magnetic storage media such as floppy disks (trademark), cassette tapes, and removable hard disks; media with built-in rewritable non-volatile memory such as memory cards; and media with built-in ROM such as ROM cartridges.

[0049] Although the invention has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. Furthermore, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from its essential scope. Therefore, it is intended that the invention not be limited to the specific embodiments disclosed, but that the invention will include all embodiments falling within the scope of the present application.

Claims

[1] Infotainment system (100, 200, 300) for a motor vehicle, the system comprising: a navigation system (202); an entertainment system (110, 204); an audio output device (108, 206); and a control system (102) coupled to the navigation system (202), the entertainment system (110, 204), and the audio output device (108, 206), controlling access to the audio output device (108, 206) by the navigation system (202) and the entertainment system (110, 204), comprising a call detection device (212) that determines whether a call is being conducted, alters the operation of the audio output device (108, 206) if a call is being conducted, and alters the operation of the audio output device (108, 206) by delaying the playback of a navigation announcement on the audio output device (108, 206) during at least a portion of the call by delaying the navigation announcement for a portion of the call until a location-based limit is reached at which the motor vehicle has reached a specified minimum distance before a corresponding driver action should be taken,The navigation announcement is preceded by an introduction if the call is interrupted by the navigation announcement. [2] The infotainment system (100, 200, 300) of claim 1, wherein the control system (102) includes an announcement controller (214) that stores announcements and controls when an announcement is played. [3] The infotainment system (100, 200, 300) of claim 2, wherein the announcement controller (214) comprises an announcement memory (302) that stores announcements received from the navigation system (202), an announcement playback device (304) that causes announcements to be delivered to the audio output device (108, 206), and an announcement control element (305) that is coupled to the announcement playback device (304) and the conversation recognition device (212) and controls when the announcement playback device (304) causes announcements to be delivered to the audio output device (108, 206). [4] Computer-assisted method for operating an infotainment system (100, 200, 300) in a motor vehicle, wherein the infotainment system (100, 200, 300) comprises at least one navigation system (202) and one entertainment system (110, 204), the method comprising: Receiving a navigation announcement at a computer-aided control system (102) of the infotainment system (100, 200, 300); Receiving an announcement playback command from the navigation system (202) at the computerized control system (102) to play the navigation announcement; Determine that a conversation is being conducted by at least one occupant of the motor vehicle; and Delaying playback of the navigation announcement on an audio output device (108, 206) during at least a portion of the conversation by delaying the navigation announcement for a portion of the conversation until a location-based limit is reached at which the motor vehicle has reached a predetermined minimum distance before a corresponding driver action is to be taken, wherein the navigation announcement is preceded by an introduction if the navigation announcement interrupts the conversation.

Images