Method for displaying audio content to a user, and a suitably trained audio interference and buffer playback system.

Buffering and accelerating primary audio content during secondary source interference ensures uninterrupted playback by catching up with the primary source, offering a seamless transition and preventing information loss.

DE102013208360B4Active Publication Date: 2025-10-30GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102013208360
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2012-05-15
Filing Date
2013-05-07
Publication Date
2025-10-30
Estimated Expiration
2033-05-07

AI Technical Summary

Technical Problem

Primary audio sources are often disturbed during playback by secondary sources, causing the user to miss important information, such as navigation instructions, due to the attenuation of the primary audio content during interference events.

Method used

Buffering primary audio content during disturbances and playing it back at an accelerated rate until it catches up with the primary source, followed by a gradual transition to match the primary source's speed, and optionally repeating or gradually adjusting the playback speed for a seamless experience.

Benefits of technology

Ensures the user does not miss primary audio content by using buffered playback to catch up with the primary source, providing a smooth and seamless transition, thereby maintaining uninterrupted audio experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for displaying audio content to a user, wherein the method comprises the steps that: Audio content is played back to the user from a primary audio source; a secondary audio source interferes with the audio content output by the primary audio source, wherein the secondary audio source reproduces secondary audio content that takes precedence over the output of the audio content from the primary audio source; Audio content from the primary audio source is buffered when the disturbance starts; characterized by the fact that the audio content from the primary audio source is attenuated during interference from the secondary audio source; The buffered audio content is played back to the user at an accelerated playback speed after the disruption; wherein the buffered audio content reproduced for the user further includes audio content from a predetermined time period prior to interference by the secondary audio source until the time at which the audio content output from the buffer matches the audio content output from the primary audio source.
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND OF THE INVENTION

[0001] The invention relates generally to a method for displaying audio content to a user and a correspondingly designed audio interference and buffer playback system according to the preamble of claim 1 or claim 5, as known, for example, from US 2010 / 0246342 A1.

[0002] Such a system is also described in publications US 2008 / 0226101 A1 and US 5 692 213 A.

[0003] Primary audio sources can be categorized into pauseable and non-pauseable audio sources. Examples of pauseable audio sources include CD players, USB flash drives used as audio sources, and portable audio devices connected via Bluetooth. Examples of non-pauseable audio sources include XM radio, FM radio, and audio devices connected via an audio jack (input cable).

[0004] Primary audio sources are often interfered with by secondary sources, such as a navigation device providing turn-by-turn directions, during audio playback. These devices offer audio guidance to direct a user along a predetermined route. A problem with interference from a secondary source using a device or system that provides audio navigation instructions is that the user misses information that would have been provided by the primary source during the interference event. Specifically, if a navigation maneuver is required, the primary source is muted for the duration of the navigation device's route guidance.When the disruption to the output of navigation instructions is complete, playback of the audio content by the primary audio source resumes; however, if the navigation information takes priority, it is possible that playback of audio content from the primary audio source may be missed or disrupted, so that the user does not hear information from the primary audio source due to the disruption. SUMMARY OF THE INVENTION

[0005] One advantage of this embodiment is the buffering and playback of primary audio content from a primary audio source when a disturbance event occurs as a result of secondary audio output from a secondary audio source. After the disturbance event occurs, attenuating the audio content of the primary audio source, the buffered audio content is played back at an accelerated playback speed until it can catch up with the playback of the primary audio content from the primary audio source. Consequently, a user does not miss any primary audio content output by the primary audio source, as the buffered playback is performed at an accelerated speed that allows it to catch up with the output of the primary audio source, enabling the user to listen in real time.Furthermore, at the start of playback of the buffered audio content, the played audio content is gradually accelerated to a desired maximum playback rate, and shortly before the buffered audio content catches up with the output of the primary audio content from the primary audio source, it is gradually slowed down to the speed of the primary audio source's output, thus providing the user with a smooth and seamless transition between the accelerated buffered output and the output from the primary audio source.

[0006] One embodiment considers a method for displaying audio content to a user, comprising the features of claim 1. Audio content is played back to the user from a primary audio source. A secondary audio source interferes with the audio content output by the primary audio source. The secondary audio source plays back secondary audio content, which takes precedence over the output of the audio content from the primary audio source. The audio content from the primary audio source is attenuated during the interference by the secondary audio source. Upon initiation of the interference, audio content from the primary audio source is buffered. The buffered audio content is played back to the user after the interference at an accelerated playback speed.

[0007] One embodiment considers an audio interference and buffer playback system with the features of claim 5. A primary audio source plays primary audio content. A secondary audio source plays secondary audio content. A processing unit detects an interference event, which includes the secondary audio source playing secondary audio content that takes precedence over the primary audio source. The processing unit attenuates the output of the primary audio content in response to the interference event. A buffer stores the audio content from the primary audio source during the interference event. The buffered audio content is played back to the user by the processing unit at an accelerated playback speed after the interference event. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a block diagram of a vehicle entertainment and information system. Fig. 2 is a timeline of a disturbance event. Fig. Figure 3 is a timeline of a disturbance event using buffered audio content according to an unclaimed embodiment. Fig. Figure 4 is a timeline of a disturbance event using repeating and buffered audio content according to a first embodiment of the invention; Fig. Figure 5 is a timeline of a disturbance event using accelerated and slowed-down buffered audio content according to a second embodiment. DETAILED DESCRIPTION

[0008] In Fig. Figure 1 shows a vehicle entertainment and information system 10. The vehicle entertainment and information system 10 comprises a primary audio source 12 and a secondary audio source 14, a processor 16, and a buffer 18. A speaker system 20 outputs the audio content from the primary audio source 12. The processor 16 can be any type of processing device. The speaker system 20 can also output audio content from the secondary audio source 14, or the secondary audio source 14 can include a speaker that is independent of the speaker system 20 to output the audio content from the secondary audio source 14.

[0009] The primary audio source 12 includes, but is not limited to, AM / FM radio, satellite radio, CD players, portable audio devices (connected by a wired interface, such as an audio aux interface, or by a wireless interface, such as Bluetooth) and USB memory sticks for outputting music, messages or other information to a user.

[0010] The secondary audio source 14 includes, but is not limited to, navigation units, telephone call receiving devices, and text message receiving devices. The secondary audio sources 14 are devices in which audio content is output acoustically.

[0011] The processor 16 can control several tasks within the vehicle entertainment and information system 10. For example, the processor 16 can detect the interference event in order to control the primary audio output and a buffer 18 for storing the primary audio content in the event that the interference event occurs. The interference event occurs when the primary audio source 12 is outputting primary audio content to the user and the secondary audio source 14 interferes with the primary audio source 12 by outputting secondary audio content. Typically, the secondary audio content is information that requires the user's immediate attention, such as instructions from a navigation system. Consequently, the processor 16 interferes with the primary audio source 12 by attenuating the audio content output by the primary audio source 12, while the audio content from the secondary audio source 14 is output to the user.

[0012] Fig. Figure 2 shows an example timeline representing a disturbance event. A timeline 22 is shown to reproduce audio content from the primary audio source and the secondary primary source. At the start of time t0, the primary audio content 24 is reproduced by the primary audio source (e.g., radio). The primary audio content might, for example, include a message such as "Thus, three percent growth is expected for 2012."

[0013] At time t1, a disturbance event occurs in which a message in the form of audio content is emitted from the secondary audio source while the primary audio source is playing the primary audio content. At time t1, the audio content from the primary audio source is also attenuated so that the user can hear the audio content from the secondary audio source. An example of the audio content emitted from the secondary audio source could be a message such as "Turn left," as in Fig. 2 is represented by 26.

[0014] At time t2, playback of audio content from the secondary source is complete, and the audio content from the primary audio source is not attenuated. Any remaining parts of the message are then output to the user from t2 onward. The resulting audio message output to the user is "Thus, a three-way 'Turn left!' wave is expected for 2012," as defined by 28 in Fig. 2 is shown. Consequently, part of the primary audio content reproduced by the primary audio source is omitted, and the audio message from the primary audio source may become unintelligible.

[0015] To prevent the user from missing parts of the primary audio content when the interference event occurs, the audio content from the primary audio source is buffered. Once the audio message from the secondary audio source has finished playing, the buffered audio content is played back at an accelerated speed.

[0016] Fig. Figure 3 shows an example timeline for playing back the buffered audio content. The primary audio content is played back from t0 to t1 as shown by Figure 30. The disturbance event occurs at t1. At t1, the primary audio content is attenuated and buffered. The secondary audio content is output between t1 and t2 as shown by Figure 32. At time t2, when the audio message from the secondary audio source is complete, the buffered audio content is played back from the primary audio source at an accelerated speed as shown by Figure 34. The purpose of playing back the buffered audio content at the accelerated speed is to allow the playback to catch up with the live output from the primary output source. That is, the accelerated playback is performed only for a limited time, until the buffered audio content matches the played-back audio content being output directly from the primary audio source. As shown in Figure 34, the buffered audio content is played back at a speed that allows the primary audio source to catch up with the live output from the primary output source. Fig. As shown in Figure 3, the buffered audio content is played back at the accelerated speed at time t2 until it matches the audio content output by the primary audio source, for example, at t3. At this point, t3, buffering ends, and the audio content directly played back by the primary audio source is output through the speaker, as shown in Figure 36. Consequently, all the audio content played back by the primary audio source is output to the user. It is important to understand that buffering of the primary audio content continues even after the audio message from the secondary audio source has finished playing back at t2, because it takes time for the playback of the buffered audio content to catch up with the live audio content. Therefore, buffering continues until it is determined that the buffered audio output content directly matches the audio output from the primary audio source.The accelerated playback speed of the audio content is determined as a function of the following parameters, which include, but are not limited to, the duration of the disturbance, the time since playback of the buffered audio content began, the amount of audio content remaining in the buffer, and the audio format of the primary audio source. The amount of audio content remaining in the buffer can refer to both the quantity of content and the actual value of the content (e.g., audio content that would accelerate playback of sections containing silence or low-volume sounds more, or a different playback behavior for music compared to speech).

[0017] Fig. Figure 4 shows an embodiment of the invention in which, after the disturbance, repeatedly played audio content is used. First, to illustrate a problem, Fig. 3. Referring to this, after the interruption event at t2 has ended, playback of the primary audio content resumes directly from the point where it was muted. While this allows the user to avoid missing any part of the primary audio content, it is possible that the user will try to remember exactly what was discussed before the interruption. Therefore, as in Fig. Figure 4 shows a portion of the primary audio content that was played to the user before the disruption event, played back to the user after the disruption has ended and playback is initiated. This replay helps the user identify which part of the topic was discussed before the disruption.

[0018] The information that is repeatedly played back is buffered for a short duration (e.g., 1 second). For example, the duration of the audio content that is repeatedly played back might be only 1 second of the primary audio content. This is a sufficient duration to provide the user with familiarity with the point at which the primary audio content left off before the disturbance event. The duration for which this information is repeatedly played back and buffered is predetermined. Furthermore, the duration can be reconfigured by users who wish to hear more of the repeatedly played primary audio content.

[0019] To enable repeatable playback after a disturbance event, constant buffering is required during playback of the primary audio content, even when no disturbance event is present. Repeatable data is defined as audio content that has already been audibly output to the user. However, constant buffering does not require large amounts of repeatable data to be held in the buffer; rather, only the amount of buffer space necessary to store the data for a repeatable playback is allocated. Data stored in the buffer that relates to the repeatable information is removed when new information is retrieved.This means that if the allocated buffer space only allows for a duration of 1 second for recurring data, the new recurring data is buffered, and the old recurring data stored in the buffer is removed. Consequently, small amounts of data are constantly added to and output from the buffer in a cycle, without the need to store large amounts of data for extended periods. When a disturbance event is triggered, the output audio content from 1 second prior to the disturbance event is stored in the buffer, as is the primary audio content played back by the primary audio source after the disturbance event.

[0020] As in Fig. Figure 4 shows that the primary audio content is output to the user directly from the primary audio source before the disturbance event, as shown in Figure 40. At time t1, the audio content from the primary audio source is attenuated, and the audio content from the secondary audio source is output to the user, as shown in Figure 42. After the audio message from the secondary audio source finishes, the primary audio message is played back to the user. Part of the message includes a section of the message that was already output to the user, as shown in Figure 44. This allows the user to identify where the primary audio content left off. For example, before the disturbance event, the primary audio content "Thus, a three" is output to the user.After time t2, “three” is repeated when playing back the buffered information together with the information buffered after the disturbance event, as represented by the accelerated playback 46 and the audio content from the primary audio source 48.

[0021] Fig. Figure 5 shows an embodiment in which the speed of the buffered audio content is gradually accelerated and decelerated during playback. An abrupt increase in playback speed is noticeable to the user and can be perceived as disruptive or annoying. Therefore, a gradual acceleration and deceleration of the audio content playback provides a smoother and more natural transition into and out of accelerated playback.

[0022] Fig. Figure 5 shows an example timeline of a playback speed profile using gradual acceleration and deceleration of buffered audio playback. The timeline includes a vertical axis representing the playback speed. For example, a 1.0x speed represents 1 timescale of the normal playback speed of the audio content from the primary audio source, whereas 1.1x represents 1.1 timescale of the normal playback speed of the audio content from the primary audio source.

[0023] The timeline shown includes audio playback from a primary audio source and a disturbance event from a secondary audio source, such as a navigation device. At t0, the audio content from the primary audio source is output to the user, as shown by 50. At t1, a disturbance event occurs from the navigation device to output navigation instructions to the user, as shown by 52. ​​At t1, the audio content from the radio is also buffered. The audio content from the radio is also added to the buffer for a predetermined duration before t1; this is referred to as repeating audio content.

[0024] At t2, the audio output of the navigation instructions to the user is complete. At t2, playback of the buffered audio content also begins. The buffered audio content includes the repeating audio content 54, followed by the primary audio content from the radio, whose buffering started when the navigation instructions began, as shown by 56.

[0025] A predetermined speed is used as the maximum playback speed for the buffered audio content. This maximum playback speed can be fixed or reconfigurable, as different users may prefer different maximum playback speeds.

[0026] During the time period between t2 and t4, as represented by 58, the playback speed of the buffered audio content is gradually increased at a given rate up to the desired maximum playback speed (e.g. 1.1 x the playback speed of the audio content from the primary audio source).

[0027] During the time period between t4 and t5, as represented by 60, the buffered audio content is played back at maximum playback speed for a substantial part of the playback of the buffered audio content.

[0028] Before the buffered audio content matches the audio content from the primary output source, the speed at which the buffered audio is played back to the user is gradually slowed down. This gradual slowing down of the buffered audio content avoids abrupt changes when transitioning between the output of the buffered audio content and the output of the primary audio source. As described in Fig. As shown in Figure 5, the playback speed of the buffered audio content from t5 to t6, as depicted in Figure 62, is gradually slowed down at a respective rate until it reaches the playback speed at which the audio content is played back from the primary audio source. The output of the buffered audio content matches the output of the primary audio source when the playback speed is slowed down to the same speed as the output of the primary audio source, which is shown in Figure 5. Fig.5 at t6. After t6, the output of the buffered audio content is stopped, and only the audio content from the primary audio source is output to the user, as represented by 64. Consequently, a gradual transition occurs when the buffered audio content is initially played and when the buffered audio content is finished.

[0029] The amount of audio content remaining in the buffer can also determine when deceleration begins. The deceleration process is initiated when the amount of audio content in the buffer falls below a certain threshold. For example, the amount of audio content added to the buffer during playback is a function of how quickly the accelerated audio content is output. To accelerate the played audio content, audio content is extracted from the buffer at a faster rate than the output rate of the primary audio source (e.g., 1.1 times the output rate of the primary audio source). If the deceleration profile is also known, it is possible to predict in advance how the net buffer content will decelerate according to that profile.Based on the rate at which the accelerated audio content is output above the normal output rate of the primary audio source, the reduction in the amount of buffered audio content can be determined at any given time. The system not only determines the amount of audio content that should be added to the buffer at any given time, but also determines at what point the gradual deceleration can begin when playing back the buffered audio content. Consequently, when the playback of the audio content matches the output from the primary source, the playback speed of the buffered content is essentially the same as that of the primary audio source, and no audio content remains in the buffer when the match occurs.

[0030] It is important to understand that gradual acceleration or deceleration, unlike linear acceleration or deceleration, can be nonlinear. Furthermore, different and independent strategies can be used to determine either gradual acceleration or deceleration. For example, gradual acceleration might be linear, whereas gradual deceleration might be nonlinear. The overall goal is to seamlessly integrate the accelerated playback for the user, without it being disruptive or noticeable.

[0031] The time interval between t4 and t5 can be determined based on various factors, including the duration of the disturbance from the secondary audio source; a maximum playback speed; the duration of the repeating phase; the time required to accelerate to the maximum playback speed and decelerate back to the normal speed of the primary audio content; and the strategy for increasing the playback speed (e.g., linear and non-linear). Based on the factors used to calculate the interval between t4 and t5, accelerations and decelerations can be determined for a smooth transition between the normal playback speed of the primary audio source and the respective maximum playback speed.

[0032] Furthermore, a frequency shift can be applied to the accelerated playback of audio content to give a more natural sound to the buffered audio content that is output at the accelerated speed.

[0033] Buffering missed audio content and playing it back at an accelerated speed prevents the user from missing any audio output from the primary audio source. Additionally, alternative controls can be implemented that allow the user to exit buffered playback and immediately resume playback from the primary audio source. An example would be if the user was listening to music and missing a portion of the program is not critical. Furthermore, controls can be implemented that allow the user to temporarily pause buffered playback if they need to focus on another task, such as a complex traffic situation, and do not wish to pay attention to the output of the primary audio source.In such a case, an accelerated playback speed can be used. Furthermore, controls can be implemented that allow the user to repeat a portion of the buffered audio content if they do not understand it.

Claims

[1] Method for displaying audio content to a user, the method comprising the steps of: Audio content is played back to the user from a primary audio source; a secondary audio source interferes with the audio content output by the primary audio source, wherein the secondary audio source reproduces secondary audio content that takes precedence over the output of the audio content from the primary audio source; Audio content from the primary audio source is buffered when the disturbance starts; characterized by , that the audio content from the primary audio source is attenuated during interference from the secondary audio source; The buffered audio content is played back to the user at an accelerated playback speed after the disruption; wherein the buffered audio content reproduced for the user further includes audio content from a predetermined time period prior to interference by the secondary audio source until the time at which the audio content output from the buffer matches the audio content output from the primary audio source. [2] Method according to claim 1, further comprising the step of playing back the audio content from the primary audio source to the user in real time after the audio content output from the buffer matches the audio content output from the primary audio source. [3] Method according to claim 1, wherein the accelerated playback speed is reconfigurable. [4] Audio interference and buffer playback system, comprising: a primary audio source (12) for playing back primary audio content; a secondary audio source (14) for playing back secondary audio content; a processing unit (16) that detects a disturbance event which includes the secondary audio source (14) reproducing secondary audio content that takes precedence over the primary audio source (12); and a buffer (18) to buffer the audio content from the primary (12) audio source during the disturbance event; characterized by , that the processing unit (16) attenuates the output of the primary audio content in response to the disturbance event; wherein the buffered audio content is played back to the user at an accelerated playback speed by the processing unit (16) after the disturbance event; and wherein the buffered audio content reproduced for the user further comprises audio content from a predetermined time period before the disturbance by the secondary audio source (14) until the time at which the audio content output from the buffer (18) matches the audio content output from the primary audio source (12). [5] Audio interference and buffer playback system according to claim 4, wherein the output of the buffered audio content is frequency-shifted. [6] Audio distortion and buffer playback system according to claim 4, wherein the processing device (16) gradually increases the playback speed of the buffered audio content from a time when the buffered content is initially played back until a time when the playback speed reaches a maximum playback speed. [7] Audio interference and buffer playback system according to claim 4, wherein the processing device (16) gradually reduces the accelerated playback speed of the buffered audio content from the maximum playback speed to the speed at which the audio content is played back from the primary audio source (12), wherein a point in time at which the reduced playback speed matches a playback speed from the primary audio source (12) occurs when the audio content output from the buffer (18) matches the audio content output from the primary audio source (12).

Citation Information

Patent Citations

  • Audio control system for a vehicle

    US20080226101A1

  • Device for uninterrupted listening to radio broadcast

    US20100246342A1

  • Method for controlling real-time presentation of audio / visual data on a computer system

    US5692213A